Dilemmas and Craftsmanship

Propensity score analysis: an alternative statistical approach for HRD researchers

Purpose

This paper aims to introduce matching in propensity score analysis (PSA) as an alternative statistical approach for researchers looking to make causal inferences using intact groups.

Design/methodology/approach

An illustrative example demonstrated the varying results of analysis of variance, analysis of covariance and PSA on a heuristic data set. The three approaches were compared by results and violations of statistical assumptions.

Findings

Through the illustrative example, it is demonstrated how different statistical approaches can produce varied results. Only PSA mitigated pre-existing group differences without violating the assumption of independence.

Originality/value

This paper attempts to answer calls in the literature for more robust statistical methodologies to better inform human resource development practice and theory.

Principles for planning and conducting comparative effectiveness research

Aims: To develop principles for planning and conducting comparative effectiveness research (CER). Methods: Beginning with a modified existing list of health technology assessment principles, we developed a set of CER principles using literature review, engagement of multiple experts and broad stakeholder feedback. Results & conclusion: Thirteen principles and actions to fulfill their intent are proposed. Principles include clarity of objectives, transparency, engagement of stakeholders, consideration of relevant perspectives, use of relevant comparators, and evaluation of relevant outcomes and treatment heterogeneity. Should these principles be found appropriate and useful, CER studies should be audited for adherence to them and monitored for their impact on care management, patient relevant outcomes and clinical guidelines.