Incentivizing performance in health care: a rapid review, typology and qualitative study of unintended consequences

BACKGROUND

Health systems are increasingly implementing policy-driven programs to incentivize performance using contracts, scorecards, rankings, rewards, and penalties. Studies of these "Performance Management" (PM) programs have identified unintended negative consequences. However, no single comprehensive typology of the negative and positive unintended consequences of PM in healthcare exists and most studies of unintended consequences were conducted in England or the United States. The aims of this study were: (1) To develop a comprehensive typology of unintended consequences of PM in healthcare, and (2) To describe multiple stakeholder perspectives of the unintended consequences of PM in cancer and renal care in Ontario, Canada.

METHODS

We conducted a rapid review of unintended consequences of PM in healthcare (n = 41 papers) to develop a typology of unintended consequences. We then conducted a secondary analysis of data from a qualitative study involving semi-structured interviews with 147 participants involved with or impacted by a PM system used to oversee 40 care delivery networks in Ontario, Canada. Participants included administrators and clinical leads from the networks and the government agency managing the PM system. We undertook a hybrid inductive and deductive coding approach using the typology we developed from the rapid review.

RESULTS

We present a comprehensive typology of 48 negative and positive unintended consequences of PM in healthcare, including five novel unintended consequences not previously identified or well-described in the literature. The typology is organized into two broad categories: unintended consequences on (1) organizations and providers and on (2) patients and patient care. The most common unintended consequences of PM identified in the literature were measure fixation, tunnel vision, and misrepresentation or gaming, while those most prominent in the qualitative data were administrative burden, insensitivity, reduced morale, and systemic dysfunction. We also found that unintended consequences of PM are often mutually reinforcing.

CONCLUSIONS

Our comprehensive typology provides a common language for discourse on unintended consequences and supports systematic, comparable analyses of unintended consequences across PM regimes and healthcare systems. Healthcare policymakers and managers can use the results of this study to inform the (re-)design and implementation of evidence-informed PM programs.

Dimensions of performance and related key performance indicators addressed in healthcare organisations: A literature review

INTRODUCTION

Performance measurement systems have become essential managerial tools for healthcare organisations in the last few decades. They allow hospital managers to pilot their institution and assess the development of the organisation in helping managers in decision-making and viewing the different impacts of these decisions. However, there is a need to investigate further the dimensions of performance those performance measurement systems address.

METHODS

A literature review was primarily conduced about performance measures in healthcare organisations. A comparative study was secondly made to identify the different performance dimensions that are present in the literature during the last decade. Forty-nine studies were considered and sixteen proposal frameworks were used to make the comparative analyses.

RESULTS

We classified dimensions depending on the frequency of mobilisation of their components in four categories: the stars, the first runners-up, the opportunists and the forgotten ones. For each of the dimensions presented in this classification, the main types of KPIs proposed in the theoretical frameworks are presented. A discussion on relevance and possible blind spots is then conducted.

CONCLUSION

Although they were a lot of proposal frameworks of KPI proposed in the last decades to assess healthcare organisations, some dimensions remain underrepresented. There is still a need to develop structure KPI and describe their links. To go further, the development of dashboards asks the question of the definition of KPI, the description of their interconnections and their temporality of driving, because static performance reporting systems are not able to completely satisfy healthcare manager's decision support needs.

A realist review to assess for whom, under what conditions and how pay for performance programmes work in low- and middle-income countries

Pay for performance (P4P) programmes are popular health system-focused interventions aiming to improve health outcomes in low-and middle-income countries (LMICs). This realist review aims to understand how, why and under what circumstance P4P works in LMICs.We systematically searched peer-reviewed and grey literature databases, and examined the mechanisms underpinning P4P effects on: utilisation of services, patient satisfaction, provider productivity and broader health system, and contextual factors moderating these. This evidence was then used to construct a causal loop diagram.We included 112 records (19 grey literature; 93 peer-reviewed articles) assessing P4P schemes in 36 countries. Although we found mixed evidence of P4P's effects on identified outcomes, common pathways to improved outcomes include: community outreach; adherence to clinical guidelines, patient-provider interactions, patient trust, facility improvements, access to drugs and equipment, facility autonomy, and lower user fees. Contextual factors shaping the system response to P4P include: degree of facility autonomy, efficiency of banking, role of user charges in financing public services; staffing levels; staff training and motivation, quality of facility infrastructure and community social norms. Programme design features supporting or impeding health system effects of P4P included: scope of incentivised indicators, fairness and reach of incentives, timely payments and a supportive, robust verification system that does not overburden staff. Facility bonuses are a key element of P4P, but rely on provider autonomy for maximum effect. If health system inputs are vastly underperforming pre-P4P, they are unlikely to improve only due to P4P. This is the first realist review describing how and why P4P initiatives work (or fail) in different LMIC contexts by exploring the underlying mechanisms and contextual and programme design moderators. Future studies should systematically examine health system pathways to outcomes for P4P and other health system strengthening initiatives, and offer more understanding of how programme design shapes mechanisms and effects.

How are pay-for-performance schemes in healthcare designed in low- and middle-income countries? Typology and systematic literature review

BACKGROUND

Pay for performance (P4P) schemes provide financial incentives to health workers or facilities based on the achievement of pre-specified performance targets and have been widely implemented in health systems across low and middle-income countries (LMICs). The growing evidence base on P4P highlights that (i) there is substantial variation in the effect of P4P schemes on outcomes and (ii) there appears to be heterogeneity in incentive design. Even though scheme design is likely a key determinant of scheme effectiveness, we currently lack systematic evidence on how P4P schemes are designed in LMICs.

METHODS

We develop a typology to classify the design of P4P schemes in LMICs, which highlights different design features that are a priori likely to affect the behaviour of incentivised actors. We then use results from a systematic literature review to classify and describe the design of P4P schemes that have been evaluated in LMICs. To capture academic publications, Medline, Embase, and EconLit databases were searched. To include relevant grey literature, Google Scholar, Emerald Insight, and websites of the World Bank, WHO, Cordaid, Norad, DfID, USAID and PEPFAR were searched.

RESULTS

We identify 41 different P4P schemes implemented in 29 LMICs. We find that there is substantial heterogeneity in the design of P4P schemes in LMICs and pinpoint precisely how scheme design varies across settings. Our results also highlight that incentive design is not adequately being reported on in the literature - with many studies failing to report key design features.

CONCLUSIONS

We encourage authors to make a greater effort to report information on P4P scheme design in the future and suggest using the typology laid out in this paper as a starting point.

Role of a hospital accreditation program in developing a process management system

Purpose

The purpose of this paper is to clarify the effects of the Iranian Hospital Accreditation Program (IHAP) on hospital processes from the viewpoint of the staff charged with establishing the program.

Design/methodology/approach

This qualitative study is based on the data collected in semi-structured interviews conducted in 2016, which involved eight questions. Interviews were held with 70 staff members at 14 hospitals. Managerial staff were purposively interviewed based on their familiarity and involvement with the program. The hospitals were divided into five groups, comprising public, private, charity, military and social service hospitals. A thematic analysis was carried out using the collected data.

Findings

Three themes emerged from the data, which together comprise a process management cycle: the establishment, implementation, and control phases of the program. For each phase, various positive trends, as well as hurdles for establishing the program, declared which were framed two sub-themes as positive effects and challenges.

Originality/value

The findings contribute to the body of evidence used by policy-makers and hospital managers to improve the change management processes related to the Iranian IHAP. Although positive changes in the process management cycles at Iranian hospitals were noted, successful implementation of the program demands a thorough assessment of the hospitals’ technical and financial needs (taking into account disparities between hospitals), and there is an urgent requirement for a plan to meet these needs.

Strategic Faults in Implementation of Hospital Accreditation Programs in Developing Countries: Reflections on the Iranian Experience

Establishment of hospital accreditation programs is increasingly growing across numerous developing nations. Such initiatives aim to improve quality of care. However, such establishments, mainly incentivized by successful and famous accreditation plans in developed countries, usually suffer from lack of necessary arrangements which, in turn, result in undesired consequences. Indeed, the first priority for such nations, including Iran, is not establishment of accreditation programs, yet strict licensing plans.