Does performance-based financing increase value for money in low- and middle- income countries? A systematic review

Interventions to improve pharmacists' competency in chronic disease management: a systematic review of randomized controlled trials

INTRODUCTION

Effective chronic disease management (CDM) is vital for addressing chronic disease challenges. Given the importance of ensuring pharmacists' competence in CDM, interventions targeting knowledge, skills, and attitudes are essential. Therefore, a comprehensive and up-to-date study is needed to analyze these interventions' effect and potential development. Categorizing the interventions based on the Effective Practice and Organization of Care (EPOC) taxonomy is essential for better informing policymakers. The objectives of this systematic review were to identify interventions to improve pharmacists' competency in chronic disease management based on the EPOC taxonomy and summarize their effectiveness.

METHODS

Following methods in the Cochrane Handbook, a systematic search was conducted up to April 2024 on MEDLINE and Scopus. The inclusion criteria were an intervention study with a randomized controlled trial (RCT) design published in English, targeting pharmacists, and measuring knowledge, skills, and attitudes in aspects of CDM. The risk of bias was assessed using Cochrane's RoB 2 tool for either randomized or cluster-randomized trials. Findings are reported narratively and align with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.

RESULTS

We included 11 RCT studies that focused on various aspects of CDM among community and hospital pharmacists. Implementation strategies and combined implementation strategies-delivery arrangements interventions were identified. Six implementation strategies interventions consistently yielded effective results, with scores ranging from 0.99 to 9.17 (p < 0.05). However, the other two implementation strategies interventions reported mixed results, with no significant improvements in knowledge or skills. Two implementation strategies-delivery arrangements interventions showed improvements, with score differences ranging from 4.5% (95% CI: 1.6%-7.4%) to 30% (95% CI: 29%-40%). Conversely, one implementation strategies-delivery arrangements intervention showed no significant improvement. The risk of bias assessment revealed varying levels of bias across the studies.

CONCLUSIONS

Implementation strategies and combined implementation strategies-delivery arrangements interventions improved pharmacists' competency in CDM. Most interventions consistently resulted in significant improvements in pharmacists' knowledge, skills, and attitudes. These findings underscore the potential of tailored, competency-based interventions to improve pharmacist competencies in CDM. Policymakers can use these insights to create guidelines and policies that promote ongoing professional development for pharmacists.

Pay-for-performance in Taiwan: A systematic review and meta-analysis of the empirical literature

OBJECTIVES

This study aimed to assess the impact of pay-for-performance (P4P) programmes on healthcare in Taiwan.

STUDY DESIGN

This was a systematic review and meta-analysis.

METHODS

A systematic literature search was performed using the PubMed, Medline, Embase, Cochrane review, Scopus, Web of Science and PsycINFO databases up to July 2023. Meta-analysis of the available outcomes was conducted using a random-effects model.

RESULTS

The search yielded 85 studies, of which 58 investigated the programme for diabetes mellitus (DM), eight looked at the programme for chronic kidney disease (CKD), and the remaining studies examined programmes for breast cancer, tuberculosis, schizophrenia and chronic obstructive pulmonary disease. The DM P4P programme was a cost-effective strategy associated with reduced hospitalisation and subsequent complications. The CKD P4P was associated with a lower risk of dialysis initiation. The P4P programme also improved outcomes in breast cancer, cure rates in tuberculosis, reduced admissions for schizophrenia and reduced acute exacerbation in chronic obstructive pulmonary disease. The meta-analysis revealed that the P4P programme for DM (odds ratio [OR] = 0.59; 95% confidence interval [CI] = 0.48-0.73) and CKD (OR = 0.73; 95% CI = 0.67-0.81) significantly reduced mortality risk. However, participation rate in the DM P4P programme was only 19% in 2014.

CONCLUSIONS

P4P programmes in Taiwan improve quality of care. However, participation was voluntary and the participation rate was very low, raising the concern of selective enrolment of participants (i.e. 'cherry-picking' behaviour) by physicians. Future programme reforms should focus on well-designed features with the aim of reducing healthcare disparities.

Inclusion of disability in primary healthcare facilities and socioeconomic inequity in Brazil

OBJECTIVE

To describe disability-related performance and inequality nationwide in Brazil, and the changes that took place between 2012 and 2019 after the introduction of Programme for Improving Primary Care Access and Quality (PMAQ).

METHODS

We derived scores for disability-related care and accessibility of primary healthcare facilities from PMAQ indicators collected in round 1 (2011-2013), and round 3 (2015-2019). We assessed how scores changed after the introduction of PMAQ. We used census data on per capita income of local areas to examine the disability-specific care and accessibility scores by income group. We undertook ordinary least squares regressions to examine the association between PMAQ scores and per capita income of each local area across implementation rounds.

RESULTS

Disability-related care scores were low in round 1 (18.8, 95%CI 18.3-19.3, out of a possible 100) and improved slightly by round 3 (22.5, 95%CI 22.0-23.1). Accessibility of primary healthcare facilities was also poor in round 1 (30.3, 95%CI 29.8-30.8) but doubled by round 3 (60.8, 95%CI 60.3-61.3). There were large socioeconomic inequalities in round 1, with both scores approximately twice as high in the richest compared to the poorest group. Inequalities weakened somewhat for accessibility scores by round 3. These trends were confirmed through regression analyses, controlling for other area characteristics. Disability-related and accessibility scores also varied strongly between states in both rounds.

CONCLUSIONS

People with disabilities are being left behind by the Brazilian healthcare system, particularly in poor areas, which will challenge the achievement of universal health coverage.

Evaluation of a results-based financing nutrition intervention for tuberculosis patients in Madhya Pradesh, India, implemented during the COVID-19 pandemic

BACKGROUND

Reducing malnutrition through food supplementation is a critical component of the WHO End Tuberculosis (TB) strategy. A results-based financing (RBF) initiative in Madhya Pradesh, India-called Mukti-introduced an intensive nutrition intervention, including home visits, counseling, food basket distribution, and assistance in obtaining government benefits. Phase 1 of the program (Dhar District), implemented by ChildFund India (ChildFund) and funded by USAID, coincided with the COVID-19 lockdown in 2020. Under an RBF reimbursement scheme, ChildFund was paid based on treatment retention for 6 months and weight gain of 6 kg for adults.

METHODS

The evaluation used a mixed methods approach. Qualitative components included interviews with key informants and focus groups with program participants. Quantitative components included an analysis of program data (i.e., patient demographics, receipt of program services, and weight gain). An impact analysis of retention in treatment used data from a government database. A difference-in-differences model was used to compare results from baseline data and the program period for Dhar District to similar data for the adjacent Jhabua District.

RESULTS

The program was well implemented and appreciated by patients and providers. Patients received an average of 10.2 home visits and 6.2 food baskets. While all age and sex groups gained weight significantly over their 6-month treatment period, there was no program impact on treatment retention. Seventy-six percent of patients achieved both outcome goals. And though average program costs were under budget, ChildFund experienced a loss in the results-based financing scheme, which was covered by USAID to continue program expansion.

CONCLUSIONS

Implementing a nutrition supplementation and education program for TB patients in India is feasible. The intervention improved weight gain despite COVID-19-related lockdowns. The Mukti program did not impact treatment retention, which was already high at baseline. Program costs were modest, but the results-based financing reimbursement scheme resulted in a loss for the implementer. Overall, the RBF model led to an increased focus on outcomes for program staff and other stakeholders, which led to more efficient service delivery. Future research should examine total costs (including donated staff time) more extensively to determine the cost-effectiveness of Mukti and similar interventions.

Comparative effectiveness of financing models in development assistance for health and the role of results-based funding approaches: a scoping review

Over the past three decades, there has been an unprecedented growth in development assistance for health through different financing models, ranging from donations to results-based approaches, to improve health in low- and middle-income countries. Since then, the global burden of disease has started to shift. However, it is still not entirely clear what the comparative effect of the different financing models is. To assess the effect of these financing models on various healthcare targets, we systematically reviewed the peer-reviewed and gray literature. We identified 19 studies and found that results-based financing approaches have an overall positive impact on institutional delivery rates and numbers of healthcare facility visits, though this impact varies greatly by context.Donors might be better served by providing a results-based financing scheme combining demand and supply side health-related schemes. It is essential to include rigorous monitoring and evaluation strategies when designing financing models.

The Flipped Break-Even: Re-Balancing Demand- and Supply-Side Financing of Health Centers in Cambodia

Supply-side healthcare financing still dominates healthcare financing in many countries where the government provides line-item budgets for health facilities irrespective of the quantity or quality of services rendered. There is a risk that this approach will reduce the efficiency of services and the value of money for patients. This paper analyzes the situation of public health centers in Cambodia to determine the relevance of supply- and demand-side financing as well as lump sum and performance-based financing. Based on a sample of the provinces of Kampong Thom and Kampot in the year 2019, we determined the income and expenditure of each facility and computed the unit cost with comprehensive step-down costing. Furthermore, the National Quality Enhancement Monitoring Tool (NQEMT) provided us with a quality score for each facility. Finally, we calculated the efficiency as the quotient of quality and cost per service unit as well as correlations between the variables. The results show that the largest share of income was received from supply-side financing, i.e., the government supports the health centers with line-item budgets irrespective of the number of patients and the quality of care. This paper demonstrates that the efficiency of public health centers increases if the relevance of performance-based financing increases. Thus, the authors recommend increasing performance-based financing in Cambodia to improve value-based healthcare. There are several alternatives available to re-balance demand- and supply-side financing, and all of them must be thoroughly analyzed before they are implemented.

The effect of performance-based financing interventions on out-of-pocket expenses intended to improve access to and utilization of maternal health services in sub-Saharan Africa: protocol for a systematic review and meta-analysis

BACKGROUND

Out-of-pocket expenses have been reported as a major barrier to accessing antenatal care and skilled birth delivery in most of sub-Saharan Africa. Performance-based financing (PBF) is one of several strategies introduced in lower- and middle-income countries to strengthen a weak health system. This review aims to synthesize evidence on the effectiveness of PBF interventions implemented with the objective of reducing out-of-pocket expenses and improving access to and utilization of ANC and skilled birth delivery and family planning in sub-Saharan Africa. It will consider evidence across health sectors and identify gaps in the evidence. METHODS AND ANALYSIS: This protocol is reported according to Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guideline. The systematic review will apply a three-step strategy to search five databases (CINAHL, PubMed, Ovid Medline, EMBASE, Cochrane.) and grey literature with the help of a librarian. Two independent reviewers will conduct screening to determine eligibility and critical appraisal of selected studies using the risk of bias criteria developed by the Cochrane EPOC Group and the New Castle Ottawa Scale for observational studies. The certainty of evidence for the outcomes will be assessed using "Grades of Recommendation, Assessment, Development, and Evaluation" (GRADE) approach. This review will consider experimental and quasi-experimental study designs and observational studies. Studies published in English and French language(s) will be included. Studies published since the introduction of PBF in sub-Saharan Africa will be included. Data will be collected on each item that contributes to out-of-pocket expenses. This review will adopt the Multiple Dimensions of Access Framework to organize the findings.

DISCUSSION

This systematic review will support evidence-informed data for the performance-based financing community and government by identifying, describing, and assessing the impact of performance-based financing interventions on out-of-pocket expenses in promoting access and utilization of ANC, skilled birth delivery, and family planning across health sectors.

SYSTEMATIC REVIEW REGISTRATION

This review has been registered with PROSPERO, Registration number CRD42020222893 .

Exploring the Efficiency of Primary Health Care Provision in Rural and Sparsely Populated Areas: A Case Study from Mongolia

Mongolia is facing serious challenges in the health sector and the macro-economic sphere that have important implications for health financing and to complete universal health coverage. In this context, improving the efficiency of primary health care facilities appears as a critical issue. We study the efficiency of Soum Health Centres (SHCs), that provide primary care in rural Mongolia. Based on activity and resources data collected for all SHCs of Mongolia in 2017 and 2018 we estimate bias-adjusted efficiency scores. A double bootstrap truncated regression procedure is then used to study the factors associated with SHCs’ efficiency. On average, SHCs could potentially engage in the same activity while reducing overall resource use by around 23%. A comparatively higher population density and dependency ratio in the district where they are located tend to favour SHCs’ efficiency. Conversely, the higher the poverty rate in the soum, the lower the efficiency. We find a positive association between SHCs’ efficiency and the proportion of doctors in the health workforce. The human resources allocation process and the capitation formula currently used to pay SHCs should be adjusted based on the size and socioeconomic/demographic characteristics of the population living in the catchment area of SHCs.

An Investigation of the Relationship Between the Performance and Management Practices of Health Facilities Under a Performance-Based Financing Scheme in Nigeria

Whereas the effect of performance-based financing (PBF) on improving the quantity and quality of health services has been established, little is known about what matters for health facilities to improve performance under a PBF scheme. This study examined the associations between management practices and the performance of primary health care centers (PHCCs) under a PBF scheme in Nigeria. This study utilized longitudinal data on monthly institutional deliveries and outpatient visits collected between December 2011 and March 2016 from 111 randomly selected PHCCs in Adamawa, Ondo, and Nasarawa states of Nigeria. A management practices scorecard, based on a health facility survey conducted in April/May 2016, was used to derive management practices scores for the 111 PHCCs. The management practices examined included activities to recruit and retain clients, staff's attention to performance targets, listening and responding to client feedback, teamwork building, and addressing low-performing staff. A multilevel, multilinear regression model was used to investigate the associations between health facility performance (monthly number of institutional deliveries and outpatient visits) and management practices at the PHCCs, adjusting for key control variables (number of skilled health workers, the size of PHCC catchment population, PHCC quality score, seasonality, and states). Following PBF introduction, PHCCs with medium management score had 0.42 (95% CI 0.18-0.65; p<0.001) and 9.93 (95% CI 6.15-13.71; p<0.001) higher monthly improvement rates for institutional delivery and outpatient visits respectively compared to the PHCCs with low management score. Also, the PHCCs with high management scores had 0.49 (95%CI 0.28-0.70; p<0.001) and 5.10 (95%CI 1.76-8.44; p<0.003) higher monthly improvement rates for institutional delivery and outpatient visits compared to the PHCCs with low management scores. These findings suggest the importance of management practices in facilitating the effect of PBF on health facility performance, and the need to strengthen PHCC management practices in low- and-middle-income countries.

Decentralized facility financing versus performance-based payments in primary health care: a large-scale randomized controlled trial in Nigeria

BACKGROUND

Health system financing presents a challenge in many developing countries. We assessed two reform packages, performance-based financing (PBF) and direct facility financing (DFF), against each other and business-as-usual for maternal and child healthcare (MCH) provision in Nigeria.

METHODS

We sampled 571 facilities (269 in PBF; 302 in DFF) in 52 districts randomly assigned to PBF or DFF, and 215 facilities in 25 observable-matched control districts. PBF facilities received $2 ($1 for operating grants plus $1 for bonuses) for every $1 received by DFF facilities (operating grants alone). Both received autonomy, supervision, and enhanced community engagement, isolating the impact of additional performance-linked facility and health worker payments. Facilities and households with recent pregnancies in facility catchments were surveyed at baseline (2014) and endline (2017). Outcomes were Penta3 immunization, institutional deliveries, modern contraceptive prevalence rate (mCPR), four-plus antenatal care (ANC) visits, insecticide-treated mosquito net (ITN) use by under-fives, and directly observed quality of care (QOC). We estimated difference-in-differences with state fixed effects and clustered standard errors.

RESULTS

PBF increased institutional deliveries by 10% points over DFF and 7% over business-as-usual (p<0.01). PBF and DFF were more effective than business-as-usual for Penta3 (p<0.05 and p<0.01, respectively); PBF also for mCPR (p<0.05). Twenty-one of 26 QOC indicators improved in both PBF and DFF relative to business-as-usual (p<0.05). However, except for deliveries, PBF was as or less effective than DFF: Penta3 immunization and ITN use were each 6% less than DFF (p<0.1 for both) and QOC gains were also comparable. Utilization gains come from the middle of the rural wealth distribution (p<0.05).

CONCLUSIONS

Our findings show that both PBF and DFF represent significant improvements over business-as-usual for service provision and quality of care. However, except for institutional delivery, PBF and DFF do not differ from each other despite PBF disbursing $2 for every dollar disbursed by DFF. These findings highlight the importance of direct facility financing and decentralization in improving PHC and suggest potential complementarities between the two approaches in strengthening MCH service delivery.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03890653 ; May 8, 2017. Retrospectively registered.

Pay for performance in primary care: the contribution of the Programme for Improving Access and Quality of Primary Care (PMAQ) on avoidable hospitalisations in Brazil, 2009-2018

Background

Evidence on the effect of pay-for-performance (P4P) schemes on provider performance is mixed in low-income and middle-income countries. Brazil introduced its first national-level P4P scheme in 2011 (PMAQ-Brazilian National Programme for Improving Primary Care Access and Quality). PMAQ is likely one of the largest P4P schemes in the world. We estimate the association between PMAQ and hospitalisations for ambulatory care sensitive conditions (ACSCs) based on a panel of 5564 municipalities.

Methods

We conducted a fixed effect panel data analysis over the period of 2009–2018, controlling for coverage of primary healthcare, hospital beds per 10 000 population, education, real gross domestic product per capita and population density. The outcome is the hospitalisation rate for ACSCs among people aged 64 years and under per 10 000 population. Our exposure variable is defined as the percentage of family health teams participating in PMAQ, which captures the roll-out of PMAQ over time. We also provided several sensitivity analyses, by using alternative measures of the exposure and outcome variables, and a placebo test using transport accident hospitalisations instead of ACSCs.

Results

The results show a negative and statistically significant association between the rollout of PMAQ and ACSC rates for all age groups. An increase in PMAQ participating of one percentage point decreased the hospitalisation rate for ACSC by 0.0356 (SE 0.0123, p=0.004) per 10 000 population (aged 0–64 years). This corresponds to a reduction of approximately 60 829 hospitalisations in 2018. The impact is stronger for children under 5 years (−0.0940, SE 0.0375, p=0.012), representing a reduction of around 11 936 hospitalisations. Our placebo test shows that the association of PMAQ on the hospitalisation rate for transport accidents is not statistically significant, as expected.

Conclusion

We find that PMAQ was associated with a modest reduction in hospitalisation for ACSCs.

The effects of performance-based financing on neonatal health outcomes in Burundi, Lesotho, Senegal, Zambia and Zimbabwe

Maternal and newborn care has been a primary focus of performance-based financing (PBF) projects, which have been piloted or implemented in 21 countries in sub-Saharan Africa since 2007. Several evaluations of PBF have demonstrated improvements to facility delivery or quality of care. However, no studies have measured the impact of PBF programmes directly on neonatal health outcomes in Africa, nor compared PBF programmes against another. We assess the impact of PBF on early neonatal health outcomes and associated health care utilization and quality in Burundi, Lesotho, Senegal, Zambia and Zimbabwe. We pooled Demographic and Health Surveys and Multiple Indicator Cluster Surveys and apply difference-in-differences analysis to estimate the effect of PBF projects supported by the World Bank on early neonatal mortality and low birthweight. We also assessed the effect of PBF on intermediate outputs that are frequently explicitly incentivized in PBF projects, including facility delivery and antenatal care utilization and quality, and caesarean section. Finally, we examined the impact among births to poor or high-risk women. We found no statistically significant impact of PBF on neonatal health outcomes, health care utilization or quality in a pooled sample. PBF was also not associated with better health outcomes in each country individually, though in some countries and among poor women PBF improved facility delivery, antenatal care utilization or antenatal care quality. There was no improvement on the health outcomes among poor or high-risk women in the five countries. PBF had no impact on early neonatal health outcomes in the five African countries studied and had limited and variable effects on the utilization and quality of neonatal health care. These findings suggest that there is a need for both a deeper assessment of PBF and for other strategies to make meaningful improvements to neonatal health outcomes.

What happens when performance-based financing meets free healthcare? Evidence from an interrupted time-series analysis

In spite of the wide attention performance-based financing (PBF) has received over the past decade, no evidence is available on its impacts on quantity and mix of service provision nor on its interaction with parallel health financing interventions. Our study aimed to examine the PBF impact on quantity and mix of service provision in Burkina Faso, while accounting for the parallel introduction of a free healthcare policy. We used Health Management Information System data from 838 primary-level health facilities across 24 districts and relied on an interrupted time-series analysis with independent controls. We placed two interruptions, one to account for PBF and one to account for the free healthcare policy. In the period before the free healthcare policy, PBF produced significant but modest increases across a wide range of maternal and child services, but a significant decrease in child immunization coverage. In the period after the introduction of the free healthcare policy, PBF did not affect service provision in intervention compared with control facilities, possibly indicating a saturation effect. Our findings indicate that PBF can produce modest increases in service provision, without altering the overall service mix. Our findings, however, also indicate that the introduction of other health financing reforms can quickly crowd out the effects produced by PBF. Further qualitative research is required to understand what factors allow healthcare providers to increase the provision of some, but not all services and how they react to the joint implementation of PBF and free health care.

A more practical guide to incorporating health equity domains in implementation determinant frameworks

BACKGROUND

Due to striking disparities in the implementation of healthcare innovations, it is imperative that researchers and practitioners can meaningfully use implementation determinant frameworks to understand why disparities exist in access, receipt, use, quality, or outcomes of healthcare. Our prior work documented and piloted the first published adaptation of an existing implementation determinant framework with health equity domains to create the Health Equity Implementation Framework. We recommended integrating these three health equity domains to existing implementation determinant frameworks: (1) culturally relevant factors of recipients, (2) clinical encounter or patient-provider interaction, and (3) societal context (including but not limited to social determinants of health). This framework was developed for healthcare and clinical practice settings. Some implementation teams have begun using the Health Equity Implementation Framework in their evaluations and asked for more guidance.

METHODS

We completed a consensus process with our authorship team to clarify steps to incorporate a health equity lens into an implementation determinant framework.

RESULTS

We describe steps to integrate health equity domains into implementation determinant frameworks for implementation research and practice. For each step, we compiled examples or practical tools to assist implementation researchers and practitioners in applying those steps. For each domain, we compiled definitions with supporting literature, showcased an illustrative example, and suggested sample quantitative and qualitative measures.

CONCLUSION

Incorporating health equity domains within implementation determinant frameworks may optimize the scientific yield and equity of implementation efforts by assessing and ideally addressing implementation and equity barriers simultaneously. These practical guidance and tools provided can assist implementation researchers and practitioners to concretely capture and understand barriers and facilitators to implementation disparities.

Paying for performance to improve the delivery of health interventions in low- and middle-income countries

BACKGROUND

There is growing interest in paying for performance (P4P) as a means to align the incentives of healthcare providers with public health goals. Rigorous evidence on the effectiveness of these strategies in improving health care and health in low- and middle-income countries (LMICs) is lacking; this is an update of the 2012 review on this topic.

OBJECTIVES

To assess the effects of paying for performance on the provision of health care and health outcomes in low- and middle-income countries.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, and 10 other databases between April and June 2018. We also searched two trial registries, websites, online resources of international agencies, organizations and universities, and contacted experts in the field. Studies identified from rerunning searches in 2020 are under 'Studies awaiting classification.'

SELECTION CRITERIA

We included randomized or non-randomized trials, controlled before-after studies, or interrupted time series studies conducted in LMICs (as defined by the World Bank in 2018). P4P refers to the transfer of money or material goods conditional on taking a measurable action or achieving a predetermined performance target. To be included, a study had to report at least one of the following outcomes: patient health outcomes, changes in targeted measures of provider performance (such as the delivery of healthcare services), unintended effects, or changes in resource use.

DATA COLLECTION AND ANALYSIS

We extracted data as per original review protocol and narratively synthesised findings. We used standard methodological procedures expected by Cochrane. Given diversity and variability in intervention types, patient populations, analyses and outcome reporting, we deemed meta-analysis inappropriate. We noted the range of effects associated with P4P against each outcome of interest. Based on intervention descriptions provided in documents, we classified design schemes and explored variation in effect by scheme design.

MAIN RESULTS

We included 59 studies: controlled before-after studies (19), non-randomized (16) or cluster randomized trials (14);  and interrupted time-series studies (9). One study included both an interrupted time series and a controlled before-after study. Studies focused on a wide range of P4P interventions, including target payments and payment for outputs as modified by quality (or quality and equity assessments). Only one study assessed results-based aid. Many schemes were funded by national governments (23 studies) with the World Bank funding most externally funded schemes (11 studies). Targeted services varied; however, most interventions focused on reproductive, maternal and child health indicators. Participants were predominantly located in public or in a mix of public, non-governmental and faith-based facilities (54 studies). P4P was assessed predominantly at health facility level, though districts and other levels were also involved. Most studies assessed the effects of P4P against a status quo control (49 studies); however, some studies assessed effects against comparator interventions (predominantly enhanced financing intended to match P4P funds (17 studies)). Four studies reported intervention effects against both comparator and status quo. Controlled before-after studies were at higher risk of bias than other study designs. However, some randomised trials were also downgraded due to risk of bias. The interrupted time-series studies provided insufficient information on other concurrent changes in the study context. P4P compared to a status quo control For health services that are specifically targeted, P4P may slightly improve health outcomes (low certainty evidence), but few studies assessed this. P4P may also improve service quality overall (low certainty evidence); and probably increases the availability of health workers, medicines and well-functioning infrastructure and equipment (moderate certainty evidence). P4P may have mixed effects on the delivery and use of services (low certainty evidence) and may have few or no distorting unintended effects on outcomes that were not targeted (low-certainty evidence), but few studies assessed these. For secondary outcomes, P4P may make little or no difference to provider absenteeism, motivation or satisfaction (low certainty evidence); but may improve patient satisfaction and acceptability (low certainty evidence); and may positively affect facility managerial autonomy (low certainty evidence). P4P probably makes little to no difference to management quality or facility governance (low certainty evidence). Impacts on equity were mixed (low certainty evidence). For health services that are untargeted, P4P probably improves some health outcomes (moderate certainty evidence); may improve the delivery, use and quality of some health services but may make little or no difference to others (low certainty evidence); and may have few or no distorting unintended effects (low certainty evidence). The effects of P4P on the availability of medicines and other resources are uncertain (very low certainty evidence). P4P compared to other strategies For health outcomes and services that are specifically targeted, P4P may make little or no difference to health outcomes (low certainty evidence), but few studies assessed this. P4P may improve service quality (low certainty evidence); and may have mixed effects on the delivery and use of health services and on the availability of equipment and medicines (low certainty evidence). For health outcomes and services that are untargeted, P4P may make little or no difference to health outcomes and to the delivery and use of health services (low certainty evidence). The effects of P4P on service quality, resource availability and unintended effects are uncertain (very low certainty evidence). Findings of subgroup analyses Results-based aid, and schemes using payment per output adjusted for service quality, appeared to yield the greatest positive effects on outcomes. However, only one study evaluated results-based aid, so the effects may be spurious. Overall, schemes adjusting both for quality of service and rewarding equitable delivery of services appeared to perform best in relation to service utilization outcomes.

AUTHORS' CONCLUSIONS

The evidence base on the impacts of P4P schemes has grown considerably, with study quality gradually increasing. P4P schemes may have mixed effects on outcomes of interest, and there is high heterogeneity in the types of schemes implemented and evaluations conducted. P4P is not a uniform intervention, but rather a range of approaches. Its effects depend on the interaction of several variables, including the design of the intervention (e.g., who receives payments ), the amount of additional funding,  ancillary components (such as technical support) and contextual factors (including organizational context).

What theories underpin performance-based financing? A scoping review

PURPOSE

The study aims to explore the theoretical bases justifying the use of performance-based financing (PBF) in the health sector in low- and middle-income countries (LMICs).

DESIGN/METHODOLOGY/APPROACH

The authors conducted a scoping review of the literature on PBF so as to identify the theories utilized to underpin it and analyzed its theoretical justifications.

FINDINGS

Sixty-four studies met the inclusion criteria. Economic theories were predominant, with the principal-agent theory being the most commonly-used theory, explicitly referred to by two-thirds of included studies. Psychological theories were also common, with a wide array of motivation theories. Other disciplines in the form of management or organizational science, political and social science and systems approaches also contributed. However, some of the theories referred to contradicted each other. Many of the studies included only casually alluded to one or more theories, and very few used these theories to justify or support PBF. No theory emerged as a dominant, consistent and credible justification of PBF, perhaps except for the principal-agent theory, which was often inappropriately applied in the included studies, and when it included additional assumptions reflecting the contexts of the health sector in LMICs, might actually warn against adopting PBF.

PRACTICAL IMPLICATIONS

Overall, this review has not been able to identify a comprehensive, credible, consistent, theoretical justification for using PBF rather than alternative approaches to health system reforms and healthcare providers' motivation in LMICs.

ORIGINALITY/VALUE

The theoretical justifications of PBF in the health sector in LMICs are under-documented. This review is the first of this kind and should encourage further debate and theoretical exploration of the justifications of PBF.

Financial situation and challenges for management of SME hospitals: Evidence from Poland

The hospital represents a specific organisation, operating in a turbulent environment and financed to a large extent by public funds. The health sector is exposed to constant political and social pressure. This causes significant problems with maintaining its financial stability, which particularly affects hospitals in the SME sector. The aim of this paper is to examine the relationship between selected financial indicators and some environmental phenomena that affect the financial situation and future financial stability of a selected group of hospitals from the SME group. The results will also be compared to the situation of other SME entities. The research is based on descriptive analysis, descriptive statistics, and correlation analysis of selected data. The results indicate that the financial situation of hospitals belonging to the SME group differs significantly from the overall SME sector, and does not bode positively for their future development. The current financial situation presents particular challenges for managers in balancing financial streams and ensuring economic sustainability. At the same time, this situation should encourage decision-makers to ensure an adequate level of revenues for these public service providers, as well as face other challenges related to operational management.

A realist review to assess for whom, under what conditions and how pay for performance programmes work in low- and middle-income countries

Pay for performance (P4P) programmes are popular health system-focused interventions aiming to improve health outcomes in low-and middle-income countries (LMICs). This realist review aims to understand how, why and under what circumstance P4P works in LMICs.We systematically searched peer-reviewed and grey literature databases, and examined the mechanisms underpinning P4P effects on: utilisation of services, patient satisfaction, provider productivity and broader health system, and contextual factors moderating these. This evidence was then used to construct a causal loop diagram.We included 112 records (19 grey literature; 93 peer-reviewed articles) assessing P4P schemes in 36 countries. Although we found mixed evidence of P4P's effects on identified outcomes, common pathways to improved outcomes include: community outreach; adherence to clinical guidelines, patient-provider interactions, patient trust, facility improvements, access to drugs and equipment, facility autonomy, and lower user fees. Contextual factors shaping the system response to P4P include: degree of facility autonomy, efficiency of banking, role of user charges in financing public services; staffing levels; staff training and motivation, quality of facility infrastructure and community social norms. Programme design features supporting or impeding health system effects of P4P included: scope of incentivised indicators, fairness and reach of incentives, timely payments and a supportive, robust verification system that does not overburden staff. Facility bonuses are a key element of P4P, but rely on provider autonomy for maximum effect. If health system inputs are vastly underperforming pre-P4P, they are unlikely to improve only due to P4P. This is the first realist review describing how and why P4P initiatives work (or fail) in different LMIC contexts by exploring the underlying mechanisms and contextual and programme design moderators. Future studies should systematically examine health system pathways to outcomes for P4P and other health system strengthening initiatives, and offer more understanding of how programme design shapes mechanisms and effects.

Health Insurance in Sub-Saharan Africa: A Scoping Review of the Methods Used to Evaluate its Impact

We conducted a scoping review with the objective of synthesizing available literature and mapping what designs and methods have been used to evaluate health insurance reforms in sub-Saharan Africa. We systematically searched for scientific and grey literature in English and French published between 1980 and 2017 using a combination of three key concepts: "Insurance" and "Impact evaluation" and "sub-Saharan Africa". The search led to the inclusion of 66 articles with half of the studies pertaining to the evaluation of National Health Insurance schemes, especially the Ghanaian one, and one quarter pertaining to Community-Based Health Insurance and Mutual Health Organization schemes. Sixty-one out of the 66 studies (92%) included were quantitative studies, while only five (8%) were defined as mixed methods. Most studies included applied an observational design (n = 37; 56%), followed by a quasi-experimental (n = 27; 41%) design; only two studies (3%) applied an experimental design. The findings of our scoping review are in line with the observation emerging from prior reviews focused on content in pointing at the fact that evidence on the impact of health insurance is still relatively weak as it is derived primarily from studies relying on observational designs. Our review did identify an increase in the use of quasi-experimental designs in more recent studies, suggesting that we could observe a broadening and deepening of the evidence base on health insurance in Africa over the next few years.

Accessibility to First-Mile health services: A time-cost model for rural Uganda

This study estimates the geographical disconnection in rural Low-Middle-Income Countries (LMIC) between First-Mile suppliers of healthcare services and end-users. This detachment is due to geographical barriers and to a shortage of technical, financial, and human resources that enable peripheral health facilities to perform effective and prompt diagnosis. End-users typically have easier access to cell-phones than hospitals, so mHealth can help to overcome such barriers, transforming inpatients/outpatients into home-patients, decongesting hospitals, especially during epidemics. This generates savings for patients and the healthcare system. The advantages of mHealth are well known, but there is a literature gap in the description of its economic returns. This study applies a geographical model to a typical LMIC, Uganda, quantifying the time-cost to reach an equipped medical center. Time-cost measures the disconnection between First-Mile hubs and end-users, the potential demand of mHealth by remote end-users, and the consequent savings. The results highlight an average time-cost of 75 min, well above the recommended thresholds, and estimate that mHealth leads to significant savings (1.5 monthly salaries and 21% of public health budget). Community health workers and private actors may re-engineer healthcare resources through Public-Private Partnerships (PPP), remunerated with results-based financing (RBF). These findings can contribute to improving healthcare resource allocation in LMIC.

The evidence gap on gendered impacts of performance-based financing among family physicians for chronic disease care: a systematic review reanalysis in contexts of single-payer universal coverage

BACKGROUND

Although pay-for-performance (P4P) among primary care physicians for enhanced chronic disease management is increasingly common, the evidence base is fragmented in terms of socially equitable impacts in achieving the quadruple aim for healthcare improvement: better population health, reduced healthcare costs, and enhanced patient and provider experiences. This study aimed to assess the literature from a systematic review on how P4P for diabetes services impacts on gender equity in patient outcomes and the physician workforce.

METHODS

A gender-based analysis was performed of studies retrieved through a systematic search of 10 abstract and citation databases plus grey literature sources for P4P impact assessments in multiple languages over the period January 2000 to April 2018, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The study was restricted to single-payer national health systems to minimize the risk of physicians sorting out of health organizations with a strong performance pay component. Two reviewers scored and synthesized the integration of sex and gender in assessing patient- and provider-oriented outcomes as well as the quality of the evidence.

FINDINGS

Of the 2218 identified records, 39 studies covering eight P4P interventions in seven countries were included for analysis. Most (79%) of the studies reported having considered sex/gender in the design, but only 28% presented sex-disaggregated patient data in the results of the P4P assessment models, and none (0%) assessed the interaction of patients' sex with the policy intervention. Few (15%) of the studies controlled for the provider's sex, and none (0%) discussed impacts of P4P on the work life of providers from a gender perspective (e.g., pay equity).

CONCLUSIONS

There is a dearth of evidence on gender-based outcomes of publicly funded incentivizing physician payment schemes for chronic disease care. As the popularity of P4P to achieve health system goals continues to grow, so does the risk of unintended consequences. There is a critical need for research integrating gender concerns to help inform performance-based health workforce financing policy options in the era of the Sustainable Development Goals.

Pay for Performance: A Reflection on How a Global Perspective Could Enhance Policy and Research

Pay-for-performance (P4P) is the provision of financial incentives to healthcare providers based on pre-specified performance targets. P4P has been used as a policy tool to improve healthcare provision globally. However, researchers tend to cluster into those working on high or low- and middle-income countries (LMICs), with still limited knowledge exchange, potentially constraining opportunities for learning from across income settings. We reflect here on some commonalities and differences in the design of P4P schemes, research questions, methods and data across income settings. We highlight how a global perspective on knowledge synthesis could lead to innovations and further knowledge advancement.

Misunderstandings and ambiguities in strategic purchasing in low- and middle-income countries

Strategic purchasing is branded as an approach that is necessary for progress towards universal health coverage. While we agree that publicly purchased health services should respond to society's needs and patient expectations, and thus generally endorse strategic purchasing, here we would like to explore two emerging concerns within current discussions in low- and middle-income countries. First, there exists a great deal of misunderstanding and conceptual unclarity, within practitioner groups, around the concept of strategic purchasing and what instruments it incorporates. Second, there is a growing trend to regularly fuse strategic purchasing into a performance-based financing (PBF) discourse in ways that increasingly blur their distinctive properties and policy orientations, while perhaps too easily obfuscating potential tensions. We believe the discourse on strategic purchasing would benefit from better conceptual clarity by dissociating and prioritising its two objectives, namely: priority should be given to needs-based allocation of resources, while rewarding performance is a subsequent concern. We argue there is a need for a more thoroughgoing conceptual and empirical re-examination of strategic purchasing's priorities, its link with PBF, as well as for a wider evidence-base on what strategic purchasing tools exist and which are most appropriate for diverse contexts.

Implementing performance-based financing in peripheral health centres in Mali: what can we learn from it?

Introduction

Numerous sub-Saharan African countries have experimented with performance-based financing (PBF) with the goal of improving health system performance. To date, few articles have examined the implementation of this type of complex intervention in Francophone West Africa. This qualitative research aims to understand the process of implementing a PBF pilot project in Mali's Koulikoro region.

Method

We conducted a contrasted multiple case study of performance in 12 community health centres in three districts. We collected 161 semi-structured interviews, 69 informal interviews and 96 non-participant observation sessions. Data collection and analysis were guided by the Consolidated Framework for Implementation Research adapted to the research topic and local context.

Results

Our analysis revealed that the internal context of the PBF implementation played a key role in the process. High-performing centres exercised leadership and commitment more strongly than low-performing ones. These two characteristics were associated with taking initiatives to promote PBF implementation and strengthening team spirit. Information regarding the intervention was best appropriated by qualified health professionals. However, the limited duration of the implementation did not allow for the emergence of networks or champions. The enthusiasm initially generated by PBF quickly dissipated, mainly due to delays in the implementation schedule and the payment modalities.

Conclusion

PBF is a complex intervention in which many actors intervene in diverse contexts. The initial level of performance and the internal and external contexts of primary healthcare facilities influence the implementation of PBF. Future work in this area would benefit from an interdisciplinary approach combining public health and anthropology to better understand such an intervention. The deductive–inductive approach must be the stepping-stone of such a methodological approach.

The impact of the obstetrical risk insurance scheme in Mauritania on maternal healthcare utilization: a propensity score matching analysis

In Mauritania, obstetrical risk insurance (ORI) has been progressively implemented at the health district level since 2002 and was available in 25% of public healthcare facilities in 2015. The ORI scheme is based on pre-payment scheme principles and focuses on increasing the quality of and access to both maternal and perinatal healthcare. Compared with many community-based health insurance schemes, the ORI scheme is original because it is not based on risk pooling. For a pre-payment of 16-18 USD, women are covered during their pregnancy for antenatal care, skilled delivery, emergency obstetrical care [including caesarean section (C-section) and transfer] and a postnatal visit. The objective of this study is to evaluate the impact of ORI enrolment on maternal and child health services using data from the Multiple Indicator Cluster Survey (MICS) conducted in 2015. A total of 4172 women who delivered within the last 2 years before the interview were analysed. The effect of ORI enrolment on the outcomes was estimated using a propensity score matching estimation method. Fifty-eight per cent of the studied women were aware of ORI, and among these women, more than two-thirds were enrolled. ORI had a beneficial effect among the enrolled women by increasing the probability of having at least one prenatal visit by 13%, the probability of having four or more visits by 11% and the probability of giving birth at a healthcare facility by 15%. However, we found no effect on postnatal care (PNC), C-section rates or neonatal mortality. This study provides evidence that a voluntary pre-payment scheme focusing on pregnant women improves healthcare services utilization during pregnancy and delivery. However, no effect was found on PNC or neonatal mortality. Some efforts should be exerted to improve communication and accessibility to ORI.

The cost-effectiveness of using results-based financing to reduce maternal and perinatal mortality in Malawi

INTRODUCTION

Results-based financing (RBF) is being promoted to increase coverage and quality of maternal and perinatal healthcare in sub-Saharan Africa (SSA) countries. Evidence on the cost-effectiveness of RBF is limited. We assessed the cost-effectiveness within the context of an RBF intervention, including performance-based financing and conditional cash transfers, in rural Malawi.

METHODS

We used a decision tree model to estimate expected costs and effects of RBF compared with status quo care during single pregnancy episodes. RBF effects on maternal case fatality rates were modelled based on data from a maternal and perinatal programme evaluation in Zambia and Uganda. We obtained complementary epidemiological information from the published literature. Service utilisation rates for normal and complicated deliveries and associated costs of care were based on the RBF intervention in Malawi. Costs were estimated from a societal perspective. We estimated incremental cost-effectiveness ratios per disability adjusted life year (DALY) averted, death averted and life-year gained (LYG) and conducted sensitivity analyses to how robust results were to variations in key model parameters.

RESULTS

Relative to status quo, RBF implied incremental costs of US$1122, US$26 220 and US$987 per additional DALY averted, death averted and LYG, respectively. The share of non-RBF facilities that provide quality care, life expectancy of mothers at time of delivery and the share of births in non-RBF facilities strongly influenced cost-effectiveness values. At a willingness to pay of US$1485 (3 times Malawi gross domestic product per capita) per DALY averted, RBF has a 77% probability of being cost-effective.

CONCLUSIONS

At high thresholds of wiliness-to-pay, RBF is a cost-effective intervention to improve quality of maternal and perinatal healthcare and outcomes, compared with the non-RBF based approach. More RBF cost-effectiveness analyses are needed in the SSA region to complement the few published studies and narrow the uncertainties surrounding cost-effectiveness estimates.

Understanding efficiency and the effect of pay-for-performance across health facilities in Tanzania

BACKGROUND

Ensuring efficient use and allocation of limited resources is crucial to achieving the UHC goal. Performance-based financing that provides financial incentives for health providers reaching predefined targets would be expected to enhance technical efficiency across facilities by promoting an output-oriented payment system. However, there is no study which has systematically assessed efficiency scores across facilities before and after the introduction of pay-for-performance (P4P). This paper seeks to fill this knowledge gap.

METHODS

We used data of P4P evaluation related to healthcare inputs (staff, equipment, medicines) and outputs (outpatient consultations and institutional deliveries) from 75 health facilities implementing P4P in Pwani region, and 75 from comparison districts in Tanzania. We measured technical efficiency using Data Envelopment Analysis and obtained efficiency scores across facilities before and after P4P scheme. We analysed which factors influence technical efficiency by regressing the efficiency scores over a number of contextual factors. We also tested the impact of P4P on efficiency through a difference-in-differences regression analysis.

RESULTS

The overall technical efficiency scores ranged between 0.40 and 0.65 for hospitals and health centres, and around 0.20 for dispensaries. Only 21% of hospitals and health centres were efficient when outpatient consultations and deliveries were considered as output, and <3% out of all facilities were efficient when outpatient consultations only were considered as outputs. Higher efficiency scores were significantly associated with the level of care (hospital and health centre) and wealthier catchment populations. Despite no evidence of P4P effect on efficiency on average, P4P might have improved efficiency marginally among public facilities.

CONCLUSION

Most facilities were not operating at their full capacity indicating potential for improving resource usage. A better understanding of the production process at the facility level and of how different healthcare financing reforms affects efficiency is needed. Effective reforms should improve inputs, outputs but also efficiency.

At what cost is performance-based financing implemented? Novel evidence from Malawi

Our study estimated the full economic cost of implementing performance-based financing [PBF, the Support for Service Delivery Integration Performance-Based Incentives (SSDI-PBI) programme], as a means of first introducing strategic purchasing in a low-income setting, Malawi. Our analysis distinguished design from implementation costs and traces costs across personnel and non-personnel cost categories over the 2012-15 period. The full cost of the SSDI-PBI programme amounted to USD 3 402 187, equivalent to USD 6.46 per targeted beneficiary. The design phase accounted for about one-third (USD 1 161 332) of the total costs, while the incentives (USD 1 140 436) represented about one-third of the total cost of the intervention and about half the cost of the implementation phase. With a cost of USD 1 605 178, personnel costs represented the dominant cost category. Our study indicated that the introduction of PBF entailed consumption of a substantial amount of resources, hence representing an important opportunity cost for the health system.

Effects of pay-for-performance for primary care physicians on diabetes outcomes in single-payer health systems: a systematic review

BACKGROUND

Although pay-for-performance (P4P) for diabetes care is increasingly common, evidence of its effectiveness in improving population health and health system sustainability is deficient. This information gap is attributable in part to the heterogeneity of healthcare financing, covered medical conditions, care settings, and provider remuneration arrangements within and across countries. We systematically reviewed the literature concentrating on whether P4P for physicians in primary and community care leads to better diabetes outcomes in single-payer national health insurance systems.

METHODS

Studies were identified by searching ten databases (01/2000-04/2018) and scanning the reference lists of review articles and other global health literature. We included primary studies evaluating the effects of introducing P4P for diabetes care among primary care physicians in countries of universal health coverage. Outcomes of interest included patient morbidity, avoidable hospitalization, premature death, and healthcare costs.

RESULTS

We identified 2218 reports; after exclusions, 10 articles covering 8 P4P interventions in 7 countries were eligible for analysis. Five studies, capturing records from 717,166 patients with diabetes, were graded as high-quality evaluations of P4P on health outcomes. Based on three quality studies, P4P can result in reduced risk of mortality over the longer term-when linked to performance metrics. However, studies from other jurisdictions, where P4P was not linked to specific patient-oriented objectives, yielded little or mixed evidence of positive health impacts.

CONCLUSION

Evidence of the effectiveness of P4P depends on whether physicians' incentive payments are explicitly tied to performance metrics. However, the most appropriate indicators for performance monitoring remain in question. More research with rigorous evaluation in different settings is needed.

Stakeholder Perceptions and Context of the Implementation of Performance-Based Financing in District Hospitals in Mali

BACKGROUND

To improve the performance of the healthcare system, Mali's government implemented a pilot project of performance-based financing (PBF) in the field of reproductive health. It was established in the Koulikoro region. This research analyses the process of implementing PBF at district hospital (DH) level, something which has rarely been done in Africa.

METHODS

This qualitative research is based on a multiple, explanatory, and contrasting case study with nested levels of analysis. It covered three of the 10 DHs in the Koulikoro region. We conducted 36 interviews: 12 per DH with council of circle's members (2) and health personnel (10). We also conducted 24 non-participant observation sessions, 16 informal interviews, and performed a literature review. We performed data analysis using the Consolidated Framework for Implementation Research (CFIR).

RESULTS

Stakeholders perceived the PBF pilot project as a vertical intervention from outside that focused solely on reproductive health. Local actors were not involved in the design of the PBF model. Several difficulties regarding the quality of its design and implementation were highlighted: too short duration of the intervention (8 months), choice and insufficient number of indicators according to the priority of the donors, and impossibility of making changes to the model during its implementation. All health workers adhered to the principles of PBF intervention. Except for members of the district health management team (DHMT) involved in the implementation, respondents only had partial knowledge of the PBF intervention. The implementation of PBF appeared to be easier in District 3 Hospital compared to District 1 and District 2 because it benefited from a pre-pilot project and had good leadership.

CONCLUSION

The PBF programme offered an opportunity to improve the quality of care provided to the population through the motivation of health personnel in Mali. However, several obstacles were observed during the implementation of the PBF pilot project in DHs. When designing and implementing PBF in DHs, it is necessary to consider factors that can influence the implementation of a complex intervention.

Primary health care financing interventions: a systematic review and stakeholder-driven research agenda for the Asia-Pacific region

INTRODUCTION

Interventions targeting the financing of primary health care (PHC) systems could accelerate progress towards universal health coverage; however, there is limited evidence to guide best-practice implementation of these interventions. This study aimed to generate a stakeholder-led research agenda in the area of PHC financing interventions in the Asia-Pacific region.

METHODS

We adopted a two-stage process: (1) a systematic review of financing interventions targeting PHC service delivery in the Asia-Pacific region was conducted to develop an evidence gap map and (2) an electronic-Delphi (e-Delphi) exercise with key national PHC stakeholders was undertaken to prioritise these evidence needs.

RESULTS

Thirty-one peer-reviewed articles (including 10 systematic reviews) and 10 grey literature reports were included in the review. There was limited consistency in results across studies but there was evidence that some interventions (removal of user fees, ownership models of providers and contracting arrangements) could impact PHC service access, efficiency and out-of-pocket cost outcomes. The e-Delphi exercise highlighted the importance of contextual factors and prioritised research in the areas of: (1) interventions to limit out-of-pocket costs; (2) financing models to enhance health system performance and maintain PHC budgets; (3) the design of incentives to promote optimal care without unintended consequences and (4) the comparative effectiveness of different PHC service delivery strategies using local data.

CONCLUSION

The research questions which were deemed most important by stakeholders are not addressed in the literature. There is a need for more research on how financing interventions can be implemented at scale across health systems. Such research needs to be pragmatic and balance academic rigour with practical considerations.

Coming Full Circle: How Health Worker Motivation and Performance in Results-Based Financing Arrangements Hinges on Strong and Adaptive Health Systems

BACKGROUND

This paper presents findings from a study which sought to understand why health workers working under the results-based financing (RBF) arrangements in Zimbabwe reported being satisfied with the improvements in working conditions and compensation, but paradoxically reported lower motivation levels compared to those not working under RBF arrangements.

METHODS

A qualitative study was conducted amongst health workers and managers working in health facilities that were implementing the RBF arrangements and those that were not. Through purposeful sampling, 4 facilities in RBF implementing districts that reported poor motivation and satisfaction, were included as study sites. Four facilities located in non-RBF districts which reported high motivation and satisfaction were also included. Data was collected through in-depth interviews and analyzed using the framework approach.

RESULTS

Results based financing arrangements introduce a wide range of new institutional arrangements, roles, tasks, and ways of doing things, for facility staff, facility managers and, district and provincial health management teams. Findings reveal that insufficient preparedness of people and processes for this change, constrained managers and workers performance. Results based financing arrangements introduce explicit and tacit changes, including but not limited to, incentive logics, in the system. Findings show that unless systematic efforts are made to enable the absorption of these changes in the system: eg, through reconfiguring the decision space available at various levels, through clarification of accountability relationships, through building personnel and process capacities, before instituting changes, the full potential of the RBF arrangements cannot be realised.

CONCLUSION

Our study demonstrates the importance of analysing existing institutional, management and governance arrangements and capabilities and taking these into account when designing and implementing RBF interventions. Introducing RBF arrangements cannot alone overcome chronic systemic weaknesses. For a system wide change, as RBF arguably is, to be effected, explicit organisational change management processes need to be put in place, across the system. Carefully designed processes, which take into account the interest and willingness of various actors to change, and which are cognizant of and constructively engage with potential bottlenecks and points of resistance, should accompany any health system change initiative.

Evaluation of results-based financing in the Republic of the Congo: a comparison group pre-post study

Results-based financing (RBF) has been advocated and increasingly scaled up in low- and middle-income countries to increase utilization and quality of key primary care services, thereby reducing maternal and child mortality rates. This pilot RBF study in the Republic of the Congo from 2012 to 2014 used a quasi-experimental research design. The authors conducted pre- and post-household surveys and gathered health facility services data from both intervention and comparison groups. Using a difference-in-differences approach, the study evaluated the impact of RBF on maternal and child health services. The household survey found statistically significant improvements in quality of services regarding the availability of medicines, perceived quality of care, hygiene of health facilities and being respected at the reception desk. The health facility survey showed no adverse effects and significantly favourable impacts on: curative visits, patient referral, children receiving vitamin A, HIV testing of pregnant women and assisted deliveries. These improvements, in relative terms, ranged from 42% (assisted deliveries) to 155% (children receiving vitamin A). However, the household survey found no statistically significant impacts on the five indicators measuring the use of maternal health services, including the percentage of pregnant women using prenatal care, 3+ prenatal care, postnatal care, assisted delivery, and family planning. Surprisingly, RBF was found to be associated with a reduction of coverage of the third diphtheria, pertussis, and tetanus immunization among children in the household survey. From the health facility survey, no association was found between RBF and full immunization among children. Overall, the study shows a favourable impact of an RBF programme on most, but not all, targeted maternal and child health services. Several aspects of programme implementation, such as timely disbursement of incentives, monitoring health facility performance, and transparency of using funds could be further strengthened to maximize RBF's impact.

Cost-effectiveness of results-based financing, Zambia: a cluster randomized trial

Objective

To evaluate the cost-effectiveness of results-based financing and input-based financing to increase use and quality of maternal and child health services in rural areas of Zambia.

Methods

In a cluster-randomized trial from April 2012 to June 2014, 30 districts were allocated to three groups: results-based financing (increased funding tied to performance on pre-agreed indicators), input-based financing (increased funding not tied to performance) or control (no additional funding), serving populations of 1.33, 1.26 and 1.40 million people, respectively. We assessed incremental financial costs for programme implementation and verification, consumables and supervision. We evaluated coverage and quality effectiveness of maternal and child health services before and after the trial, using data from household and facility surveys, and converted these to quality-adjusted life years (QALYs) gained.

Findings

Coverage and quality of care increased significantly more in results-based financing than control districts: difference in differences for coverage were 12.8% for institutional deliveries, 8.2% postnatal care, 19.5% injectable contraceptives, 3.0% intermittent preventive treatment in pregnancy and 6.1% to 29.4% vaccinations. In input-based financing districts, coverage increased significantly more versus the control for institutional deliveries (17.5%) and postnatal care (13.2%). Compared with control districts, 641 more lives were saved (lower-upper bounds: 580-700) in results-based financing districts and 362 lives (lower-upper bounds: 293-430) in input-based financing districts. The corresponding incremental cost-effectiveness ratios were 809 United States dollars (US$) and US$ 413 per QALY gained, respectively.

Conclusion

Compared with the control, both results-based financing and input-based financing were cost-effective in Zambia.

Universal Health Coverage in Francophone Sub-Saharan Africa: Assessment of Global Health Experts' Confidence in Policy Options

Many countries rely on standard recipes for accelerating progress toward universal health coverage (UHC). With limited generalizable empirical evidence, expert confidence and consensus plays a major role in shaping country policy choices. This article presents an exploratory attempt conducted between April and September 2016 to measure confidence and consensus among a panel of global health experts in terms of the effectiveness and feasibility of a number of policy options commonly proposed for achieving UHC in low- and middle-income countries, such as fee exemptions for certain groups of people, ring-fenced domestic health budgets, and public-private partnerships. To ensure a relative homogeneity of contexts, we focused on French-speaking sub-Saharan Africa. We initially used the Delphi method to arrive at expert consensus, but since no consensus emerged after 2 rounds, we adjusted our approach to a statistical analysis of the results from our questionnaire by measuring the degree of consensus on each policy option through 100 (signifying total consensus) minus the size of the interquartile range of the individual scores. Seventeen global health experts from various backgrounds, but with at least 20 years' experience in the broad region, participated in the 2 rounds of the study. The results provide an initial "mapping" of the opinions of a group of experts and suggest interesting lessons. For the 18 policy options proposed, consensus emerged only on strengthening the supply of quality primary health care services (judged as being effective with a confidence score of 79 and consensus score of 90), and on fee exemptions for the poorest (judged as being fairly easy to implement with a confidence score of 66 and consensus score of 85). For none of the 18 common policy options was there consensus on both potential effectiveness and feasibility, with very diverging opinions concerning 5 policy options. The lack of confidence and consensus within the panel seems to reflect the lack of consistent evidence on the proposed policy options. This suggests that experts' opinions should be framed within strengthened inclusive and "evidence-informed deliberative processes" where the trade-offs along the 3 dimensions of UHC-extending the population covered against health hazards, expanding the range of services and benefits covered, and reducing out-of-pocket expenditures-can be discussed in a transparent and contextualized setting.

Perceptions on evaluative and formative functions of external supervision of Rwandan primary healthcare facilities: A qualitative study

BACKGROUND

External supervision of primary healthcare facilities in low- and middle-income countries often has a managerial main purpose in which the role of support for professional development is unclear.

AIM

To explore how Rwandan primary healthcare supervisors and providers (supervisees) perceive evaluative and formative functions of external supervision.

DESIGN

Qualitative, exploratory study.

DATA

Focus group discussions: three with supervisors, three with providers, and one mixed (n = 31). Findings were discussed with individual and groups of supervisors and providers.

RESULTS

Evaluative activities occupied providers' understanding of supervision, including checking, correcting, marking and performance-based financing. These were presented as sources of motivation, that in self-determination theory indicate introjected regulation. Supervisors preferred to highlight their role in formative supervision, which may mask their own and providers' uncontested accounts that systematic performance evaluations predominated supervisors' work. Providers strongly requested larger focus on formative and supportive functions, voiced as well by most supervisors. Impact of performance evaluation on motivation and professional development is discussed.

CONCLUSION

While external supervisors intended to support providers' professional development, our findings indicate serious problems with this in a context of frequent evaluations and performance marking. Separating the role of supporter and evaluator does not appear as the simple solution. If external supervision is to improve health care services, it is essential that supervisors and health centre managers are competent to support providers in a way that transparently accounts for various performance pressures. This includes delivery of proper formative supervision with useful feedback, maintaining an effective supervisory relationship, as well as ensuring providers are aware of the purpose and content of evaluative and formative supervision functions.

Performance-based financing in low-income and middle-income countries: isn't it time for a rethink?

This paper questions the view that performance-based financing (PBF) in the health sector is an effective, efficient and equitable approach to improving the performance of health systems in low-income and middle-income countries (LMICs). PBF was conceived as an open approach adapted to specific country needs, having the potential to foster system-wide reforms. However, as with many strategies and tools, there is a gap between what was planned and what is actually implemented. This paper argues that PBF as it is currently implemented in many contexts does not satisfy the promises. First, since the start of PBF implementation in LMICs, concerns have been raised on the basis of empirical evidence from different settings and disciplines that indicated the risks, cost and perverse effects. However, PBF implementation was rushed despite insufficient evidence of its effectiveness. Second, there is a lack of domestic ownership of PBF. Considering the amounts of time and money it now absorbs, and the lack of evidence of effectiveness and efficiency, PBF can be characterised as a donor fad. Third, by presenting itself as a comprehensive approach that makes it possible to address all aspects of the health system in any context, PBF monopolises attention and focuses policy dialogue on the short-term results of PBF programmes while diverting attention and resources from broader processes of change and necessary reforms. Too little care is given to system-wide and long-term effects, so that PBF can actually damage health services and systems. This paper ends by proposing entry points for alternative approaches.

Twelve months of implementation of health care performance-based financing in Burkina Faso: A qualitative multiple case study

To improve health services' quantity and quality, African countries are increasingly engaging in performance-based financing (PBF) interventions. Studies to understand their implementation in francophone West Africa are rare. This study analysed PBF implementation in Burkina Faso 12 months post-launch in late 2014. The design was a multiple and contrasted case study involving 18 cases (health centres). Empirical data were collected from observations, informal (n = 224) and formal (n = 459) interviews, and documents. Outside the circle of persons trained in PBF, few in the community had knowledge of it. In some health centres, the fact that staff were receiving bonuses was intentionally not announced to populations and community leaders. Most local actors thought PBF was just another project, but the majority appreciated it. There were significant delays in setting up agencies for performance monitoring, auditing, and contracting, as well as in the payment. The first audits led rapidly to coping strategies among health workers and occasionally to some staging beforehand. No community-based audits had yet been done. Distribution of bonuses varied from one centre to another. This study shows the importance of understanding the implementation of public health interventions in Africa and of uncovering coping strategies.

Donor-funded project's sustainability assessment: a qualitative case study of a results-based financing pilot in Koulikoro region, Mali

BACKGROUND

Results-based financing (RBF) is emerging as a new alternative to finance health systems in many African countries. In Mali, a pilot project was conducted to improve demand and supply of health services through financing performance in targeted services. No study has explored the sustainability process of such a project in Africa. This study's objectives were to understand the project's sustainability process and to assess its level of sustainability.

METHODS

Sustainability was examined through its different determinants, phases, levels and contexts. These were explored using qualitative interviews to discern, via critical events, stakeholders' ideas regarding the project's sustainability. Data collection sites were chosen with the participation of different stakeholders, based on a variety of criteria (rural/urban settings, level of participation, RBF participants still present, etc.). Forty-nine stakeholders were then interviewed in six community health centres and two referral health centres (from 11/12/15 to 08/03/16), including health practitioners, administrators, and those involved in implementing and conceptualizing the program (government and NGOs). A theme analysis was done with the software © QDA Miner according to the study's conceptual framework.

RESULTS

The results of this project show a weak level of sustainability due to many factors. While some gains could be sustained (ex.: investments in long-term resources, high compatibility of values and codes, adapted design to the implementations contexts, etc.) other intended benefits could not (ex.: end of investments, lack of shared cultural artefacts around RBF, loss of different tasks and procedures, need of more ownership of the project by the local stakeholders). A lack of sustainability planning was observed, and few critical events were associated to phases of sustainability.

CONCLUSIONS

While this RBF project aimed at increasing health agents' motivation through different mechanisms (supervision, investments, incentives, etc.), these results raise questions on what types of motivation could be more stable and what could be the place of local stakeholders in the project; all this with the aim of more sustained and efficient results.

Household costs and time to seek care for pregnancy related complications: The role of results-based financing

Results-based financing (RBF) schemes-including performance based financing (PBF) and conditional cash transfers (CCT)-are increasingly being used to encourage use and improve quality of institutional health care for pregnant women in order to reduce maternal and neonatal mortality in low-income countries. While there is emerging evidence that RBF can increase service use and quality, little is known on the impact of RBF on costs and time to seek care for obstetric complications, although the two represent important dimensions of access. We conducted this study to fill the existing gap in knowledge by investigating the impact of RBF (PBF+CCT) on household costs and time to seek care for obstetric complications in four districts in Malawi. The analysis included data on 2,219 women with obstetric complications from three waves of a population-based survey conducted at baseline in 2013 and repeated in 2014(midline) and 2015(endline). Using a before and after approach with controls, we applied generalized linear models to study the association between RBF and household costs and time to seek care. Results indicated that receipt of RBF was associated with a significant reduction in the expected mean time to seek care for women experiencing an obstetric complication. Relative to non-RBF, time to seek care in RBF areas decreased by 27.3% (95%CI: 28.4-25.9) at midline and 34.2% (95%CI: 37.8-30.4) at endline. No substantial change in household costs was observed. We conclude that the reduced time to seek care is a manifestation of RBF induced quality improvements, prompting faster decisions on care seeking at household level. Our results suggest RBF may contribute to timely emergency care seeking and thus ultimately reduce maternal and neonatal mortality in beneficiary populations.

The unintended consequences of community verifications for performance-based financing in Burkina Faso

Performance-based financing (PBF) is being widely implemented to improve healthcare services in Africa. An essential component of PBF involves conducting community verifications, wherein investigators from local associations attempt to trace samples of patients. Community surveys are administered to patients to verify whether healthcare workers reported fictitious services to increase their revenue. At the same time, client satisfaction surveys are administered to assess whether patients are satisfied with the services received. Although some global health actors are concerned that PBF can trigger unintended consequences, this topic remains neglected. The objective of this study was to document the unintended consequences of community verification. Guided by the diffusion of innovations theory, we conducted a multiple case study. The cases were the catchment areas of seven healthcare facilities in Burkina Faso. Data were collected between January 2016 and May 2016 using non-participant observation, 92 semi-structured interviews, and informal discussions. Participants included a wide range of stakeholders, such as community verifiers, investigators, patients, and healthcare providers. Data were coded using QDA Miner, and thematic analysis was conducted. Healthcare workers did not significantly disturb or try to influence community verifiers during patient selection for community verifications. Unintended consequences included stakeholders' dissatisfaction regarding compensation modalities, work overload for community verifiers, and falsification of verification data by investigators. Community verifications led to loss of patient confidentiality as well as fears and apprehensions, although some patients were pleased to share their views regarding healthcare services. Community verifications also triggered marital issues, resulting in conflicts with, or interference from, husbands. The numerous challenges associated with locating patients in their communities led stakeholders to question the validity and utility of the results. These unintended consequences could jeopardize the overall effectiveness of community verifications. Attention should be paid to these unintended consequences to inform effective implementation and refine future interventions.

Health financing policies in Sub-Saharan Africa: government ownership or donors' influence? A scoping review of policymaking processes

BACKGROUND

The rise on the international scene of advocacy for universal health coverage (UHC) was accompanied by the promotion of a variety of health financing policies. Major donors presented health insurance, user fee exemption, and results-based financing policies as relevant instruments for achieving UHC in Sub-Saharan Africa. The "donor-driven" push for policies aiming at UHC raises concerns about governments' effective buy-in of such policies. Because the latter has implications on the success of such policies, we searched for evidence of government ownership of the policymaking process.

METHODS

We conducted a scoping review of the English and French literature from January 2001 to December 2015 on government ownership of decision-making on policies aiming at UHC in Sub-Saharan Africa. Thirty-five (35) results were retrieved. We extracted, synthesized and analyzed data in order to provide insights on ownership at five stages of the policymaking process: emergence, formulation, funding, implementation, and evaluation.

RESULTS

The majority of articles (24/35) showed mixed results (i.e. ownership was identified at one or more levels of policymaking process but not all) in terms of government ownership. Authors of only five papers provided evidence of ownership at all reviewed policymaking stages. When results demonstrated some lack of government ownership at any of the five stages, we noticed that donors did not necessarily play a role: other actors' involvement was contributing to undermining government-owned decision-making, such as the private sector. We also found evidence that both government ownership and donors' influence can successfully coexist.

DISCUSSION

Future research should look beyond indicators of government ownership, by analyzing historical factors behind the imbalance of power between the different actors during policy negotiations. There is a need to investigate how some national actors become policy champions and thereby influence policy formulation. In order to effectively achieve government ownership of financing policies aiming at UHC, we recommend strengthening the State's coordination and domestic funding mobilization roles, together with securing a higher involvement of governmental (both political and technical) actors by donors.

Travelling models and the challenge of pragmatic contexts and practical norms: the case of maternal health

As in other areas of international development, we are witnessing the proliferation of ‘traveling models’ developed by international experts and introduced in an almost identical format across numerous countries to improve some aspect of maternal health systems in low- and middle-income countries. These policies and protocols are based on ‘miracle mechanisms’ that have been taken out of their original context but are believed to be intrinsically effective in light of their operational devices.

In reality, standardised interventions are, in Africa and elsewhere, confronted with pragmatic implementation contexts that are always varied and specific, and which lead to drifts, distortions, dismemberments and bypasses. The partogram, focused antenatal care, the prevention of mother-to-child transmission of HIV or performance-based payment all illustrate these implementation gaps, often caused by the routine behaviour of health personnel who follow practical norms (and a professional culture) that are often distinct from official norms – as is the case with midwives.

Experiences in maternal and child health in Africa suggest that an alternative approach would be to start with the daily reality of social and practical norms instead of relying on models, and to promote innovations that emerge from within local health systems.

Performance-based financing contributes to the resilience of health services affected by the Liberian Ebola outbreak

Setting: The Liberian counties of Bong, with performance-based financing (PBF) for all 36 public primary-care facilities, and Margibi, with no PBF for its 24 public primary-care facilities. Objective: To compare whether specific maternal and child health indicators changed in the two counties during the pre-Ebola (2013), Ebola (2014) and post-Ebola (2015) disease outbreak periods from July to September each year. Design: This was a cross-sectional study. Results: For pregnant women, the numbers of antenatal visits, intermittent preventive malaria treatments, human immunodeficiency virus (HIV) tests and facility-based births with skilled attendants all fell during the Ebola period, with decreases being significantly more marked in Margibi County. Apart from HIV testing, which remained low in both counties, these indicators increased in the post-Ebola period, with increases significantly more marked in Bong than in Margibi. The number of childhood immunisations decreased significantly in Bong in the Ebola period compared with the pre-Ebola period, but increased to above pre-Ebola levels in the post-Ebola period. There were markedly larger decreases in childhood immunisations in Margibi County during the Ebola period, which remained significantly lower in the post-Ebola period compared with Bong County. Conclusion: In a PBF-supported county, selected maternal and childhood health indicators showed less deterioration during Ebola and better recovery post-Ebola than in a non-PBF-supported county.