What Happens When Donors Pull Out? Examining Differences in Motivation Between Health Workers Who Recently Had Performance-Based Financing (PBF) Withdrawn With Workers Who Never Received PBF in the Democratic Republic of Congo

Activity-based contracting for optimization of the mass distribution of insecticide-treated nets in the Democratic Republic of Congo: pilot implementation in Kwilu province

BACKGROUND

Promoting the use of insecticide-treated mosquito nets (ITNs) is one of the main strategies for reducing malaria-related morbidity. An innovative activity-based contracting (ABC) approach has been implemented in Kwilu Province, Democratic Republic of Congo to optimize ITN mass distribution campaigns, with payments based on contractually defined programmatic outcomes for key campaign activities following independent verification of results.

METHODS

This internal evaluation was carried out using a mixed methods approach combining qualitative and quantitative document and content analysis from a series of three workshops: validation workshops for campaign results at provincial level for the 2021 and 2022 campaigns; internal evaluation workshop for the Kwilu campaign as part of the ABC approach organized by "Santé pour tous en milieu rural" (SANRU) with its sub-contractors; and national campaign evaluation workshop organized by the National Malaria Control Program.

RESULTS

The pilot campaign with the ABC approach in Kwilu has demonstrated better results than campaigns conducted using the standard, non-ABC, approach: better household coverage (99.9% vs. 97.3%) and improved compliance with ITN allocation to households based on the household size (98. 9% vs. 84.7%); lower loss of ITNs (0.3% vs. 0.5%) with immediate penalties for lost ITNs in the province under the ABC approach; shorter campaign lead times (14 vs. 28 weeks from the start of training to the launch of distribution). This last point is crucial, as it is likely to generate efficiencies and contribute to ensuring timely ITN replacement campaigns.

CONCLUSION

The challenges encountered and the lessons learned in the implementation of the pilot ABC approach in Kwilu could guide future distribution campaigns in the DRC and other African countries that would like to engage in distribution campaigns based on performance-based incentive contracts.

Good while it lasted? Estimating the long-term and withdrawal effects of results-based financing in Malawi on maternal care utilisation using routine data

OBJECTIVES

This study aimed to evaluate the effect of introduction and subsequent withdrawal of the Results-based Financing for Maternal and Newborn Health Initiative (RBF4MNH) in Malawi on utilisation of facility-based childbirths, antenatal care (ANC) and postnatal care (PNC).

DESIGN

A controlled interrupted time series design was used with secondary data from the Malawian Health Management Information System.

SETTING

Healthcare facilities at all levels identified as providing maternity services in four intervention districts and 20 non-intervention districts in Malawi.

PARTICIPANTS

Routinely collected, secondary data of total monthly service utilisation of facility-based childbirths, ANC and PNC services.

INTERVENTIONS

The intervention is the RBF4MNH initiative, introduced by the Malawian government in 2013 to improve maternal and infant health outcomes and withdrawn in 2018 after ceasing of donor funding.

OUTCOME MEASURES

Differences in total volume and trends of utilisation of facility-based childbirths, ANC and PNC services, compared between intervention versus non-intervention districts, for the study period of 90 consecutive months.

RESULTS

No significant effect was observed, on utilisation trends for any of the three services during the first 2.5 years of intervention. In the following 2.5 years after full implementation, we observed a small positive increase for facility-based childbirths (+0.62 childbirths/month/facility) and decrease for PNC (-0.55 consultations/month/facility) trends of utilisation respectively. After withdrawal, facility-based childbirths and ANC consultations dropped both in immediate volume after removal (-10.84 childbirths/facility and -20.66 consultations/facility, respectively), and in trends of utilisation over time (-0.27 childbirths/month/facility and -1.38 consultations/month/facility, respectively). PNC utilisation levels seemed unaffected in intervention districts against a decline in the rest of the country.

CONCLUSIONS

Concurrent with wider literature, our results suggest that effects of complex health financing interventions, such as RBF4MNH, can take a long time to be seen. They might not be sustained beyond the implementation period if measures are not adopted to reform existing health financing structures.

Evaluation of an organisational-level monetary incentive to promote the health and wellbeing of workers in small and medium-sized enterprises: A mixed-methods cluster randomised controlled trial

We conducted an independent evaluation on the effectiveness of an organisational-level monetary incentive to encourage small and medium-sized enterprises (SMEs) to improve employees' health and wellbeing. This was A mixed-methods cluster randomised trial with four arms: high monetary incentive, low monetary incentive, and two no monetary incentive controls (with or without baseline measurements to examine 'reactivity' The consequence of particpant awareness of being studied, and potential impact on participant behavior effects). SMEs with 10-250 staff based in West Midlands, England were eligible. We randomly selected up to 15 employees at baseline and 11 months post-intervention. We elicited employee perceptions of employers' actions to improve health and wellbeing; and employees' self-reported health behaviours and wellbeing. We also interviewed employers and obtained qualitative data. One hundred and fifty-two SMEs were recruited. Baseline assessments were conducted in 85 SMEs in three arms, and endline assessments in 100 SMEs across all four arms. The percentage of employees perceiving "positive action" by their employer increased after intervention (5 percentage points, pp [95% Credible Interval -3, 21] and 3pp [-9, 17], in models for high and low incentive groups). Across six secondary questions about specific issues the results were strongly and consistently positive, especially for the high incentive. This was consistent with qualitative data and quantitative employer interviews. However, there was no evidence of any impact on employee health behaviour or wellbeing outcomes, nor evidence of 'reactivity'. An organisational intervention (a monetary incentive) changed employee perceptions of employer behaviour but did not translate into changes in employees' self-reports of their own health behaviours or wellbeing. Trial registration: AEARCTR-0003420, registration date: 17.10.2018, retrospectively registered (delays in contracts and identfying a suitable trial registry). The authors confirm that there are no ongoing and related trials for this intervention.

Investigating the sustainability of self-help programmes in the context of leprosy and the work of leprosy missions in Nigeria, Nepal and India: a qualitative study protocol

INTRODUCTION

Leprosy occurs among very poor people who may be stigmatised and pushed further to the margins of society. Programmes to improve social integration and stimulate economic development have been implemented to help break the vicious cycle of poverty, reduced quality of life and ulcer recurrence. These involve forming groups of people, with a common concern, to provide mutual support and form saving syndicates-hence the term 'self-help groups' (SHGs). While there is literature on the existence and effectiveness of SHGs during the funded periods, little is known about their sustainability. We aim to explore the extent to which SHG programme activities have continued beyond the funding period and record evidence of sustained benefits.

METHODS AND ANALYSIS

In India, Nepal and Nigeria, we identified programmes funded by international non-governmental organisations, primarily aimed at people affected by leprosy. In each case, financial and technical support was allocated for a predetermined period (up to 5 years).We will review documents, including project reports and meeting minutes, and conduct semistructured interviews with people involved in delivery of the SHG programme, potential beneficiaries and people in the wider environment who may have been familiar with the programme. These interviews will gauge participant and community perceptions of the programmes and barriers and facilitators to sustainability. Data will be analysed thematically and compared across four study sites.

ETHICS AND DISSEMINATION

Approval was obtained from the University of Birmingham Biomedical and Scientific Research Ethics Committee. Local approval was obtained from: The Leprosy Mission Trust India Ethics Committee; Federal Capital Territory Health Research Ethics Committee in Nigeria and the Health Research Ethics Committee of Niger State Ministry of Health; University of Nigeria Teaching Hospital and the Nepal Health and Research Council. Results will be disseminated via peer-reviewed journals, conference presentations and community engagement events through the leprosy missions.

Estimated impact from the withdrawal of primary care financial incentives on selected indicators of quality of care in Scotland: controlled interrupted time series analysis

OBJECTIVE

To determine whether the withdrawal of the Quality and Outcomes Framework (QOF) scheme in primary care in Scotland in 2016 had an impact on selected recorded quality of care, compared with England where the scheme continued.

DESIGN

Controlled interrupted time series regression analysis.

SETTING

General practices in Scotland and England.

PARTICIPANTS

979 practices with 5 599 171 registered patients in Scotland, and 7921 practices with 56 270 628 registered patients in England in 2013-14, decreasing to 864 practices in Scotland and 6873 in England in 2018-19, mainly due to practice mergers.

MAIN OUTCOME MEASURES

Changes in quality of care at one year and three years after withdrawal of QOF financial incentives in Scotland at the end of the 2015-16 financial year for 16 indicators (two complex processes, nine intermediate outcomes, and five treatments) measured annually for financial years from 2013-14 to 2018-19.

RESULTS

A significant decrease in performance was observed for 12 of the 16 quality of care indicators in Scotland one year after QOF was abolished and for 10 of the 16 indicators three years after QOF was abolished, compared with England. At three years, the absolute percentage point difference between Scotland and England was largest for recording (by tick box) of mental health care planning (-40.2 percentage points, 95% confidence interval -45.5 to -35.0) and diabetic foot screening (-22.8, -33.9 to -11.7). Substantial reductions were, however, also observed for intermediate outcomes, including blood pressure control in patients with peripheral arterial disease (-18.5, -22.1 to -14.9), stroke or transient ischaemic attack (-16.6, -20.6 to -12.7), hypertension (-13.7, -19.4 to -7.9), diabetes (-12.7, -15.0 to -12.4), or coronary heart disease (-12.8, -14.9 to -10.8), and for glycated haemoglobin control in people with HbA_1c levels ≤75 mmol/mol (-5.0, -8.4 to -1.5). No significant differences were observed between Scotland and England for influenza immunisation and antiplatelet or anticoagulant treatment for coronary heart disease three years after withdrawal of incentives.

CONCLUSION

The abolition of financial incentives in Scotland was associated with reductions in recorded quality of care for most performance indicators. Changes to pay for performance should be carefully designed and implemented to monitor and respond to any reductions in care quality.

Discontinuation of performance-based financing in primary health care: impact on family planning and maternal and child health

Performance-based financing (PBF) is advocated as an effective means to improve the quality of care by changing healthcare providers' behavior. However, there is limited evidence on its effectiveness in low- and middle-income countries and on its implementation in primary care settings. Evidence on the effect of discontinuing PBF is even more limited than that of introducing PBF schemes. We estimate the effects of discontinuing PBF in Egypt on family planning, maternal health, and child health outcomes. We use a difference-in-differences (DiD) model with fixed effects, exploiting a unique dataset of six waves of spatially constructed facility-level health outcomes. We find that discontinuing performance-based incentives to providers had a negative effect on the knowledge of contraceptive methods, iron supplementation during pregnancy, the prevalence of childhood acute respiratory infection, and, more importantly, under-five child mortality, all of which were indirectly targeted by the PBF scheme. No significant effects are reported for directly targeted outcomes. Our findings suggest that PBF can induce permanent changes in providers' behavior, but this may come at the expense of non-contracted outcomes.

A critical interpretive synthesis of power and mistreatment of women in maternity care

Labouring women may be subjected to physical and verbal abuse that reflects dynamics of power, described as Mistreatment of Women (MoW). This Critical Interpretive Synthesis on power and MoW consolidates current research and advances theory and practice through inter-disciplinary literature exploration. The review was undertaken in 3 phases. Phase 1 consisted of topic scoping; phase 2 entailed exploration of key power-related drivers emerging from the topic scoping; and phase 3 entailed data synthesis and analysis, with a particular focus on interventions. We identified 63 papers for inclusion in Phase 1. These papers utilized a variety of methods and approaches and represented a wide range of geographic regions. The power-related drivers of mistreatment in these articles span multiple levels of the social ecological model, including intrapersonal (e.g. lack of knowledge about one's rights), interpersonal (e.g. patient-provider hierarchy), community (e.g. widespread discrimination against indigenous women), organizational (e.g. pressure to achieve performance goals), and law/policy (e.g. lack of accountability for rights violations). Most papers addressed more than one level of the social-ecological model, though a significant minority were focused just on interpersonal factors. During Phase 1, we identified priority themes relating to under-explored power-related drivers of MoW for exploration in Phase 2, including lack of conscientization and normalization of MoW; perceptions of fitness for motherhood; geopolitical and ethnopolitical projects related to fertility; and pressure to achieve quantifiable performance goals. We ultimately included 104 papers in Phase 2. The wide-ranging findings from Phase 3 (synthesis and analysis) coalesce in several key meta-themes, each with their own evidence-base for action. Consistent with the notion that research on power can point us to "drivers of the drivers," the paper includes some intervention-relevant insights for further exploration, including as relating to broader social norms, health systems design, and the utility of multi-level strategies.

Reviewing the evidence on health financing for effective coverage: do financial incentives work?

The widening gap between improving healthcare coverage rates and stagnating health outcomes across low-income and middle-income countries highlights the need for investments in quality of care, in addition to access. New research, presented in a World Bank report, examines one type of relevant policy reform: performance-based financing (PBF), which is a package reform that always includes performance pay to front-line health workers and often also provides facility autonomy, transparency and community engagement. A large body of rigorous studies and new analysis show that in under-resourced, centralised health systems, PBF can result in gains to service utilisation, but only has limited impacts on quality. Even the relative benefits of PBF on service utilisation are less clear when compared with (1) direct facility financing which provides front-line facilities with operating budgets and provider autonomy, but not performance pay and (2) demand-side financial support for health services (ie, conditional cash transfers and vouchers). Thus, the central component of PBF—the performance pay—appears to add little value over flexible payment systems and provider autonomy. The analysis shows that this lack of impact is unsurprising because most of the constraints to improving quality do not lie with the health worker in these settings. While PBF was conceived as a complex package ‘blueprint’, we review the evidence to conclude that only some elements seem to make sense. To improve quality of care, health financing should pivot from performance pay while retaining the elements of direct facility financing, autonomy, transparency and community engagement.

Contextual factors influencing a training intervention aimed at improved maternal and newborn healthcare in a health zone of the Democratic Republic of Congo

Background

Maternal and neonatal mortality and morbidity in the Democratic Republic of Congo (DRC) are among the highest worldwide. As part of a quality improvement programme in a health zone in the DRC aimed at contributing to reduced maternal and neonatal mortality and morbidity, a three-pillar training intervention around childbirth was developed and implemented in collaboration between Swedish and Congolese researchers and healthcare professionals. The aim of this study is to explore contextual factors influencing this intervention.

Methods

A qualitative research design was used, with data collected through focus group discussions (n = 7) with healthcare professionals involved in the intervention before and at the end (n = 9). Transcribed discussions were inductively analysed using content analysis.

Results

Three generic categories describe the contextual factors influencing the intervention: i) Incentives motivated participants’ efforts to begin a training programme; ii) Involving the local health authorities was important; and (iii) Having physical space, electricity, and equipment in place was crucial.

Conclusions

This study and similar ones highlight that incentives of various types are crucial contextual factors that influence training interventions, and have to be considered already in the planning of such interventions. One such factor is expectations of monetary incentives. To meet this in a small research project like ours would require a reduction of the scale and thus limit the implementation of new evidence-based knowledge into practice aimed at reducing maternal mortality and morbidity.

The status of emergency obstetric and newborn care in post-conflict eastern DRC: a facility-level cross-sectional study

Background

Pregnancy-related mortality remains persistently higher in post-conflict areas. Part of the blame lies with continued disruption to vital care provision, especially emergency obstetric and newborn care (EmONC). In such settings, assessment of EmONC is essential for data-driven interventions needed to reduce preventable maternal and neonatal mortality. In the North Kivu Province (NKP), the epicentre of armed conflict in eastern Democratic Republic of the Congo (DRC) between 2006 and 2013, the post-conflict status of EmONC is unknown. We assessed the availability, use, and quality of EmONC in 3 health zones (HZs) of the NKP to contribute to informed policy and programming in improving maternal and newborn health (MNH) in the region.

Method

A cross-sectional survey of all 42 public facilities designated to provide EmONC in 3 purposively selected HZs in the NKP (Goma, Karisimbi, and Rutshuru) was conducted in 2017. Interviews, reviews of maternity ward records, and observations were used to assess the accessibility, use, and quality of EmONC against WHO standards.

Results

Only three referral facilities (two faith-based facilities in Goma and the MSF-supported referral hospital of Rutshuru) met the criteria for comprehensive EmONC. None of the health centres qualified as basic EmONC, nor could they offer EmONC services 24 h, 7 days a week (24/7). The number of functioning EmONC per 500,000 population was 1.5. Assisted vaginal delivery was the least performed signal function, followed by parenteral administration of anticonvulsants, mainly due to policy restrictions and lack of demand. The 3 HZs fell short of WHO standards for the use and quality of EmONC. The met need for EmONC was very low and the direct obstetric case fatality rate exceeded the maximum acceptable level. However, the proportion the proportion of births by caesarean section in EmONC facilities was within acceptable range in the HZs of Goma and Rutshuru. Overall, the intrapartum and very early neonatal death rate was 1.5%.

Conclusion

This study provides grounds for the development of coordinated and evidence-based programming, involving local and external stakeholders, as part of the post-conflict effort to address maternal and neonatal morbidity and mortality in the NKP. Particular attention to basic EmONC is required, focusing on strengthening human resources, equipment, supply chains, and referral capacity, on the one hand, and on tackling residual insecurity that might hinder 24/7 staff availability, on the other.

Developing strategies to attract, retain and support midwives in rural fragile settings: participatory workshops with health system stakeholders in Ituri Province, Democratic Republic of Congo

BACKGROUND

Midwifery plays a vital role in the quality of care as well as rapid and sustained reductions in maternal and newborn mortality. Like most other sub-Saharan African countries, the Democratic Republic of Congo experiences shortages and inequitable distribution of health workers, particularly in rural areas and fragile settings. The aim of this study was to identify strategies that can help to attract, support and retain midwives in the fragile and rural Ituri province.

METHODS

A qualitative participatory research design, through a workshop methodology, was used in this study. Participatory workshops were held in Bunia, Aru and Adja health districts in Ituri Province with provincial, district and facility managers, midwives and nurses, and non-governmental organisation, church medical coordination and nursing school representatives. In these workshops, data on the availability and distribution of midwives as well as their experiences in providing midwifery services were presented and discussed, followed by the development of strategies to attract, retain and support midwives. The workshops were digitally recorded, transcribed and thematically analysed using NVivo 12.

RESULTS

The study revealed that participants acknowledged that most of the policies in relation to rural attraction and retention of health workers were not implemented, whilst a few have been partially put in place. Key strategies embedded in the realities of the rural fragile Ituri province were proposed, including organising midwifery training in nursing schools located in rural areas; recruiting students from rural areas; encouraging communities to use health services and thus generate more income; lobbying non-governmental organisations and churches to support the improvement of midwives' living and working conditions; and integrating traditional birth attendants in health facilities. Contextual solutions were proposed to overcome challenges.

CONCLUSION

Midwives are key skilled birth attendants managing maternal and newborn healthcare in rural areas. Ensuring their availability through effective attraction and retention strategies is essential in fragile and rural settings. This participatory approach through a workshop methodology that engages different stakeholders and builds on available data, can promote learning health systems and develop pragmatic strategies for the attraction and retention of health workers in fragile remote and rural settings.

Pay for Performance: A Reflection on How a Global Perspective Could Enhance Policy and Research

Pay-for-performance (P4P) is the provision of financial incentives to healthcare providers based on pre-specified performance targets. P4P has been used as a policy tool to improve healthcare provision globally. However, researchers tend to cluster into those working on high or low- and middle-income countries (LMICs), with still limited knowledge exchange, potentially constraining opportunities for learning from across income settings. We reflect here on some commonalities and differences in the design of P4P schemes, research questions, methods and data across income settings. We highlight how a global perspective on knowledge synthesis could lead to innovations and further knowledge advancement.