Performance-based financing to increase utilization of maternal health services: Evidence from Burkina Faso

Comparative effectiveness of financing models in development assistance for health and the role of results-based funding approaches: a scoping review

Over the past three decades, there has been an unprecedented growth in development assistance for health through different financing models, ranging from donations to results-based approaches, to improve health in low- and middle-income countries. Since then, the global burden of disease has started to shift. However, it is still not entirely clear what the comparative effect of the different financing models is. To assess the effect of these financing models on various healthcare targets, we systematically reviewed the peer-reviewed and gray literature. We identified 19 studies and found that results-based financing approaches have an overall positive impact on institutional delivery rates and numbers of healthcare facility visits, though this impact varies greatly by context.Donors might be better served by providing a results-based financing scheme combining demand and supply side health-related schemes. It is essential to include rigorous monitoring and evaluation strategies when designing financing models.

Discontinuation of performance-based financing in primary health care: impact on family planning and maternal and child health

Performance-based financing (PBF) is advocated as an effective means to improve the quality of care by changing healthcare providers' behavior. However, there is limited evidence on its effectiveness in low- and middle-income countries and on its implementation in primary care settings. Evidence on the effect of discontinuing PBF is even more limited than that of introducing PBF schemes. We estimate the effects of discontinuing PBF in Egypt on family planning, maternal health, and child health outcomes. We use a difference-in-differences (DiD) model with fixed effects, exploiting a unique dataset of six waves of spatially constructed facility-level health outcomes. We find that discontinuing performance-based incentives to providers had a negative effect on the knowledge of contraceptive methods, iron supplementation during pregnancy, the prevalence of childhood acute respiratory infection, and, more importantly, under-five child mortality, all of which were indirectly targeted by the PBF scheme. No significant effects are reported for directly targeted outcomes. Our findings suggest that PBF can induce permanent changes in providers' behavior, but this may come at the expense of non-contracted outcomes.

To What Extent Do Free Healthcare Policies and Performance-Based Financing Reduce Out-of-Pocket Expenditures for Outpatient services? Evidence From a Quasi-experimental Study in Burkina Faso

BACKGROUND

Burkina Faso has been implementing financing reforms towards universal health coverage (UHC) since 2006. Recently, the country introduced a performance-based financing (PBF) program as well as user fee removal (gratuité) policy for health services aimed at pregnant and lactating women and children under 5. We aim to assess the effect of gratuité and PBF policies on facility-based out-of-pocket expenditures (OOPEs) for outpatient services.

METHODS

Our study is a controlled pre- and post-test design using healthcare facility data from the PBF program's impact evaluation collected in 2014 and 2017. We compared OOPE related to primary healthcare use incurred by children under 5 and individuals above 5 to assess the effect of the gratuité policy on OOPE. We further compared OOPE incurred by individuals residing in PBF districts and non-PBF districts to estimate the effect of the PBF on OOPE. Effects were estimated using difference-in-differences models, distinguishing the estimation of the probability of incurring OOPE from the estimation of the magnitude of OOPE using a generalized linear model (GLM).

RESULTS

The proportion of children under 5 incurring OOPE declined significantly from 90% in 2014 to 3% in 2017. Concurrently, mean OOPE also decreased. Differences in both the probability of incurring OOPE and mean OOPE between PBF and non-PBF facilities were small. Our difference in differences estimates indicated that gratuité produced an 84% (CI -86%, -81%) reduction in the probability of incurring OOPE and reduced total OOPE by 54% (CI 63%, 42%). We detected no significant effects of PBF, either in reducing the probability of incurring OOPE or in its magnitude.

CONCLUSION

User fee removal is an effective demand-side intervention for enhancing financial accessibility. As a supply-side intervention, PBF appears to have limited effects on reducing financial burden.

Exploring the roles of players in strategic purchasing for healthcare in Africa-a scoping review

Following the World Health Organization (WHO) guidance on strategic purchasing in 2000, low- and middle-income countries (LMICs) are trying to shift from passive purchasing (using fixed budgets) to strategic purchasing of healthcare which ties reimbursement to outcomes. However, there is limited evidence on strategic purchasing in Africa. We conducted a scoping literature review aimed at summarizing the roles played by governments, purchasers and providers in relation to citizens/population in strategic purchasing in Africa. The review searched for scientific journal articles that contained data on strategic purchasing collected from Africa. The literature search identified 957 articles of which 80 matched the inclusion criteria and were included in the review. The study revealed that in some countries strategic purchasing has been used as a tool for healthcare reforms or for strengthening systems that were not functional under fixed budgets. However, there was some evidence of a lack of government commitment in taking leading roles and funding strategic purchasing. Further, in some countries the laws need to be revised to accommodate new arrangements that were not part of fixed budgets. The review also established that there were some obstacles within the public health systems that deterred purchasers from promoting efficiency among providers and that prevented providers from having full autonomy in decision making. As African countries strive to shift from passive to strategic purchasing of healthcare, there is need for full government commitment on strategic purchasing. There is need to further revise appropriate legal frameworks to support strategic purchasing, conduct assessments of the healthcare systems before designing strategic purchasing schemes and to sensitize the providers and citizens on their roles and entitlements respectively.

Factors impacting antenatal care utilization: a systematic review of 37 fragile and conflict-affected situations

BACKGROUND

It is estimated that over 930 million people live in fragile and conflict-affected situations (FCAS) worldwide. These regions, characterized by violence, civil unrest, and war, are often governed by corrupt administrations who are unwilling to provide their citizens with basic human rights. Individuals living in FCAS face health inequities; however, women are disproportionally affected and face additional barriers to accessing sexual and reproductive services, including antenatal care (ANC). This systematic review aims to identify the factors that impact ANC usage in the 37 countries or regions classified as FCAS in 2020 by The World Bank.

METHODS

Using the PRISMA guidelines, a systematic search of five databases (SCOPUS, Web of Science, PubMed, EMBASE, and CINAHL) was conducted. Results were limited to human studies, written in English, and published between January 2002 and January 2022. Studies that identified factors affecting utilization of ANC or maternal health services were included for review and critically appraised using the National Institute of Health's Quality Assessment Tools. Findings were summarized using a narrative synthesis approach.

RESULTS

The database search yielded 26,527 studies. After title, abstract and full-text review, and exclusion of duplicate articles, 121 studies remained. Twenty-eight of the 37 FCAS were represented in the included studies. The studies highlighted that women in FCAS' are still not meeting the World Health Organization's 2002 recommendation of four ANC visits during pregnancy, a recommendation which has since been increased to eight visits. The most cited factors impacting ANC were socioeconomic status, education, and poor quality of ANC. Despite all studies being conducted in conflict-affected regions, only nine studies explicitly identified conflict as a direct barrier to accessing ANC.

CONCLUSION

This review demonstrated that there is a paucity in the literature examining the direct and indirect impacts of conflict on ANC utilization. Specifically, research should be conducted in the nine FCAS that are not currently represented in the literature. To mitigate the barriers that prevent utilization of maternal health services identified in this review, policy makers, women utilizing ANC, and global organizations should attempt to collaborate to enact policy change at the local level.

Rethinking integrated service delivery for malaria

Despite worldwide efforts and much progress toward malaria control, declines in malaria morbidity and mortality have hit a plateau. While many nations achieved significant malaria suppression or even elimination, success has been uneven, and other nations have made little headway-or even lost ground in this battle. These alarming trends threaten to derail the attainment of global targets for malaria control. Among the challenges impeding success in malaria reduction, many strategies center malaria as a set of technical problems in commodity development and delivery. Yet, this narrow perspective overlooks the importance of strong health systems and robust healthcare delivery. This paper argues that strategies that move the needle on health services and behaviors offer a significant opportunity to achieve malaria control through a comprehensive approach that integrates malaria with broader health services efforts. Indeed, malaria may serve as the thread that weaves integrated service delivery into a path forward for universal health coverage. Using key themes identified by the "Rethinking Malaria in the Context of COVID-19" effort through engagement with key stakeholders, we provide recommendations for pursuing integrated service delivery that can advance malaria control via strengthening health systems, increasing visibility and use of high-quality data at all levels, centering issues of equity, promoting research and innovation for new tools, expanding knowledge on effective implementation strategies for interventions, making the case for investing in malaria among stakeholders, and engaging impacted communities and nations.

The impact of maternal and child health and nutrition improvement project on maternal health service utilization in Ghana: An Interrupted time series analysis

Maternal and Child Health and Nutrition Improvement Project (MCHNP) is an intervention that, adopts financial strategies to provide incentives as a means of motivating community health workers and ensuring accountability. This study highlights on the service delivery component of the intervention; thus, utilization of essential community nutrition and health action. This paper aims to determine the differential impact of MCHNP on maternal health service utilization in Ghana. A retrospective longitudinal pre-test post-test study design was employed. Six administrative regions were used for analyzing the impact of the intervention in uptake of maternal health services. Administrative data were extracted from the DHIMS2 database for the periods of January 2014 to December 2018. Analysis was conducted using interrupted time series analysis (ITSA) due to the absence of a control group. The difference in the pre-intervention and post-intervention means were statistically significant in the Central, Western, Eastern and Upper West region for the proportion of ANC 4 visits. With the exception of Northern region that recorded negative impact (-0.005; p-value >0.05), all the remaining regions recorded positive impacts on the percentage of women that had 4 ANC visits. All six regions had positive impacts in the proportion of women that received supervised delivery. However, none of these impacts were statistically significant; thus, the MCHNP intervention had no significant impact on maternal health outcomes which are, ANC four visits and skilled deliveries.

Economic evaluation of a conditional cash transfer to retain women in the continuum of care during pregnancy, birth and the postnatal period in Kenya

There is limited evidence on the cost and cost-effectiveness of cash transfer programmes to improve maternal and child health in Kenya and other sub-Saharan African countries. This article presents the economic evaluation results of the Afya trial, assessing the costs, cost-effectiveness and equity impact of a demand-side financing intervention that promotes utilisation of maternal health services in rural Kenya. The cost of implementing the Afya intervention was estimated from a provider perspective. Cost data were collected prospectively from all implementing and non-implementing partners, and from health service providers. Cost-efficiency was analysed using cost-transfer ratios and cost per mother enrolled into the intervention. Cost-effectiveness was assessed as cost per additional eligible antenatal care visit as a result of the intervention, when compared with standard care. The equity impact of the intervention was also assessed using a multidimensional poverty index (MPI). Programme cost per mother enrolled was International (INT)$313 of which INT$ 92 consisted of direct transfer payments, suggesting a cost transfer ratio of 2.4. Direct healthcare utilisation costs reflected a small proportion of total provider costs, amounting to INT$ 21,756. The total provider cost of the Afya intervention was INT$808,942. The provider cost per additional eligible ANC visit was INT$1,035. This is substantially higher than estimated annual health expenditure per capita at the county level of $INT61. MPI estimates suggest around 27.4% of participant households were multidimensionally poor. MPI quintiles did not significantly modify the intervention effect, suggesting the impact of the intervention did not differ by socioeconomic status. Based on the available evidence, it is not possible to conclude whether the Afya intervention was cost-effective. A simple comparison with current health expenditure in Siaya county suggests that the intervention as implemented is likely to be unaffordable. Consideration needs to be given to strengthening the supply-side of the cash transfer intervention before replication or uptake at scale.

What happens when performance-based financing meets free healthcare? Evidence from an interrupted time-series analysis

In spite of the wide attention performance-based financing (PBF) has received over the past decade, no evidence is available on its impacts on quantity and mix of service provision nor on its interaction with parallel health financing interventions. Our study aimed to examine the PBF impact on quantity and mix of service provision in Burkina Faso, while accounting for the parallel introduction of a free healthcare policy. We used Health Management Information System data from 838 primary-level health facilities across 24 districts and relied on an interrupted time-series analysis with independent controls. We placed two interruptions, one to account for PBF and one to account for the free healthcare policy. In the period before the free healthcare policy, PBF produced significant but modest increases across a wide range of maternal and child services, but a significant decrease in child immunization coverage. In the period after the introduction of the free healthcare policy, PBF did not affect service provision in intervention compared with control facilities, possibly indicating a saturation effect. Our findings indicate that PBF can produce modest increases in service provision, without altering the overall service mix. Our findings, however, also indicate that the introduction of other health financing reforms can quickly crowd out the effects produced by PBF. Further qualitative research is required to understand what factors allow healthcare providers to increase the provision of some, but not all services and how they react to the joint implementation of PBF and free health care.

Impact of Performance-Based Financing on effective coverage for curative child health services in Burkina Faso: Evidence from a quasi-experimental design

OBJECTIVE

To evaluate the impact of Performance-Based Financing (PBF) on effective coverage of child curative health services in primary healthcare facilities in Burkina Faso.

METHODS

An impact evaluation of a PBF pilot programme, using an experiment nested within a quasi-experimental design, was carried out in 12 intervention and 12 comparison districts in six regions of Burkina Faso. Across the 24 districts, primary healthcare facilities (537 both at baseline and endline) and households (baseline = 7978 endline = 7898) were surveyed. Within these households, 12 350 and 15 021 under-five-year-olds caretakers were interviewed at baseline and endline respectively. Linking service quality to service utilisation, we used difference-in-differences to estimate the impact of PBF on effective coverage of curative child health services.

RESULTS

Our study failed to detect any effect of PBF on effective coverage. Looking specifically into quality of care indicators, we detected a positive effect of PBF on structural elements of quality of care related to general service readiness, but not on the overall facility quality score, capturing both service readiness and the content of childcare.

CONCLUSION

The current study makes a unique contribution to PBF literature, as this is the first study assessing PBF impact on effective coverage for curative child health services in low-income settings. The absence of any significant effects of PBF on effective coverage suggests that PBF programmes require a stronger design focus on quality of care elements especially when implemented in a context of free healthcare policy.

Paying for performance to improve the delivery of health interventions in low- and middle-income countries

BACKGROUND

There is growing interest in paying for performance (P4P) as a means to align the incentives of healthcare providers with public health goals. Rigorous evidence on the effectiveness of these strategies in improving health care and health in low- and middle-income countries (LMICs) is lacking; this is an update of the 2012 review on this topic.

OBJECTIVES

To assess the effects of paying for performance on the provision of health care and health outcomes in low- and middle-income countries.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, and 10 other databases between April and June 2018. We also searched two trial registries, websites, online resources of international agencies, organizations and universities, and contacted experts in the field. Studies identified from rerunning searches in 2020 are under 'Studies awaiting classification.'

SELECTION CRITERIA

We included randomized or non-randomized trials, controlled before-after studies, or interrupted time series studies conducted in LMICs (as defined by the World Bank in 2018). P4P refers to the transfer of money or material goods conditional on taking a measurable action or achieving a predetermined performance target. To be included, a study had to report at least one of the following outcomes: patient health outcomes, changes in targeted measures of provider performance (such as the delivery of healthcare services), unintended effects, or changes in resource use.

DATA COLLECTION AND ANALYSIS

We extracted data as per original review protocol and narratively synthesised findings. We used standard methodological procedures expected by Cochrane. Given diversity and variability in intervention types, patient populations, analyses and outcome reporting, we deemed meta-analysis inappropriate. We noted the range of effects associated with P4P against each outcome of interest. Based on intervention descriptions provided in documents, we classified design schemes and explored variation in effect by scheme design.

MAIN RESULTS

We included 59 studies: controlled before-after studies (19), non-randomized (16) or cluster randomized trials (14);  and interrupted time-series studies (9). One study included both an interrupted time series and a controlled before-after study. Studies focused on a wide range of P4P interventions, including target payments and payment for outputs as modified by quality (or quality and equity assessments). Only one study assessed results-based aid. Many schemes were funded by national governments (23 studies) with the World Bank funding most externally funded schemes (11 studies). Targeted services varied; however, most interventions focused on reproductive, maternal and child health indicators. Participants were predominantly located in public or in a mix of public, non-governmental and faith-based facilities (54 studies). P4P was assessed predominantly at health facility level, though districts and other levels were also involved. Most studies assessed the effects of P4P against a status quo control (49 studies); however, some studies assessed effects against comparator interventions (predominantly enhanced financing intended to match P4P funds (17 studies)). Four studies reported intervention effects against both comparator and status quo. Controlled before-after studies were at higher risk of bias than other study designs. However, some randomised trials were also downgraded due to risk of bias. The interrupted time-series studies provided insufficient information on other concurrent changes in the study context. P4P compared to a status quo control For health services that are specifically targeted, P4P may slightly improve health outcomes (low certainty evidence), but few studies assessed this. P4P may also improve service quality overall (low certainty evidence); and probably increases the availability of health workers, medicines and well-functioning infrastructure and equipment (moderate certainty evidence). P4P may have mixed effects on the delivery and use of services (low certainty evidence) and may have few or no distorting unintended effects on outcomes that were not targeted (low-certainty evidence), but few studies assessed these. For secondary outcomes, P4P may make little or no difference to provider absenteeism, motivation or satisfaction (low certainty evidence); but may improve patient satisfaction and acceptability (low certainty evidence); and may positively affect facility managerial autonomy (low certainty evidence). P4P probably makes little to no difference to management quality or facility governance (low certainty evidence). Impacts on equity were mixed (low certainty evidence). For health services that are untargeted, P4P probably improves some health outcomes (moderate certainty evidence); may improve the delivery, use and quality of some health services but may make little or no difference to others (low certainty evidence); and may have few or no distorting unintended effects (low certainty evidence). The effects of P4P on the availability of medicines and other resources are uncertain (very low certainty evidence). P4P compared to other strategies For health outcomes and services that are specifically targeted, P4P may make little or no difference to health outcomes (low certainty evidence), but few studies assessed this. P4P may improve service quality (low certainty evidence); and may have mixed effects on the delivery and use of health services and on the availability of equipment and medicines (low certainty evidence). For health outcomes and services that are untargeted, P4P may make little or no difference to health outcomes and to the delivery and use of health services (low certainty evidence). The effects of P4P on service quality, resource availability and unintended effects are uncertain (very low certainty evidence). Findings of subgroup analyses Results-based aid, and schemes using payment per output adjusted for service quality, appeared to yield the greatest positive effects on outcomes. However, only one study evaluated results-based aid, so the effects may be spurious. Overall, schemes adjusting both for quality of service and rewarding equitable delivery of services appeared to perform best in relation to service utilization outcomes.

AUTHORS' CONCLUSIONS

The evidence base on the impacts of P4P schemes has grown considerably, with study quality gradually increasing. P4P schemes may have mixed effects on outcomes of interest, and there is high heterogeneity in the types of schemes implemented and evaluations conducted. P4P is not a uniform intervention, but rather a range of approaches. Its effects depend on the interaction of several variables, including the design of the intervention (e.g., who receives payments ), the amount of additional funding,  ancillary components (such as technical support) and contextual factors (including organizational context).

No effects of pilot performance-based intervention implementation and withdrawal on the coverage of maternal and child health services in the Koulikoro region, Mali: an interrupted time series analysis

Performance-based financing (PBF) has been promoted and increasingly implemented across low- and middle-income countries to increase the utilization and quality of primary health care. However, the evidence of the impact of PBF is mixed and varies substantially across settings. Thus, further rigorous investigation is needed to be able to draw broader conclusions about the effects of this health financing reform. We examined the effects of the implementation and subsequent withdrawal of the PBF pilot programme in the Koulikoro region of Mali on a range of relevant maternal and child health indicators targeted by the programme. We relied on a control interrupted time series design to examine the trend in maternal and child health service utilization rates prior to the PBF intervention, during its implementation and after its withdrawal in 26 intervention health centres. The results for these 26 intervention centres were compared with those for 95 control health centres, with an observation window that covered 27 quarters. Using a mixed-effects negative binomial model combined with a linear spline regression model and covariates adjustment, we found that neither the introduction nor the withdrawal of the pilot PBF programme bore a significant impact in the trend of maternal and child health service use indicators in the Koulikoro region of Mali. The absence of significant effects in the health facilities could be explained by the context, by the weaknesses in the intervention design and by the causal hypothesis and implementation. Further inquiry is required in order to provide policymakers and practitioners with vital information about the lack of effects detected by our quantitative analysis.

Addressing challenges in routine health data reporting in Burkina Faso through Bayesian spatiotemporal prediction of weekly clinical malaria incidence

Sub-Saharan African (SSA) countries’ health systems are often vulnerable to unplanned situations that can hinder their effectiveness in terms of data completeness and disease control. For instance, in Burkina Faso following a workers' strike, comprehensive data on several diseases were unavailable for a long period in 2019. Weather, seasonal-malaria-chemoprevention (SMC), free healthcare, and other contextual data, which are purported to influence malarial disease, provide opportunities to fit models to describe the clinical malaria data and predict the disease spread. Bayesian spatiotemporal modeling was applied to weekly malaria surveillance data from Burkina Faso (2011–2018) while considering the effects of weather, health programs and contextual factors. Then, a prediction was used to deal with weekly missing data for the entire year of 2019, and SMC and free healthcare effects were quantified. Our proposed model accurately predicted weekly clinical malaria incidence (correlation coefficient, r = 0.90). The distribution of clinical malaria incidence was heterogeneous across the country. Overall, national predicted clinical malaria incidence in 2019 (605 per 1000 [95% CrI: 360–990]) increased by 24.7% compared with the year 2015. SMC and the interaction between free healthcare and health facility attendance were associated with a reduction in clinical malaria incidence. Our modeling approach could be a useful tool for strengthening health systems’ resilience by addressing data completeness and could support SSA countries in developing appropriate targets and indicators to facilitate the subnational control effort.

Factors That Influence Data Use to Improve Health Service Delivery in Low- and Middle-Income Countries

BACKGROUND

Health service delivery indicators are designed to reveal how well health services meet a community's needs. Effective use of the data can enable targeted improvements in health service delivery. We conducted a systematic review to identify the factors that influence the use of health service delivery indicators to improve delivery of primary health care services in low- and middle-income settings.

METHODS

We reviewed empirical studies published in 2005 or later that provided evidence on the use of health service delivery data at the primary care level in low- and middle-income countries. We searched Scopus, Medline, the Cochrane Library, and citations of included studies. We also searched the gray literature, using a separate strategy. We extracted information on study design, setting, study population, study objective, key findings, and any identified lessons learned.

RESULTS

Twelve studies met the inclusion criteria. This small number of studies suggests there is insufficient evidence to draw reliable conclusions. However, a content analysis identified the following potentially influential factors, which we classified into 3 categories: governance (leadership, participatory monitoring, regular review of data); production of information (presentation of findings, data quality, qualitative data); and health information system resources (electronic health management information systems, organizational structure, training). Contextual factors and performance-based financing were also each found to have a role; however, discussing these as mediating factors may not be practical in terms of promoting data use.

CONCLUSION

Scant evidence exists regarding factors that influence the use of health service delivery indicators to improve delivery of primary health care services in low- and middle-income countries. However, the existing evidence highlights some factors that may have a role in improving data use. Further research may benefit from comparing data use factors across different types of program indicators or using our classification as a framework for field experiments.

Using routine health information data for research in low- and middle-income countries: a systematic review

BACKGROUND

Routine health information systems (RHISs) support resource allocation and management decisions at all levels of the health system, as well as strategy development and policy-making in many low- and middle-income countries (LMICs). Although RHIS data represent a rich source of information, such data are currently underused for research purposes, largely due to concerns over data quality. Given that substantial investments have been made in strengthening RHISs in LMICs in recent years, and that there is a growing demand for more real-time data from researchers, this systematic review builds upon the existing literature to summarize the extent to which RHIS data have been used in peer-reviewed research publications.

METHODS

Using terms 'routine health information system', 'health information system', or 'health management information system' and a list of LMICs, four electronic peer-review literature databases were searched from inception to February 202,019: PubMed, Scopus, EMBASE, and EconLit. Articles were assessed for inclusion based on pre-determined eligibility criteria and study characteristics were extracted from included articles using a piloted data extraction form.

RESULTS

We identified 132 studies that met our inclusion criteria, originating in 37 different countries. Overall, the majority of the studies identified were from Sub-Saharan Africa and were published within the last 5 years. Malaria and maternal health were the most commonly studied health conditions, although a number of other health conditions and health services were also explored.

CONCLUSIONS

Our study identified an increasing use of RHIS data for research purposes, with many studies applying rigorous study designs and analytic methods to advance program evaluation, monitoring and assessing services, and epidemiological studies in LMICs. RHIS data represent an underused source of data and should be made more available and further embraced by the research community in LMIC health systems.

Implementing performance-based financing in peripheral health centres in Mali: what can we learn from it?

Introduction

Numerous sub-Saharan African countries have experimented with performance-based financing (PBF) with the goal of improving health system performance. To date, few articles have examined the implementation of this type of complex intervention in Francophone West Africa. This qualitative research aims to understand the process of implementing a PBF pilot project in Mali's Koulikoro region.

Method

We conducted a contrasted multiple case study of performance in 12 community health centres in three districts. We collected 161 semi-structured interviews, 69 informal interviews and 96 non-participant observation sessions. Data collection and analysis were guided by the Consolidated Framework for Implementation Research adapted to the research topic and local context.

Results

Our analysis revealed that the internal context of the PBF implementation played a key role in the process. High-performing centres exercised leadership and commitment more strongly than low-performing ones. These two characteristics were associated with taking initiatives to promote PBF implementation and strengthening team spirit. Information regarding the intervention was best appropriated by qualified health professionals. However, the limited duration of the implementation did not allow for the emergence of networks or champions. The enthusiasm initially generated by PBF quickly dissipated, mainly due to delays in the implementation schedule and the payment modalities.

Conclusion

PBF is a complex intervention in which many actors intervene in diverse contexts. The initial level of performance and the internal and external contexts of primary healthcare facilities influence the implementation of PBF. Future work in this area would benefit from an interdisciplinary approach combining public health and anthropology to better understand such an intervention. The deductive–inductive approach must be the stepping-stone of such a methodological approach.

How to Estimate Optimal Malaria Readiness Indicators at Health-District Level: Findings from the Burkina Faso Service Availability and Readiness Assessment (SARA) Data

One of the major contributors of malaria-related deaths in Sub-Saharan African countries is the limited accessibility to quality care. In these countries, malaria control activities are implemented at the health-district level (operational entity of the national health system), while malaria readiness indicators are regionally representative. This study provides an approach for estimating health district-level malaria readiness indicators from survey data designed to provide regionally representative estimates. A binomial-hierarchical Bayesian spatial prediction method was applied to Burkina Faso Service Availability and Readiness Assessment (SARA) survey data to provide estimates of essential equipment availability and readiness for malaria care. Predicted values of each indicator were adjusted by the type of health facility, location, and population density. Then, a health district composite readiness profile was built via hierarchical ascendant classification. All surveyed health-facilities were mandated by the Ministry of Health to manage malaria cases. The spatial distribution of essential equipment and malaria readiness was heterogeneous. Around 62.9% of health districts had a high level of readiness to provide malaria care and prevention during pregnancy. Low-performance scores for managing malaria cases were found in big cities. Health districts with low coverage for both first-line antimalarial drugs and rapid diagnostic tests were Baskuy, Bogodogo, Boulmiougou, Nongr-Massoum, Sig-Nonghin, Dafra, and Do. We provide health district estimates and reveal gaps in basic equipment and malaria management resources in some districts that need to be filled. By providing local-scale estimates, this approach could be replicated for other types of indicators to inform decision makers and health program managers and to identify priority areas.

Bayesian Spatiotemporal Modeling of Routinely Collected Data to Assess the Effect of Health Programs in Malaria Incidence During Pregnancy in Burkina Faso

Control of malaria in pregnancy (MiP) remains a major challenge in Burkina Faso. Surveillance of the burden due to MiP based on routinely collected data at a fine-scale level, followed by an appropriate analysis and interpretation, may be crucial for evaluating and improving the effectiveness of existing control measures. We described the spatio-temporal dynamics of MiP at the community-level and assessed health program effects, mainly community-based health promotion, results-based financing, and intermittent-preventive-treatment with sulphadoxine-pyrimethamine (IPTp-SP). Community-aggregated monthly MiP cases were downloaded from Health Management Information System and combined with covariates from other sources. The MiP spatio-temporal pattern was decomposed into three components: overall spatial and temporal trends and space-time interaction. Bayesian hierarchical spatio-temporal Poisson models were used to fit the MiP incidence rate and assess health program effects. The overall annual incidence increased between 2015 and 2017. The findings reveal spatio-temporal heterogenicity throughout the year, which peaked during rainy season. From the model without covariates, 96 communities located mainly in the Cascades, South-West, Center-West, Center-East, and Eastern regions, exhibited significant relative-risk levels. The combined effect (significant reducing effect) of RBF, health promotion and IPTp-SP strategies was greatest in 17.7% (17/96) of high burden malaria communities. Despite intensification of control efforts, MiP remains high at the community-scale. The provided risk maps are useful tools for highlighting areas where interventions should be optimized, particularly in high-risk communities.

Responding to policy makers' evaluation needs: combining experimental and quasi-experimental approaches to estimate the impact of performance based financing in Burkina Faso

BACKGROUND

The last two decades have seen a growing recognition of the need to expand the impact evaluation toolbox from an exclusive focus on randomized controlled trials to including quasi-experimental approaches. This appears to be particularly relevant when evaluation complex health interventions embedded in real-life settings often characterized by multiple research interests, limited researcher control, concurrently implemented policies and interventions, and other internal validity-threatening circumstances. To date, however, most studies described in the literature have employed either an exclusive experimental or an exclusive quasi-experimental approach.

METHODS

This paper presents the case of a study design exploiting the respective advantages of both approaches by combining experimental and quasi-experimental elements to evaluate the impact of a Performance-Based Financing (PBF) intervention in Burkina Faso. Specifically, the study employed a quasi-experimental design (pretest-posttest with comparison) with a nested experimental component (randomized controlled trial). A difference-in-differences approach was used as the main analytical strategy.

DISCUSSION

We aim to illustrate a way to reconcile scientific and pragmatic concerns to generate policy-relevant evidence on the intervention's impact, which is methodologically rigorous in its identification strategy but also considerate of the context within which the intervention took place. In particular, we highlight how we formulated our research questions, ultimately leading our design choices, on the basis of the knowledge needs expressed by the policy and implementing stakeholders. We discuss methodological weaknesses of the design arising from contextual constraints and the accommodation of various interests, and how we worked ex-post to address them to the best extent possible to ensure maximal accuracy and credibility of our findings. We hope that our case may be inspirational for other researchers wishing to undertake research in settings where field circumstances do not appear to be ideal for an impact evaluation.

TRIAL REGISTRATION

Registered with RIDIE (RIDIE-STUDY-ID- 54412a964bce8 ) on 10/17/2014.

Assessing changes in costs of maternal postpartum services between 2013 and 2014 in Burkina Faso

Introduction

In Africa, a majority of women bring their infant to health services for immunization, but few are checked in the postpartum (PP) period. The Missed opportunities for maternal and infant health (MOMI) EU-funded project has implemented a package of interventions at community and facility levels to uptake maternal and infant postpartum care (PPC). One of these interventions is the integration of maternal PPC in child clinics and infant immunization services, which proved to be successful for improving maternal and infant PPC.

Aim

Taking stock of the progress achieved in terms of PPC with the implementation of the interventions, this paper assesses the economic cost of maternal PPC services, for health services and households, before and after the project start in Kaya health district (Burkina Faso).

Methods

PPC costs to health services are estimated using secondary data on personnel and infrastructure and primary data on time allocation. Data from two household surveys collected before and after one year intervention among mothers within one year PP are used to estimate the household cost of maternal PPC visits. We also compare PPC costs for households and health services with or without integration. We focus on the costs of the PPC intervention at days 6–10 that was most successful.

Results

The average unit cost of health services for days 6–10 maternal PPC decreased from 4.6 USD before the intervention in 2013 (Jan-June) to 3.5 USD after the intervention implementation in 2014. Maternal PPC utilization increased with the implementation of the interventions but so did days 6–10 household mean costs. Similarly, the household costs increased with the integration of maternal PPC to BCG immunization.

Conclusion

In the context of growing reproductive health expenditures from many funding sources in Burkina Faso, the uptake of maternal PPC led to a cost reduction, as shown for days 6–10, at health services level. Further research should determine whether the increase in costs for households would be deterrent to the use of integrated maternal and infant PPC.

The Importance of Leadership and Organizational Capacity in Shaping Health Workers' Motivational Reactions to Performance-Based Financing: A Multiple Case Study in Burkina Faso

BACKGROUND

Performance-based financing (PBF) is currently tested in many low- and middle-income countries as a health system strengthening strategy. One of the main mechanisms through which PBF is assumed to effect change is by motivating health workers to improve their service delivery performance. This article aims at a better understanding of such motivational effects of PBF. In particular, the study focused on organizational context factors and health workers' perceptions thereof as moderators of the motivational effects of PBF, which to date has been little explored.

METHODS

We conducted a multiple case study in 2 district hospitals and 16 primary health facilities across three districts. Health facilities were purposely sampled according to pre-PBF performance levels. Within sampled facilities, 82 clinical skilled healthcare workers were in-depth interviewed one year after the start of the PBF intervention. Data were analyzed using a blended deductive and inductive process, using self-determination theory (SDT) as an analytical framework.

RESULTS

Results show that the extent to which PBF contributed to positive, sustainable forms of motivation depended on the "ground upon which PBF fell," beyond health workers' individual personalities and disposition. In particular, health workers described three aspects of the organizational context in which PBF was implemented: the extent to which existing hierarchies fostered as opposed to hindered participation and transparency; managers' handling of the increased performance feedback inherent in PBF; and facility's pre-PBF levels in regards to infrastructure, equipment, and human resources.

CONCLUSION

Our results underline the importance of leadership styles and pre-implementation performance levels in shaping health workers' motivational reactions to PBF. Ancillary interventions aimed at fostering participatory as opposed to directional leadership or start-up support to low-performing health facilities will likely boost PBF effects in regards to the development of valuable motivational capacities.

An assessment of a performance-based management agreement initiative in Ghana's health service

BACKGROUND

As part of its efforts to improve efficiency, accountability and overall performance, the Ghana Health Service (GHS) introduced annual Performance-based Management Agreements (PMAs) in the year 2013. However, no assessment of this initiative has since been made in order to inform policy and practice. This paper provides an assessment of this policy initiative from the perspective of managers at various levels of service implementation.

METHODS

Mixed methods were employed. Questionnaires were administered to managers through an online survey (using Google forms). Descriptive and inferential statistical methods were used to analyze and present quantitative results while qualitative data was analyzed via thematic analysis.

RESULTS

The content and objectives of the PMAs were observed to be comprehensive and directed at ensuring high performance of directorates. Targets of PMAs were found to be aligned with overall health sector objectives and priorities. The directors felt PMAs were useful for delegating task to subordinates. PMAs were also found to increase commitment and contributed to improving teamwork and prudent use of resources. However, PMAs were found to lack clear implementation strategies and were not backed by incentives and sanctions. Also, budgetary allocations did not reflect demands of PMAs. Furthermore, directors at lower levels were not adequately consulted in setting PMAs targets as such district specific challenges and priorities are not usually factored into the process. Insufficient training of staff and lack of requisite staff were key challenges confronting the implementation of PMAs in most directorates. Weak monitoring and evaluation was also observed to significantly affect the success of PMAs.

CONCLUSION

There is the need to address the weaknesses and improve on the existing strengths identified by this assessment in order to enhance the effectiveness of PMAs utilization in the Ghana health service.

The unintended consequences of combining equity measures with performance-based financing in Burkina Faso

BACKGROUND

User fees and poor quality of care contribute to low use of healthcare services in Burkina Faso. The government implemented an innovative intervention that combines equity measures with performance-based financing (PBF). These health equity measures included a community-based selection of indigents to receive user fee exemptions and paying healthcare centres higher purchase prices for services provided to indigents. Research suggests complex interventions can trigger changes not targeted by program planners. To date, however, there is a knowledge gap regarding the unintended consequences that can emerge from combining PBF with health equity measures. Our objective is to document unintended consequences of the equity measures in this complex intervention.

METHODS

We developed a conceptual framework using the diffusion of innovations theory. For the design, we conducted a multiple case study. The cases were four healthcare facilities in one district. We collected data through 93 semi-structured interviews, informal discussions, observation, as well as intervention documents. We conducted thematic analysis using a hybrid deductive-inductive approach. We also used secondary data to describe the monthly evolution of services provided to indigent and non-indigent patients before and after indigent cards were distributed. Time series graphs were used to validate some results.

RESULTS

Local actors, including members of indigent selection committees and healthcare workers, re-invented elements of the PBF equity measures over which they had control to increase their relative advantage or to adapt to implementation challenges and context. Some individuals who did not meet the local conceptualization of indigents were selected to the detriment of others who did. Healthcare providers believed that distributing free medications led to financial difficulties and drug shortages, especially given the low purchase prices and long payment delays. Healthcare workers adopted measures to limit free services delivered to indigents, which led to conflicts between indigents and providers. Ultimately, selected indigents received uncertain and unequal coverage.

CONCLUSIONS

The severity of unintended consequences undermined the effectiveness and equity of the intervention. If the intervention is prolonged and expanded, decision-makers and implementers will have to address these unintended consequences to reduce inequities in accessing care.

Contribution of the results-based financing strategy to improving maternal and child health indicators in Burkina Faso

In response to the poor performance of its public health care provision, Burkina Faso decided, to implement results-based financing (RBF). This strategy relies on a strategic purchase of the quantity and quality of services provided by health workers, monitored by a set of indicators. However, there is a lack of evidence on its effects. The objective of this article is to appreciate the effect of RBF on a set of maternal and child health (MCH) indicators in Burkina Faso. The study design is quasi-experimental comparative with a control group before and after the implementation of the RBF. To estimate the effect of RBF, we used two methods of analysis: (1) the segmented regression to measure the effect of RBF in the health districts (HD) implementing RBF (RBF HD) and (2) the difference-in-difference test to estimate the effect of RBF considering the differences in mean between RBF HD and HD that did not implement RBF (non-RBF HD). We found among five indicators studied that only the postnatal consultation coverage in RBF HD was significantly higher (7.68%; P = 0.04) than in the non-RBF HD. Overall, our findings do not clearly demonstrate the effectiveness of RBF in improving MCH indicators in Burkina Faso.

Twelve months of implementation of health care performance-based financing in Burkina Faso: A qualitative multiple case study

To improve health services' quantity and quality, African countries are increasingly engaging in performance-based financing (PBF) interventions. Studies to understand their implementation in francophone West Africa are rare. This study analysed PBF implementation in Burkina Faso 12 months post-launch in late 2014. The design was a multiple and contrasted case study involving 18 cases (health centres). Empirical data were collected from observations, informal (n = 224) and formal (n = 459) interviews, and documents. Outside the circle of persons trained in PBF, few in the community had knowledge of it. In some health centres, the fact that staff were receiving bonuses was intentionally not announced to populations and community leaders. Most local actors thought PBF was just another project, but the majority appreciated it. There were significant delays in setting up agencies for performance monitoring, auditing, and contracting, as well as in the payment. The first audits led rapidly to coping strategies among health workers and occasionally to some staging beforehand. No community-based audits had yet been done. Distribution of bonuses varied from one centre to another. This study shows the importance of understanding the implementation of public health interventions in Africa and of uncovering coping strategies.