Protocol for the process evaluation of interventions combining performance-based financing with health equity in Burkina Faso

Costing curative outpatient care for the poorest in Burkina Faso: informing universal health coverage and leaving no one behind

INTRODUCTION

The poorest in Burkina Faso face numerous barriers to healthcare access, including financial and geographic obstacles, as well as a high burden of chronic conditions and multimorbidity. This study estimates the average cost of providing curative outpatient consultations at first-level healthcare facilities to the poorest in Burkina Faso. It also estimates the budgetary impact of scaling up free access to these services nationwide. The findings provide essential evidence on cost structures to inform decision-makers in developing policies aimed at achieving universal health coverage and ensuring that no one is left behind.

METHODS

We conducted a micro-costing study to estimate the economic costs of providing curative outpatient healthcare services to the poorest at first-level healthcare facilities, considering a health system perspective. We measured the consumption of capital costs (building and equipment) using survey data from 32 primary health facilities and recurrent costs (drugs and consumables) from medical records of 1380 poor patients in Diébougou district. These individuals were targeted and exempted from user fees through a community-based targeting approach. We obtained unit costs from official price lists, pharmacy registries, and expert interviews. We calculated the national budget for providing curative care services to the exempted poorest based on the average cost per first-level consultation.

RESULTS

The estimated capital and recurrent costs of providing curative care services ranged between USD 0.59 - USD 0.61 and USD 2.58 - USD 5.00, respectively. The total cost ranged between USD 3.17 - USD 5.61 per first-level consultation. Providing curative care to the bottom 20% of the population, assuming 0.25 healthcare contacts per person per year, would result in an annual expense ranging from USD 2.77 M to USD 5.38 M (0.74-1.43% of the healthcare budget in 2019). With 2 healthcare contacts per person per year, costs increase to USD 22.19 M to USD 43.05 M (5.91-11.45% of the healthcare budget).

CONCLUSION

The results can inform policies aimed at expanding access to curative care for the poorest in Burkina Faso, contributing to the goals of universal health coverage and leaving no one behind. Further research is needed to enhance cost estimation and budgeting for higher-level care in the country.

Nutritional status of children under five years and associated factors in 24 districts of Burkina Faso

Malnutrition in children is a serious health problem, especially in Sub-Saharan Africa, with heavy socioeconomic burdens. The prevalence of stunting remains high in Burkina Faso. There is a need to further investigate undernutrition and identify the major factors contributing to its persistence. We aimed to assess the nutritional status of children aged under five years and the associated factors of undernutrition in Burkina Faso. We conducted a second study using a baseline household survey of the impact assessment of a performance-based financing program. The analysis focused on data of 10,032 children aged 0-59 months collected from households in 537 villages. Anthropometric indicators were assessed using the World Health Organization standards, and their association with children, mothers, and households' characteristics were assessed using logistic regression. Stunting occurred in 40.1% of children, wasting in 25.1%, and underweight in 34%. Children having both stunting, wasting, and underweight were 7.3%. Stunting and underweight was associated with the sex. Stunting was associated with ethnic groups: Fulani with AdjOR = 1.20 (95%CI: 1.01-1.42), household economic level: poorest AdjOR = 1.25 (95%CI: 1.10-1.43), two and more children aged under five years in households: AdjOR = 1.16 (95%CI: 1.05-1.27), distance more than 5km from household to health facility: with Adj OR = 1.21 (95%CI: 1.10-1.35) and household food insecurity. This study identified the modifiable factors that determine the high prevalence of undernutrition in Burkina Faso. Strategies and interventions to improve the health and economic status of the community are needed to reduce the occurrence of undernutrition.

Why did performance-based financing in Burkina Faso fail to achieve the intended equity effects? A process tracing study

In recent years, performance-based financing (PBF) has attracted attention as a means of reforming provider payment mechanisms in low- and middle-income countries. Particularly in combination with demand-side interventions, PBF has been assumed to benefit also the most vulnerable and disadvantaged groups. However, impact evaluations have often found this not to be the case. In Burkina Faso, PBF was coupled with specific equity measures to enhance healthcare utilization among the ultra-poor, but failed to produce the expected effects. Our study used the process tracing methodology to unravel the reasons for the lack of impact produced by the equity measures. We relied on published evidence, secondary data analysis, and findings from a qualitative study to support or invalidate the hypothesized causal mechanism, that is the reconstructed theory of change of the equity measures. Our findings show how various contextual, design, and implementation challenges hindered the causal mechanism from unfolding as planned. These included issues with the identification and exemption of the ultra-poor on the demand side, and with financial issues and considerations on the supply side. In broader terms, our findings underline the difficulty in improving access to care for the ultra-poor, given the multifaceted and complex nature of barriers to care the most vulnerable face. From a methodological point of view, our study demonstrates the value and applicability of process tracing in complementing other forms of evaluation for complex interventions in global health.

Examining the implementation of the Linda Mama free maternity program in Kenya

Background

In 2013, Kenya introduced a free maternity policy in all public healthcare facilities. In 2016, the Ministry of Health shifted responsibility for the program, now called Linda Mama, to the National Hospital Insurance Fund (NHIF) and expanded access beyond public sector. This study aimed to examine the implementation of the Linda Mama program.

Methods

We conducted a mixed‐methods cross‐sectional study at the national level and in 20 purposively sampled facilities across five counties in Kenya. We collected data using in‐depth interviews (n = 104), administered patient‐exit questionnaires (n = 108), and carried out document reviews. Qualitative data were analysed using a framework approach while quantitative data were analysed descriptively.

Results

Linda Mama was designed and resulted in improved accountability and expand benefits. In practice however, beneficiaries did not access some services that were part of the revised benefit package. Second, out of pocket payments were still being incurred by beneficiaries. Health facilities in most counties had lost financial autonomy and had no access to reimbursements from NHIF for services provided; but those with financial autonomy were able to boost facility revenue and enhance service delivery. Further, fund disbursements from NHIF were characterised by delays and unpredictability. Implementation experiences reveal that there was inadequate communication, claim processing challenges and reimbursement rates were deemed insufficient.

Conclusions

Our findings show that there are challenges associated with the implementation of the Linda Mama program and highlights the need for process evaluations for programs to track implementation, ensure continuous learning, and provide opportunities for course correcting programs' implementation.

Sustainability determinants of the Burkinabe performance-based financing project

PURPOSE

A performance-based financing (PBF) pilot project was implemented in 2011 in Burkina Faso. After more than five years of implementation (data collection in 2016), the project's sustainability was not guaranteed. This study's objective is to assess this project's sustainability in 2016 by identifying the presence/absence of different determinants of sustainability according to the conceptual framework of Seppey et al. (2017).

DESIGN/METHODOLOGY/APPROACH

It uses a case study approach using in-depth interviews with various actors at the local, district/regional and national levels. Participants (n = 37) included health practitioners, management team members, implementers and senior members of health directions. A thematic analysis based on the conceptual framework was conducted, as well as an inductive analysis.

FINDINGS

Results show the project's sustainability level was weak according to an unequal presence of sustainability's determinants; some activities are being maintained but not fully routinised. Discrepancies between the project and the context's values appeared to be important barriers towards sustainability. Project's ownership by key stakeholders also seemed superficial despite the implementers' leadership towards its success. The project's objective towards greater autonomy for health centres was also directly confronting the Burkinabe's hierarchical health system.

ORIGINALITY/VALUE

This study reveals many fits and misfits between a PBF project and its context affecting its ability to sustain activities through time. It also underlines the importance of using a conceptual framework in implementing and evaluating interventions. These results could be interesting for decision-makers and implementers in further assessing PBF projects elsewhere.

What theories underpin performance-based financing? A scoping review

PURPOSE

The study aims to explore the theoretical bases justifying the use of performance-based financing (PBF) in the health sector in low- and middle-income countries (LMICs).

DESIGN/METHODOLOGY/APPROACH

The authors conducted a scoping review of the literature on PBF so as to identify the theories utilized to underpin it and analyzed its theoretical justifications.

FINDINGS

Sixty-four studies met the inclusion criteria. Economic theories were predominant, with the principal-agent theory being the most commonly-used theory, explicitly referred to by two-thirds of included studies. Psychological theories were also common, with a wide array of motivation theories. Other disciplines in the form of management or organizational science, political and social science and systems approaches also contributed. However, some of the theories referred to contradicted each other. Many of the studies included only casually alluded to one or more theories, and very few used these theories to justify or support PBF. No theory emerged as a dominant, consistent and credible justification of PBF, perhaps except for the principal-agent theory, which was often inappropriately applied in the included studies, and when it included additional assumptions reflecting the contexts of the health sector in LMICs, might actually warn against adopting PBF.

PRACTICAL IMPLICATIONS

Overall, this review has not been able to identify a comprehensive, credible, consistent, theoretical justification for using PBF rather than alternative approaches to health system reforms and healthcare providers' motivation in LMICs.

ORIGINALITY/VALUE

The theoretical justifications of PBF in the health sector in LMICs are under-documented. This review is the first of this kind and should encourage further debate and theoretical exploration of the justifications of PBF.

Factors related to excessive out-of-pocket expenditures among the ultra-poor after discontinuity of PBF: a cross-sectional study in Burkina Faso

BACKGROUND

Measuring progress towards financial risk protection for the poorest is essential within the framework of Universal Health Coverage. The study assessed the level of out-of-pocket expenditure and factors associated with excessive out-of-pocket expenditure among the ultra-poor who had been targeted and exempted within the context of the performance-based financing intervention in Burkina Faso. Ultra-poor were selected based on a community-based approach and provided with an exemption card allowing them to access healthcare services free of charge.

METHODS

We performed a descriptive analysis of the level of out-of-pocket expenditure on formal healthcare services using data from a cross-sectional study conducted in Diébougou district. Multivariate logistic regression was performed to investigate the factors related to excessive out-of-pocket expenditure among the ultra-poor. The analysis was restricted to individuals who reported formal health service utilisation for an illness-episode within the last six months. Excessive spending was defined as having expenditure greater than or equal to two times the median out-of-pocket expenditure.

RESULTS

Exemption card ownership was reported by 83.64% of the respondents. With an average of FCFA 23051.62 (USD 39.18), the ultra-poor had to supplement a significant amount of out-of-pocket expenditure to receive formal healthcare services at public health facilities which were supposed to be free. The probability of incurring excessive out-of-pocket expenditure was negatively associated with being female (β = - 2.072, p = 0.00, ME = - 0.324; p = 0.000) and having an exemption card (β = - 1.787, p = 0.025; ME = - 0.279, p = 0.014).

CONCLUSIONS

User fee exemptions are associated with reduced out-of-pocket expenditure for the ultra-poor. Our results demonstrate the importance of free care and better implementation of existing exemption policies. The ultra-poor's elevated risk due to multi-morbidities and severity of illness need to be considered when allocating resources to better address existing inequalities and improve financial risk protection.

Do Targeted User Fee Exemptions Reach the Ultra-Poor and Increase their Healthcare Utilisation? A Panel Study from Burkina Faso

Background: A component of the performance-based financing intervention implemented in Burkina Faso was to provide free access to healthcare via the distribution of user fee exemption cards to previously identified ultra-poor. This study examines the factors that led to the receipt of user fee exemption cards, and the effect of card possession on the utilisation of healthcare services. Methods: A panel data set of 1652 randomly selected ultra-poor individuals was used. Logistic regression was applied on the end line data to identify factors associated with the receipt of user fee exemption cards. Random-effects modelling was applied to the panel data to determine the effect of the card possession on healthcare service utilisation among those who reported an illness six months before the surveys. Results: Out of the ultra-poor surveyed in 2017, 75.51% received exemption cards. Basic literacy (p = 0.03), living within 5 km from a healthcare centre (p = 0.02) and being resident in Diébougou or Gourcy (p = 0.00) were positively associated with card possession. Card possession did not increase health service utilisation (β = −0.07; 95% CI = −0.45; 0.32; p = 0.73). Conclusion: A better intervention design and implementation is required. Complementing demand-side strategies could guide the ultra-poor in overcoming all barriers to healthcare access.

How does performance-based financing affect the availability of essential medicines in Cameroon? A qualitative study

Performance-based financing (PBF) is being implemented across low- and middle-income countries to improve the availability and quality of health services, including medicines. Although a few studies have examined the effects of PBF on the availability of essential medicines (EMs) in low- and middle-income countries, there is limited knowledge of the mechanisms underlying these effects. Our research aimed to explore how PBF in Cameroon influenced the availability of EMs, and to understand the pathways leading to the experiential dimension related with the observed changes. The design was an exploratory qualitative study. Data were collected through in-depth interviews, using semi-structured questionnaires. Key informants were selected using purposive sampling. The respondents (n = 55) included health services managers, healthcare providers, health authorities, regional drugs store managers and community members. All interviews were recorded, transcribed and analysed using qualitative data analysis software. Thematic analysis was performed. Our findings suggest that the PBF programme improved the perceived availability of EMs in three regions in Cameroon. The change in availability of EMs experienced by stakeholders resulted from several pathways, including the greater autonomy of facilities, the enforced regulation from the district medical team, the greater accountability of the pharmacy attendant and supply system liberalization. However, a sequence of challenges, including delays in PBF payments, limited autonomy, lack of leadership and contextual factors such as remoteness or difficulty in access, was perceived to hinder the capacity to yield optimal changes, resulting in heterogeneity in performance between health facilities. The participants raised concerns regarding the quality control of drugs, the inequalities between facilities and the fragmentation of the drug management system. The study highlights that some specific dimensions of PBF, such as pharmacy autonomy and the liberalization of drugs supply systems, need to be supported by equity interventions, reinforced regulation and measures to ensure the quality of drugs at all levels.

The Importance of Leadership and Organizational Capacity in Shaping Health Workers' Motivational Reactions to Performance-Based Financing: A Multiple Case Study in Burkina Faso

BACKGROUND

Performance-based financing (PBF) is currently tested in many low- and middle-income countries as a health system strengthening strategy. One of the main mechanisms through which PBF is assumed to effect change is by motivating health workers to improve their service delivery performance. This article aims at a better understanding of such motivational effects of PBF. In particular, the study focused on organizational context factors and health workers' perceptions thereof as moderators of the motivational effects of PBF, which to date has been little explored.

METHODS

We conducted a multiple case study in 2 district hospitals and 16 primary health facilities across three districts. Health facilities were purposely sampled according to pre-PBF performance levels. Within sampled facilities, 82 clinical skilled healthcare workers were in-depth interviewed one year after the start of the PBF intervention. Data were analyzed using a blended deductive and inductive process, using self-determination theory (SDT) as an analytical framework.

RESULTS

Results show that the extent to which PBF contributed to positive, sustainable forms of motivation depended on the "ground upon which PBF fell," beyond health workers' individual personalities and disposition. In particular, health workers described three aspects of the organizational context in which PBF was implemented: the extent to which existing hierarchies fostered as opposed to hindered participation and transparency; managers' handling of the increased performance feedback inherent in PBF; and facility's pre-PBF levels in regards to infrastructure, equipment, and human resources.

CONCLUSION

Our results underline the importance of leadership styles and pre-implementation performance levels in shaping health workers' motivational reactions to PBF. Ancillary interventions aimed at fostering participatory as opposed to directional leadership or start-up support to low-performing health facilities will likely boost PBF effects in regards to the development of valuable motivational capacities.

The unintended consequences of combining equity measures with performance-based financing in Burkina Faso

BACKGROUND

User fees and poor quality of care contribute to low use of healthcare services in Burkina Faso. The government implemented an innovative intervention that combines equity measures with performance-based financing (PBF). These health equity measures included a community-based selection of indigents to receive user fee exemptions and paying healthcare centres higher purchase prices for services provided to indigents. Research suggests complex interventions can trigger changes not targeted by program planners. To date, however, there is a knowledge gap regarding the unintended consequences that can emerge from combining PBF with health equity measures. Our objective is to document unintended consequences of the equity measures in this complex intervention.

METHODS

We developed a conceptual framework using the diffusion of innovations theory. For the design, we conducted a multiple case study. The cases were four healthcare facilities in one district. We collected data through 93 semi-structured interviews, informal discussions, observation, as well as intervention documents. We conducted thematic analysis using a hybrid deductive-inductive approach. We also used secondary data to describe the monthly evolution of services provided to indigent and non-indigent patients before and after indigent cards were distributed. Time series graphs were used to validate some results.

RESULTS

Local actors, including members of indigent selection committees and healthcare workers, re-invented elements of the PBF equity measures over which they had control to increase their relative advantage or to adapt to implementation challenges and context. Some individuals who did not meet the local conceptualization of indigents were selected to the detriment of others who did. Healthcare providers believed that distributing free medications led to financial difficulties and drug shortages, especially given the low purchase prices and long payment delays. Healthcare workers adopted measures to limit free services delivered to indigents, which led to conflicts between indigents and providers. Ultimately, selected indigents received uncertain and unequal coverage.

CONCLUSIONS

The severity of unintended consequences undermined the effectiveness and equity of the intervention. If the intervention is prolonged and expanded, decision-makers and implementers will have to address these unintended consequences to reduce inequities in accessing care.

The "hot potato" topic: challenges and facilitators to promoting respectful maternal care within a broader health intervention in Tanzania

In recent years, mistreatment during childbirth has captured the public health and maternal health consciousness as not only an affront to women's rights but also a formidable deterrent to the uptake of facility-based childbirth - and thus to reductions in maternal mortality. The challenge ahead is to determine what can be done to address this public health problem. A modest but growing body of research has demonstrated that interventions to foster Respectful Maternity Care (RMC) can enact change, albeit in the relatively controlled context of a trial or study. Herein we describe our experiences in weaving elements of RMC across tiers of an existing maternal and newborn health program. As a commentary, this document does not outline program results, but instead highlights challenges and facilitators to promoting RMC within a large-scale, multi-district health platform. We conclude with lessons learned during the process and urge that others share their program learning experiences in an effort to strengthen the knowledge base on what works and what does not work in terms of addressing this complex, context-sensitive issue.

How much does community-based targeting of the ultra-poor in the health sector cost? Novel evidence from Burkina Faso

BACKGROUND

Targeting efforts aimed at increasing access to care for the poorest by reducing to a minimum or completely eliminating payments at point of use are increasingly being adopted across low and middle income countries, within the framework of Universal Health Coverage policies. No evidence, however, is available on the real cost of designing and implementing these efforts. Our study aimed to fill this gap in knowledge through the systematic assessment of both the financial and economic costs associated with designing and implementing a pro-poor community-based targeting intervention across eight districts in rural Burkina Faso.

METHODS

We conducted a partial retrospective economic evaluation (i.e. estimating costs, but not benefits) associated with the abovementioned targeting intervention. We adopted a health system perspective, including all costs incurred by the government and its development partners as well as costs incurred by the community when working as volunteers on behalf of government structures. To trace both financial and economic costs, we combined Activity-Based Costing with Resource Consumption Accounting. To this purpose, we consulted and extracted information from all relevant design/implementation documents and conducted additional key informant structured interviews to assess the resource consumption that was not valued in the documents.

RESULTS

For the entire community-based targeting intervention, we estimated a financial cost of USD 587,510 and an economic cost of USD 1,213,447. The difference was driven primarily by the value of the time contributed by the community. Communities carried the main economic burden. With a total of 102,609 ultra-poor identified, the financial cost and the economic cost per ultra-poor person were respectively USD 5,73 and USD 11,83.

CONCLUSION

The study is first of its kind to accurately trace the financial and economic costs of a community-based targeting intervention aiming to identify the ultra-poor. The financial costs amounted to USD 5,73 and the economic costs to USD 11,83 per ultra-poor person identified. The financial costs of almost USD 6 represents 21% of the per capita government expenditure on health.

Examining the Implementation of the Free Maternity Services Policy in Kenya: A Mixed Methods Process Evaluation

Background: Kenya introduced a free maternity policy in 2013 to address the cost barrier associated with accessing maternal health services. We carried out a mixed methods process evaluation of the policy to examine the extent to which the policy had been implemented according to design, and positive experiences and challenges encountered during implementation.

Methods: We conducted a mixed methods study in 3 purposely selected counties in Kenya. Data were collected through in-depth interviews (IDIs) with policy-makers at the national level, health managers at the county level, and frontline staff at the health facility level (n=60), focus group discussions (FGDs) with community representatives (n=10), facility records, and document reviews. We analysed the data using a framework approach.

Results: Rapid implementation led to inadequate stakeholder engagement and confusion about the policy. While the policy was meant to cover antenatal visits, deliveries, and post-natal visits, in practice the policy only covered deliveries. While the policy led to a rapid increase in facility deliveries, this was not matched by an increase in health facility capacity and hence compromised quality of care. The policy led to an improvement in the level of revenues for facilities. However, in all three counties, reimbursements were not made on time. The policy did not have a system of verifying health facility reports on utilization of services.

Conclusion: The Kenyan Ministry of Health (MoH) should develop a formal policy on the free maternity services, and provide clear guidelines on its content and implementation arrangements, engage with and effectively communicate the policy to stakeholders, ensure timeliness of payment disbursement to healthcare facilities, and introduce a mechanism for verifying utilization reports prepared by healthcare providers. User fee removal policies such as free maternity programmes should be accompanied by supply side capacity strengthening.

Performance-based Financing in Africa: Time to Test Measures for Equity

Over the past 15 years, hundreds of millions of dollars have been invested in reforms founded on performance-based financing (PBF) in low- and middle-income countries. While evidence on its effectiveness and efficiency is still controversial, there appears to be an emerging consensus that equity has not been adequately considered. In this article, we show how PBF-type interventions in Africa have not sufficiently taken into account equity of access to care for the worst-off and their financial protection. In reviewing the history of health reforms in Africa, we show that this omission is nothing new. We suggest that strategic purchasing and PBF-type actions would benefit from being implemented in ways that promote equity and the financial protection of populations in Africa. Without such a reorientation of reforms, it will be impossible to achieve universal health coverage by 2030.

A study on the implementation fidelity of the performance-based financing policy in Burkina Faso after 12 months

BACKGROUND

Performance-based financing (PBF) in the health sector has recently gained momentum in low- and middle-income countries (LMICs) as one of the ways forward for achieving Universal Health Coverage. The major principle underlying PBF is that health centers are remunerated based on the quantity and quality of services they provide. PBF has been operating in Burkina Faso since 2011, and as a pilot project since 2014 in 15 health districts randomly assigned into four different models, before an eventual scale-up. Despite the need for expeditious documentation of the impact of PBF, caution is advised to avoid adopting hasty conclusions. Above all, it is crucial to understand why and how an impact is produced or not. Our implementation fidelity study approached this inquiry by comparing, after 12 months of operation, the activities implemented against what was planned initially and will make it possible later to establish links with the policy's impacts.

METHODS

Our study compared, in 21 health centers from three health districts, the implementation of activities that were core to the process in terms of content, coverage, and temporality. Data were collected through document analysis, as well as from individual interviews and focus groups with key informants.

RESULTS

In the first year of implementation, solid foundations were put in place for the intervention. Even so, implementation deficiencies and delays were observed with respect to certain performance auditing procedures, as well as in payments of PBF subsidies, which compromised the incentive-based rationale to some extent.

CONCLUSION

Over next months, efforts should be made to adjust the intervention more closely to context and to the original planning.

Street-level workers' inadequate knowledge and application of exemption policies in Burkina Faso jeopardize the achievement of universal health coverage: evidence from a cross-sectional survey

BACKGROUND

Street-level workers play a key role in public health policies in Africa, as they are often the ones to ensure their implementation. In Burkina Faso, the State formulated two different user-fee exemption policies for indigents, one for deliveries (2007), and one for primary healthcare (2009). The objective of this study was to measure and understand the determinants of street-level workers' knowledge and application of these exemption measures.

METHODS

We used cross-sectional data collected between October 2013 and March 2014. The survey targeted 1521 health workers distributed in 498 first-line centres, 18 district hospitals, 5 regional hospitals, and 11 private or other facilities across 24 districts. We used four different random effects models to identify factors associated with knowledge and application of each of the above-mentioned exemption policies.

RESULTS

Only 9.2% of workers surveyed knew of the directive exempting the worst-off, and only 5% implemented it. Knowledge and application of the delivery exemption were higher, with 27% of all health workers being aware of the delivery exemption directive and 24.2% applying it. Mobile health workers were found to be consistently more likely to apply both exemptions. Health workers who were facility heads were significantly more likely to know about the indigent exemption for primary health care and to apply it. Health workers in districts with higher proportions of very poor people were significantly more likely to know about and apply the delivery exemption. Nearly 60% of respondents indicated either 5% or 10% as the percentage of people they would deem adequate to target for exemption.

CONCLUSION

This quantitative study confirmed earlier qualitative results on the importance of training and informing health workers and monitoring the measures targeting equity, to ensure compliance with government directives. The local context (e.g., hierarchy, health system, interventions) and the ideas that street-level workers have about the policy instruments can influence their effective implementation. Methods for remunerating health workers and health centres also need to be adapted to ensure equity measures are applied to achieve universal healthcare.

Twelve months of implementation of health care performance-based financing in Burkina Faso: A qualitative multiple case study

To improve health services' quantity and quality, African countries are increasingly engaging in performance-based financing (PBF) interventions. Studies to understand their implementation in francophone West Africa are rare. This study analysed PBF implementation in Burkina Faso 12 months post-launch in late 2014. The design was a multiple and contrasted case study involving 18 cases (health centres). Empirical data were collected from observations, informal (n = 224) and formal (n = 459) interviews, and documents. Outside the circle of persons trained in PBF, few in the community had knowledge of it. In some health centres, the fact that staff were receiving bonuses was intentionally not announced to populations and community leaders. Most local actors thought PBF was just another project, but the majority appreciated it. There were significant delays in setting up agencies for performance monitoring, auditing, and contracting, as well as in the payment. The first audits led rapidly to coping strategies among health workers and occasionally to some staging beforehand. No community-based audits had yet been done. Distribution of bonuses varied from one centre to another. This study shows the importance of understanding the implementation of public health interventions in Africa and of uncovering coping strategies.

Maternal and neonatal health impact of obstetrical risk insurance scheme in Mauritania: a quasi experimental before-and-after study

A variety of health financing schemes shaped on pre-payment scheme have been implemented across Sub-Saharan Africa (SSA) to address the Millennium Development Goals (MDGs). In Mauritania, the Obstetric Risk Insurance package (ORI) focusing on maternal and perinatal health has been progressively implemented at the health district level since 2002. Here, our main objective was to assess the effectiveness of the ORI in increasing facility-based delivery rates, as well as increases in family planning, antenatal and postnatal care, caesarean delivery and neonatal health, from demographic and health survey data between 2002 and 2011. We also examined whether the effects of the ORI varied between strata of the population. The study was based on a quasi-experimental before-and-after design to assess the causal link between availability of ORI and increase in use of maternal health services and neonatal mortality. In combination with geographical information system, difference-in-differences and odd ratio approaches were used to address our objectives. Indicators of access to care for pregnant women and neonatal health and improved in both non-intervention and intervention groups during the study period. There was no global effect of the availability of ORI on facility-based delivery rates, nor on the use of antenatal and postnatal care services, except for qualified antenatal services. However, delivery rates in local health centres with ORI increased more rapidly than in those with no ORI, the contrary was shown for hospitals. Caesarean delivery and family planning decreased with ORI. Although late neonatal mortality rates remained low in the country, a significant decrease was seen in districts without ORI. Except for some strata of the population, ORI has not really met its objective of attracting more pregnant women towards facility-based health care.

Characterisation of the rural indigent population in Burkina Faso: a screening tool for setting priority healthcare services in sub-Saharan Africa

BACKGROUND

In Africa, health research on indigent people has focused on how to target them for services, but little research has been conducted to identify the social groups that compose indigence. Our aim was to identify what makes someone indigent beyond being recognised by the community as needing a card for free healthcare.

METHODS

We used data from a survey conducted to evaluate a state-led intervention for performance-based financing of health services in two districts of Burkina Faso. In 2015, we analysed data of 1783 non-indigents and 829 people defined as indigents by their community in 21 villages following community-based targeting processes. Using a classification tree, we built a model to select socioeconomic and health characteristics that were likely to distinguish between non-indigents and indigents. We described the screening performance of the tree using data from specific nodes.

RESULTS

Widow(er)s under 45 years of age, unmarried people aged 45 years and over, and married women aged 60 years and over were more likely to be identified as indigents by their community. Simple rules based on age, marital status and gender detected indigents with sensitivity of 75.6% and specificity of 55% among those 45 years and over; among those under 45, sensitivity was 85.5% and specificity 92.2%. For both tests combined, sensitivity was 78% and specificity 81%.

CONCLUSION

In moving towards universal health coverage, Burkina Faso should extend free access to priority healthcare services to widow(er)s under 45, unmarried people aged 45 years and over, and married women aged 60 years and over, and services should be adapted to their health needs.

ETHICS CONSIDERATIONS

The collection, storage and release of data for research purposes were authorised by a government ethics committee in Burkina Faso (Decision No. 2013-7-066). Respondent consent was obtained verbally.

The unintended consequences of community verifications for performance-based financing in Burkina Faso

Performance-based financing (PBF) is being widely implemented to improve healthcare services in Africa. An essential component of PBF involves conducting community verifications, wherein investigators from local associations attempt to trace samples of patients. Community surveys are administered to patients to verify whether healthcare workers reported fictitious services to increase their revenue. At the same time, client satisfaction surveys are administered to assess whether patients are satisfied with the services received. Although some global health actors are concerned that PBF can trigger unintended consequences, this topic remains neglected. The objective of this study was to document the unintended consequences of community verification. Guided by the diffusion of innovations theory, we conducted a multiple case study. The cases were the catchment areas of seven healthcare facilities in Burkina Faso. Data were collected between January 2016 and May 2016 using non-participant observation, 92 semi-structured interviews, and informal discussions. Participants included a wide range of stakeholders, such as community verifiers, investigators, patients, and healthcare providers. Data were coded using QDA Miner, and thematic analysis was conducted. Healthcare workers did not significantly disturb or try to influence community verifiers during patient selection for community verifications. Unintended consequences included stakeholders' dissatisfaction regarding compensation modalities, work overload for community verifiers, and falsification of verification data by investigators. Community verifications led to loss of patient confidentiality as well as fears and apprehensions, although some patients were pleased to share their views regarding healthcare services. Community verifications also triggered marital issues, resulting in conflicts with, or interference from, husbands. The numerous challenges associated with locating patients in their communities led stakeholders to question the validity and utility of the results. These unintended consequences could jeopardize the overall effectiveness of community verifications. Attention should be paid to these unintended consequences to inform effective implementation and refine future interventions.

An exploratory study assessing psychological distress of indigents in Burkina Faso: a step forward in understanding mental health needs in West Africa

Background

Poverty is known as an important determinant of health, but empirical data are still missing on the relationships between poverty, other adverse living conditions, and psychological distress, particularly in low-income countries.

This study aimed to assess mental health needs and psychological distress among the poorest in rural settings in Burkina Faso where food security and access to water, electricity, schooling, and healthcare are limited.

Methods

We randomly selected 2000 individuals previously identified as indigents by a community-targeting process. Interviewers visited participants (n = 1652) in their homes and completed a questionnaire on mental health variables that included presence and intensity of anxious, depressive, psychotic, and aggressive symptoms, as well as level of psychological distress. Descriptive statistics, Spearman correlations, and logistic regressions were performed.

Results

In all, 40.2% of the sample reported 10 or more anxious/depressive symptoms in the past 30 days, and 25.5% reported having experienced at least one psychotic symptom over their lifetime, 65.6% of whom had had those symptoms for many years. The number of anxious and depressive symptoms was significantly associated with the level of psychological distress (r = 0.423, p < .001). Predictors of distress level included: poor health condition (F(1) = 23.743, p <. 001), being a woman (F(1) = 43.926, p < .001), not having any income (F(1) = 16.185, p < .001), having begged for food in the past 30 days (F(1) = 12.387, p < .001), being illiterate, and being older (F(1) = 21.487, p < .001). Approximately one third of respondents reporting anxious/depressive or psychotic symptoms (28.2 and 30.0%, respectively) had not talked about their symptoms to anyone in their social network.

Conclusions

These results suggest alarmingly high levels of psychological distress and reported symptoms among the poorest in rural settings in Burkina Faso, which can be explained by their difficult living conditions. However, these results must be interpreted from a transcultural perspective to avoid decontextualized misinterpretations. Ethnographic works are needed to document the larger context within which these distress results can be analyzed.

Does performance-based financing increase value for money in low- and middle- income countries? A systematic review

Governments of low- and middle-income countries (LMICs) are widely implementing performance-based financing (PBF) to improve healthcare services. However, it is unclear whether PBF provides good value for money compared to status quo or other interventions aimed at strengthening the healthcare system in LMICs. The objective of this systematic review is to identify and synthesize the existing literature that examines whether PBF represents an efficient manner of investing resources. We considered PBF to be efficient when improved care quality or quantity was achieved with equal or lower costs, or alternatively, when the same quality of care was achieved using less financial resources. A manual search of the reference lists of two recent systematic reviews on economic evaluations of PBF was conducted to identify articles that met our inclusion and exclusion criteria. Subsequently, a search strategy was developed with the help of a librarian. The following databases and search engines were used: PubMed, EconLit, Google Scholar and Google. Experts on economic evaluations were consulted for validation of the selected studies. A total of seven articles from five LMICs were selected for this review. We found the overall strength of the evidence to be weak. None of the articles were full economic evaluations; they did not make clear connections between the costs and effects of PBF. Only one study reported using a randomized controlled trial, but issues with the randomization procedure were reported. Important alternative interventions to strengthen the capacities of the healthcare system have not been considered. Few studies examined the costs and consequences of PBF in the long term. Important costs and consequences were omitted from the evaluations. Few LMICs are represented in the literature, despite wide implementation. Lastly, most articles had at least one author employed by an organization involved in the implementation of PBF, thereby resulting in potential conflicts of interest. Stronger empirical evidence on whether PBF represents good value for money in LMICs is needed.

Evaluating complex health financing interventions: using mixed methods to inform further implementation of a novel PBI intervention in rural Malawi

Background

Gaps remain in understanding how performance-based incentive (PBI) programs affect quality of care and service quantity, whether programs are cost effective and how programs could be tailored to meet client and provider needs while remaining operationally viable. In 2014, Malawi’s Ministry of Health launched the Service Delivery Integration-PBI (SSDI-PBI) program. The program is unique in that no portion of performance bonuses are paid to individual health workers, and it shifts responsibility for infrastructure and equipment procurement from facility staff to implementing partners. This protocol outlines an approach that analyzes processes and outcomes, considers expected and unexpected consequences of the program and frames the program’s outputs relative to its costs. Findings from this evaluation will inform the intended future scale-up of PBI in Malawi.

Methods/design

This study employs a prospective controlled before-and-after triangulation design to assess effects of the PBI program by analyzing quantitative and qualitative data from intervention and control facilities. Guided by a theoretical framework, the evaluation consists of four main components: service provision, health worker motivation, implementation processes and costing. Quality and access outcomes are assessed along four dimensions: (1) structural elements (related to equipment, drugs, staff); (2) process elements (providers’ compliance with standards); (3) outputs (service utilization); (4) experiential elements (experiences of service delivery). The costing component includes costs related to start-up, ongoing management, and the cost of incentives themselves. The cost analysis considers costs incurred within the Ministry of Health, funders, and the implementing agency. The evaluation relies on primary data (including interviews and surveys) and secondary data (including costing and health management information system data).

Discussion

Through the lens of a PBI program, we illustrate how complex interventions can be evaluated via not only primary, mixed-methods data collection, but also through a wealth of secondary data from program implementers (including monitoring, evaluation and financial data), and the health system (including service utilization and service readiness data). We also highlight the importance of crafting a theory and using theory to inform the nature of data collected. Finally, we highlight the need to be responsive to stakeholders in order to enhance a study’s relevance.

Terrorist attack of 15 January 2016 in Ouagadougou: how resilient was Burkina Faso's health system?

In Africa, health systems are often not very responsive. Their resilience is often tested by health or geopolitical crises. The Ebola epidemic, for instance, exposed the fragility of health systems, and recent terrorist attacks have required countries to respond to urgent situations. Up until 2014, Burkina Faso's health system strongly resisted these pressures and reforms had always been minor. However, since late 2014, Burkina Faso has had to contend with several unprecedented crises. In October 2014, there was a popular insurrection. Then, in September 2015, the Security Regiment of the deposed president attempted a coup d'état. Finally, on 15 January 2016, a terrorist attack occurred in the capital, Ouagadougou. These events involved significant human injury and casualties. In these crises, the Burkinabè health system was sorely tried, testing its responsiveness, resiliency and adaptability. We describe the management of the recent terrorist attack from the standpoint of health system resilience. It would appear that the multiple crises that had occurred within the previous 2 years led to appropriate management of that terrorist attack thanks to the rapid mobilisation of personnel and good communication between centres. For example, the health system had put in place a committee and an emergency response plan, adapted blood bank services and psychology services, and made healthcare free for victims. Nevertheless, the system encountered several challenges, including the development of framework documents for resources (financial, material and human) and their use and coordination in crisis situations.

Measuring and understanding the effects of a performance based financing scheme applied to nutrition services in Burundi-a mixed method impact evaluation design

BACKGROUND

Malnutrition is a huge problem in Burundi. In order to improve the provision of services at hospital, health centre and community levels, the Ministry of Health is piloting the introduction of malnutrition prevention and care indicators within its performance based financing (PBF) scheme. Paying for units of services and for qualitative indicators is expected to enhance provision and quality of these nutrition services, as PBF has done, in Burundi and elsewhere, for several other services.

METHODS

This paper presents the protocol for the impact evaluation of the PBF scheme applied to malnutrition. The research design consists in a mixed methods model adopting a sequential explanatory design. The quantitative component is a cluster-randomized controlled evaluation design: among the 90 health centres selected for the study, half receive payment related to their results in malnutrition activities, while the other half get a budget allocation. Qualitative research will be carried out both during the intervention period and at the end of the quantitative evaluation. Data are collected from 1) baseline and follow-up surveys of 90 health centres and 6,480 households with children aged 6 to 23 months, 2) logbooks filled in weekly in health centres, and 3) in-depth interviews and focus group discussions. The evaluation aims to provide the best estimate of the impact of the project on malnutrition outcomes in the community as well as outputs at the health centre level (malnutrition care outputs) and to describe quantitatively and qualitatively the changes that took place (or did not take place) within health centres as a result of the program.

DISCUSSION

Although PBF schemes are blooming in low in-come countries, there is still a need for evidence, especially on the impact of revising the list of remunerated indicators. It is expected that this impact evaluation will be helpful for the national policy dialogue in Burundi, but it will also provide key evidence for countries with an existing PBF scheme and confronted with malnutrition problems on the appropriateness to extend the strategy to nutrition services.

TRIAL REGISTRATION

ClinicalTrials.gov PRS Identifier: NCT02721160; registered March 2016.

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

Background

Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses.

Objective

In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania.

Design

The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability.

Discussion

This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes.

Evaluation Indexes of Military Hospitals From the Experts' Perspective: A Qualitative Study

Given the importance of evaluation in an organization and considering the objectives and missions of military hospitals, we aimed to extract some indexes (in addition to common evaluation indexes) for use in evaluating military hospitals. This was an applied-type qualitative study. The participants were 15 health experts who were first chosen by a purposeful sampling, which was then continued by theoretical sampling. The data obtained were analyzed by using MAXQDA11 software and the content analysis method. After 290 obtained codes were analyzed, 17 indexes in 6 domains were extracted, including capacity development for crisis periods, equipment and facilities, training and research, passive defense, treatment, and services, from which 8 indexes were related to capacity development for crisis periods and equipment and facilities (4 indexes each), 3 indexes were related to services, and 6 indexes were related to training and research, passive defense, and treatment (2 indexes each). The results of the present research, as a supplement to current evaluation methods such as accreditation, can be used for the comprehensive evaluation of military hospitals.