Exploring the accuracy of self-reported maternal and newborn care in select studies from low and middle-income country settings: do respondent and facility characteristics affect measurement?

BACKGROUND

Accurate data on the receipt of essential maternal and newborn health interventions is necessary to interpret and address gaps in effective coverage. Validation results of commonly used content and quality of care indicators routinely implemented in international survey programs vary across settings. We assessed how respondent and facility characteristics influenced the accuracy of women's recall of interventions received in the antenatal and postnatal periods.

METHODS

We synthesized reporting accuracy using data from a known sample of validation studies conducted in Sub-Saharan Africa and Southeast Asia, which assessed the validity of women's self-report of received antenatal care (ANC) (N = 3 studies, 3,169 participants) and postnatal care (PNC) (N = 5 studies, 2,462 participants) compared to direct observation. For each study, indicator sensitivity and specificity are presented with 95% confidence intervals. Univariate fixed effects and bivariate random effects models were used to examine whether respondent characteristics (e.g., age group, parity, education level), facility quality, or intervention coverage level influenced the accuracy of women's recall of whether interventions were received.

RESULTS

Intervention coverage was associated with reporting accuracy across studies for the majority (9 of 12) of PNC indicators. Increasing intervention coverage was associated with poorer specificity for 8 indicators and improved sensitivity for 6 indicators. Reporting accuracy for ANC or PNC indicators did not consistently differ by any other respondent or facility characteristic.

CONCLUSIONS

High intervention coverage may contribute to higher false positive reporting (poorer specificity) among women who receive facility-based maternal and newborn care while low intervention coverage may contribute to false negative reporting (lower sensitivity). While replication in other country and facility settings is warranted, results suggest that monitoring efforts should consider the context of care when interpreting national estimates of intervention coverage.

Developing and Testing a Chatbot to Integrate HIV Education Into Family Planning Clinic Waiting Areas in Lusaka, Zambia

BACKGROUND

To maximize protection against both unintended pregnancy and HIV, it is important that family planning (FP) services integrate HIV counseling, both to support method choice and identify potential HIV services of interest, such as pre-exposure prophylaxis (PrEP). However, FP providers often lack sufficient time and knowledge to address HIV vulnerability with clients. To potentially offload some of the initial HIV counseling burden from FP providers, we developed and tested a chatbot that provided information about HIV and dual protection to FP clients in waiting areas of FP clinics in Lusaka, Zambia.

CHATBOT DEVELOPMENT

We drafted a scripted conversation and tested it in English in formative workshops with Zambian women between the ages of 15 and 49 years. After translating the content to Bemba and Nyanja, we conducted a second round of workshops to validate the translations, before uploading the content into the chatbot platform.

CHATBOT USER TEST

Thirty volunteers tested the chatbot in 3 Lusaka FP clinics, completing an exit survey to provide feedback. A large majority (83%) said they learned new HIV information from the chatbot. Twenty (67%) learned about PrEP for the first time through the chat. Most (96%) reported discussing HIV with the provider, after engaging with the chatbot. In response to an open-ended question, several testers volunteered that they wanted to learn more about PrEP.

CONCLUSIONS

Pre-consultation waiting-area time is an underutilized opportunity to impart HIV information to FP clients, thereby preparing them to discuss their dual HIV and pregnancy prevention needs when they see their providers. FP clients expressed particular interest in learning more about PrEP, underscoring the importance of integrating HIV into FP services.

The inclusion of sexual and reproductive health services within universal health care through intentional design

In this paper, we argue that how sexual and reproductive health (SRH) services are included in UHC and health financing matters, and that this has implications for universality and equity. This is a matter of rights, given the differential health risks that women face, including unwanted pregnancy. How traditional vertical SRH services are compensated under UHC also matters and should balance incentives for efficiency with incentives for appropriate provision using the rights-based approach to user-centred care so that risks of sub-optimal outcomes are mitigated. This suggests that as UHC benefits packages are designed, there is need for the SRH community to advocate for more than simple “SRH inclusion”. This paper describes a practical approach to integrate quality of SRH care within the UHC agenda using a framework called the “5Ps”. The framework emphasises a “systems” and “design” lens as important steps to quality. The framework can be applied at different scales, from the health system to the individual user level. It also pays attention to how financing and resource policies intended to promote UHC may support or undermine the respect, protection and fulfilment of SRH and rights. The framework was originally developed with a specific emphasis on quality provision of family planning. In this paper, we have extended it to cover other SRH services.

Strength in Diversity: Integrating Community in Primary Health Care to Advance Universal Health Coverage

The supplement highlights a systems approach that recognizes the communities' roles and their interactions with other health system actors to accelerate outcomes and reflect the diversity of the community health ecosystem. Several cross-cutting priorities emerge from the articles, namely coverage, community health financing, policy change, institutionalization, resilience, accountability, community engagement, and whole-of-society efforts.

Development and validation of a multi-dimensional scale to assess community health worker motivation

BACKGROUND

Ensuring that Community Health Workers (CHWs) are motivated is critical to their performance, retention and well-being - and ultimately to the effectiveness of community health systems worldwide. While CHW motivation is as multi-dimensional construct, there is no multi-dimensional measure available to guide programming. In this study, we developed and validated a pragmatic, multi-dimensional measure of CHW motivation.

METHODS

Scale validation entailed qualitative and survey research in Mali and Bangladesh. We developed a pool of work satisfaction items as well as several items assessing the importance of hypothesized sub-dimensions of motivation, based on the literature and expert consultations. Qualitative research helped finalize scale sub-dimensions and items. We tested the scale in surveys with CHWs in Mali (n = 152, 40% female, mean age 32) and Bangladesh (n = 76 women, mean age 46). We applied a split-sample exploratory/confirmatory factor analysis (EFA/CFA) in Mali, and EFA in Bangladesh, then assessed reliability. We also gauged convergent/predictive validity, assessing associations between scale scores with conceptually related variables.

RESULTS

The final 22-item scale has four sub-dimensions: Quality of supervision, Feeling valued and capacitated in your work, Peer respect and support, and Compensation and workload. Model fit in CFAs was good, as were reliabilities for the full scale (alpha: 0.84 in Mali, 0.93 in Bangladesh) and all sub-dimensions. To construct scores for the final scale, we weighted the scores for each sub-dimension by CHW-reported importance of that sub-dimension. Final possible range was -6 to +6 (sub-dimensions), -24 to +24 (full scale). Mean (standard deviation) of full-scale scores were 5.0 (3.3) in Mali and 14.5 (5.3) in Bangladesh. In both countries, higher motivation was significantly associated with higher overall interest in their work, feeling able to improve health/well-being in their community, as well as indicators of higher performance and retention.

CONCLUSIONS

We found that the Multi-dimensional Motivation (MM) scale for CHWs is a valid and reliable measure that comprehensively assesses motivation. We recommend the scale be employed in future research around CHW performance and community health systems strengthening worldwide. The scale should be further evaluated within longitudinal studies assessing CHW performance and retention outcomes over time.

Measuring quality of care at the community level using the contraceptive method information index plus and client reported experience metrics in Bangladesh

BACKGROUND

Low rates of contraceptive continuation in Bangladesh are a symptom of poor quality family planning (FP) counseling. Improving family planning counseling by the country's community health care workers (CHWs) could improve contraceptive continuation. This study explores client experiences of care from CHWs, as measured by the method information index plus (MII+) and communication quality metric.

METHODS

Conducted in a peri-urban sub-district with low contraceptive use rates, this mixed methods study explores FP client experiences with community-based counseling and referrals by Family Welfare Assistants (FWAs), a CHW cadre providing FP services. Client- and patient-reported experience with community FP services was measured by the MII+ and communication quality metric. A quantitative post-service exit survey was coupled with observations of the interactions between 62 FWAs and 692 female clients to measure FWA and client FP knowledge, FWA capacities, attitudes, quality of FP communication, FP referrals, and contraceptive uptake.

RESULTS

Summary MII+ scores suggest that only 20% of clients reported adequate provision of information for informed decisions. Observations and self-reporting alike suggest moderate to high quality of communication during FWA and client interactions. Despite FWAs' theoretical knowledge of long-acting reversible and permanent FP methods, few clients were referred to facilities for them; 81% of clients who preferred a pill received it, while only 34% of clients seeking long-acting methods received needed referrals.

CONCLUSIONS

Quality community-based FP counseling could help address rising contraceptive discontinuation rates in Bangladesh. While MII and MII+ scores in this study were low, and FWA evinced numerous misconceptions, FWAs demonstrated strong communication skills that facilitate rapport and trust with their clients and communities. Bangladesh's policy and programs should capitalize upon these relationships and enhance CHWs' knowledge of all method types, and side effects management, with updated job aids, refresher training, and supervision.

Measuring Service Quality and Assessing Its Relationship to Contraceptive Discontinuation: A Prospective Cohort Study in Pakistan and Uganda

BACKGROUND

The quality of contraceptive counseling that women receive from their provider can influence their future contraceptive continuation. We examined (1) whether the quality of contraceptive service provision could be measured in a consistent way by using existing tools from 2 large-scale social franchises, and (2) whether facility quality measures based on these tools were consistently associated with contraceptive discontinuation.

METHODS

We linked existing, routinely collected facility audit data from social franchise clinics in Pakistan and Uganda with client data. Clients were women aged 15-49 who initiated a modern, reversible contraceptive method from a sampled clinic. Consented participants completed an exit interview and were contacted 3, 6, and 12 months later. We collapsed indicators into quality domains using theory-based categorization, created summative quality domain scores, and used Cox proportional hazards models to estimate the relationship between these quality domains and discontinuation while in need of contraception.

RESULTS

The 12-month all-modern method discontinuation rate was 12.5% among the 813 enrolled women in Pakistan and 5.1% among the 1,185 women in Uganda. We did not observe similar associations between facility-level quality measures and discontinuation across these 2 settings. In Pakistan, an increase in the structural privacy domain was associated with a 60% lower risk of discontinuation, adjusting for age and baseline method (P<.001). In Uganda, an increase in the management support domain was associated with a 33% reduction in discontinuation risk, controlling for age and baseline method (P=.005).

CONCLUSIONS

We were not able to leverage existing, widely used quality measurement tools to create quality domains that were consistently associated with discontinuation in 2 study settings. Given the importance of contraceptive service quality and recent advances in indicator standardization in other areas, we recommend further effort to harmonize and simplify measurement tools to measure and improve contraceptive quality of care for all.

Family Planning in Zambia: An Investment Pillar for Economic Development

Family planning represents a 'best buy' in global efforts to achieve sustainable development and attain improvements in sexual and reproductive health. By meeting contraceptive needs of all women, significant public health impact and development gains accrue. At the same time, governments face the complex challenge of allocating finite resources to competing priorities, each of which presents known and unknown challenges and opportunities. Zambia has experienced a slow but steady increase in contraceptive prevalence, with slight decline in total fertility rate (TFR), over the past 20 years. Drawing from the Zambian context, including a review of current policy solutions, we present a case for making investments in voluntary family planning (FP), underpinned by a human rights framework, as a pillar for accelerating development and socio-economic advancement. Through multilevel interventions aimed at averting unintended pregnancies, Zambia - and other low- and middle-income countries - can reduce their age dependency ratios and harness economic growth opportunities awarded by the demographic dividend while improving the health and quality of life of the population.

Initiation and continuity of maternal healthcare: examining the role of vouchers and user-fee removal on maternal health service use in Kenya

This study explores the relationship between two health financing initiatives on women's progression through the maternal health continuum in Kenya: a subsidized reproductive health voucher programme (2006-16) and the introduction of free maternity services in all government facilities (2013). Using cross-sectional survey data, we ran three multivariable logistic regression models examining the effects of the voucher programme, free maternity policy, health insurance and other determinants on (1) early antenatal care (ANC) initiation (first visit within the first trimester of pregnancy), (2) receiving continuous care (1+ ANC, facility birth, 1+ post-natal care (PNC) check) and (3) completing the maternal health pathway as recommended (4+ ANC, facility birth, 1+ PNC, with first check occurring within 48 h of delivery). Full implementation of the voucher programme was positively associated with receiving continuous care among users of 1+ ANC [interaction term adjusted odds ratio (aOR): 1.33, P = 0.014]. Early ANC initiation (aOR: 1.32, P = 0.001) and use of private sector ANC (aOR: 1.93, P < 0.001) were also positively associated with use of continuous care among ANC users. Among continuous care users, early ANC was associated with increased odds of completing the maternal health pathway as recommended (aOR: 3.80, P < 0.001). Higher parity was negatively associated with all three outcomes, while having health insurance was positively associated with each outcome. The impact of other sociodemographic factors such as maternal age, education, wealth quintile, urban residence, and employment varied by outcome; however, the findings generally suggest that marginalized women faced greater barriers to early ANC initiation and continuity of care. Health financing and women's timing and source of ANC are strongly related to their subsequent progression through the maternal health pathway. To increase continuity of care and improve maternal health outcomes, policymakers must therefore focus on equitably reducing financial and other barriers to care seeking and improving quality of care throughout the continuum.

A conceptual framework for measuring community health workforce performance within primary health care systems

BACKGROUND

With the 40th anniversary of the Declaration of Alma-Ata, a global effort is underway to re-focus on strengthening primary health care systems, with emphasis on leveraging community health workers (CHWs) towards the goal of achieving universal health coverage for all. Institutionalizing effective, sustainable community health systems is currently limited by a lack of standard metrics for measuring CHW performance and the systems they work within. Developed through iterative consultations, supported by the Bill & Melinda Gates Foundation and in partnership with USAID and UNICEF, this paper details a framework, list of indicators, and measurement considerations for monitoring CHW performance in low- and middle-income countries.

METHODS

A review of peer-reviewed articles, reports, and global data collection tools was conducted to identify key measurement domains in monitoring CHW performance. Three consultations were successively convened with global stakeholders, community health implementers, advocates, measurement experts, and Ministry of Health representatives using a modified Delphi approach to build consensus on priority indicators. During this process, a structured, web-based survey was administered to identify the importance and value of specific measurement domains, sub-domains, and indicators determined through the literature reviews and initial stakeholder consultations. Indicators with more than 75% support from participants were further refined with expert qualitative input.

RESULTS

Twenty-one sub-domains for measurement were identified including measurement of incentives for CHWs, supervision and performance appraisal, data use, data reporting, service delivery, quality of services, CHW absenteeism and attrition, community use of services, experience of services, referral/counter-referral, credibility/trust, and programmatic costs. Forty-six indicators were agreed upon to measure the sub-domains. In the absence of complete population enumeration and digitized health information systems, the quality of metrics to monitor CHW programs is limited.

CONCLUSIONS

Better data collection approaches at the community level are needed to strengthen management of CHW programs and community health systems. The proposed list of metrics balances exhaustive and pragmatic measurement of CHW performance within primary healthcare systems. Adoption of the proposed framework and associated indicators by CHW program implementors may improve programmatic effectiveness, strengthen their accountability to national community health systems, drive programmatic quality improvement, and plausibly improve the impact of these programs.

Looking at the bigger picture: effect of performance-based contracting of district health services on equity of access to maternal health services in Zambia

Zambia has been using output-based approaches for over two decades to finance whole or part of the public health system. Between 1996 and 2006, performance-based contracting (PBC) was implemented countrywide with the Central Board of Health (CBoH) as the provider of health services. This study reviews the association between PBC and equity of access to maternal health services in Zambia between 1996 and 2006. A comprehensive document review was undertaken to evaluate the implementation process, followed by a trend analysis of health expenditure at district level, and a segmented regression analysis of data on antenatal care (ANC) and deliveries at health facilities that was obtained from five demographic and health survey datasets (1992, 1996, 2002, 2007 and 2014). The results show that PBC was anchored by high-level political support, an overarching policy and legal framework, and collective planning and implementation with all key stakeholders. Decentralization of health service provision was also an enabling factor. ANC coverage increased in both the lower and upper wealth quintiles during the PBC era, followed by a declining trend after the PBC era in both quintiles. Further, the percentage of women delivering at health facilities increased during the PBC era, particularly in rural areas and among the poor. The positive trend continued after the PBC era with similar patterns in both lower and upper wealth quintiles. Despite these gains, per capita health expenditure at district level declined during the PBC era, with the situation worsening after the PBC era. The study concludes that a nationwide PBC approach can contribute to improved equity of access to maternal health services and that PBC is a cost-efficient and sustainable policy reform. The study calls for policymakers to comprehensively evaluate the impact of health system reforms before terminating them.

The Extent to Which Performance-Based Financing Programs' Operations Manuals Reflect Rights-Based Principles: Implications for Family Planning Services

Rights principles should be prioritized and more clearly stated in performance-based financing (PBF) guidance and operational documents. Additional research, including development of validated measurement metrics, is needed to help PBF programs systematically align with rights-based approaches to health care including family planning.

Recognition is growing that development programs need to be guided by rights as well as to promote, protect, and fulfill them. Drawing from a content analysis of performance-based financing (PBF) implementation manuals, we quantify the extent to which these manuals use a rights perspective to frame family planning services. PBF is an adaptable service purchasing strategy that aims to improve equity and quality of health service provision. PBF can contribute toward achieving global family planning goals and has institutional support from multiple development partners including the Global Financing Facility in support of Every Woman Every Child. A review of 23 PBF implementation manuals finds that all documents are focused largely on the implementation of quality and accountability mechanisms, but few address issues of accessibility, availability, informed choice, acceptability, and/or nondiscrimination and equity. Notably, operational inclusion of agency, autonomy, empowerment, and/or voluntarism of health care clients is absent. Based on these findings, we argue that current PBF programs incorporate some mention of rights but are not systematically aligned with a rights-based approach. If PBF programs better reflected the importance of client-centered, rights-based programming, program performance could be improved and risk of infringing rights could be reduced. Given the mixed evidence for PBF benefits and the risk of perverse incentives in earlier PBF programs that were not aligned with rights-based approaches, we argue that greater attention to the rights principles of acceptability, accessibility, availability, and quality; accountability; agency and empowerment; equity and nondiscrimination; informed choice and decision making; participation; and privacy and confidentiality would improve health service delivery and health system performance for all stakeholders with clients at the center. Based on this review, we recommend making the rights-based approach explicit in PBF; progressively operationalizing rights, drawing from local experience; validating rights-based metrics to address measurement gaps; and recognizing the economic value of aligning PBF with rights principles. Such recommendations anchor an aspirational rights agenda with a practical PBF strategy on the need and opportunity for validated metrics.

"What is the best method of family planning for me?": a text mining analysis of messages between users and agents of a digital health service in Kenya

Background: Text message-based interventions have been shown to have consistently positive effects on health improvement and behavior change. Some studies suggest that personalization, tailoring, and interactivity can increase efficacy. With the rise in artificial intelligence and its incorporation into interventions, there is an opportunity to rethink how these characteristics are designed for greater effect. A key step in this process is to better understand how users engage with interventions. In this paper, we apply a text mining approach to characterize the ways that Kenyan men and women communicated with the first iterations of askNivi, a free sexual and reproductive health information service.  Methods: We tokenized and processed more than 179,000 anonymized messages that users exchanged with live agents, enabling us to count word frequency overall, by sex, and by age/sex cohorts. We also conducted two manual coding exercises: (1) We manually classified the intent of 3,834 user messages in a training dataset; and (2) We manually coded all conversations between a random subset of 100 users who engaged in extended chats.  Results: Between September 2017 and January 2019, 28,021 users (mean age 22.5 years, 63% female) sent 87,180 messages to askNivi, and 18 agents sent 92,429 replies. Users wrote most often about family planning methods, contraception, side effects, pregnancy, menstruation, and sex, but we observed different patterns by sex and age. User intents largely reflected the marketing focus on reproductive health, but other topics emerged. Most users sought factual information, but requests for advice and symptom reports were common.  Conclusions: Young people in Kenya have a great desire for accurate and reliable information on health and wellbeing, which is easy to access and trustworthy. Text mining is one way to better understand how users engage with interventions like askNivi and maximize what artificial intelligence has to offer.

Family Planning in Zambia: An Investment Pillar for Economic Development

Family planning represents a ‘best buy’ in global efforts to achieve sustainable development and attain improvements in sexual and reproductive health. Ensuring access is amongst key transformative strategies that underpin health and sustainable development. It confers fertility choices on women and couples within a human rights framework. By meeting contraceptive needs of all women, significant public health impact and development gains accrue. At the same time, governments face the complex challenge of allocating finite resources to competing priorities, each of which presents known and unknown challenges and opportunities. As such, there is a need to carefully consider the estimated costs and benefits for each proposed investment in health, education, social welfare, and security. Zambia has experienced a slow but steady increase in contraceptive prevalence, with slight decline in total fertility rate (TFR), over the past 20 years. Increasing voluntary modern contraceptive use among women offers opportunities to reduce unintended pregnancy while effectively harnessing the demographic dividend in order to bolster socioeconomic outcomes for households and communities. Drawing from the Zambian context, we present a case for making investments in voluntary family planning (FP), underpinned by a human rights framework, as a pillar for accelerating development and socio-economic advancement. Through multilevel interventions aimed at averting unintended pregnancies, Zambia – and other low- and middle-income countries – can reduce their age dependency ratios and harness economic growth opportunities awarded by the demographic dividend while improving the health and quality of life of the population.

Setting the global research agenda for community health systems: literature and consultative review

BACKGROUND

Globally, there is renewed interest in and momentum for strengthening community health systems, as also emphasized by the recent Astana Declaration. Recent reviews have identified factors critical to successful community health worker (CHW) programs but pointed to significant evidence gaps. This review aims to propose a global research agenda to strengthen CHW programs.

METHODS AND RESULTS

We conducted a search for extant systematic reviews on any intermediate factors affecting the effectiveness of CHW programs in February 2018. A total of 30 articles published after year 2000 were included. Data on research gaps were abstracted and summarized under headings based on predominant themes identified in the literature. Following this data gathering phase, two technical advisory groups comprised of experts in the field of community health-including policymakers, implementors, researchers, advocates and donors-were convened to discuss, validate, and prioritize the research gaps identified. Research gap areas that were identified in the literature and validated through expert consultation include selection and training of CHWs, community embeddedness, institutionalization of CHW programs (referrals, supervision, and supply chain), CHW needs including incentives and remuneration, governance and sustainability of CHW programs, performance and quality of care, and cost-effectiveness of CHW programs. Priority research questions included queries on effective policy, financing, governance, supervision and monitoring systems for CHWs and community health systems, implementation questions around the role of digital technologies, CHW preferences, and drivers of CHW motivation and retention over time.

CONCLUSIONS

As international interest and investment in CHW programs and community health systems continue to grow, it becomes critical not only to analyze the evidence that exists, but also to clearly define research questions and collect additional evidence to ensure that CHW programs are effective, efficient, equity promoting, and evidence based. Generally, the literature places a strong emphasis on the need for higher quality, more robust research.

Evaluating Quality of Contraceptive Counseling: An Analysis of the Method Information Index

The Method Information Index (MII) is calculated from contraceptive users’ responses to questions regarding counseling content—whether they were informed about methods other than the one they received, told about method‐specific side effects, and advised what to do if they experienced side effects. The MII is increasingly reported in national surveys and used to track program performance, but little is known about its properties. Using additional questions, we assessed the consistency between responses and the method received in a prospective, multicountry study. We employed two definitions of consistency: (1) presence of any concordant response, and (2) absence of discordant responses. Consistency was high when asking whether users were informed about other methods and what to do about side effects. Responses were least consistent when asking whether side effects were mentioned. Adjusting for inconsistency, scores were up to 50 percent and 30 percent lower in Pakistan and Uganda, respectively, compared to unadjusted MII scores. Additional questions facilitated better understanding of counseling quality.

Making free public healthcare attractive: optimizing health equity funds in Cambodia

Background

Following the introduction of user fees in Cambodia, Health Equity Funds (HEF) were developed to enable poor people access to public health services by paying public health providers on their behalf, including non-medical costs for hospitalised beneficiaries (HEFB). The national scheme covers 3.1 million pre-identified HEFB. Uptake of benefits, however, has been mixed and a substantial proportion of poor people still initiate care at private facilities where they incur considerable out-of-pocket costs. We examine the benefits of additional interventions compared to existing stand-alone HEF scenarios in stimulating care seeking at public health facilities among eligible poor people.

Methods

We report on three configurations of HEF and their ability to attract HEFB to initiate care at public health facilities and their degree of financial risk protection: HEF covering only hospital services (HoHEF), HEF covering health centre and hospital services (CHEF), and Integrated Social Health Protection Scheme (iSHPS) that allowed non-HEFB community members to enrol in HEF. The iSHPS also used vouchers for selected health services, pay-for-performance for quantity and quality of care, and interventions aimed at increasing health providers’ degree of accountability. A cross sectional survey collected information from 1636 matched HEFB households in two health districts with iSHPS and two other health districts without iSHPS. Respondents were stratified according to the three HEF configurations for the descriptive analysis.

Results

The findings indicated that the proportion of HEFB who sought care first from public health providers in iSHPS areas was 55.7%, significantly higher than the 39.5% in the areas having HEF with health centres (CHEF) and 13.4% in the areas having HEF with hospital services only (HoHEF). The overall costs (out-of-pocket and transport) associated with the illness episode were lowest for cases residing within iSHPS sites, US$10.4, and highest in areas where health centres were not included in the package (HoHEF), US$20.7. Such costs were US$19.5 at HEF with health centres (CHEF).

Conclusions

The findings suggest that HEF encompassing health centre and hospital services and complemented by additional interventions are better than stand-alone HEF in attracting sick HEFB to public health facilities and lowering out-of-pocket expenses associated with healthcare seeking.

Assessing the community-level impact of a decade of user fee policy shifts on health facility deliveries in Kenya, 2003-2014

Background

The long-term impact of user fee removal policies on health service utilization in low- and middle-income countries may vary depending on the context in which they are implemented, including whether there are policy actions to support implementation. We examined the community-level impact of a decade of user fee policy shifts on health facility delivery among poorest and rural women and compared the changes with those among the richest and urban women in Kenya using data from three rounds of nationally representative surveys.

Methods

Data are from births occurring in the 5 years preceding the survey to women aged 15-49 years who were interviewed in the 2003, 2008-2009 and 2014 Kenya Demographic and Health Surveys. A total of 5949, 6079 and 20,964 births were reported in respective surveys. We conducted interrupted time series analysis predicting changes in quarterly proportions of births occurring in public and private health facilities as well as at home before and after the 2004, 2007 and 2013 user fee policy shifts in Kenya.

Results

There were no statistically significant immediate changes in the proportion of births occurring in public facilities following the 2004, 2007 and 2013 user fee policy shifts among poor or rural women. There was, however, a statistically significant increase in home deliveries among all women and among those from the poorest households immediately following the 2004 policy. There was also a statistically significant increase in public facility deliveries among women from the two top quintiles, which was accompanied by a statistically decline in home deliveries immediately after the 2007 policy shift. Differences in trends in public facility deliveries between pre- and post-policy periods were not statistically significant for all sub-groups of women, indicating that even among the sub-group that experienced significant immediate increase after the 2007 policy shift, this pattern was not sustained over time.

Conclusion

The findings of this paper provide empirical evidence that poorly implemented user fee removal policies benefit more well-off than poor women and in cases where there are significant immediate effects on uptake of facility delivery, this trend is not sustained over time.

Electronic supplementary material

The online version of this article (10.1186/s12939-018-0774-4) contains supplementary material, which is available to authorized users.

"New Users" Are Confusing Our Counting: Reaching Consensus on How to Measure "Additional Users" of Family Planning

FP2020's overarching goal is framed around the new metric of “additional users.” This measure inherently captures population-level change but has been conflated with other ambiguous metrics, such as “new users.” Therefore, we propose a standard set of terms to provide more consistent measurement. Although commonly used service-level metrics cannot be directly compared to the population-level metric of additional users, we describe 2 modeling approaches that can allow service-level data to inform estimates of additional users.

Family Planning Vouchers in Low and Middle Income Countries: A Systematic Review

Family planning (FP) vouchers have targeted subsidies to disadvantaged populations for quality reproductive health services since the 1960s. To summarize the effect of FP voucher programs in low‐ and middle‐income countries, a systematic review was conducted, screening studies from 33 databases through three phases: keyword search, title and abstract review, and full text review. Sixteen articles were selected including randomized control trials, controlled before‐and‐after, interrupted time series analyses, cohort, and before‐and‐after studies. Twenty‐three study outcomes were clustered around contraceptive uptake, with study outcomes including fertility in the early studies and equity and discontinuation in more recent publications. Research gaps include measures of FP quality, unintended outcomes, clients’ qualitative experiences, FP voucher integration with health systems, and issues related to scale‐up of the voucher approach.

Increasing Uptake of Long-Acting Reversible Contraceptives in Cambodia Through a Voucher Program: Evidence From a Difference-in-Differences Analysis

OBJECTIVE

This article evaluates the use of modern contraceptives among poor women exposed to a family planning voucher program in Cambodia, with a particular focus on the uptake of long-acting reversible contraceptives (LARCs).

METHODS

We used a quasi-experimental study design and data from before-and-after intervention cross-sectional household surveys (conducted in 2011 and 2013) in 9 voucher program districts in Kampong Thom, Kampot, and Prey Veng provinces, as well as 9 comparison districts in neighboring provinces, to evaluate changes in use of modern contraceptives and particularly LARCs in the 12 months preceding each survey. Survey participants in the analytical sample were currently married, non-pregnant women ages 18 to 45 years (N = 1,936 at baseline; N = 1,986 at endline). Difference-in-differences (DID) analyses were used to examine the impact of the family planning voucher.

RESULTS

Modern contraceptive use increased in both intervention and control areas between baseline and endline: in intervention areas, from 22.4% to 31.6%, and in control areas, from 25.2% to 31.0%. LARC use also increased significantly between baseline and endline in both intervention (from 1.4% to 6.7%) and control (from 1.9% to 3.5%) areas, but the increase in LARC use was 3.7 percentage points greater in the intervention area than in the control area (P = .002), suggesting a positive and significant association of the voucher program with LARC use. The greatest increases occurred among the poorest and least educated women.

CONCLUSION

A family planning voucher program can increase access to and use of more effective long-acting methods among the poor by reducing financial and information barriers.

Poverty identification for a pro-poor health insurance scheme in Tanzania: reliability and multi-level stakeholder perceptions

Background

Many low income countries have policies to exempt the poor from user charges in public facilities. Reliably identifying the poor is a challenge when implementing such policies. In Tanzania, a scorecard system was established in 2011, within a programme providing free national health insurance fund (NHIF) cards, to identify poor pregnant women and their families, based on eight components. Using a series of reliability tests on a 2012 dataset of 2,621 households in two districts, this study compares household poverty levels using the scorecard, a wealth index, and monthly consumption expenditures.

Methods

We compared the distributions of the three wealth measures, and the consistency of household poverty classification using cross-tabulations and the Kappa statistic. We measured errors of inclusion and exclusion of the scorecard relative to the other methods. We also gathered perceptions of the scorecard criteria through qualitative interviews with stakeholders at multiple levels of the health system.

Findings

The distribution of the scorecard was less skewed than other wealth measures and not truncated, but demonstrated clumping. There was a higher level of agreement between the scorecard and the wealth index than consumption expenditure. The scorecard identified a similar number of poor households as the “basic needs” poverty line based on monthly consumption expenditure, with only 45 % errors of inclusion. However, it failed to pick up half of those living below the “basic needs” poverty line as being poor. Stakeholders supported the inclusion of water sources, income, food security and disability measures but had reservations about other items on the scorecard.

Conclusion

In choosing poverty identification strategies for programmes seeking to enhance health equity it’s necessary to balance between community acceptability, local relevance and the need for such a strategy. It is important to ensure the strategy is efficient and less costly than alternatives in order to effectively reduce health disparities.

The effect of a multi-component intervention on disrespect and abuse during childbirth in Kenya

Background

Disrespect and abuse (D & A) during labor and delivery are important issues correlated with human rights, equity, and public health that also affect women’s decisions to deliver in facilities, which provide appropriate management of maternal and neonatal complications. Little is known about interventions aimed at lowering the frequency of disrespectful and abusive behaviors.

Methods

Between 2011 and 2014, a pre-and-post study measured D & A levels in a three-tiered intervention at 13 facilities in Kenya under the Heshima project. The intervention involved working with policymakers to encourage greater focus on D & A, training providers on respectful maternity care, and strengthening linkages between the facility and community for accountability and governance. At participating facilities, postpartum women were approached at discharge and asked to participate in the study; those who consented were administered a questionnaire on D & A in general as well as six typologies, including physical and verbal abuse, violations of confidentiality and privacy, detainment for non-payment, and abandonment. Observation of provider-patient interaction during labor was also conducted in the same facilities. In both exit interview and observational studies, multivariate analyses of risk factors for D & A controlled for differences in socio-demographic and facility characteristics between baseline and endline surveys.

Results

Overall D & A decreased from 20–13 % (p < 0.004) and among four of the six typologies D & A decreased from 40–50 %. Night shift deliveries were associated with greater verbal and physical abuse. Patient and infant detainment declined dramatically from 8.0–0.8 %, though this was partially attributable to the 2013 national free delivery care policy.

Conclusion

Although a number of contextual factors may have influenced these findings, the magnitude and consistency of the observed decreases suggest that the multi-component intervention may have the potential to reduce the frequency of D & A. Greater efforts are needed to develop stronger evaluation methods for assessing D & A in other settings.

Community-level effect of the reproductive health vouchers program on out-of-pocket spending on family planning and safe motherhood services in Kenya

Background

Although vouchers can protect individuals in low-income countries from financial catastrophe and impoverishment arising from out-of-pocket expenditures on healthcare, their effectiveness in achieving this goal depends on whether both service and transport costs are subsidized as well as other factors such as service availability in a given locality and community perceptions about the quality of care. This paper examines the community-level effect of the reproductive health vouchers program on out-of-pocket expenditure on family planning, antenatal, delivery and postnatal care services in Kenya.

Methods

Data are from two rounds of cross-sectional household surveys in voucher and non-voucher sites. The first survey was conducted between May 2010 and July 2011 among 2,933 women aged 15–49 years while the second survey took place between July and October 2012 among 3,094 women of similar age groups. The effect of the program on out-of-pocket expenditure is determined by difference-in-differences estimation. Analysis entails comparison of changes in proportions, means and medians as well as estimation of multivariate linear regression models with interaction terms between indicators for study site (voucher or non-voucher) and period of study (2010–2011 or 2012).

Results

There were significantly greater declines in the proportions of women from voucher sites that paid for antenatal, delivery and postnatal care services at health facilities compared to those from non-voucher sites. The changes were also consistent with increased uptake of the safe motherhood voucher in intervention sites over time. There was, however, no significant difference in changes in the proportions of women from voucher and non-voucher sites that paid for family planning services. The results further show that there were significant differences in changes in the amount paid for family planning and antenatal care services by women from voucher compared to those from non-voucher sites. Although there were greater declines in the average amount paid for delivery and postnatal care services by women from voucher compared to those from non-voucher sites, the difference-in-differences estimates were not statistically significant.

Conclusions

The reproductive health vouchers program in Kenya significantly contributed to reductions in the proportions of women in the community that paid out-of-pocket for safe motherhood services at health facilities.

A cross sectional comparison of postnatal care quality in facilities participating in a maternal health voucher program versus non-voucher facilities in Kenya

Background

Health service fees constitute substantial barriers for women seeking childbirth and postnatal care. In an effort to reduce health inequities, the government of Kenya in 2006 introduced the output-based approach (OBA), or voucher programme, to increase poor women’s access to quality Safe Motherhood services including postnatal care. To help improve service quality, OBA programmes purchase services on behalf of the poor and marginalised, with provider reimbursements for verified services. Kenya’s programme accredited health facilities in three districts as well as in two informal Nairobi settlements.

Methods

Postnatal care quality in voucher health facilities (n = 21) accredited in 2006 and in similar non-voucher health facilities (n = 20) are compared with cross sectional data collected in 2010. Summary scores for quality were calculated as additive sums of specific aspects of each attribute (structure, process, outcome). Measures of effect were assessed in a linear regression model accounting for clustering at facility level. Data were analysed using Stata 11.0.

Results

The overall quality of postnatal care is poor in voucher and non-voucher facilities, but many facilities demonstrated ‘readiness’ for postnatal care (structural attributes: infrastructure, equipment, supplies, staffing, training) indicated by high scores (83/111), with public voucher facilities scoring higher than public non-voucher facilities. The two groups of facilities evinced no significant differences in postnatal care mean process scores: 14.2/55 in voucher facilities versus 16.4/55 in non-voucher facilities; coefficient: -1.70 (-4.9, 1.5), p = 0.294. Significantly more newborns were seen within 48 hours (83.5 % versus 72.1 %: p = 0.001) and received Bacillus Calmette-Guerin (BCG) (82.5 % versus 76.5 %: p < 0.001) at voucher facilities than at non-voucher facilities.

Conclusions

Four years after facility accreditation in Kenya, scores for postnatal care quality are low in all facilities, even those with Safe Motherhood vouchers. We recommend the Kenya OBA programme review its Safe Motherhood reimbursement package and draw lessons from supply side results-based financing initiatives, to improve postnatal care quality.

Protocol for the evaluation of a free health insurance card scheme for poor pregnant women in Mbeya region in Tanzania: a controlled-before and after study

BACKGROUND

The use of demand-side financing mechanisms to increase health service utilisation among target groups and enhance service quality is gaining momentum in many low- and middle-income countries. However, there is limited evidence on the effects of such schemes on equity, financial protection, quality of care, and cost-effectiveness. A scheme providing free health insurance cards to poor pregnant women and their households was first introduced in two regions of Tanzania in 2011 and gradually expanded in 2012.

METHODS

A controlled before and after study will examine in one district the effect of the scheme on utilization, quality, and cost of healthcare services accessed by poor pregnant women and their households in Tanzania. Data will be collected 4 months before implementation of the scheme and 17 months after the start of implementation from a survey of 24 health facilities, 288 patients exiting consultations and 1500 households of women who delivered in the previous year in one intervention district (Mbarali). 288 observations of provider-client interactions will also be carried out. The same data will be collected from a comparison district in a nearby region. A process evaluation will ascertain how the scheme is implemented in practice and the level of implementation fidelity and potential moderators. The process evaluation will draw from impact evaluation data and from three rounds of data collection at the national, regional, district, facility and community levels. An economic evaluation will measure the cost-effectiveness of the scheme relative to current practice from a societal perspective.

DISCUSSION

This evaluation will generate evidence on the impact and cost-effectiveness of targeted health insurance for pregnant women in a low income setting, as well as building a better understanding of the implementation process and challenges for programs of this nature.

Does a voucher program improve reproductive health service delivery and access in Kenya?

Background

Current assessments on Output-Based Aid (OBA) programs have paid limited attention to the experiences and perceptions of the healthcare providers and facility managers. This study examines the knowledge, attitudes, and experiences of healthcare providers and facility managers in the Kenya reproductive health output-based approach voucher program.

Methods

A total of 69 in-depth interviews with healthcare providers and facility managers in 30 voucher accredited facilities were conducted. The study hypothesized that a voucher program would be associated with improvements in reproductive health service provision. Data were transcribed and analyzed by adopting a thematic framework analysis approach. A combination of inductive and deductive analysis was conducted based on previous research and project documents.

Results

Facility managers and providers viewed the RH-OBA program as a feasible system for increasing service utilization and improving quality of care. Perceived benefits of the program included stimulation of competition between facilities and capital investment in most facilities. Awareness of family planning (FP) and gender-based violence (GBV) recovery services voucher, however, remained lower than the maternal health voucher service. Relations between the voucher management agency and accredited facilities as well as existing health systems challenges affect program functions.

Conclusions

Public and private sector healthcare providers and facility managers perceive value in the voucher program as a healthcare financing model. They recognize that it has the potential to significantly increase demand for reproductive health services, improve quality of care and reduce inequities in the use of reproductive health services. To improve program functioning going forward, there is need to ensure the benefit package and criteria for beneficiary identification are well understood and that the public facilities are permitted greater autonomy to utilize revenue generated from the voucher program.

Exploring the prevalence of disrespect and abuse during childbirth in Kenya

Background

Poor quality of care including fear of disrespect and abuse (D&A) perpetuated by health workers influences women’s decisions to seek maternity care. Key manifestations of D&A include: physical abuse, non-consented care, non-confidential care, non-dignified care, discrimination, abandonment, and detention in facilities. This paper describes manifestations of D&A experienced in Kenya and measures their prevalence.

Methods

This paper is based on baseline data collected during a before-and-after study designed to measure the effect of a package of interventions to reduce the prevalence of D&A experienced by women during labor and delivery in thirteen Kenyan health facilities. Data were collected through an exit survey of 641 women discharged from postnatal wards. We present percentages of D&A manifestations and odds ratios of its relationship with demographic characteristics using a multivariate fixed effects logistic regression model.

Results

Twenty percent of women reported any form of D&A. Manifestations of D&A includes: non-confidential care (8.5%), non-dignified care (18%), neglect or abandonment (14.3%), Non-consensual care (4.3%) physical abuse (4.2%) and, detainment for non-payment of fees (8.1). Women aged 20-29 years were less likely to experience non-confidential care compared to those under 19; OR: [0.6 95% CI (0.36, 0.90); p=0.017]. Clients with no companion during delivery were less likely to experience inappropriate demands for payment; OR: [0.49 (0.26, 0.95); p=0.037]; while women with higher parities were three times more likely to be detained for lack of payment and five times more likely to be bribed compared to those experiencing there first birth.

Conclusion

One out of five women experienced feeling humiliated during labor and delivery. Six categories of D&A during childbirth in Kenya were reported. Understanding the prevalence of D&A is critical in developing interventions at national, health facility and community levels to address the factors and drivers that influence D&A in facilities and to encourage clients’ future facility utilization.

Can reproductive health voucher programs improve quality of postnatal care? A quasi-experimental evaluation of Kenya's safe motherhood voucher scheme

This study tests the group-level causal relationship between the expansion of Kenya's Safe Motherhood voucher program and changes in quality of postnatal care (PNC) provided at voucher-contracted facilities. We compare facilities accredited since program inception in 2006 (phase I) and facilities accredited since 2010-2011 (phase II) relative to comparable non-voucher facilities. PNC quality is assessed using observed clinical content processes, as well as client-reported outcome measures. Two-tailed unpaired t-tests are used to identify differences in mean process quality scores and client-reported outcome measures, comparing changes between intervention and comparison groups at the 2010 and 2012 data collection periods. Difference-in-differences analysis is used to estimate the reproductive health (RH) voucher program's causal effect on quality of care by exploiting group-level differences between voucher-accredited and non-accredited facilities in 2010 and 2012. Participation in the voucher scheme since 2006 significantly improves overall quality of postnatal care by 39% (p=0.02), where quality is defined as the observable processes or components of service provision that occur during a PNC consultation. Program participation since phase I is estimated to improve the quality of observed maternal postnatal care by 86% (p=0.02), with the largest quality improvements in counseling on family planning methods (IRR 5.0; p=0.01) and return to fertility (IRR 2.6; p=0.01). Despite improvements in maternal aspects of PNC, we find a high proportion of mothers who seek PNC are not being checked by any provider after delivery. Additional strategies will be necessary to standardize provision of packaged postnatal interventions to both mother and newborn. This study addresses an important gap in the existing RH literature by using a strong evaluation design to assess RH voucher program effectiveness on quality improvement.

Lessons from sexual and reproductive health voucher program design and function: a comprehensive review

Background

Developing countries face challenges in financing healthcare; often the poor do not receive the most basic services. The past decade has seen a sharp increase in the number of voucher programs, which target output-based subsidies for specific services to poor and underserved groups. The dearth of literature that examines lessons learned risks the wheel being endlessly reinvented. This paper examines commonalities and differences in voucher design and implementation, highlighting lessons learned for the design of new voucher programmes.

Methodology

The methodology comprised: discussion among key experts to develop inclusion/exclusion criteria; up-dating the literature database used by the DFID systematic review of voucher programs; and networking with key contacts to identify new programs and obtain additional program documents. We identified 40 programs for review and extracted a dataset of more than 120 program characteristics for detailed analysis.

Results

All programs aimed to increase utilisation of healthcare, particularly maternal health services, overwhelmingly among low-income populations. The majority contract(ed) private providers, or public and private providers, and all facilitate(d) access to services that are well defined, time-limited and reflect the country’s stated health priorities.

All voucher programs incorporate a governing body, management agency, contracted providers and target population, and all share the same incentive structure: the transfer of subsidies from consumers to service providers, resulting in a strong effect on both consumer and provider behaviour. Vouchers deliver subsidies to individuals, who in the absence of the subsidy would likely not have sought care, and in all programs a positive behavioural response is observed, with providers investing voucher revenue to attract more clients. A large majority of programs studied used targeting mechanisms.

Conclusions

While many programs remain too small to address national-level need among the poor, large programs are being developed at a rate of one every two years, with further programs in the pipeline. The importance of addressing inequalities in access to basic services is recognized as an important component in the drive to achieve universal health coverage; vouchers are increasingly acknowledged as a promising targeting mechanism in this context, particularly where social health insurance is not yet feasible.

Determinants of health insurance ownership among women in Kenya: evidence from the 2008-09 Kenya demographic and health survey

BACKGROUND

The Government of Kenya is making plans to implement a social health insurance program by transforming the National Hospital Insurance Fund (NHIF) into a universal health coverage program. The objective of this study was to examine the determinants associated with health insurance ownership among women in Kenya.

METHODS

Data came from the 2008-09 Kenya Demographic and Health Survey, a nationally representative survey. The sample comprised 8,435 women aged 15-49 years. Descriptive statistics and multivariable logistic regression analysis were used to describe the characteristics of the sample and to identify factors associated with health insurance ownership.

RESULTS

Being employed in the formal sector, being married, exposure to the mass media, having secondary education or higher, residing in households in the middle or rich wealth index categories and residing in a female-headed household were associated with having health insurance. However, region of residence was associated with a lower likelihood of having insurance coverage. Women residing in Central (OR = 0.4; p < 0.01) and North Eastern (OR = 0.1; p < 0.5) provinces were less likely to be insured compared to their counterparts in Nairobi province.

CONCLUSIONS

As the Kenyan government transforms the NHIF into a universal health program, it is important to implement a program that will increase equity and access to health care services among the poor and vulnerable groups.

Assessing the population-level impact of vouchers on access to health facility delivery for women in Kenya

Although available evidence indicates that vouchers improve service utilization among the target populations, we do not know whether increased utilization results from improved access (new clients who would not have used services without the voucher) or from shifting clients from non-accredited to contracted service providers. This paper examines whether the safe motherhood voucher program in Kenya is associated with improved access to health facility delivery using information on births within two years preceding the survey in voucher and comparison sites. Data were collected in 2010-2011 and in 2012 among 2933 and 3094 women aged 15-49 years reporting 962 and 1494 births within two years before the respective surveys. Analysis entails cross-tabulations and estimation of multilevel random-intercept logit models. The results show that the proportion of births occurring at home declined by more than 10 percentage points while the proportion of births delivered in health facilities increased by a similar margin over time in voucher sites. The increase in facility-based births occurred in both public and private health facilities. There was also a significant increase in the likelihood of facility-based delivery (odds ratios [OR]: 2.04; 95% confidence interval [CI]: 1.40-2.98 in the 2006 voucher arm; OR: 1.72; 95% CI: 1.22-2.43 in the 2010-2011 voucher arm) in voucher sites over time. In contrast, there were no significant changes in the likelihood of facility-based delivery in the comparison arm over time. These findings suggest that the voucher program contributed to improved access to institutional delivery by shifting births from home to health facilities. However, available evidence from qualitative data shows that some women who purchased the vouchers did not use them because of high transportation costs to accredited facilities. The implication is that substantial improvements in service uptake could be achieved if the program subsidized transportation costs as well.

Reproductive health voucher program and facility based delivery in informal settlements in Nairobi: a longitudinal analysis

Introduction

In Kenya, the maternal mortality rate had ranged from 328 to 501 deaths per 100,000 live births over the last three decades. To reduce these rates, the government launched in 2006 a means-tested reproductive health output-based approach (OBA) voucher program that covers costs of antenatal care, a facility-based delivery (FBD) and a postnatal visit in prequalified healthcare facilities. This paper investigated whether women who bought the voucher for their index child and had a FBD were more likely to deliver a subsequent child in a facility compared to those who did not buy vouchers.

Methods and Findings

We used population-based cohort data from two Nairobi slums where the voucher program was piloted. We selected mothers of at least two children born between 2006 and 2012 and divided the mothers into two groups: Index-OBA mothers bought the voucher for the index child (N=352), and non-OBA mothers did not buy the voucher during the study period (N=514). The most complete model indicated that the adjusted odds-ratio of FBD of subsequent child when the index child was born in a facility was 3.89 (p<0.05) and 4.73 (p<0.01) in Group 2.

Discussion and Conclusion

The study indicated that the voucher program improved poor women access to FBD. Furthermore, the FBD of an index child appeared to have a persistent effect, as a subsequent child of the same mother was more likely to be born in a facility as well. While women who purchased the voucher have higher odds of delivering their subsequent child in a facility, those odds were smaller than those of the women who did not buy the voucher. However, women who did not buy the voucher were less likely to deliver in a good healthcare facility, negating their possible benefit of facility-based deliveries. Pathways to improve access to FBD to all near poor women are needed.

Safe motherhood voucher programme coverage of health facility deliveries among poor women in South-western Uganda

There has been increased interest in and experimentation with demand-side mechanisms such as the use of vouchers that place purchasing power in the hands of targeted consumers to improve the uptake of healthcare services in low-income settings. A key measure of the success of such interventions is the extent to which the programmes have succeeded in reaching the target populations. This article estimates the coverage of facility deliveries by a maternal health voucher programme in South-western Uganda and examines whether such coverage is correlated with district-level characteristics such as poverty density and the number of contracted facilities. Analysis entails estimating the voucher coverage of health facility deliveries among the general population and poor population (PP) using programme data for 2010, which was the most complete calendar year of implementation of the Uganda safe motherhood (SM) voucher programme. The results show that: (1) the programme paid for 38% of estimated deliveries among the PP in the targeted districts, (2) there was a significant negative correlation between the poverty density in a district and proportions of births to poor women that were covered by the programme and (3) improving coverage of health facility deliveries for poor women is dependent upon increasing the sales and redemption rates. The findings suggest that to the extent that the programme stimulated demand for SM services by new users, it has the potential of increasing facility-based births among poor women in the region. In addition, the significant negative correlation between the poverty density and the proportions of facility-based births to poor women that are covered by the voucher programme suggests that there is need to increase both voucher sales and the rate of redemption to improve coverage in districts with high levels of poverty.

An assessment of opportunities and challenges for public sector involvement in the maternal health voucher program in Uganda

Background

Continued inequities in coverage, low quality of care, and high out-of-pocket expenses for health services threaten attainment of Millennium Development Goals 4 and 5 in many sub-Saharan African countries. Existing health systems largely rely on input-based supply mechanisms that have a poor track record meeting the reproductive health needs of low-income and underserved segments of national populations. As a result, there is increased interest in and experimentation with results-based mechanisms like supply-side performance incentives to providers and demand-side vouchers that place purchasing power in the hands of low-income consumers to improve uptake of facility services and reduce the burden of out-of-pocket expenditures. This paper describes a reproductive health voucher program that contracts private facilities in Uganda and explores the policy and implementation issues associated with expansion of the program to include public sector facilities.

Methods

Data presented here describes the results of interviews of six district health officers and four health facility managers purposefully selected from seven districts with the voucher program in southwestern Uganda. Interviews were transcribed and organized thematically, barriers to seeking RH care were identified, and how to address the barriers in a context where voucher coverage is incomplete as well as opportunities and challenges for expanding the program by involving public sector facilities were investigated.

Results

The findings show that access to sexual and reproductive health services in southwestern Uganda is constrained by both facility and individual level factors which can be addressed by inclusion of the public facilities in the program. This will widen the geographical reach of facilities for potential clients, effectively addressing distance related barriers to access of health care services. Further, intensifying ongoing health education, continuous monitoring and evaluation, and integrating the voucher program with other services is likely to address some of the barriers. The public sector facilities were also seen as being well positioned to provide voucher services because of their countrywide reach, enhanced infrastructure, and referral networks. The voucher program also has the potential to address public sector constraints such as understaffing and supply shortages.

Conclusions

Accrediting public facilities has the potential to increase voucher program coverage by reaching a wider pool of poor mothers, shortening distance to service, strengthening linkages between public and private sectors through public-private partnerships and referral systems as well as ensuring the awareness and buy-in of policy makers, which is crucial for mobilization of resources to support the sustainability of the programs. Specifically, identifying policy champions and consulting with key policy sectors is key to the successful inclusion of the public sector into the voucher program.

Community experiences and perceptions of reproductive health vouchers in Kenya

BACKGROUND

Research on demand-side health care financing approaches such as output-based aid (OBA) programs have focused on evaluating the role of the programs improving such outcomes as utilization of services and quality of services with limited focus on the experiences and perceptions of the target communities. This paper examines community members' views of the output-based aid voucher program in Kenya.

METHODS

A household survey was conducted in 2010 among 1,336 women aged 15-49 years living in the catchment areas of contracted health facilities in three districts participating in the voucher program (Kisumu, Kiambu and Kitui). Twenty seven focus group discussions were conducted with voucher users, non-users, opinion leaders and voucher distributors in the three districts as well as in Nairobi. Analysis of the quantitative data involved frequency distributions and cross-tabulations. Qualitative data were transcribed and analyzed by adopting framework analysis and further triangulation of themes across respondents.

RESULTS

Majority (84%) of survey respondents had heard about the safe motherhood voucher compared to 24% and 1% that had heard about the family planning and gender-based violence recovery services (GBVRS) vouchers respectively. Similarly, 20% of the respondents had used the safe motherhood voucher compared to 2% for family planning and none for the GBVRS vouchers. From the community members' perspectives, the voucher program is associated with improvements in access to health services for poor women, improved quality of care, and empowerment of women to make health care decisions. However, community members cited difficulties in accessing some accredited health facilities, limitations with the system of selling vouchers, lack of male involvement in women's reproductive health issues, and poor understanding of the benefits associated with purchasing the voucher.

CONCLUSION

The findings of this paper showed that the voucher program in Kenya is viewed by the community members as a feasible system for increasing service utilization, improving quality of care, and reducing financial barriers to accessing reproductive health services. However, the techniques of program execution such as proper information and availability of the distributors as well as local attitudes influence whether vouchers are purchased and used.

Increase in facility-based deliveries associated with a maternal health voucher programme in informal settlements in Nairobi, Kenya

OBJECTIVE

To measure whether there was an association between the introduction of an output-based voucher programme and the odds of a facility-based delivery in two Nairobi informal settlements.

DATA SOURCES

Nairobi Urban Health and Demographic Surveillance System (NUHDSS) and two cross-sectional household surveys in Korogocho and Viwandani informal settlements in 2004-05 and 2006-08.

METHODS

Odds of facility-based delivery were estimated before and after introduction of an output-based voucher. Supporting NUHDSS data were used to determine whether any trend in maternal health care was coincident with immunizations, a non-voucher outpatient service. As part of NUHDSS, households in Korogocho and Viwandani reported place of delivery and the presence of a skilled birth attendant (2003-10) and vaccination coverage (2003-09). A detailed maternal and child health (MCH) tool was added to NUHDSS (September 2006-10). Prospective enrolment in NUHDSS-MCH was conditional on having a newborn after September 2006. In addition to recording mother's place of delivery, NUHDSS-MCH recorded the use of the voucher.

FINDINGS

There were significantly greater odds of a facility-based delivery among respondents during the voucher programme compared with similar respondents prior to voucher launch. Testing whether unrelated outpatient care also increased, a falsification exercise found no significant increase in immunizations for children 12-23 months of age in the same period. Although the proportion completing any antenatal care (ANC) visit remained above 95% of all reported pregnancies and there was a significant increase in facility-based deliveries, the proportion of women completing 4+ ANC visits was significantly lower during the voucher programme.

CONCLUSIONS

A positive association was observed between vouchers and facility-based deliveries in Nairobi. Although there is a need for higher quality evidence and validation in future studies, this statistically significant and policy relevant finding suggests that increases in facility-based deliveries can be achieved through output-based finance models that target subsidies to underserved populations.

Redeeming qualities: exploring factors that affect women's use of reproductive health vouchers in Cambodia

Background

One approach to delivering healthcare in developing countries is through voucher programs, where vouchers are distributed to a specific population for free or subsidized health care. Recent evaluations suggest that vouchers have the potential to extend coverage of priority health services to the poor in developing countries. In Cambodia, a reproductive health voucher program was implemented in January 2011. This study aims to explore women’s early experiences accessing health services with their vouchers at accredited clinics.

Methods

This qualitative exploratory study used focus group methodology to gather information from five groups of older (>25 years) and four groups of younger (18–25 years) women who were eligible for the voucher program in three rural provinces. Focus groups were digitally recorded, transcribed and translated from Khmer into English. Data analysis was an iterative process, which comprised of open coding to find commonalities that reflected categories or themes and axial coding to relate initial themes to each other. Next, a basic framework for analysis was formed by integrating the themes into the framework.

Results

Two overarching themes were identified in the data: 1) factors that facilitate voucher use and 2) factors that inhibit voucher use. Within each of these themes, three subthemes were identified: 1) pre-existing factors, 2) distribution factors, and 3) redemption factors. Overall, women expressed positive feelings towards the voucher program, while several areas for program improvement were identified including the importance of addressing pre-existing demand-side barriers to using reproductive health services, the need for more comprehensive counselling during voucher distribution, and the persistent cost of unofficial payments expected by midwives after delivery irrespective of voucher use.

Conclusions

Early information from program beneficiaries can lead to timely and responsive changes that can help to maximize program success. This study highlights the importance of tailoring voucher programs to specific community needs, a strategy that can lead to better program uptake.

Study protocol for promoting respectful maternity care initiative to assess, measure and design interventions to reduce disrespect and abuse during childbirth in Kenya

BACKGROUND

Increases in the proportion of facility-based deliveries have been marginal in many low-income countries in the African region. Preliminary clinical and anthropological evidence suggests that one major factor inhibiting pregnant women from delivering at facility is disrespectful and abusive treatment by health care providers in maternity units. Despite acknowledgement of this behavior by policy makers, program staff, civil society groups and community members, the problem appears to be widespread but prevalence is not well documented. Formative research will be undertaken to test the reliability and validity of a disrespect and abuse (D&A) construct and to then measure the prevalence of disrespect and abuse suffered by clinic clients and the general population.

METHODS/DESIGN

A quasi-experimental design will be followed with surveys at twelve health facilities in four districts and one large maternity hospital in Nairobi and areas before and after the introduction of disrespect and abuse (D&A) interventions. The design is aimed to control for potential time dependent confounding on observed factors.

DISCUSSION

This study seeks to conduct implementation research aimed at designing, testing, and evaluating an approach to significantly reduce disrespectful and abusive (D&A) care of women during labor and delivery in facilities. Specifically the proposed study aims to: (i) determine the manifestations, types and prevalence of D&A in childbirth (ii) develop and validate tools for assessing D&A (iii) identify and explore the potential drivers of D&A (iv) design, implement, monitor and evaluate the impact of one or more interventions to reduce D&A and (v) document and assess the dynamics of implementing interventions to reduce D&A and generate lessons for replication at scale.

Self reported risk reduction behavior associated with HIV counseling and testing: a comparative analysis of facility- and home-based models in rural Uganda

Home-based human immunodeficiency virus (HIV) voluntary counseling and testing (VCT) in Uganda is being promoted to increase coverage, in addition to main stay approach of service provision through health facilities. The aim of this study was to compare self reported risk reduction behavior among clients receiving facility and home-based HIV VCT within a rural context. Pre-post intervention client surveys were conducted in November 2007 (baseline) and March 2008 (follow up) in southwestern Uganda. The facility-based VCT intervention was provided to 500 clients and home-based VCT to 494 clients at baseline, in 2 different sub-counties. A total of 76% (759/994) of these clients were interviewed at the follow up visit. The respondents who received facility-based VCT were more likely to report abstinence (adjusted Odds Ratio [aOR]=1.47, 95% CI 1.074, 2.02), reducing multi sexual relationships (aOR=3.23, 95% CI 2.02, 5.16) and more frequent use of condoms (aOR=3.14, 95% CI 1.60, 6.18). However, they were less likely to report, discussing HIV (aOR=0.63, 95% CI 0.46, 0.85) with their sexual partner/s and having sex with only one partner (aOR=0.72, 95% CI 0.519-0.99). While facility-based VCT appears to promote abstinence and condom use home-based VCT on the other hand promotes faithfulness and disclosure. VCT services should, therefore, be provided through both models in a complementary relationship and not as surrogates within given settings.

A policy analysis of the implementation of a Reproductive Health Vouchers Program in Kenya

BACKGROUND

Innovative financing strategies such as those that integrate supply and demand elements like the output-based approach (OBA) have been implemented to reduce financial barriers to maternal health services. The Kenyan government with support from the German Development Bank (KfW) implemented an OBA voucher program to subsidize priority reproductive health services. Little evidence exists on the experience of implementing such programs in different settings. We describe the implementation process of the Kenyan OBA program and draw implications for scale up.

METHODS

Policy analysis using document review and qualitative data from 10 in-depth interviews with facility in-charges and 18 with service providers from the contracted facilities, local administration, health and field managers in Kitui, Kiambu and Kisumu districts as well as Korogocho and Viwandani slums in Nairobi.

RESULTS

The OBA implementation process was designed in phases providing an opportunity for learning and adapting the lessons to local settings; the design consisted of five components: a defined benefit package, contracting and quality assurance; marketing and distribution of vouchers and claims processing and reimbursement. Key implementation challenges included limited feedback to providers on the outcomes of quality assurance and accreditation and budgetary constraints that limited effective marketing leading to inadequate information to clients on the benefit package. Claims processing and reimbursement was sophisticated but required adherence to time consuming procedures and in some cases private providers complained of low reimbursement rates for services provided.

CONCLUSIONS

OBA voucher schemes can be implemented successfully in similar settings. For effective scale up, strong partnership will be required between the public and private entities. The government's role is key and should include provision of adequate funding, stewardship and looking for opportunities to utilize existing platforms to scale up such strategies.

Exploring the effectiveness of the output-based aid voucher program to increase uptake of gender-based violence recovery services in Kenya: a qualitative evaluation

Background

Few studies in Africa have explored in detail the ability of output-based aid (OBA) voucher programs to increase access to gender-based violence recovery (GBVR) services.

Methods

A qualitative study was conducted in 2010 and involved: (i) in-depth interviews (IDIs) with health managers, service providers, voucher management agency (VMA) managers and (ii) focus group discussions (FGDs) with voucher users, voucher non-users, voucher distributors and opinion leaders drawn from five program sites in Kenya.

Results

The findings showed promising prospects for the uptake of OBA GBVR services among target population. However, a number of factors affect the uptake of the services. These include lack of general awareness of the GBVR services vouchers, lack of understanding of the benefit package, immediate financial needs of survivors, as well as stigma and cultural beliefs that undermine reporting of cases or seeking essential medical services. Moreover, accreditation of only hospitals to offer GBVR services undermines access to the services in rural areas. Poor responsiveness from law enforcement agencies and fear of reprisal from perpetrators also undermine treatment options and access to medical services. Low provider knowledge on GBVR services and lack of supplies also affect effective provision and management of GBVR services.

Conclusions

The above findings suggest that there is a need to build the capacity of health care providers and police officers, strengthen the community strategy component of the OBA program to promote the GBVR services voucher, and conduct widespread community education programs aimed at prevention, ensuring survivors know how and where to access services and addressing stigma and cultural barriers.

Community-level impact of the reproductive health vouchers programme on service utilization in Kenya

This paper examines community-level association between exposure to the reproductive health vouchers programme in Kenya and utilization of services. The data are from a household survey conducted among 2527 women (15–49 years) from voucher and comparable non-voucher sites. Analysis entails cross-tabulations with Chi-square tests and significant tests of proportions as well as estimation of multi-level logit models to predict service utilization by exposure to the programme. The results show that for births occurring after the voucher programme began, women from communities that had been exposed to the programme since 2006 were significantly more likely to have delivered at a health facility and to have received skilled care during delivery compared with those from communities that had not been exposed to the programme at all. There were, however, no significant differences in the timing of first trimester utilization of antenatal care (ANC) and making four or more ANC visits by exposure to the programme. In addition, poor women were significantly less likely to have used safe motherhood services (health facility delivery, skilled delivery care and postnatal care) compared with their non-poor counterparts regardless of exposure to the programme. Nonetheless, a significantly higher proportion of poor women from communities that had been exposed to the programme since 2006 used the services compared with their poor counterparts from communities that had not been exposed to the programme at all. The findings suggest that the programme is associated with increased health facility deliveries and skilled delivery care especially among poor women. However, it has had limited community-level impact on the first trimester timing of antenatal care use and making four or more visits, which remain a challenge despite the high proportion of women in the country that make at least one antenatal care visit during pregnancy.

Evaluation of the impact of the voucher and accreditation approach on improving reproductive health behaviors and status in Kenya

Abtsract