Challenges and opportunities in evaluating programmes incorporating human-centred design: lessons learnt from the evaluation of Adolescents 360

Policies for expanding family planning coverage: lessons from five successful countries

Background

Enhancing the design of family planning interventions is crucial for promoting gender equality and improving maternal and child health outcomes. We identified, critically appraised, and synthesized policies and strategies from five selected countries that successfully increased family planning coverage.

Methods

We conducted a policy analysis through a scoping review and document search, focusing on documents published from 1950 to 2023 that examined or assessed policies aimed at enhancing family planning coverage in Brazil, Ecuador, Egypt, Ethiopia, and Rwanda. A search was conducted through PubMed, SCOPUS, and Web of Science. Government documents and conference proceedings were also critically analyzed. National health surveys were analyzed to estimate time trends in demand for family planning satisfied by modern methods (mDFPS) at the national level and by wealth. Changes in the method mix were also assessed. The findings of the studies were presented in a narrative synthesis.

Findings

We selected 231 studies, in which 196 policies were identified. All countries started to endorse family planning in the 1960s, with the number of identified policies ranging between 21 in Ecuador and 52 in Ethiopia. Most of the policies exclusively targeted women and were related to supplying contraceptives and enhancing the quality of the services. Little focus was found on monitoring and evaluation of the policies implemented.

Conclusion

Among the five selected countries, a multitude of actions were happening simultaneously, each with its own vigor and enthusiasm. Our findings highlight that these five countries were successful in increasing family planning coverage by implementing broader multi-sectoral policies and considering the diverse needs of the population, as well as the specific contextual factors at play. Successful policies require a nuanced consideration of how these policies align with each culture's framework, recognizing that both sociocultural norms and the impact of past public policies shape the current state of family planning.

Effect and cost-effectiveness of human-centred design-based approaches to increase adolescent uptake of modern contraceptives in Nigeria, Ethiopia and Tanzania: Population-based, quasi-experimental studies

Around half of adolescent pregnancies in low- and middle-income countries are unintended, contributing to millions of unsafe abortions per year. Adolescents 360 (A360), a girl-centred initiative, aimed to increase voluntary uptake of modern contraceptives among adolescents in Nigeria, Ethiopia and Tanzania. We evaluated the effectiveness and cost-effectiveness of A360 in increasing modern contraceptive use in selected geographies. We used before-and-after cross-sectional studies of adolescent girls in four settings. Two Nigerian settings had purposefully selected comparison areas. Baseline and endline household surveys were conducted. The primary study outcome was modern contraceptive prevalence rate (mCPR). Secondary outcomes mapped onto the A360 Theory of Change. Interpretation was aided by a process evaluation along with secular mCPR trends and self-reported A360 exposure data. Incremental design and implementation costs were calculated from implementer systems, site visits, surveys, and interviews. mCPR change was modelled into maternal disability-adjusted life years (DALY) averted to calculate incremental cost-effectiveness ratios. In Oromia, Ethiopia, mCPR increased by 5% points (95% CI 1-10; n = 1,697). In Nigeria, there was no evidence of an effect of A360 on mCPR in Nasarawa (risk ratio: 0·96, 95% CI: 0·76-1·21; n = 5,414) or in Ogun (risk ratio: 1·08, 95% CI: 0·92-1·26; n = 3,230). In Mwanza, Tanzania, mCPR decreased by 9% points (-17 to -0.3; n = 1,973). Incremental cost per DALY averted were $30,855 in Oromia, $111,416 in Nasarawa, $30,114 in Ogun, and $25,579 in Mwanza. Costs per DALY averted were 14-53 times gross domestic product per capita. A360 did not lead to increased adolescent use of modern contraceptives at a population level, except in Oromia, and was not cost-effective. This novel adolescent-centred design approach showed some promise in addressing the reproductive health needs of adolescents, but must be accompanied by efforts to address the contextual drivers of low modern contraceptive use.

Use of implementation science to advance family planning programs in low- and middle-income countries: A systematic review

Objective

As environmental and economic pressures converge with demands to achieve sustainability development goals, low- and middle-income countries (LMIC) increasingly require strategies to strengthen and scale-up evidence-based practices (EBP) related to family planning (FP). Implementation science (IS) can help these efforts. The purpose of this article is to elucidate patterns in the use of IS in FP research and identify ways to maximize the potential of IS to advance FP in LMIC.

Design and methods

We conducted a systematic review that describes how IS concepts and principles have been operationalized in LMIC FP research published from 2007-2021. We searched six databases for implementation studies of LMIC FP interventions. Our review synthesizes the characteristics of implementation strategies and research efforts used to enhance the performance of FP-related EBP in these settings, identifying gaps, strengths and lessons learned.

Results

Four-hundred and seventy-two studies were eligible for full-text review. Ninety-two percent of studies were carried out in one region only, whereas 8 percent were multi-country studies that took place across multiple regions. 37 percent of studies were conducted in East Africa, 21 percent in West and Central Africa, 19 percent in Southern Africa and South Asia, respectively, and fewer than 5 percent in other Asian countries, Latin America and Middle East and North Africa, respectively. Fifty-four percent were on strategies that promoted individuals' uptake of FP. Far fewer were on strategies to enhance the coverage, implementation, spread or sustainability of FP programs. Most studies used quantitative methods only and evaluated user-level outcomes over implementation outcomes. Thirty percent measured processes and outcomes of strategies, 15 percent measured changes in implementation outcomes, and 31 percent report on the effect of contextual factors. Eighteen percent reported that they were situated within decision-making processes to address locally identified implementation issues. Fourteen percent of studies described measures to involve stakeholders in the research process. Only 7 percent of studies reported that implementation was led by LMIC delivery systems or implementation partners.

Conclusions

IS has potential to further advance LMIC FP programs, although its impact will be limited unless its concepts and principles are incorporated more systematically. To support this, stakeholders must focus on strategies that address a wider range of implementation outcomes; adapt research designs and blend methods to evaluate outcomes and processes; and establish collaborative research efforts across implementation, policy, and research domains. Doing so will expand opportunities for learning and applying new knowledge in pragmatic research paradigms where research is embedded in usual implementation conditions and addresses critical issues such as scale up and sustainability of evidence-informed FP interventions.Systematic Review Registration: https://www.crd.york.ac.uk/prospero/, identifier: CRD42020199353.

Cost-effectiveness analysis of human-centred design for global health interventions: a quantitative framework

Introduction

Human-centred design (HCD) is a problem-solving approach that is increasingly used to develop new global health interventions. However, there is often a large initial cost associated with HCD, and global health decision-makers would benefit from an improved understanding of the cost-effectiveness of HCD, particularly the trade-offs between the up-front costs of design and the long-term costs of delivering health interventions.

Methods

We developed a quantitative framework from a health systems perspective to illustrate the conditions under which HCD-informed interventions are likely to be cost-effective, taking into consideration five elements: cost of HCD, per-client intervention cost, anticipated number of clients reached, anticipated incremental per-client health benefit (ie, disability-adjusted life years (DALYs) averted) and willingness-to-pay. We evaluated several combinations of fixed and implementation cost scenarios based on the estimated costs of an HCD-informed approach to tuberculosis (TB) contact investigation in Uganda over a 2-year period to illustrate the use of this framework.

Results

The cost-effectiveness of HCD-informed TB contact investigation in Uganda was estimated to vary from US$8400 (2400 clients reached, lower HCD cost estimate) to US$306 000 per DALY averted (120 clients reached, baseline HCD cost estimate). In our model, cost-effectiveness was improved further when the interventions were expected to have wider reach or higher per-client health benefits.

Conclusion

HCD can be cost-effective when used to inform interventions that are anticipated to reach a large number of clients, or in which the cost of HCD is smaller relative to the cost of delivering the intervention itself.

Innovative demand creation strategies to increase voluntary medical male circumcision uptake: a pragmatic randomised controlled trial in Zimbabwe

INTRODUCTION

Reaching men aged 20-35 years, the group at greatest risk of HIV, with voluntary medical male circumcision (VMMC) remains a challenge. We assessed the impact of two VMMC demand creation approaches targeting this age group in a randomised controlled trial (RCT).

METHODS

We conducted a 2×2 factorial RCT comparing arms with and without two interventions: (1) standard demand creation augmented by human-centred design (HCD)-informed approach; (2) standard demand creation plus offer of HIV self-testing (HIVST). Interpersonal communication (IPC) agents were the unit of randomisation. We observed implementation of demand creation over 6 months (1 May to 31 October 2018), with number of men circumcised assessed over 7 months. The primary outcome was the number of men circumcised per IPC agent using the as-treated population of actual number of months each IPC agent worked. We conducted a mixed-methods process evaluation within the RCT.

RESULTS

We randomised 140 IPC agents, 35 in each arm. 132/140 (94.3%) attended study training and 105/132 (79.5%) reached at least one client during the trial period and were included in final analysis. There was no evidence that the HCD-informed intervention increased VMMC uptake versus no HCD-informed intervention (incident rate ratio (IRR) 0.87, 95% CI 0.38 to 2.02; p=0.75). Nor did offering men a HIVST kit at time of VMMC mobilisation (IRR 0.65, 95% CI 0.28 to 1.50; p=0.31). Among IPC agents that reported reaching at least one man with demand creation, both the HCD-informed intervention and HIVST were deemed useful. There were some challenges with trial implementation; <50% of IPC agents converted any men to VMMC, which undermined our ability to show an effect of demand creation and may reflect acceptability and feasibility of the interventions.

CONCLUSION

This RCT did not show evidence of an effect of HCD-informed demand intervention or HIVST on VMMC uptake. Findings will inform future design and implementation of demand creation evaluations.

TRIAL REGISTRATION NUMBER

PACTR201804003064160.

Elevating Social and Behavior Change as an Essential Component of Family Planning Programs

The global family planning community has made significant progress towards enabling 120 million more women and girls to use contraceptives by 2020, though we enter the decade ahead with a long road yet to travel. While investment in strong health systems and supply chains is still needed, the supply‐driven approach dominant in family planning fails to address the individual, relational, and social barriers faced by women and couples in achieving their reproductive intentions and desired family size. Overcoming these barriers will require a better understanding of behavioral drivers and the social environment in which family planning decisions are made, and an increased investment in the proven, yet underutilized, approach of social and behavior change (SBC). We make the case that a more intentional focus on the science of human behavior in family planning can help advance the achievement of global, regional, and national goals while also calling for strategic and sustained investment that reflects the critical importance and proven impact of SBC approaches.