Learning before leaping: integration of an adaptive study design process prior to initiation of BetterBirth, a large-scale randomized controlled trial in Uttar Pradesh, India

The effect of the WHO Safe Childbirth Checklist on essential delivery practices and birth outcomes: Evidence from a pair-wise matched randomized controlled trial in Pakistan

We study the effect of the Safe Childbirth Checklist (SCC) - a tool developed by the WHO to improve the quality of delivery care - on a range of provider- and patient-level outcomes. We conducted a clustered pair-wise matched randomized controlled trial among 166 health providers in two districts of Pakistan. This included primary and secondary health facilities as well as non-facility based rural health workers. We do not find positive effects on health outcomes, but on the adherence to some essential delivery practices, mostly to those conducted during the patient's admission to the delivery ward. We also find increased rates of referrals to higher-level facilities.

Early essential newborn care in national tertiary hospitals in Cambodia and Lao People's Democratic Republic: a cross-sectional study

BACKGROUND

Ministries of health in collaboration with the World Health Organization Regional Office for the Western Pacific (WPRO) have been scaling up early essential newborn care (EENC). This study was carried out to understand current EENC practices at hospitals in two priority countries: the Kingdom of Cambodia (Cambodia) and Lao People's Democratic Republic (Lao PDR).

METHODS

EENC is subdivided into 79 checkpoints, referencing the self-monitoring checklist developed by the WPRO. Each checkpoint is rated using a 0 to 2-point scale, and a percentage was calculated for the rate of practice of each checkpoint by dividing the total scores by the maximum possible scores.

RESULTS

In total, 55 and 56 deliveries were observed in Cambodia and Lao PDR, respectively, and 35 and 34 normal deliveries were included in the analysis. The overall rates of the practices within the first 15 minutes after birth were high in both countries. The rates of the practices before birth and 15 minutes after birth were lower than the rates of the practices performed within the first 15 minutes after birth, especially "hand wash before preparation", "preparation for newborn resuscitation", and "monitoring of postpartum mothers and babies". A detailed analysis revealed that the quality of the practices differed between the two countries regarding skin-to-skin contact and breastfeeding support.

CONCLUSIONS

The high rates of the practices within the first 15 minutes after birth suggest that the EENC coaching sessions supported by ministries of health and the WPRO have been effective. Differences in the quality of practices performed at a high rate between the two countries appeared to be related to factors such as the timing of the study, the perception of the staff, and the situation at the health facilities. These differences and identified practices with lower rates should be improved according to the situation in each country or health facility. Therefore, determining the quality of the practices in a country or a health facility is important. To further improve the quality of EENC, interventions tailored to the specific situation are necessary.

Effects of the World Health Organization Safe Childbirth Checklist on Quality of Care and Birth Outcomes in Aceh, Indonesia: A Cluster-Randomized Clinical Trial

Importance

To address major causes of perinatal and maternal mortality, the World Health Organization developed the Safe Childbirth Checklist (SCC), which to our knowledge has been rigorously evaluated only in combination with high-intensity coaching.

Objective

To evaluate the effect of the SCC with medium-intensity coaching on health care workers' performance of essential birth practices.

Design, Setting, and Participants

This cluster randomized clinical trial without blinding included 32 hospitals and community health centers in the province of Aceh, Indonesia (a medium-resource setting) that met the criterion of providing at least basic emergency obstetric and newborn care. Baseline data were collected from August to October 2016, and outcomes were measured from March to April 2017. Data were analyzed from January 2020 to October 2021.

Interventions

After applying an optimization method, facilities were randomly assigned to the treatment or control group (16 facilities each). The SCC with 11 coaching visits was implemented during a 6-month period.

Main Outcomes and Measures

For the primary outcome, clinical observers documented whether 36 essential birth practices were applied at treatment and control facilities at 1 or more of 4 pause points during the birthing process (admission to the hospital, just before pushing or cesarean delivery, soon after birth, and before hospital discharge). Probability models for binary outcome measures were estimated using ordinary least-squares regressions, complemented by Firth logit and complier average causal effect estimations.

Results

Among the 32 facilities that participated in the trial, a significant increase of up to 41 percentage points was observed in the application of 5 of 36 essential birth practices in the 16 treatment facilities compared with the 16 control facilities, including communication of danger signs at admission (treatment: 136 of 155 births [88%]; control: 79 of 107 births [74%]), measurement of neonatal temperature (treatment: 9 of 31 births [29%]; control: 1 of 20 births [5%]), newborn feeding checks (treatment: 22 of 34 births [65%]; control: 5 of 21 births [24%]), and the rate of communication of danger signs to mothers and birth companions verbally (treatment: 30 of 36 births [83%]; control: 14 of 22 births [64%]) and in a written format (treatment: 3 of 24 births [13%]; control: 0 of 16 births [0%]).

Conclusions and Relevance

In this cluster randomized clinical trial, health facilities that implemented the SCC with medium-intensity coaching had an increased rate of application for 5 of 36 essential birth practices compared with the control facilities. Medium-intensity coaching may not be sufficient to increase uptake of the SCC to a satisfying extent, but it may be worthwhile to assess a redesigned coaching approach prompting long-term behavioral change and, therefore, effectiveness.

Trial Registration

isrctn.org Identifier: ISRCTN11041580.

Human-centered implementation research: a new approach to develop and evaluate implementation strategies for strengthening referral networks for hypertension in western Kenya

BACKGROUND

Human-centered design (HCD) is an increasingly recognized approach for engaging stakeholders and developing contextually appropriate health interventions. As a component of the ongoing STRENGTHS study (Strengthening Referral Networks for Management of Hypertension Across the Health System), we report on the process and outcomes of utilizing HCD to develop the implementation strategy prior to a cluster-randomized controlled trial.

METHODS

We organized a design team of 15 local stakeholders to participate in an HCD process to develop implementation strategies. We tested prototypes for acceptability, appropriateness, and feasibility through focus group discussions (FGDs) with various community stakeholder groups and a pilot study among patients with hypertension. FGD transcripts underwent content analysis, and pilot study data were analyzed for referral completion and reported barriers to referral. Based on this community feedback, the design team iteratively updated the implementation strategy. During each round of updates, the design team reflected on their experience through FGDs and a Likert-scale survey.

RESULTS

The design team developed an implementation strategy consisting of a combined peer navigator and a health information technology (HIT) package. Overall, community participants felt that the strategy was acceptable, appropriate, and feasible. During the pilot study, 93% of referrals were completed. FGD participants felt that the implementation strategy facilitated referral completion through active peer engagement; enhanced communication between clinicians, patients, and health administrators; and integrated referral data into clinical records. Challenges included referral barriers that were not directly addressed by the strategy (e.g. transportation costs) and implementation of the HIT package across multiple health record systems. The design team reflected that all members contributed significantly to the design process, but emphasized the need for more transparency in how input from study investigators was incorporated into design team discussions.

CONCLUSIONS

The adaptive process of co-creation, prototyping, community feedback, and iterative redesign aligned our implementation strategy with community stakeholder priorities. We propose a new framework of human-centered implementation research that promotes collaboration between community stakeholders, study investigators, and the design team to develop, implement, and evaluate HCD products for implementation research. Our experience provides a feasible and replicable approach for implementation research in other settings.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT02501746 , registration date: July 17, 2015.

Aiming for quality: a global compass for national learning systems

INTRODUCTION

Transforming a health system into a learning one is increasingly recognized as necessary to support the implementation of a national strategic direction on quality with a focus on frontline experience. The approach to a learning system that bridges the gap between practice and policy requires active exploration.

METHODS

This scoping review adapted the methodological framework for scoping studies from Arksey and O'Malley. The central research question focused on common themes for learning to improve the quality of health services at all levels of the national health system, from government policy to point-of-care delivery.

RESULTS

A total of 3507 records were screened, resulting in 101 articles on strategic learning across the health system: health professional level (19%), health organizational level (15%), subnational/national level (26%), multiple levels (35%), and global level (6%). Thirty-five of these articles focused on learning systems at multiple levels of the health system. A national learning system requires attention at the organizational, subnational, and national levels guided by the needs of patients, families, and the community. The compass of the national learning system is centred on four cross-cutting themes across the health system: alignment of priorities, systemwide collaboration, transparency and accountability, and knowledge sharing of real-world evidence generated at the point of care.

CONCLUSION

This paper proposes an approach for building a national learning system to improve the quality of health services. Future research is needed to validate the application of these guiding principles and make improvements based on the findings.

ANALYSIS OF "LEARN-AS-YOU-GO" (LAGO) STUDIES

In Learn-As-you-GO (LAGO) adaptive studies, the intervention is a complex multicomponent package, and is adapted in stages during the study based on past outcome data. This design formalizes standard practice in public health intervention studies. An effective intervention package is sought, while minimizing intervention package cost. In LAGO study data, the interventions in later stages depend upon the outcomes in the previous stages, violating standard statistical theory. We develop an estimator for the intervention effects, and prove consistency and asymptotic normality using a novel coupling argument, ensuring the validity of the test for the hypothesis of no overall intervention effect. We develop a confidence set for the optimal intervention package and confidence bands for the success probabilities under alternative package compositions. We illustrate our methods in the BetterBirth Study, which aimed to improve maternal and neonatal outcomes among 157,689 births in Uttar Pradesh, India through a multicomponent intervention package.

Improving the quality of childbirth services in Zambia through introduction of the Safe Childbirth Checklist and systems-focused mentorship

Although strong evidence exists about the effectiveness of basic childbirth services in reducing maternal and newborn mortality, these services are not provided in every childbirth, even those at health facilities. The WHO Safe Childbirth Checklist (SCC) was developed as a job aide to remind health workers of evidenced-based practices to be provided at specific points in the childbirth process. The Zambian government requested context-specific evidence on the feasibility and outcomes associated with introducing the checklist and related mentorship. A study was conducted on use of the SCC in four facilities in Nchelenge District of Zambia. Observations of childbirth services were conducted just before and six months after the introduction of the intervention. Observers used a structured tool to record adherence to essential services indicated on the checklist. The primary outcome of interest was the change in the average proportion of essential childbirth practices completed. Feedback questionnaires were administered to health workers before and six months after the intervention. At baseline and endline, 108 and 148 pause points were observed, respectively. There was an increase from 57% to 76% of tasks performed (p = 0.04). Considering only these cases where necessary supplies were available, health workers completed 60% of associated tasks at baseline compared to 84% at endline (p<0.01). Some tasks, such as taking an infant's temperature and hand washing, were never or rarely performed at baseline. Feedback from the health workers indicated that nearly all health workers agreed or strongly agreed with positive statements about the intervention. The performance of health workers in Zambia in completing essential practices in childbirth was low at baseline but improvements were observed with the introduction of the SCC and mentorship. Our results suggest that such interventions could improve quality of care for facility-based childbirth. However, national-level commitment to ensuring availability of trained staff and supplies is essential for success. Trial registration Clinical Trials.gov (NCT03263182) Registered August 28, 2017 This study adheres to CONSORT guidelines.

Evaluating implementation strategies for essential newborn care interventions in low- and low middle-income countries: a systematic review

Neonatal mortality remains a significant health problem in low-income settings. Low-cost essential newborn care (ENC) interventions with proven efficacy and cost-effectiveness exist but have not reached high coverage (≥90%). Little is known about the strategies used to implement these interventions or how they relate to improved coverage. We conducted a systematic review of implementation strategies and implementation outcomes for ENC in low- and low middle-income countries capturing evidence from five medical and global health databases from 1990 to 2018. We included studies of implementation of delayed cord clamping, immediate drying, skin-to-skin contact (SSC) and/or early initiation of breastfeeding implemented in the first hour (facility-based studies) or the 1st day (community-based studies) of life. Implementation strategies and outcomes were categorized according to published frameworks: Expert Recommendations for Implementing Change and Outcomes for Implementation Research. The relationship between implementation strategies and outcomes was evaluated using standardized mean differences and correlation coefficients. Forty-three papers met inclusion criteria. Interventions included community-based care/health promotion and facility-based support and health care provider training. Included studies used 3-31 implementation strategies, though the consistency with which strategies were applied was variable. Conduct educational meetings was the most frequently used strategy. Included studies reported 1-4 implementation outcomes with coverage reported most frequently. Heterogeneity was high and no statistically significant association was found between the number of implementation strategies used and coverage of ENC. This review highlights several challenges in learning from implementation of ENC in low- and low middle-income countries, particularly poor description of interventions and implementation outcomes. We recommend use of UK Medical Research Council guidelines (2015) for process evaluations and checklists for reporting implementation studies. Improved reporting of implementation research in this setting is necessary to learn how to improve service delivery and outcomes and thereby reduce neonatal mortality.

Human-centered design as a guide to intervention planning for non-communicable diseases: the BIGPIC study from Western Kenya

BACKGROUND

Non-communicable disease (NCD) care in Sub-Saharan Africa is challenging due to barriers including poverty and insufficient health system resources. Local culture and context can impact the success of interventions and should be integrated early in intervention design. Human-centered design (HCD) is a methodology that can be used to engage stakeholders in intervention design and evaluation to tailor-make interventions to meet their specific needs.

METHODS

We created a Design Team of health professionals, patients, microfinance officers, community health workers, and village leaders. Over 6 weeks, the Design Team utilized a four-step approach of synthesis, idea generation, prototyping, and creation to develop an integrated microfinance-group medical visit model for NCD. We tested the intervention with a 6-month pilot and conducted a feasibility evaluation using focus group discussions with pilot participants and community members.

RESULTS

Using human-centered design methodology, we designed a model for NCD delivery that consisted of microfinance coupled with monthly group medical visits led by a community health educator and a rural clinician. Benefits of the intervention included medication availability, financial resources, peer support, and reduced caregiver burden. Critical concerns elicited through iterative feedback informed subsequent modifications that resulted in an intervention model tailored to the local context.

CONCLUSIONS

Contextualized interventions are important in settings with multiple barriers to care. We demonstrate the use of HCD to guide the development and evaluation of an innovative care delivery model for NCDs in rural Kenya. HCD can be used as a framework to engage local stakeholders to optimize intervention design and implementation. This approach can facilitate the development of contextually relevant interventions in other low-resource settings.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT02501746, registration date: July 17, 2015.

Coaching Intensity, Adherence to Essential Birth Practices, and Health Outcomes in the BetterBirth Trial in Uttar Pradesh, India

BACKGROUND

Coaching can improve the quality of care in primary-level birth facilities and promote birth attendant adherence to essential birth practices (EBPs) that reduce maternal and perinatal mortality. The intensity of coaching needed to promote and sustain behavior change is unknown. We investigated the relationship between coaching intensity, EBP adherence, and maternal and perinatal health outcomes using data from the BetterBirth Trial, which assessed the impact of a complex, coaching-based implementation of the World Health Organization's Safe Childbirth Checklist in Uttar Pradesh, India.

METHODS

For each birth, we defined multiple coaching intensity metrics, including coaching frequency (coaching visits per month), cumulative coaching (total coaching visits accrued during the intervention), and scheduling adherence (coaching delivered as scheduled). We considered coaching delivered at both facility and birth attendant levels. We assessed the association between coaching intensity and birth attendant adherence to 18 EBPs and with maternal and perinatal health outcomes using regression models.

RESULTS

Coaching frequency was associated with modestly increased EBP adherence. Delivering 6 coaching visits per month to facilities was associated with adherence to 1.3 additional EBPs (95% confidence interval [CI]=0.6, 1.9). High-frequency coaching delivered with high coverage among birth attendants was associated with greater improvements: providing 70% of birth attendants at a facility with at least 1 visit per month was associated with adherence to 2.0 additional EBPs (95% CI=1.0, 2.9). Neither cumulative coaching nor scheduling adherence was associated with EBP adherence. Coaching was generally not associated with health outcomes, possibly due to the small magnitude of association between coaching and EBP adherence.

CONCLUSIONS

Frequent coaching may promote behavior change, especially if delivered with high coverage among birth attendants. However, the effects of coaching were modest and did not persist over time, suggesting that future coaching-based interventions should explore providing frequent coaching for longer periods.

Optimizing the development and evaluation of complex interventions: lessons learned from the BetterBirth Program and associated trial

BACKGROUND

Despite extensive efforts to develop and refine intervention packages, complex interventions often fail to produce the desired health impacts in full-scale evaluations. A recent example of this phenomenon is BetterBirth, a complex intervention designed to implement the World Health Organization's Safe Childbirth Checklist and improve maternal and neonatal health. Using data from the BetterBirth Program and its associated trial as a case study, we identified lessons to assist in the development and evaluation of future complex interventions.

METHODS

BetterBirth was refined across three sequential development phases prior to being tested in a matched-pair, cluster randomized trial in Uttar Pradesh, India. We reviewed published and internal materials from all three development phases to identify barriers hindering the identification of an optimal intervention package and identified corresponding lessons learned. For each lesson, we describe its importance and provide an example motivated by the BetterBirth Program's development to illustrate how it could be applied to future studies.

RESULTS

We identified three lessons: (1) develop a robust theory of change (TOC); (2) define optimization outcomes, which are used to assess the effectiveness of the intervention across development phases, and corresponding criteria for success, which determine whether the intervention has been sufficiently optimized to warrant full-scale evaluation; and (3) create and capture variation in the implementation intensity of components. When applying these lessons to the BetterBirth intervention, we demonstrate how a TOC could have promoted more complete data collection. We propose an optimization outcome and related criteria for success and illustrate how they could have resulted in additional development phases prior to the full-scale trial. Finally, we show how variation in components' implementation intensities could have been used to identify effective intervention components.

CONCLUSION

These lessons learned can be applied during both early and advanced stages of complex intervention development and evaluation. By using examples from a real-world study to demonstrate the relevance of these lessons and illustrating how they can be applied in practice, we hope to encourage future researchers to collect and analyze data in a way that promotes more effective complex intervention development and evaluation.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02148952; registered on May 29, 2014.

Continued nursing education in low-income and middle-income countries: a narrative synthesis

Introduction

Continued nursing education and development can reduce mortality and morbidity of patients and can alleviate the shortage of healthcare workers by training of nurses for high-demand skill sets. We reviewed patterns of educational interventions and strategies in initiating behaviour change, improving patient outcomes or knowledge for nurses in low- and middle-income countries (LMICs).

Methods

The study searched the MEDLINE (PubMed), Embase, CINAHL, Google Scholar and Web of Science databases. The study included interventional studies on continued nursing education from 2007 to 2017. Of the 6216 publications retrieved, 98 articles were included and analysed by three independent reviewers.

Results

Of the 98 studies that met inclusion criteria, five were randomised controlled trials, two were qualitative in design and the remaining 91 were quasi-experimental, before-and-after studies. Of these studies, the median sample size of participants was 64, and the majority were conducted in Asia (53.1%). During the 10-year study period, 20.4% was conducted in 2015, the highest proportion, with a general increase in number of studies over time from 2007 to 2017. Main themes that arose from the review included train-the-trainer models, low-dose/high-frequency models, use of multiple media for training, and emphasis on nurse empowerment, strong international partnerships, and the integration of cultural context. Overall, the studies were limited in quality and lacked rigorous study design.

Conclusion

Continued nursing education in LMICs is essential and effective in improving nurses’ knowledge base, and thus patient outcomes and quality of care. Long-term, randomised studies are needed to understand how training strategies compare in impact on nurses and patients.

Availability of Safe Childbirth Supplies in 284 Facilities in Uttar Pradesh, India

Objectives Vital to implementation of the World Health Organization (WHO) Safe Childbirth Checklist (SCC), designed to improve delivery of 28 essential birth practices (EBPs), is the availability of safe birth supplies: 22 EBPs on the SCC require one or more supplies. Mapping availability of these supplies can determine the scope of shortages and need for supply chain strengthening. Methods A cross-sectional survey on the availability of functional and/or unexpired supplies was assessed in 284 public-sector facilities in 38 districts in Uttar Pradesh, India. The twenty-three supplies were categorized into three non-mutually exclusive groups: maternal (8), newborn (9), and infection control (6). Proportions and mean number of supplies available were calculated; means were compared across facility types using t-tests and across districts using a one-way ANOVA. Log-linear regression was used to evaluate facility characteristics associated with supply availability. Results Across 284 sites, an average of 16.9 (73.5%) of 23 basic childbirth supplies were available: 63.4% of maternal supplies, 79.1% of newborn supplies, and 78.7% of infection control supplies. No facility had all 23 supplies available and only 8.5% had all four medicines assessed. Significant variability was observed by facility type and district. In the linear model, facility type and distance from district hospital were significant predictors of higher supply availability. Conclusions for Practice In Uttar Pradesh, more remote sites, and primary and community health centers, were at higher risk of supply shortages. Supply chain management must be improved for facility-based delivery and quality of care initiatives to reduce maternal and neonatal harm.

How is implementation research applied to advance health in low-income and middle-income countries?

This paper examines the characteristics of implementation research (IR) efforts in low-income and middle-income countries (LMICs) by describing how key IR principles and concepts have been used in published health research in LMICs between 1998 and 2016, with focus on how to better apply these principles and concepts to support large-scale impact of health interventions in LMICs. There is a stark discrepancy between principles of IR and what has been published. Most IR studies have been conducted under conditions where the researchers have considerable influence over implementation and with extra resources, rather than in ‘real world’ conditions. IR researchers tend to focus on research questions that test a proof of concept, such as whether a new intervention is feasible or can improve implementation. They also tend to use traditional fixed research designs, yet the usual conditions for managing programmes demand continuous learning and change. More IR in LMICs should be conducted under usual management conditions, employ pragmatic research paradigm and address critical implementation issues such as scale-up and sustainability of evidence-informed interventions. This paper describes some positive examples that address these concerns and identifies how better reporting of IR studies in LMICs would include more complete descriptions of strategies, contexts, concepts, methods and outcomes of IR activities. This will help practitioners, policy-makers and other researchers to better learn how to implement large-scale change in their own settings.

Impact of the Safe Childbirth Checklist on health worker childbirth practices in Luapula province of Zambia: a pre-post study

Background

A strong evidence base exists regarding routine and emergency services that can effectively prevent or reduce maternal and new-born mortality. However, even when skilled providers care for women in labour, many of the recommended services are not provided, despite being available. Barriers to the provision of appropriate childbirth services may include lack of availability of supplies, limited health worker knowledge and confidence, or inadequate time. The WHO Safe Childbirth Checklist (SCC) includes reminders for evidenced-based practices at specific points in the childbirth process. Zambia is currently considering nation-wide adoption of the SCC, but there is a need for context-specific evidence. Beginning in September 2017, a program is being implemented in Nchelenge District to pilot use of the SCC, along with coaching that focuses on strengthening the systems that allow the essential practices in childbirth to be performed.

Methods

This study will use a pre-post study design to measure health worker adherence to the essential practices for delivery care outlined in the SCC. Data will be collected through observations of health workers as they care for mothers during childbirth at four facilities. Data collection will take place before the start of the intervention, at 3 months, and at 6 months post-intervention. The primary outcome interest is the change in the average proportion of essential childbirth practices completed. A health worker questionnaire will be administered at the time that the SCC is introduced and 6 months later to gather their perspectives on incorporating the SCC into clinical practice in Zambia.

Discussion

Findings are expected to inform plans for introducing the SCC in Zambia. This evaluation will aim to understand uptake and impact of the SCC and associated coaching in the context of a basic level of mentorship that the government could feasibly provide at a national scale.

Trial registration

Clinical Trials.gov (NCT03263182) Registered August 28, 2017.

Integration of the Opportunity-Ability-Motivation behavior change framework into a coaching-based WHO Safe Childbirth Checklist program in India

Objective

To evaluate whether integration of the Opportunity‐Ability‐Motivation plus Supplies (OAMS) framework into coaching improved the delivery of essential birth practices in a low‐resource setting.

Methods

This prospective mixed‐methods study used routine coaching visit data obtained from the first eight intervention facilities of the BetterBirth trial in Uttar Pradesh, India, between December 19, 2014, and October 21, 2015. The 8‐month intervention was peer coaching that integrated the OAMS framework to support uptake of the WHO Safe Childbirth Checklist. Descriptive statistics were used to measure nonadherence to essential birth practices. The frequency and accuracy of coaches’ coding of barriers and the appropriateness of chosen resolution strategies to measure feasibility, acceptability, and fidelity of using OAMS, were assessed.

Results

Coaches observed 666 deliveries, including 12 602 practices. Overall, essential practice nonadherence decreased from 15.6% (262/1675 practices observed) to 4.5% (4/88 practices) (P<0.001). Of the 1048 barriers identified, opportunity (556 [53.1%]) and motivation (287 [27.4%]) were the most frequently reported categories; the frequency of both decreased over time (P=0.003 and P<0.001, respectively). The coaches appropriately categorized 930 (99.8%) of 932 barriers and provided an appropriate strategy for 800 (85.8%). The commonest reason for unaddressed barriers was lack of coaching opportunities.

Conclusion

Successful integration of OAMS framework into delivery attendant coaching enabled coaches to rapidly diagnose barriers to practice adherence and develop responsive strategies.

ClinicalTrials.gov

NCT2148952 (WHO Universal Trial Number: U11111‐1315‐647).

Using a modified behavior change framework, peer‐coaches were able to identify barriers to the provision of essential delivery practices and design problem‐solving interventions.

Acculturation, Cultural Values, and Breastfeeding in Overweight or Obese, Low-Income, Hispanic Women at 1 Month Postpartum

BACKGROUND

Most Hispanic infants are fed formula during the first 6 weeks, and although 80% of Hispanic women initiate breastfeeding, rates of exclusive breastfeeding are much lower. Research aim: The purpose was to examine the influence of acculturation and cultural values on the breastfeeding practices of pregnant women of Mexican descent participating in the Special Supplemental Nutrition Program for Women, Infants, and Children who were enrolled in a prospective randomized clinical trial that aimed to reduce child obesity. The data were abstracted from a larger randomized clinical trial focused on prevention of child obesity.

METHODS

The sample consisted of 150 women of Mexican origin who were enrolled at the time of these analyses from the randomized clinical trial and had a prepregnancy body mass index of ≥ 25 and spoke English and/or Spanish. All breastfeeding data for this report came from data collection at 1 month postpartum.

RESULTS

A higher score on the Anglo orientation scale of the Acculturation Rating Scale for Mexican Americans was associated with less breastfeeding at 1 month postpartum and less exclusive breastfeeding.

CONCLUSION

Acculturation plays a role in breastfeeding practice. Exploring acculturation associated with breastfeeding can guide us to design culturally relevant interventions to promote breastfeeding exclusivity among immigrant mothers.

Implementing the World Health Organization safe childbirth checklist in a district Hospital in Rwanda: a pre- and post-intervention study

Background

Worldwide maternal mortality remains high, with approximately 830 maternal deaths occurring each day. About 90% of these deaths occur in low-income countries. Evidenced-based essential birth practices administered during routine obstetrical care and childbirth are key to reducing maternal and neonatal deaths. The WHO Safe Childbirth Checklist (SCC) is a low-cost tool designed to ensure birth attendants perform 29 essential birth practices (EBP) at four critical periods in the birth continuum. This study aimed to evaluate compliance with EBP in Masaka District Hospital both before and after the implementation of the WHO-SCC.

Methods

This quality improvement project took place in the Masaka District Hospital in Rwanda. Observations of the 29 EBPs were done before and after WHO SCC implementation. The implementation process consisted of providing training in the use of the checklist to all clinical staff and posting SCC posters at different locations in the maternity unit.

Results

A total 391 birth events were observed pre-intervention and 389 post-intervention. The overall EBP compliance rate increased from 46% pre-intervention to 56% post-intervention (P = 0.005). Significant improvements were seen in 11 out of 29 EBPs.

Conclusion

The implementation of the WHO SCC improved the overall EBP compliance rate in Masaka District Hospital. Determining the root cause of low compliance rate of some EBP may allow for more successful implementation of EBP interventions in the future. After further study, the SCC should be considered for scale up.

Outcomes of a Coaching-Based WHO Safe Childbirth Checklist Program in India

BACKGROUND

The prevalence of facility-based childbirth in low-resource settings has increased dramatically during the past two decades, yet gaps in the quality of care persist and mortality remains high. The World Health Organization (WHO) Safe Childbirth Checklist, a quality-improvement tool, promotes systematic adherence to practices that have been associated with improved childbirth outcomes.

METHODS

We conducted a matched-pair, cluster-randomized, controlled trial in 60 pairs of facilities across 24 districts of Uttar Pradesh, India, testing the effect of the BetterBirth program, an 8-month coaching-based implementation of the Safe Childbirth Checklist, on a composite outcome of perinatal death, maternal death, or maternal severe complications within 7 days after delivery. Outcomes - assessed 8 to 42 days after delivery - were compared between the intervention group and the control group with adjustment for clustering and matching. We also compared birth attendants' adherence to 18 essential birth practices in 15 matched pairs of facilities at 2 and 12 months after the initiation of the intervention.

RESULTS

Of 161,107 eligible women, we enrolled 157,689 (97.9%) and determined 7-day outcomes for 157,145 (99.7%) mother-newborn dyads. Among 4888 observed births, birth attendants' mean practice adherence was significantly higher in the intervention group than in the control group (72.8% vs. 41.7% at 2 months; 61.7% vs. 43.9% at 12 months; P<0.001 for both comparisons). However, there was no significant difference between the trial groups either in the composite primary outcome (15.1% in the intervention group and 15.3% in the control group; relative risk, 0.99; 95% confidence interval, 0.83 to 1.18; P=0.90) or in secondary maternal or perinatal adverse outcomes.

CONCLUSIONS

Birth attendants' adherence to essential birth practices was higher in facilities that used the coaching-based WHO Safe Childbirth Checklist program than in those that did not, but maternal and perinatal mortality and maternal morbidity did not differ significantly between the two groups. (Funded by the Bill and Melinda Gates Foundation; Clinical Trials number, NCT02148952 .).

[Assessment of adherence to the Safe Childbirth Checklist in a public maternity hospital in Northeast Brazil]

Decreasing childbirth-related mortality is a current global health priority. The World Health Organization developed the Safe Childbirth Checklist to reduce adverse events in maternal and perinatal care, using simple and effective practices. The current study aims to evaluate adherence to the checklist by professionals in a maternity hospital in Natal, Rio Grande do Norte State, Brazil. The study used an observational, cross-sectional approach to evaluate all births in three months, with data collected from patient charts. Adherence was described on the basis of presence and quality of the checklist's completion, and bivariate analysis was performed using the association with childbirth-related factors. Of 978 patient charts that were reviewed, 71% had the list, an average of 24% of the items were completed, but only 0.1% of the patient charts were totally completed; better completion was seen in vaginal deliveries and at the time of patient admission. Checklist adherence showed limitations that are inherent to the adoption of a new safety routine and requires continuous training of the health professionals to achieve better results.

Improving Neonatal Care: A Global Perspective

Each year, approximately 2.7 million babies die during the neonatal period; more than 90% of these deaths occur in developing countries, largely from preventable causes. The known, evidence-based, simple, low-cost interventions that may improve neonatal survival often have low or unknown baseline coverage rates. Gaps in coverage of essential interventions and in quality of care may be amenable to improvement strategies. However, often these gaps are not easily identified. A variety of international organizations have recommended key indicators of quality and established roadmaps for improving neonatal outcomes. Quality improvement at the facility level is an area for future investment.

Implementing the WHO Safe Childbirth Checklist: lessons from a global collaboration

The WHO Safe Childbirth Checklist (SCC) was developed to ensure the delivery of essential maternal and perinatal care practices around the time of childbirth. A research collaboration was subsequently established to explore factors that influence use of the Checklist in a range of settings around the world. This analysis article presents an overview of the WHO SCC Collaboration and the lessons garnered from implementing the Checklist across a diverse range of settings. Project leads from each collaboration site were asked to distribute two surveys. The first was given to end users, and the second to implementation teams to describe their respective experiences using the Checklist. A total of 134 end users and 38 implementation teams responded to the surveys, from 19 countries across all levels of income. End users were willing to adopt the SCC and found it easy to use. Training and the provision of supervision while using the Checklist, alongside leadership engagement and local ownership, were important factors which helped facilitate initial implementation and successful uptake of the Checklist. Teams identified several challenges, but more importantly successfully implemented the WHO SCC. A critical step in all settings was the adaptation of the Checklist to reflect local context and national protocols and standards. These findings were invaluable in developing the final version of the WHO SCC and its associated implementation guide. Our experience will provide useful insights for any institution wishing to implement the Checklist.

Improving Adherence to Essential Birth Practices Using the WHO Safe Childbirth Checklist With Peer Coaching: Experience From 60 Public Health Facilities in Uttar Pradesh, India

Implementation of the WHO Safe Childbirth Checklist with peer coaching resulted in >90% adherence to 35 of 39 essential birth practices among birth attendants after 8 months, but adherence to some practices was lower when the coach was absent.

Background:

Adherence to evidence-based essential birth practices is critical for improving health outcomes for mothers and newborns. The WHO Safe Childbirth Checklist (SCC) incorporates these practices, which occur during 4 critical pause points: on admission, before pushing (or cesarean delivery), soon after birth, and before discharge. A peer-coaching strategy to support consistent use of the SCC may be an effective approach to increase birth attendants' adherence to these practices.

Methods:

We assessed data from 60 public health facilities in Uttar Pradesh, India, that received an 8-month staggered coaching intervention from December 2014 to September 2016 as part of the BetterBirth Trial, which is studying effectiveness of an SCC-centered intervention on maternal and neonatal harm. Nurse coaches recorded birth attendants' adherence to 39 essential birth practices. Practice adherence was calculated for each intervention month. After 2 months of coaching, a subsample of 15 facilities was selected for independent observation when the coach was not present. We compared adherence to the 18 practices recorded by both coaches and independent observers.

Results:

Coaches observed birth attendants' behavior during 5,971 deliveries. By the final month of the intervention, 35 of 39 essential birth practices had achieved >90% adherence in the presence of a coach, compared with only 7 of 39 practices during the first month. Key behaviors with the greatest improvement included explanation of danger signs, temperature measurement, assessment of fetal heart sounds, initiation of skin-to-skin contact, and breastfeeding. Without a coach present, birth attendants' average adherence to practices and checklist use was 24 percentage points lower than when a coach was present (range: −1% to 62%).

Conclusion:

Implementation of the WHO Safe Childbirth Checklist with coaching improved uptake of and adherence to essential birth practices. Coordination and communication among facility staff, as well as behaviors with an immediate, tangible benefit, showed the greatest improvement. Difficult-to-perform behaviors and those with delayed or theoretical benefits were less likely to be sustained without a coach present. Coaching may be an important component in implementing the Safe Childbirth Checklist at scale. (After publication of this article, the impact results of the BetterBirth intervention were published in the New England Journal of Medicine [volume 377, pages 2313-2324, doi: 10.1056/NEJMoa1701075]. The results showed that the intervention had no significant effect on maternal or perinatal mortality or maternal morbidity, despite having positive effects on essential birth practices.)

The BetterBirth Program: Pursuing Effective Adoption and Sustained Use of the WHO Safe Childbirth Checklist Through Coaching-Based Implementation in Uttar Pradesh, India

The BetterBirth Program relied on carefully structured coaching that was multilevel, collaborative, and provider-centered to motivate birth attendants to use the WHO Safe Childbirth Checklist and improve adherence to essential birth practices. It was scaled to 60 sites as part of a randomized controlled trial in Uttar Pradesh, India.

Shifting childbirth into facilities has not improved health outcomes for mothers and newborns as significantly as hoped. Improving the quality and safety of care provided during facility-based childbirth requires helping providers to adhere to essential birth practices—evidence-based behaviors that reduce harm to and save lives of mothers and newborns. To achieve this goal, we developed the BetterBirth Program, which we tested in a matched-pair, cluster-randomized controlled trial in Uttar Pradesh, India. The goal of this intervention was to improve adoption and sustained use of the World Health Organization Safe Childbirth Checklist (SCC), an organized collection of 28 essential birth practices that are known to improve the quality of facility-based childbirth care. Here, we describe the BetterBirth Program in detail, including its 4 main features: implementation tools, an implementation strategy of coaching, an implementation pathway (Engage-Launch-Support), and a sustainability plan. This coaching-based implementation of the SCC motivates and empowers care providers to identify, understand, and resolve the barriers they face in using the SCC with the resources already available. We describe important lessons learned from our experience with the BetterBirth Program as it was tested in the BetterBirth Trial. For example, the emphasis on relationship building and respect led to trust between coaches and birth attendants and helped influence change. In addition, the cloud-based data collection and feedback system proved a valuable asset in the coaching process. More research on coaching-based interventions is required to refine our understanding of what works best to improve quality and safety of care in various settings. (After publication of this article, the impact results of the BetterBirth intervention were published in the New England Journal of Medicine [volume 377, pages 2313-2324, doi: 10.1056/NEJMoa1701075]. The results showed that the intervention had no significant effect on maternal or perinatal mortality or maternal morbidity, despite having positive effects on essential birth practices.)

Effectiveness of the WHO Safe Childbirth Checklist program in reducing severe maternal, fetal, and newborn harm in Uttar Pradesh, India: study protocol for a matched-pair, cluster-randomized controlled trial

Background

Effective, scalable strategies to improve maternal, fetal, and newborn health and reduce preventable morbidity and mortality are urgently needed in low- and middle-income countries. Building on the successes of previous checklist-based programs, the World Health Organization (WHO) and partners led the development of the Safe Childbirth Checklist (SCC), a 28-item list of evidence-based practices linked with improved maternal and newborn outcomes. Pilot-testing of the Checklist in Southern India demonstrated dramatic improvements in adherence by health workers to essential childbirth-related practices (EBPs). The BetterBirth Trial seeks to measure the effectiveness of SCC impact on EBPs, deaths, and complications at a larger scale.

Methods/design

This matched-pair, cluster-randomized controlled, adaptive trial will be conducted in 120 facilities across 24 districts in Uttar Pradesh, India. Study sites, identified according to predefined eligibility criteria, were matched by measured covariates before randomization. The intervention, the SCC embedded in a quality improvement program, consists of leadership engagement, a 2-day educational launch of the SCC, and support through placement of a trained peer “coach” to provide supportive supervision and real-time data feedback over an 8-month period with decreasing intensity. A facility-based childbirth quality coordinator is trained and supported to drive sustained behavior change after the BetterBirth team leaves the facility.

Study participants are birth attendants and women and their newborns who present to the study facilities for childbirth at 60 intervention and 60 control sites. The primary outcome is a composite measure including maternal death, maternal severe morbidity, stillbirth, and newborn death, occurring within 7 days after birth. The sample size (n = 171,964) was calculated to detect a 15% reduction in the primary outcome. Adherence by health workers to EBPs will be measured in a subset of births (n = 6000).

The trial will be conducted in close collaboration with key partners including the Governments of India and Uttar Pradesh, the World Health Organization, an expert Scientific Advisory Committee, an experienced local implementing organization (Population Services International, PSI), and frontline facility leaders and workers.

Discussion

If effective, the WHO Safe Childbirth Checklist program could be a powerful health facility-strengthening intervention to improve quality of care and reduce preventable harm to women and newborns, with millions of potential beneficiaries.

Trial registration

BetterBirth Study Protocol dated: 13 February 2014; ClinicalTrials.gov: NCT02148952; Universal Trial Number: U1111-1131-5647.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-016-1673-x) contains supplementary material, which is available to authorized users.

Race to the Top: evaluation of a novel performance-based financing initiative to promote healthcare delivery in rural Rwanda

BACKGROUND

Performance-based financing (PBF) has demonstrated a range of successes and failures in improving health outcomes across low- and middle-income countries. Evidence indicates that the success of PBF depends, in large part, on the model selected, in relation to a variety of contextual factors.

OBJECTIVE

Partners In Health∣Inshuti Mu Buzima aimed to evaluate health outcomes associated with a novel capacity-building model of PBF at health centers throughout Kirehe district, Rwanda.

DESIGN

Thirteen health centers in Kirehe district, which provide healthcare to a population of over 300,000 people, agreed to participate in a PBF initiative scheme that integrated data feedback, quality improvement coaching, peer-to-peer learning, and district-level priority setting. Health centers' progress toward collectively agreed upon site-specific health targets was assessed every 6 months for 18 months. Incentives were awarded only when health centers met goals on all three priorities health centers had collectively agreed upon: 90% coverage of community-based health insurance, 70% contraceptive prevalence rate, and zero acute severe malnutrition cases. Improvement across all four time points and facilities was measured using mixed-effects linear regression.

FINDINGS

At 6-month follow-up, 4 of 13 health centers had met 1 target. At 12-month follow-up, 7 centers had met 1 target, and by 18-month follow-up, 6 centers had met 2 targets and 2 centers had met all 3. Average health center performance had improved significantly across the district for all three targets: mean insurance coverage increased from 68% at baseline to 93% (p<0.001); mean number of acute malnutrition cases in the previous 6 months declined from 24 to 5 per facility (p<0.001); and contraceptive prevalence increased from 42 to 59% (p<0.001). A number of innovative improvement initiatives were identified.

CONCLUSION

The combining of PBF, district engagement/support, and peer-to-peer learning resulted in significant improvements despite resource constraints and is now being considered as a model for scale-up in other districts of Rwanda.

Interventions for promoting the initiation of breastfeeding

BACKGROUND

Despite the widely documented risks of not breastfeeding, initiation rates remain relatively low in many high-income countries, particularly among women in lower-income groups. In low- and middle-income countries, many women do not follow World Health Organization (WHO) recommendations to initiate breastfeeding within the first hour after birth. This is an update of a Cochrane Review, first published in 2005.

OBJECTIVES

To identify and describe health promotion activities intended to increase the initiation rate of breastfeeding.To evaluate the effectiveness of different types of breastfeeding promotion activities, in terms of changing the number of women who initiate breastfeeding.To evaluate the effectiveness of different types of breastfeeding promotion activities, in terms of changing the number of women who initiate breastfeeding early (within one hour after birth).

SEARCH METHODS

We searched Cochrane Pregnancy and Childbirth's Trials Register (29 February 2016) and scanned reference lists of all articles obtained.

SELECTION CRITERIA

Randomised controlled trials (RCTs), with or without blinding, of any breastfeeding promotion intervention in any population group, except women and infants with a specific health problem.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed trial reports for inclusion, extracted data and assessed trial quality. Discrepancies were resolved through discussion and a third review author was involved when necessary. We contacted investigators to obtain missing information.

MAIN RESULTS

Twenty-eight trials involving 107,362 women in seven countries are included in this updated review. Five studies involving 3,124 women did not contribute outcome data and we excluded them from the analyses. The methodological quality of the included trials was mixed, with significant numbers of studies at high or unclear risk of bias due to: inadequate allocation concealment (N = 20); lack of blinding of outcome assessment (N = 20); incomplete outcome data (N = 19); selective reporting (N = 22) and bias from other potential sources (N = 17). Healthcare professional-led breastfeeding education and support versus standard care The studies pooled here compare professional health workers delivering breastfeeding education and support during the prenatal and postpartum periods with standard care. Interventions included promotion campaigns and counselling, and all took place in a formal setting. There was evidence from five trials involving 564 women for improved rates ofbreastfeeding initiation among women who received healthcare professional-led breastfeeding education and support (average risk ratio (RR) 1.43, 95% confidence interval (CI) 1.07 to 1.92; Tau² = 0.07, I² = 62%, low-quality evidence) compared to those women who received standard care. We downgraded evidence due to design limitations and heterogeneity. The outcome of early initiation of breastfeeding was not reported in the studies under this comparison. Non-healthcare professional-led breastfeeding education and support versus standard care There was evidence from eight trials of 5712 women for improved rates of breastfeeding initiation among women who received interventions from non-healthcare professional counsellors and support groups (average RR 1.22, 95% CI 1.06 to 1.40; Tau² = 0.02, I² = 86%, low-quality evidence) compared to women who received standard care. In three trials of 76,373 women, there was no clear difference between groups in terms of the number of women practicing early initiation of breastfeeding (average RR 1.70, 95% CI 0.98 to 2.95; Tau² = 0.18, I² = 78%, very low-quality evidence). We downgraded the evidence for a combination of design limitations, heterogeneity and imprecision (wide confidence intervals crossing the line of no effect). Other comparisonsOther comparisons in this review also looked at the rates of initiation of breastfeeding and there were no clear differences between groups for the following comparisons of combined healthcare professional-led education with peer support or community educator versus standard care (2 studies, 1371 women) or attention control (1 study, 237 women), breastfeeding education using multimedia (a self-help manual or a video) versus routine care (2 studies, 497 women); early mother-infant contact versus standard care (2 studies, 309 women); and community-based breastfeeding groups versus no breastfeeding groups (1 study, 18,603 women). None of these comparisons reported data on early initiation of breastfeeding.

AUTHORS' CONCLUSIONS

This review found low-quality evidence that healthcare professional-led breastfeeding education and non-healthcare professional-led counselling and peer support interventions can result in some improvements in the number of women beginning to breastfeed. The majority of the trials were conducted in the USA, among women on low incomes and who varied in ethnicity and feeding intention, thus limiting the generalisability of these results to other settings.Future studies would ideally be conducted in a range of low- and high-income settings, with data on breastfeeding rates over various timeframes, and explore the effectiveness of interventions that are initiated prior to conception or during pregnancy. These might include well-described interventions, including health education, early and continuing mother-infant contact, and initiatives to help mothers overcome societal barriers to breastfeeding, all with clearly defined outcome measures.