The gas cylinder, the motorcycle and the village health team member: a proof-of-concept study for the use of the Microsystems Quality Improvement Approach to strengthen the routine immunization system in Uganda

Quality improvement in public-private partnerships in low- and middle-income countries: a systematic review

BACKGROUND

Public-private partnerships (PPP) are often how health improvement programs are implemented in low-and-middle-income countries (LMICs). We therefore aimed to systematically review the literature about the aim and impacts of quality improvement (QI) approaches in PPP in LMICs.

METHODS

We searched SCOPUS and grey literature for studies published before March 2022. One reviewer screened abstracts and full-text studies for inclusion. The study characteristics, setting, design, outcomes, and lessons learned were abstracted using a standard tool and reviewed in detail by a second author.

RESULTS

We identified 9,457 citations, of which 144 met the inclusion criteria and underwent full-text abstraction. We identified five key themes for successful QI projects in LMICs: 1) leadership support and alignment with overarching priorities, 2) local ownership and engagement of frontline teams, 3) shared authentic learning across teams, 4) resilience in managing external challenges, and 5) robust data and data visualization to track progress. We found great heterogeneity in QI tools, study designs, participants, and outcome measures. Most studies had diffuse aims and poor descriptions of the intervention components and their follow-up. Few papers formally reported on actual deployment of private-sector capital, and either provided insufficient information or did not follow the formal PPP model, which involves capital investment for a explicit return on investment. Few studies discussed the response to their findings and the organizational willingness to change.

CONCLUSIONS

Many of the same factors that impact the success of QI in healthcare in high-income countries are relevant for PPP in LMICs. Vague descriptions of the structure and financial arrangements of the PPPs, and the roles of public and private entities made it difficult to draw meaningful conclusions about the impacts of the organizational governance on the outcomes of QI programs in LMICs. While we found many articles in the published literature on PPP-funded QI partnerships in LMICs, there is a dire need for research that more clearly describes the intervention details, implementation challenges, contextual factors, leadership and organizational structures. These details are needed to better align incentives to support the kinds of collaboration needed for guiding accountability in advancing global health. More ownership and power needs to be shifted to local leaders and researchers to improve research equity and sustainability.

Interventions for improving coverage of childhood immunisation in low- and middle-income countries

BACKGROUND

Immunisation plays a major role in reducing childhood morbidity and mortality. Getting children immunised against potentially fatal and debilitating vaccine-preventable diseases remains a challenge despite the availability of efficacious vaccines, particularly in low- and middle-income countries. With the introduction of new vaccines, this becomes increasingly difficult. There is therefore a current need to synthesise the available evidence on the strategies used to bridge this gap. This is a second update of the Cochrane Review first published in 2011 and updated in 2016, and it focuses on interventions for improving childhood immunisation coverage in low- and middle-income countries.

OBJECTIVES

To evaluate the effectiveness of intervention strategies to boost demand and supply of childhood vaccines, and sustain high childhood immunisation coverage in low- and middle-income countries.

SEARCH METHODS

We searched CENTRAL, MEDLINE, CINAHL, and Global Index Medicus (11 July 2022). We searched Embase, LILACS, and Sociological Abstracts (2 September 2014). We searched WHO ICTRP and ClinicalTrials.gov (11 July 2022). In addition, we screened reference lists of relevant systematic reviews for potentially eligible studies, and carried out a citation search for 14 of the included studies (19 February 2020).

SELECTION CRITERIA

Eligible studies were randomised controlled trials (RCTs), non-randomised RCTs (nRCTs), controlled before-after studies, and interrupted time series conducted in low- and middle-income countries involving children that were under five years of age, caregivers, and healthcare providers.

DATA COLLECTION AND ANALYSIS

We independently screened the search output, reviewed full texts of potentially eligible articles, assessed the risk of bias, and extracted data in duplicate, resolving discrepancies by consensus. We conducted random-effects meta-analyses and used GRADE to assess the certainty of the evidence.

MAIN RESULTS

Forty-one studies involving 100,747 participants are included in the review. Twenty studies were cluster-randomised and 15 studies were individually randomised controlled trials. Six studies were quasi-randomised. The studies were conducted in four upper-middle-income countries (China, Georgia, Mexico, Guatemala), 11 lower-middle-income countries (Côte d'Ivoire, Ghana, Honduras, India, Indonesia, Kenya, Nigeria, Nepal, Nicaragua, Pakistan, Zimbabwe), and three lower-income countries (Afghanistan, Mali, Rwanda). The interventions evaluated in the studies were health education (seven studies), patient reminders (13 studies), digital register (two studies), household incentives (three studies), regular immunisation outreach sessions (two studies), home visits (one study), supportive supervision (two studies), integration of immunisation services with intermittent preventive treatment of malaria (one study), payment for performance (two studies), engagement of community leaders (one study), training on interpersonal communication skills (one study), and logistic support to health facilities (one study). We judged nine of the included studies to have low risk of bias; the risk of bias in eight studies was unclear and 24 studies had high risk of bias. We found low-certainty evidence that health education (risk ratio (RR) 1.36, 95% confidence interval (CI) 1.15 to 1.62; 6 studies, 4375 participants) and home-based records (RR 1.36, 95% CI 1.06 to 1.75; 3 studies, 4019 participants) may improve coverage with DTP3/Penta 3 vaccine. Phone calls/short messages may have little or no effect on DTP3/Penta 3 vaccine uptake (RR 1.12, 95% CI 1.00 to 1.25; 6 studies, 3869 participants; low-certainty evidence); wearable reminders probably have little or no effect on DTP3/Penta 3 uptake (RR 1.02, 95% CI 0.97 to 1.07; 2 studies, 1567 participants; moderate-certainty evidence). Use of community leaders in combination with provider intervention probably increases the uptake of DTP3/Penta 3 vaccine (RR 1.37, 95% CI 1.11 to 1.69; 1 study, 2020 participants; moderate-certainty evidence). We are uncertain about the effect of immunisation outreach on DTP3/Penta 3 vaccine uptake in children under two years of age (RR 1.32, 95% CI 1.11 to 1.56; 1 study, 541 participants; very low-certainty evidence). We are also uncertain about the following interventions improving full vaccination of children under two years of age: training of health providers on interpersonal communication skills (RR 5.65, 95% CI 3.62 to 8.83; 1 study, 420 participants; very low-certainty evidence), and home visits (RR 1.29, 95% CI 1.15 to 1.45; 1 study, 419 participants; very low-certainty evidence). The same applies to the effect of training of health providers on interpersonal communication skills on the uptake of DTP3/Penta 3 by one year of age (very low-certainty evidence). The integration of immunisation with other services may, however, improve full vaccination (RR 1.29, 95% CI 1.16 to 1.44; 1 study, 1700 participants; low-certainty evidence).

AUTHORS' CONCLUSIONS

Health education, home-based records, a combination of involvement of community leaders with health provider intervention, and integration of immunisation services may improve vaccine uptake. The certainty of the evidence for the included interventions ranged from moderate to very low. Low certainty of the evidence implies that the true effect of the interventions might be markedly different from the estimated effect. Further, more rigorous RCTs are, therefore, required to generate high-certainty evidence to inform policy and practice.

Service delivery interventions to improve maternal and newborn health in low- and middle-income countries: scoping review of quality improvement, implementation research and health system strengthening approaches

INTRODUCTION

This review explores the characteristics of service delivery-related interventions to improve maternal and newborn health (MNH) in low-and middle-income countries (LMICs) over the last two decades, comparing three common framings of these interventions, namely, quality improvement (QI), implementation science/research (IS/IR), and health system strengthening (HSS).

METHODS

The review followed the staged scoping review methodology proposed by Levac et al. (2010). We developed and piloted a systematic search strategy, limited to English language peer-reviewed articles published on LMICs between 2000 and March 2022. Analysis was conducted in two-quantitative and qualitative-phases. In the quantitative phase, we counted the year of publication, country(-ies) of origin, and the presence of the terms 'quality improvement', 'health system strengthening' or 'implementation science'/ 'implementation research' in titles, abstracts and key words. From this analysis, a subset of papers referred to as 'archetypes' (terms appearing in two or more of titles, abstract and key words) was analysed qualitatively, to draw out key concepts/theories and underlying mechanisms of change associated with each approach.

RESULTS

The searches from different databases resulted in a total of 3,323 hits. After removal of duplicates and screening, a total of 231 relevant articles remained for data extraction. These were distributed across the globe; more than half (n = 134) were published since 2017. Fifty-five (55) articles representing archetypes of the approach (30 QI, 16 IS/IR, 9 HSS) were analysed qualitatively. As anticipated, we identified distinct patterns in each approach. QI archetypes tended towards defined process interventions (most typically, plan-do-study-act cycles); IS/IR archetypes reported a wide variety of interventions, but had in common evaluation methodologies and explanatory theories; and HSS archetypes adopted systemic perspectives. Despite their distinctiveness, there was also overlap and fluidity between approaches, with papers often referencing more than one approach. Recognising the complexity of improving MNH services, there was an increased orientation towards participatory, context-specific designs in all three approaches.

CONCLUSIONS

Programmes to improve MNH outcomes will benefit from a better appreciation of the distinctiveness and relatedness of different approaches to service delivery strengthening, how these have evolved and how they can be combined.

A Systems-Based Framework for Immunisation System Design: Six Loops, Three Flows, Two Paradigms

Despite massive progress in vaccine coverage globally, the region of sub-Saharan Africa is lagging behind for Sustainable Development Goal 3 by 2030. Sub-national under-immunisation is part of the problem. In order to reverse the current immunisation system's (IMS) underperformance, a conceptual model is proposed that captures the complexity of IMSs in low- and middle-income countries (LMICs) and offers directions for sustainable redesign. The IMS model was constructed based on literature and stakeholder interaction in Rwanda and Kenya. The model assembles the paradigms of planned and emergency immunisation in one system and emphasises the synchronised flows of vaccinee, vaccinator and vaccine. Six feedback loops capture the main mechanisms governing the system. Sustainability and resilience are assessed based on loop dominance and dependency on exogenous factors. The diagram invites stakeholders to share their mental models and. The framework provides a systems approach for problem structuring and policy design.

Advancing sustainable development goals through immunization: a literature review

BACKGROUND

Immunization directly impacts health (SDG3) and brings a contribution to 14 out of the 17 Sustainable Development Goals (SDGs), such as ending poverty, reducing hunger, and reducing inequalities. Therefore, immunization is recognized to play a central role in reaching the SDGs, especially in low- and middle-income countries (LMICs). Despite continuous interventions to strengthen immunization systems and to adequately respond to emergency immunization during epidemics, the immunization-related indicators for SDG3 lag behind in sub-Saharan Africa. Especially taking into account the current Covid19 pandemic, the current performance on the connected SDGs is both a cause and a result of this.

METHODS

We conduct a literature review through a keyword search strategy complemented with handpicking and snowballing from earlier reviews. After title and abstract screening, we conducted a qualitative analysis of key insights and categorized them according to showing the impact of immunization on SDGs, sustainability challenges, and model-based solutions to these challenges.

RESULTS

We reveal the leveraging mechanisms triggered by immunization and position them vis-à-vis the SDGs, within the framework of Public Health and Planetary Health. Several challenges for sustainable control of vaccine-preventable diseases are identified: access to immunization services, global vaccine availability to LMICs, context-dependent vaccine effectiveness, safe and affordable vaccines, local/regional vaccine production, public-private partnerships, and immunization capacity/capability building. Model-based approaches that support SDG-promoting interventions concerning immunization systems are analyzed in light of the strategic priorities of the Immunization Agenda 2030.

CONCLUSIONS

In general terms, it can be concluded that relevant future research requires (i) design for system resilience, (ii) transdisciplinary modeling, (iii) connecting interventions in immunization with SDG outcomes, (iv) designing interventions and their implementation simultaneously, (v) offering tailored solutions, and (vi) model coordination and integration of services and partnerships. The research and health community is called upon to join forces to activate existing knowledge, generate new insights and develop decision-supporting tools for Low-and Middle-Income Countries' health authorities and communities to leverage immunization in its transformational role toward successfully meeting the SDGs in 2030.

Application of Mixed Methods in Health Services Management Research: A Systematic Review

Mixed methods research (MMR) is versatile, pragmatic, and adaptable to constraints and opportunities during a research process. Although MMR has gain popularity in health services management research, little is known about how the research approach has been used and the quality of research. We conducted a systematic review of 198 MMR articles published in selected U.S.-based and international health services management journals from 2000 through 2018 to examine the extent of MMR application and scientific rigor. Results showed limited, yet increasing, use of MMR and a high degree of correspondence between MMR designs and study purposes. However, most articles did not clearly justify using MMR designs and the reporting of method details and research integration were inadequate in a significant portion of publications. We propose a checklist to assist the preparation and review of MMR manuscripts. Additional implications and recommendations to improve transparency, rigor, and quality in MMR are discussed.

A process evaluation of the quality improvement collaborative for a community-based family planning learning site in Uganda

Background: High-quality family planning (FP) services have been associated with increased FP service demand and use, resulting in improved health outcomes for women. Community-based family planning (CBFP) is a key strategy in expanding access to FP services through community health workers or Village Health Team (VHTs) members in Uganda. We established the first CBFP learning site in Busia district, Uganda, using a quality improvement collaborative (QIC) model. This process evaluation aims to understand the QIC adaptation process, supportive implementation factors and trends in FP uptake and retention.

Methods: We collected data from two program districts: Busia (learning site) and Oyam (scale-up). We used a descriptive mixed-methods process evaluation design: desk review of program documents, program monitoring data and in-depth interviews and focus group discussions.

Results: The quality improvement (QI) process strengthened linkages between health services provided in communities and health centers. Routine interaction of VHTs, clients and midwives generated improvement ideas. Participants reported increased learning through midwife mentorship of VHTs, supportive supervision, monthly meetings, data interpretation and learning sessions. Three areas for potential sustainability and institutionalization of the QI efforts were identified: the integration of QI into other services, district-level plans and support for the QIC and motivation of QI teams. Challenges in the replication of this model include the community-level capacity for data recording and interpretation, the need to simplify QI terminology and tools for VHTs and travel reimbursements for meetings. We found positive trends in the number of women on an FP method, the number of returning clients and the number of couples counseled.

Conclusions: A QIC can be a positive approach to improve VHT service delivery. Working with VHTs on QI presents specific challenges compared to working at the facility level. To strengthen the implementation of this CBFP QIC and other community-based QICs, we provide program-relevant recommendations.

A process evaluation of the quality improvement collaborative for a community-based family planning learning site in Uganda

Background: High-quality family planning (FP) services have been associated with increased FP service demand and use, resulting in improved health outcomes for women. Community-based family planning (CBFP) is a key strategy in expanding access to FP services through community health workers or Village Health Team (VHTs) members in Uganda. We established the first CBFP learning site in Busia district, Uganda, using a quality improvement collaborative (QIC) model. This process evaluation aims to understand the QIC adaptation process, supportive implementation factors and trends in FP uptake and retention.Methods:We collected data from two program districts: Busia (learning site) and Oyam (scale-up). We used a descriptive mixed-methods process evaluation design: desk review of program documents, program monitoring data and in-depth interviews and focus group discussions.Results:The quality improvement (QI) process strengthened linkages between health services provided in communities and health centers. Routine interaction of VHTs, clients and midwives generated improvement ideas. Participants reported increased learning through midwife mentorship of VHTs, supportive supervision, monthly meetings, data interpretation and learning sessions. Three areas for potential sustainability and institutionalization of the QI efforts were identified: the integration of QI into other services, district-level plans and support for the QIC and motivation of QI teams. Challenges in the replication of this model include the community-level capacity for data recording and interpretation, the need to simplify QI terminology and tools for VHTs and travel reimbursements for meetings. We found positive trends in the number of women on an FP method, the number of returning clients and the number of couples counseled.Conclusions:A QIC can be a positive approach to improve VHT service delivery. Working with VHTs on QI presents specific challenges compared to working at the facility level. To strengthen the implementation of this CBFP QIC and other community-based QICs, we provide program-relevant recommendations.

Psychological treatments delivered by community health workers in low-resource government health systems: effectiveness of group interpersonal psychotherapy for caregivers of children affected by nodding syndrome in Uganda

BACKGROUND

Despite increasing evidence for the benefits of psychological treatments (PTs) in low- and middle-income countries, few national health systems have adopted PTs as standard care. We aimed to evaluate the effectiveness of a group interpersonal psychotherapy (IPT-G) intervention, when delivered by lay community health workers (LCHWs) in a low-resource government health system in Uganda. The intended outcome was reduction of depression among caregivers of children with nodding syndrome, a neuropsychiatric condition with high morbidity, mortality and social stigma.

METHODS

A non-randomized trial design was used. Caregivers in six villages (n = 69) received treatment as usual (TAU), according to government guidelines. Caregivers in seven villages (n = 73) received TAU as well as 12 sessions of IPT-G delivered by LCHWs. Primary outcomes were caregiver and child depression assessed at 1 and 6 months post-intervention.

RESULTS

Caregivers who received IPT-G had a significantly greater reduction in the risk of depression from baseline to 1 month [risk ratio (RR) 0.25, 95% confidence interval (CI) 0.10-0.62] and 6 months (RR 0.33, 95% CI 0.11-0.95) post-intervention compared with caregivers who received TAU. Children of caregivers who received IPT-G had significantly greater reduction in depression scores than children of TAU caregivers at 1 month (Cohen's d = 0.57, p = 0.01) and 6 months (Cohen's d = 0.54, p = 0.03). Significant effects were also observed for psychological distress, stigma and social support among caregivers.

CONCLUSION

IPT-G delivered within a low-resource health system is an effective PT for common mental health problems in caregivers of children with a severe neuropsychiatric condition and has psychological benefits for the children as well. This supports national health policy initiatives to integrate PTs into primary health care services in Uganda.

Quality improvement practices to institutionalize supply chain best practices for iCCM: Evidence from Rwanda and Malawi

Background

Supply chain bottlenecks that prevent community health workers (CHWs) from accessing essential medicines significantly increase under-5 child mortality, particularly in poor and rural areas.

Objective

Using implementation research, interventions aimed at improving supply chain practices and access to medicines were tested in Malawi and Rwanda. These interventions included simple demand-based resupply procedures, using mobile technology and traditional methods for communication, and multilevel, performance-driven quality improvement (QI) teams.

Methods

Mixed-method evaluations were conducted at baseline (2010), midline (2013), and endline (2014). Baseline assessments identified common bottlenecks and established performance levels. Midline assessments identified which intervention package had the greatest impact. Endline surveys measured the progress of scale-up and institutionalization of each innovation.

Results

In both Rwanda and Malawi CHWs, health center staff, and district managers all cited many benefits of the establishment of resupply procedures and QI teams: such as providing structure and processes, a means to analyze and discuss problems and enhance collaboration between staff.

Conclusions

Implementing simple, streamlined, demand-based resupply procedures formed the basis for informed and regular resupply, and increased the visibility of appropriate and timely community logistics data. QI teams played a critical role in reinforcing resupply procedures and routinely unlocking the bottlenecks that prevent the continuous flow of critical health products. While simple, streamlined, demand-based resupply procedures provide the basis for regular, functional, and efficient resupply of CHWs, the procedures alone are not sufficient to create consistent change in product availability. Supporting these procedures with multilevel QI teams reinforces the correct and consistent use of resupply procedures.

Interventions for improving coverage of childhood immunisation in low- and middle-income countries

BACKGROUND

Immunisation is a powerful public health strategy for improving child survival, not only by directly combating key diseases that kill children but also by providing a platform for other health services. However, each year millions of children worldwide, mostly from low- and middle-income countries (LMICs), do not receive the full series of vaccines on their national routine immunisation schedule. This is an update of the Cochrane review published in 2011 and focuses on interventions for improving childhood immunisation coverage in LMICs.

OBJECTIVES

To evaluate the effectiveness of intervention strategies to boost and sustain high childhood immunisation coverage in LMICs.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2016, Issue 4, part of The Cochrane Library. www.cochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 12 May 2016); MEDLINE In-Process and Other Non-Indexed Citations, MEDLINE Daily and MEDLINE 1946 to Present, OvidSP (searched 12 May 2016); CINAHL 1981 to present, EbscoHost (searched 12 May 2016); Embase 1980 to 2014 Week 34, OvidSP (searched 2 September 2014); LILACS, VHL (searched 2 September 2014); Sociological Abstracts 1952 - current, ProQuest (searched 2 September 2014). We did a citation search for all included studies in Science Citation Index and Social Sciences Citation Index, 1975 to present; Emerging Sources Citation Index 2015 to present, ISI Web of Science (searched 2 July 2016). We also searched the two Trials Registries: ICTRP and ClinicalTrials.gov (searched 5 July 2016) SELECTION CRITERIA: Eligible studies were randomised controlled trials (RCT), non-RCTs, controlled before-after studies, and interrupted time series conducted in LMICs involving children aged from birth to four years, caregivers, and healthcare providers.

DATA COLLECTION AND ANALYSIS

We independently screened the search output, reviewed full texts of potentially eligible articles, assessed risk of bias, and extracted data in duplicate; resolving discrepancies by consensus. We then conducted random-effects meta-analyses and used GRADE to assess the certainty of evidence.

MAIN RESULTS

Fourteen studies (10 cluster RCTs and four individual RCTs) met our inclusion criteria. These were conducted in Georgia (one study), Ghana (one study), Honduras (one study), India (two studies), Mali (one study), Mexico (one study), Nicaragua (one study), Nepal (one study), Pakistan (four studies), and Zimbabwe (one study). One study had an unclear risk of bias, and 13 had high risk of bias. The interventions evaluated in the studies included community-based health education (three studies), facility-based health education (three studies), household incentives (three studies), regular immunisation outreach sessions (one study), home visits (one study), supportive supervision (one study), information campaigns (one study), and integration of immunisation services with intermittent preventive treatment of malaria (one study).We found moderate-certainty evidence that health education at village meetings or at home probably improves coverage with three doses of diphtheria-tetanus-pertussis vaccines (DTP3: risk ratio (RR) 1.68, 95% confidence interval (CI) 1.09 to 2.59). We also found low-certainty evidence that facility-based health education plus redesigned vaccination reminder cards may improve DTP3 coverage (RR 1.50, 95% CI 1.21 to 1.87). Household monetary incentives may have little or no effect on full immunisation coverage (RR 1.05, 95% CI 0.90 to 1.23, low-certainty evidence). Regular immunisation outreach may improve full immunisation coverage (RR 3.09, 95% CI 1.69 to 5.67, low-certainty evidence) which may substantially improve if combined with household incentives (RR 6.66, 95% CI 3.93 to 11.28, low-certainty evidence). Home visits to identify non-vaccinated children and refer them to health clinics may improve uptake of three doses of oral polio vaccine (RR 1.22, 95% CI 1.07 to 1.39, low-certainty evidence). There was low-certainty evidence that integration of immunisation with other services may improve DTP3 coverage (RR 1.92, 95% CI 1.42 to 2.59).

AUTHORS' CONCLUSIONS

Providing parents and other community members with information on immunisation, health education at facilities in combination with redesigned immunisation reminder cards, regular immunisation outreach with and without household incentives, home visits, and integration of immunisation with other services may improve childhood immunisation coverage in LMIC. Most of the evidence was of low certainty, which implies a high likelihood that the true effect of the interventions will be substantially different. There is thus a need for further well-conducted RCTs to assess the effects of interventions for improving childhood immunisation coverage in LMICs.