The effectiveness of the quality improvement collaborative strategy in low- and middle-income countries: A systematic review and meta-analysis

Improvement in antibacterial use in intensive care units from Argentina: A quality improvement collaborative process evaluation using Normalization Process Theory

BACKGROUND

Healthcare-associated infections and antibiotic resistance worsen globally. Antibiotic stewardship programs (ASP) aim to optimise infection treatment and curb resistance, yet implementation hurdles persist. This study examined ASP challenges in ICUs.

METHODS

This study employed a qualitative methodological design to evaluate the implementation process of an antibiotic stewardship program (ASP) in eight intensive care units (ICUs) across Argentina. Thirty-four semi-structured interviews with healthcare workers (HCWs) were conducted. Interviews were analysed guided by Normalisation Process Theory, examining coherence, cognitive participation, collective action, and reflexive monitoring constructs.

RESULTS

Key challenges included insufficient human resources, lack of institutional support, and resistance to change, particularly among staff not initially involved in the study. Despite these challenges, the program saw partial success in improving ICU practices, particularly in antibiotic use and communication across departments. The main strategy implemented in this quality improvement collaborative was the use of improvement cycles, which served as the central component for driving change. However, participation in improvement cycles was inconsistent, and sustainability post-intervention remains uncertain due to workload pressures and the need for continuous education. Concerns about workload and communication barriers persisted. Many participants did not perceive training as a separate component, which led to low engagement. Resistance to change became evident during modifications to clinical guidelines. The intervention had a positive impact on various processes, including communication and record keeping.

CONCLUSION

This study underscores the persistent challenges in implementing ASPs in healthcare, emphasising the need for enhanced collaboration, workforce capacity building, and evidence-based practices to overcome barriers and optimize antimicrobial use to improve patient outcomes.

Improving Antibiotic Use in Argentine Pediatric Hospitals: A Process Evaluation Using Normalization Process Theory

Introduction

In the pediatric setting, overprescribing of antibiotics contributes to the rise of multidrug-resistant organisms. Antimicrobial stewardship programs (ASPs) are recommended to optimize antibiotic use and combat resistance. However, the implementation of ASPs in low- and middle-income countries faces several challenges. This study aimed to evaluate the implementation process of a multifaceted ASP in 2 pediatric hospitals in Argentina.

Methods

A qualitative study was conducted in two large public children's hospitals in Argentina, using semistructured interviews with 32 healthcare providers at the beginning and end of the ASP implementation. The study was guided by the normalization process theory.

Results

The intervention faced challenges, including limited understanding of its objectives, confusion with existing practices, and insufficient commitment from senior staff. Although junior staff were more receptive, communication barriers with external staff and workload concerns hindered broader adoption. Infectious disease specialists primarily led implementation, with limited involvement of other staff, particularly in training activities. Despite these challenges, participants reported improvements, such as the development of standardized antibiotic guidelines, better interdisciplinary collaboration, and improved communication. However, organizational support and resistance to new practices remained barriers.

Conclusions

This study highlights the importance of organizational context and staff commitment in ASP implementation. Tailored strategies that address the specific challenges of low- and middle-income countries are needed to effectively implement ASPs.

"If we work as a team, there are success stories." Unpacking team members' perceptions and experiences of what impacts team performance in a maternal and neonatal quality improvement programme in South Africa, before, and during COVID-19

Many maternal and neonatal deaths and stillbirths can be avoided if quality of care is improved. The South African National Department of Health implemented a multi-partner quality improvement (QI) programme between 2018 and 2022, in 21 facilities, with the aim to reduce maternal and perinatal mortality. We conducted a qualitative evaluation to explore QI team members' perceptions of the factors shaping variation in team performance. The evaluation was conducted in 15 purposively selected facilities. We interviewed 47 team members from the 14 facilities consenting to participate in the evaluation, over three time points. We conducted 21 individual interviews and 18 group interviews. Data were thematically analysed using ATLAS.ti 8. Based on a preliminary assessment, six teams were rated as well-performing and eight, less well-performing. Patterns of divergence between well-performing and less well-performing teams were then examined through in-depth analysis of the full data set. Well-performing teams had a core team of members with a good understanding of the programme aims and QI methodology; a second in-charge member to ensure leader continuity; and leader stability throughout the implementation period. Well-performing teams were recruited from existing facility service teams who had a positive prevailing work culture. Team leaders' enthusiasm for QI and their ability to mobilise member buy-in, and how well teams worked together, further affected teams' performance. Existing facility contexts, how teams are set up, leadership-and member buy-in into the methodology, affect QI teams' performance. Focusing on these as well as supporting leaders to foster a shared vision and culture of excellence; mitigating contextual and implementation barriers; and strengthening team members' technical QI skills, has the potential to improve QI teams' performance.

Good practices to optimise the performance of maternal and neonatal quality improvement teams: Results from a longitudinal qualitative evaluation in South Africa, before, and during COVID-19

Many maternal and neonatal deaths can be avoided if quality healthcare is provided. To this end, the South African National Department of Health implemented a quality improvement (QI) programme (2018-2022) to improve maternal and neonatal health services in 21 public health facilities. This study sought to identify good practices aimed at improving QI teams' performance by identifying optimal facility-level contextual factors and implementation processes. We purposively selected 14 facilities of the 21 facilities for a longitudinal qualitative process evaluation. We interviewed 17 team leaders, 47 members, and five QI advisors who provided technical support to the teams. The data were analysed using framework analysis. We choose the Consolidated Framework for Implementation Research as framework given that it explicates contexts and processes that shape programme implementation. Six quality improvement teams were assessed as well-performing, and eight as less well-performing. This research conceptualises a 'life course lens' for setting up and managing a QI team. We identified eight good practices, six related to implementation processes, and two contextual variables that will optimise team performance. The two most impactful practices to improve the performance of a QI team were (i) selecting healthcare workers with quality improvement-specific characteristics, and (ii) appointing advisors whose interpersonal skills match their technical quality improvement competencies.

Optimising antibacterial utilisation in Argentine intensive care units: a quality improvement collaborative

BACKGROUND

There is limited evidence from antimicrobial stewardship programmes in less-resourced settings. This study aimed to improve the quality of antibacterial prescriptions by mitigating overuse and promoting the use of narrow-spectrum agents in intensive care units (ICUs) in a middle-income country.

METHODS

We established a quality improvement collaborative (QIC) model involving nine Argentine ICUs over 11 months with a 16-week baseline period (BP) and a 32-week implementation period (IP). Our intervention package included audits and feedback on antibacterial use, facility-specific treatment guidelines, antibacterial timeouts, pharmacy-based interventions and education. The intervention was delivered in two learning sessions with three action periods along with coaching support and basic quality improvement training.

RESULTS

We included 912 patients, 357 in BP and 555 in IP. The latter had higher APACHE II (17 (95% CI: 12 to 21) vs 15 (95% CI: 11 to 20), p=0.036), SOFA scores (6 (95% CI: 4 to 9) vs 5 (95% CI: 3 to 8), p=0.006), renal failure (41.6% vs 33.1%, p=0.009), sepsis (36.1% vs 31.6%, p<0.001) and septic shock (40.0% vs 33.8%, p<0.001). The days of antibacterial therapy (DOT) were similar between the groups (change in the slope from BP to IP 28.1 (95% CI: -17.4 to 73.5), p=0.2405). There were no differences in the antibacterial defined daily dose (DDD) between the groups (change in the slope from BP to IP 43.9, (95% CI: -12.3 to 100.0), p=0.1413).The rate of antibacterial de-escalation based on microbiological culture was higher during the IP (62.0% vs 45.3%, p<0.001).The infection prevention control (IPC) assessment framework was increased in eight ICUs.

CONCLUSION

Implementing an antimicrobial stewardship program in ICUs in a middle-income country via a QIC demonstrated success in improving antibacterial de-escalation based on microbiological culture results, but not on DOT or DDD. In addition, eight out of nine ICUs improved their IPC Assessment Framework Score.

Quality improvement in public-private partnerships in low- and middle-income countries: a systematic review

BACKGROUND

Public-private partnerships (PPP) are often how health improvement programs are implemented in low-and-middle-income countries (LMICs). We therefore aimed to systematically review the literature about the aim and impacts of quality improvement (QI) approaches in PPP in LMICs.

METHODS

We searched SCOPUS and grey literature for studies published before March 2022. One reviewer screened abstracts and full-text studies for inclusion. The study characteristics, setting, design, outcomes, and lessons learned were abstracted using a standard tool and reviewed in detail by a second author.

RESULTS

We identified 9,457 citations, of which 144 met the inclusion criteria and underwent full-text abstraction. We identified five key themes for successful QI projects in LMICs: 1) leadership support and alignment with overarching priorities, 2) local ownership and engagement of frontline teams, 3) shared authentic learning across teams, 4) resilience in managing external challenges, and 5) robust data and data visualization to track progress. We found great heterogeneity in QI tools, study designs, participants, and outcome measures. Most studies had diffuse aims and poor descriptions of the intervention components and their follow-up. Few papers formally reported on actual deployment of private-sector capital, and either provided insufficient information or did not follow the formal PPP model, which involves capital investment for a explicit return on investment. Few studies discussed the response to their findings and the organizational willingness to change.

CONCLUSIONS

Many of the same factors that impact the success of QI in healthcare in high-income countries are relevant for PPP in LMICs. Vague descriptions of the structure and financial arrangements of the PPPs, and the roles of public and private entities made it difficult to draw meaningful conclusions about the impacts of the organizational governance on the outcomes of QI programs in LMICs. While we found many articles in the published literature on PPP-funded QI partnerships in LMICs, there is a dire need for research that more clearly describes the intervention details, implementation challenges, contextual factors, leadership and organizational structures. These details are needed to better align incentives to support the kinds of collaboration needed for guiding accountability in advancing global health. More ownership and power needs to be shifted to local leaders and researchers to improve research equity and sustainability.

Motivational drivers for health professionals in a large quality improvement collaborative project in Brazil: a qualitative study

BACKGROUND

The success of collaborative quality improvement (QI) projects in healthcare depends on the context and engagement of health teams; however, the factors that modulate teams' motivation to participate in these projects are still unclear. The objective of the current study was to explore the barriers to and facilitators of motivation; the perspective was health professionals in a large project aiming to implement evidence-based infection prevention practices in intensive care units of Brazilian hospitals.

METHODS

This qualitative study was based on content analysis of semistructured in-depth interviews held with health professionals who participated in a collaborative QI project named "Improving patient safety on a large scale in Brazil". In accordance with the principle of saturation, we selected a final sample of 12 hospitals located throughout the five regions of Brazil that have implemented QI; then, we conducted videoconference interviews with 28 health professionals from those hospitals. We encoded the interview data with NVivo software, and the interrelations among the data were assessed with the COM-B model.

RESULTS

The key barriers identified were belief that improvement increases workload, lack of knowledge about quality improvement, resistance to change, minimal involvement of physicians, lack of supplies, lack support from senior managers and work overload. The primary driver of motivation was tangible outcomes, as evidenced by a decrease in infections. Additionally, factors such as the active participation of senior managers, teamwork, learning in practice and understanding the reason for changes played significant roles in fostering motivation.

CONCLUSION

The motivation of health professionals to participate in collaborative QI projects is driven by a variety of barriers and facilitators. The interactions between the senior manager, quality improvement teams, and healthcare professionals generate attitudes that modulate motivation. Thus, these aspects should be considered during the implementation of such projects. Future research could explore the cost-effectiveness of motivational approaches.

Quality improvement collaboratives as part of a quality improvement intervention package for preterm births at sub-national level in East Africa: a multi-method analysis

BACKGROUND

Quality improvement collaboratives (QIC) are an approach to accelerate the spread and impact of evidence-based interventions across health facilities, which are found to be particularly successful when combined with other interventions such as clinical skills training. We implemented a QIC as part of a quality improvement intervention package designed to improve newborn survival in Kenya and Uganda. We use a multi-method approach to describe how a QIC was used as part of an overall improvement effort and describe specific changes measured and participant perceptions of the QIC.

METHODS

We examined QIC-aggregated run charts on three shared indicators related to uptake of evidence-based practices over time and conducted key informant interviews to understand participants' perceptions of quality improvement practice. Run charts were evaluated for change from baseline medians. Interviews were analysed using framework analysis.

RESULTS

Run charts for all indicators reflected an increase in evidence-based practices across both countries. In Uganda, pre-QIC median gestational age (GA) recording of 44% improved to 86%, while Kangaroo Mother Care (KMC) initiation went from 51% to 96% and appropriate antenatal corticosteroid (ACS) use increased from 17% to 74%. In Kenya, these indicators went from 82% to 96%, 4% to 74% and 4% to 57%, respectively. Qualitative results indicate that participants appreciated the experience of working with data, and the friendly competition of the QIC was motivating. The participants reported integration of the QIC with other interventions of the package as a benefit.

CONCLUSIONS

In a QIC that demonstrated increased evidence-based practices, QIC participants point to data use, friendly competition and package integration as the drivers of success, despite challenges common to these settings such as health worker and resource shortages.

TRIAL REGISTRATION NUMBER

NCT03112018.

"If you work alone on this project, you can't reach your target": unpacking the leader's role in well-performing teams in a maternal and neonatal quality improvement programme in South Africa, before and during COVID-19

The South African National Department of Health developed a quality improvement (QI) programme to reduce maternal and neonatal mortality and still births. The programme was implemented between 2018 and 2022 in 21 purposively selected public health facilities. We conducted a process evaluation to describe the characteristics and skills of the QI team leaders of well-performing teams. The evaluation was conducted in 15 of the 21 facilities. Facilities were purposively selected and comprised semi-structured interviews with leaders at three time points; reviewing of QI documentation; and 37 intermittently conducted semi-structured interviews with the QI advisors, being QI technical experts who supported the teams. These interviews focused on participants' experiences and perceptions of how the teams performed, and performance barriers and enablers. Thematic data analysis was conducted using Atlas.ti. Variation in team performance was associated with leaders' attributes and skills. However, the COVID-19 pandemic also affected team functioning. Well-performing teams had leaders who effectively navigated COVID-19 and other challenges, who embraced QI and had sound QI skills. These leaders cultivated trust by taking responsibility for failures, correcting members' mistakes in encouraging ways, and setting high standards of care. Moreover, they promoted programme ownership among members by delegating tasks. Given the critical role leaders play in team performance and thus in the outcomes of QI programmes, efforts should focus on leader selection, training, and support.

Can a quality improvement intervention improve person-centred maternity care in Kenya?

Few evidence-based interventions exist to improve person-centred maternity care in low-resource settings. This study aimed to understand whether a quality improvement (QI) intervention could improve person-centred maternity care (PCMC) experiences for women delivering in public health facilities in Kenya. A pre-post design was used to examine changes in PCMC scores across three intervention and matched control facilities at baseline (n = 491) and endline (n = 677). A QI intervention, using the Model for Improvement, was implemented in three public health facilities in Nairobi and Kiambu Counties in Kenya. Difference-in-difference analyses using models that included main effects of both treatment group and survey round was conducted to understand the impact of the intervention on PCMC scores. Findings suggest that intervention facilities' average total PCMC score decreased by 5.3 points post-intervention compared to baseline (95% CI: -8.8, -1.9) and relative to control facilities, holding socio-demographic and facility variables constant. Additionally, the intervention was significantly associated with a 1.8-point decrease in clinical quality index pre-post-intervention (95% CI: -2.9, -0.7), decreased odds of provider visits, and less likelihood to plan to use postpartum family planning. While improving the quality of women's experiences during childbirth is a critical component to ensure comprehensive, high-quality maternity care experiences and outcomes, further research is required to understand which intervention methods may be most appropriate to improve PCMC in resource-constrained settings.

What factors influence a Quality Improvement Collaborative in improving contraceptive services for foreign-born women? A qualitative study in Sweden

BACKGROUND

Improved contraceptive services could reduce the unmet need for contraception and unintended pregnancies globally. This is especially true among foreign-born women in high-income countries, as the health outcomes related to unmet need of contraception disproportionally affect this group. A widely used quality improvement approach to improve health care services is Quality Improvement Collaborative (QIC). However, evidence on to what extent, how and why it is effective and what factors influence a QIC in different healthcare contexts is limited. The purpose of this study was to analyse what factors have influenced a successful QIC intervention that is aimed to improve contraceptive service in postpartum care, mainly targeting foreign-born women in Sweden.

METHODS

A qualitative, deductive design was used, guided by the Consolidated Framework for Implementation Research (CFIR). The study triangulated secondary data from four learning seminars as part of the QIC, with primary interview data with four QIC-facilitators. The QIC involved midwives at three maternal health clinics in Stockholm County, Sweden, 2018-2019.

RESULTS

Factors from all five CFIR domains were identified, however, the majority of factors that influenced the QIC were found inside the QIC-setting, in three domains: intervention characteristics, inner setting and process. Outside factors and those related to individuals were less influential. A favourable learning climate, emphasizing co-creation and mutual learning, facilitated reflections among the participating midwives. The application of the QIC was facilitated by adaptability, trialability, and a motivated and skilled project team. Our study further suggests that the QIC was complex because it required a high level of engagement from the midwives and facilitators. Additionally, it was challenging due to unclear roles and objectives in the initial phases.

CONCLUSIONS

The application of the CFIR framework identified crucial factors influencing the success of a QIC in contraceptive services in a high-income setting. These factors highlight the importance of establishing a learning climate characterised by co-creation and mutual learning among the participating midwives as well as the facilitators. Furthermore, to invest in planning and formation of the project group during the QIC initiation; and to ensure adaptability and trialability of the improvement activities.

Sustaining extended Kangaroo mother care in stable low birthweight babies in NICU: a quality improvement collaborative of six centres of Karnataka

BACKGROUND

Kangaroo mother care (KMC) is a proven intervention for intact survival in preterms. Despite evidence, its adoption has been low. We used a point of care quality improvement (QI) approach to implement and sustain KMC in stable low birthweight babies from a baseline of 1.5 hours/baby/day to above 4 hours/baby/day through a series of plan-do-study-act (PDSA) cycles over a period of 53 weeks.

METHODS

All babies with birth weight <2000 g not on any respiratory support or phototherapy and or umbilical lines were eligible. The key quantitative outcome was KMC hours/baby/day. A QI collaborative was formed between six centres of Karnataka mentored by a team with a previous QI experience on KMC. The potential barriers for extended KMC were evaluated using fishbone analysis. Baseline data were collected over 3 weeks. A bundled approach consisting of a variety of parent centric measures (such as staff awareness, making KMC an integral part of treatment order, foster KMC, awareness sessions to parents weekly, recognising KMC champions) was employed in multiple PDSA cycles. The data were aggregated biweekly and the teams shared their implementation experiences monthly.

RESULTS

A total of 1443 parent-baby dyads were enrolled. The majority barriers were similar across the centres. Bundled approach incorporating foster KMC helped in the quick implementation of KMC even in outborns. Parental involvement and empowering nurses helped in sustaining KMC. Two centres had KMC rates above 10 hours/baby/day, while remaining four centres had KMC rates sustained above 6 hours/baby/day. Cross-learnings from team meetings helped to sustain efforts. Extended KMC could be implemented and sustained by low intensity training and QI collaboration.

CONCLUSIONS

Formation of a QI collaborative with mentoring helped in scaling implementation of extended KMC. Extended KMC could be implemented by parent centric best practices in all the centres without any additional need of resources.

Quality improvement collaborative to optimize heart failure care in patients from a network of clinics in Argentina during the COVID-19 pandemic

Heart failure (HF) is a major clinical and public health problem associated with significant mortality, morbidity, and health-care costs. Despite the existence of evidence-based guidelines for the optimal treatment of HF, the quality of care remains suboptimal. Our aim was to increase the use a care bundle in 50% of enrolled subjects during their hospitalization and discharge and to reduce their readmission for HF causes by 10%. We conducted an uncontrolled before-after study in eight hospitals in Argentina to evaluate the effect of a quality improvement intervention on the use of an HF care bundle in patients with HF New York Heart Association (NYHA) Class II-III. The HF bundle of care included medication, continuum of care, lifestyle habits, and predischarge examinations. Training and follow-up of multidisciplinary teams in each center were performed through learning sessions and plan-do-study-act improvement cycles. Data collectors reviewed bundle compliance in the health records of recruited patients after their hospital discharge and verified readmissions through phone calls to patients within 30-40 days after discharge. We recruited 200 patients (83 before and 127 during the intervention phase), and bundle compliance increased from 9.6% to 28.3% [odds ratio 3.71, 95% confidence interval (8.46; 1.63); P = .002]. Despite a slow improvement during the first months, bundle compliance gained momentum near the end of the intervention surpassing 80%. We observed a non-significant decreased readmission rate within 30 days of discharge due to HF in the postintervention period [8.4% vs. 5.5%, odds ratio 0.63, 95% CI (1.88; 0.21); P = .410]. Qualitative analysis showed that members of the intervention teams acknowledged the improvement of work organization and standardization of care, teamwork, shared mental model, and health record completeness as well as the utility of training fellows. Despite the challenges related to the pandemic, better care of patients with HF NYHA Class II-III was possible through simple interventions and collaborative work. Graphical abstract.

From purists to pragmatists: a qualitative evaluation of how implementation processes and contexts shaped the uptake and methodological adaptations of a maternal and neonatal quality improvement programme in South Africa prior to, and during COVID-19

BACKGROUND

Despite progress, maternal and neonatal mortality and still births remain high in South Africa. The South African National Department of Health implemented a quality improvement (QI) programme, called Mphatlalatsane, to reduce maternal and neonatal mortality and still births. It was implemented in 21 public health facilities, seven per participating province, between 2018 and 2022.

METHODS

We conducted a qualitative process evaluation of the contextual and implementation process factors' influence on implementation uptake amongst the QI teams in 15 purposively selected facilities. Data collection included three interview rounds with the leaders and members of the QI teams in each facility; intermittent interviews with the QI advisors; programme documentation review; observation of programme management meetings; and keeping a fieldwork journal. All data were thematically analysed in Atlas.ti. Implementation uptake varied across the three provinces and between facilities within provinces.

RESULTS

Between March and August 2020, the COVID-19 pandemic disrupted uptake in all provinces but affected QI teams in one province more severely than others, because they received limited pre-pandemic training. Better uptake among other sites was attributed to receiving more QI training pre-COVID-19, having an experienced QI advisor, and good teamwork. Uptake was more challenging amongst hospital teams which had more staff and more complicated MNH services, versus the primary healthcare facilities. We also attributed better uptake to greater district management support. A key factor shaping uptake was leaders' intrinsic motivation to apply QI methodology. We found that, across sites, organic adaptations to the QI methodology were made by teams, started during COVID-19. Teams did away with rapid testing of change ideas and keeping a paper trail of the steps followed. Though still using data to identify service problems, they used self-developed audit tools to record intervention effectiveness, and not the prescribed tools.

CONCLUSIONS

Our study underscores the critical role of intrinsic motivation of team leaders, support from experienced technical QI advisors, and context-sensitive adaptations to maximise QI uptake when traditionally recognised QI steps cannot be followed.

'The objective was about not blaming one another': a qualitative study to explore how collaboration is experienced within quality improvement collaboratives in Ethiopia

BACKGROUND

Quality improvement collaboratives are a common approach to improving quality of care. They rely on collaboration across and within health facilities to enable and accelerate quality improvement. Originating in high-income settings, little is known about how collaboration transfers to low-income settings, despite the widespread use of these collaboratives.

METHOD

We explored collaboration within quality improvement collaboratives in Ethiopia through 42 in-depth interviews with staff of two hospitals and four health centers and three with quality improvement mentors. Data were analysed thematically using a deductive and inductive approach.

RESULTS

There was collaboration at learning sessions though experience sharing, co-learning and peer pressure. Respondents were used to a blaming environment, which they contrasted to the open and non-blaming environment at the learning sessions. Respondents formed new relationships that led to across facility practical support. Within facilities, those in the quality improvement team continued to collaborate through the plan-do-study-act cycles, although this required high engagement and support from mentors. Few staff were able to attend learning sessions and within facility transfer of quality improvement knowledge was rare. This affected broader participation and led to some resentment and resistance. Improved teamwork skills and behaviors occurred at individual rather than facility or systems level, with implications for sustainability. Challenges to collaboration included unequal participation, lack of knowledge transfer, high workloads, staff turnover and a culture of dependency.

CONCLUSION

We conclude that collaboration can occur and is valued within a traditionally hierarchical system, but may require explicit support at learning sessions and by mentors. More emphasis is needed on ensuring quality improvement knowledge transfer, buy-in and system level change. This could include a modified collaborative design to provide facility-level support for spread.

Impact of hospital characteristics on implementation of a Pediatric Early Warning System in resource-limited cancer hospitals

Background

Pediatric Early Warning Systems (PEWS) aid in identification of deterioration in hospitalized children with cancer but are underutilized in resource-limited settings. Proyecto EVAT is a multicenter quality improvement (QI) collaborative in Latin America to implement PEWS. This study investigates the relationship between hospital characteristics and time required for PEWS implementation.

Methods

This convergent mixed-methods study included 23 Proyecto EVAT childhood cancer centers; 5 hospitals representing quick and slow implementers were selected for qualitative analysis. Semi-structured interviews were conducted with 71 stakeholders involved in PEWS implementation. Interviews were recorded, transcribed and translated to English, then coded using a priori and novel codes. Thematic content analysis explored the impact of hospital characteristics and QI experience on time required for PEWS implementation and was supplemented by quantitative analysis exploring the relationship between hospital characteristics and implementation time.

Results

In both quantitative and qualitative analysis, material and human resources to support PEWS significantly impacted time to implementation. Lack of resources produced various obstacles that extended time necessary for centers to achieve successful implementation. Hospital characteristics, such as funding structure and type, influenced PEWS implementation time by determining their resource-availability. Prior hospital or implementation leader experience with QI, however, helped facilitate implementation by assisting implementers predict and overcome resource-related challenges.

Conclusions

Hospital characteristics impact time required to implement PEWS in resource-limited childhood cancer centers; however, prior QI experience helps anticipate and adapt to resource challenges and more quickly implement PEWS. QI training should be a component of strategies to scale-up use of evidence-based interventions like PEWS in resource-limited settings.

"Quality teaches you how to use water. It doesn't provide a water pump": a qualitative study of context and mechanisms of action in an Ethiopian quality improvement program

BACKGROUND

Quality improvement collaboratives are a common approach to bridging the quality-of-care gap, but little is known about implementation in low-income settings. Implementers rarely consider mechanisms of change or the role of context, which may explain collaboratives' varied impacts.

METHODS

To understand mechanisms and contextual influences we conducted 55 in-depth interviews with staff from four health centres and two hospitals involved in quality improvement collaboratives in Ethiopia. We also generated control charts for selected indicators to explore any impacts of the collaboratives.

RESULTS

The cross facility learning sessions increased the prominence and focus on quality, allowed learning from experts and peers and were motivational through public recognition of success or a desire to emulate peers. Within facilities, new structures and processes were created. These were fragile and sometimes alienating to those outside the improvement team. The trusted and respected mentors were important for support, motivation and accountability. Where mentor visits were infrequent or mentors less skilled, team function was impacted. These mechanisms were more prominent, and quality improvement more functional, in facilities with strong leadership and pre-existing good teamwork; as staff had shared goals, an active approach to problems and were more willing and able to be flexible to implement change ideas. Quality improvement structures and processes were more likely to be internally driven and knowledge transferred to other staff in these facilities, which reduced the impact of staff turnover and increased buy-in. In facilities which lacked essential inputs, staff struggled to see how the collaborative could meaningfully improve quality and were less likely to have functioning quality improvement. The unexpected civil unrest in one region strongly disrupted the health system and the collaborative. These contextual issues were fluid, with multiple interactions and linkages.

CONCLUSIONS

The study confirms the need to carefully consider context in the implementation of quality improvement collaboratives. Facilities that implement quality improvement successfully may be those that already have characteristics that foster quality. Quality improvement may be alienating to those outside of the improvement team and implementers should not assume the organic spread or transfer of quality improvement knowledge.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.

Effect of a quality improvement intervention for management of preterm births on outcomes of all births in Kenya and Uganda: A secondary analysis from a facility-based cluster randomized trial

Background

A large proportion of early neonatal deaths occur at the time or on the first day of birth. The Preterm Birth Initiative East Africa (PTBi EA) set out to decrease mortality among preterm births through improving quality of facility-based intrapartum care. The PTBi EA cluster randomized trial's primary analysis showed the package reduced intrapartum stillbirth and neonatal death among preterm infants. This secondary analysis examines the impact of the PTBi intervention package on stillbirth and predischarge newborn deaths combined, among all births in 20 participating facilities in Kenya and Uganda.

Methods

Eligible facilities were pair-matched and randomly assigned (1:1) into either the intervention or the control group. All facilities received support for data strengthening and a modified World Health Organization (WHO) Safe Childbirth Checklist; facilities in the intervention group additionally received provider mentoring using PRONTO simulation and team training as well as quality improvement collaboratives. We abstracted data from maternity registers.

Results

Of the total 29 442 births that were included, Kenya had 8468 and 6465 births and Uganda had 8719 and 5790 births, in the control and intervention arms, respectively. There were 935 stillbirths and predischarge newborn deaths in the control arm and 439 in the intervention arm. The adjusted odds ratio (aOR) for the effect of the intervention on the combined outcome, among all births, was 0.96 (95% confidence interval (CI) = 0.69-1.32), which was different by country: Kenya - 1.12 (95% CI = 0.72-1.73); Uganda - 0.65 (95% CI = 0.44-0.98); P_interaction  = 0.025. These trends were similar after excluding the PTBi primary cohort.

Conclusions

The intervention package improved survival among all births in Uganda but not in Kenya. These results suggest the importance of context and facility differences that were observed between the two countries.

Registration

This trial is registered with ClinicalTrials.gov, NCT03112018.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America

BACKGROUND

Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America.

METHODS

Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact.

RESULTS

From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care.

CONCLUSIONS

Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes.

LAY SUMMARY

Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Improving the Quality of Health Care in Special Neonatal Care Units of India: A Before and After Intervention Study

BACKGROUND

We evaluated the efficacy of training health care workers (HCWs) in point-of-care quality improvement (POCQI) and a preterm newborn health care package (PHCP), followed by remote mentoring and supportive supervision in improving health care practices, neonatal survival, and morbidities in special neonatal care units (SNCUs).

METHODS

This pre- and postintervention quality improvement study was conducted at 3 SNCUs in Madhya Pradesh, India from February 2017 to February 2019. Clinical care teams comprising doctors and nurses from the study sites were trained in POCQI and the PHCP. The teams identified, prioritized, and analyzed problems and designed quality improvement initiatives at their respective health facilities. Change ideas were tested by the local teams using sequential plan-do-study-act cycles. Facilitators maintained contact with the teams through quarterly review meetings, fortnightly videoconferencing, on-demand phone calls, and group chat service. State SNCU coordinators made follow-up visits to supplement coaching. Study research staff independently collected data on admissions, health care practices, and outcomes of neonates.

FINDINGS

A total of 156 HCWs were trained in the POCQI methodology and PHCP. Sixteen quality improvement projects were formulated and implemented. Among 13,821 enrolled neonates (birth weight 2275±635 g; gestation: 35.8±2.8 weeks), improvement was seen in reduction of use of oxygen (36.1% vs. 48.0%; adjusted odds ratio [aOR]=0.60, 95% confidence interval [CI]=0.55, 0.66), antibiotics (29.4% vs. 39.0%; aOR=0.76, 95% CI=0.68, 0.85), and dairy milk (33.8% vs. 49.4%; aOR=0.34, 95% CI=0.31 to 0.38). Enteral feeds were started within 24 hours of admission in a larger number of neonates, resulting in fewer days to reach full feeds. There was no effect on survival at discharge from the hospital (aOR=0.93; 95% CI=0.80, 1.09).

CONCLUSION

A collaborative cross-learning quality improvement approach with remote mentoring, coaching, and supportive supervision was successful in improving the quality of care at SNCUs.

The role of teams in shaping quality of obstetrical care: a cross-sectional study in Dire Dawa, Ethiopia

OBJECTIVES

To examine how characteristics of clinical colleagues influence quality of care.

DESIGN

We conducted a cross-sectional observational study examining the associations between quality of care and a provider's coworkers, controlling for individual provider's characteristics and contextual factors.

SETTING

Nine health facilities in Dire Dawa Administration, Ethiopia, from December 2020 to February 2021.

PARTICIPANTS

824 clients and 95 unique providers were observed across the 9 health facilities.

OUTCOME MEASURES

We examine the quality of processes of intrapartum and immediate postpartum care during five phases of the delivery (first examination, first stage of labour, third stage of labour, immediate newborn care and immediate maternal postpartum care).

RESULTS

For the average client, 50% of the recommended routine clinical actions were completed during the delivery overall, with immediate maternal postpartum care being the least well performed (17% of recommended actions). Multiple healthcare providers were involved in 55% of deliveries. The number of providers contributing to a delivery was unassociated with the quality of care, but a one standard deviation increase in the coworker's performance was associated with a 2% point increase in quality of care (p<0.01); this association was largest among providers in the middle quartiles of performance.

CONCLUSIONS

A provider's typical performance had a modest positive association with quality of delivery care given by their coworker. As delivery care is often provided by multiple healthcare providers, examining the dynamics of how they influence one another can provide important insights for quality improvement.

Integrating hypertension and HIV care in Namibia: A quality improvement collaborative approach

Background

Hypertension (HTN) is highly prevalent among people with HIV (PWH) in Namibia, but screening and treatment for HTN are not routinely offered as part of HIV care delivery. We report the implementation of a quality improvement collaborative (QIC) to accelerate integration of HTN and HIV care within public-sector health facilities in Namibia.

Methods

Twenty-four facilities participated in the QIC with the aim of increasing HTN screening and treatment among adult PWH (>15 years). HTN was defined according to national treatment guidelines (i.e., systolic blood pressure >140 and/or diastolic blood pressure >90 across three measurements and at least two occasions), and decisions regarding initiation of treatment were made by physicians only. Teams from participating hospitals used quality improvement methods, monthly measurement of performance indicators, and small-scale tests of change to implement contextually tailored interventions. Coaching of sites was performed on a monthly basis by clinical officers with expertise in QI and HIV, and sites were convened as part of learning sessions to facilitate diffusion of effective interventions.

Results

Between March 2017 and March 2018, hypertension screening occurred as part of 183,043 (86%) clinical encounters at participating facilities. Among 1,759 PWH newly diagnosed with HTN, 992 (56%) were initiated on first-line treatment. Rates of treatment initiation were higher in facilities with an on-site physician (61%) compared to those without one (51%). During the QIC, facility teams identified fourteen interventions to improve HTN screening and treatment. Among barriers to implementation, teams pointed to malfunctions of blood pressure machines and stock outs of antihypertensive medications as common challenges.

Conclusions

Implementation of a QIC provided a structured approach for integrating HTN and HIV services across 24 high-volume facilities in Namibia. As rates of HTN treatment remained low despite ongoing facility-level changes, policy-level interventions—such as task sharing and supply chain strengthening—should be pursued to further improve delivery of HTN care among PWH beyond initial screening.

Impact of Point of Care Quality Improvement Training and Coaching on Quality Perceptions of Health Care Workers: Implication for Quality Policy

Background

The quality of infant healthcare service is one of the essential factors in preventing infant mortality. The purpose of the study was to analyze the quality performance in primary healthcare centers (PHC) and hospitals before and after the point of care quality improvement (POCQI) training for Infant Healthcare Services (IHS).

Methods

This is a mixed-method study design with convergence triangulation strategy, conducted at six public PHCs and four hospitals in two districts of West Java Province, Indonesia. One hundred health care workers (HCWs) were involved for quantitative study at baseline and end of intervention. An additional 40 patients participated as informants for qualitative study. Quantitative data analysis was performed by Rasch modeling and independent t-test for all variables, followed by content analysis for qualitative data.

Results

There were significant changes in the variables of POCQI skill (mean diff: 5.14, p=0.001), quality improvement (QI) understanding (mean diff: 1.2; p=0.001), and QI engagement (mean diff: 1.7; p=0.001) in the PHC group. Although there was an increase in process and outcome variables, the changes were not significant. There was a significant change in all variables in the hospital group which were outcome (mean diff: 2.32 (p=0.19); POCQI skill (mean diff: 2.80, p=0.001); process (mean diff: 1.48, p= 0.01); QI understanding (mean diff: 1.01; p=0.01), and QI engagement (mean diff: 1.52; p=0.03). Patient perception in the qualitative study showed that PHCs and Hospitals’ services improved. Moreover, health care workers found they have a better understanding of service quality and created quality changes and improved POCQI steps.

Conclusion

Implementation of POCQI in PHC and hospitals improved the performance of the quality of his, therefore assuring that POCQI is an appropriate approach and tool to be adopted in the policy for strengthening the health system.

Exploring the sustainability of perinatal audit in four district hospitals in the Western Cape, South Africa: a multiple case study approach

Introduction

Maternal and perinatal death surveillance and response (MPDSR) is an intervention process that uses a continuous cycle of identification, notification and review of deaths to determine avoidable causes followed by actions to improve health services and prevent future deaths. This study set out to understand how and why a perinatal audit programme, a form of MPDSR, has sustained practice in South Africa from the perspectives of those engaged in implementation.

Methods

A multiple case study design was carried out in four rural subdistricts of the Western Cape with over 10 years of implementing the programme. Data were collected from October 2019 to March 2020 through non-participant observation of seven meetings and key informant interviews with 41 purposively selected health providers and managers. Thematic analysis was conducted inductively and deductively adapting the extended normalisation process theory to examine the capability, contribution, potential and capacity of the users to implement MPDSR.

Results

The perinatal audit programme has sustained practice due to integration of activities into routine tasks (capability), clear value-add (contribution), individual and collective commitment (potential), and an enabling environment to implement (capacity). The complex interplay of actors, their relationships and context revealed the underlying individual-level and organisational-level factors that support sustainability, such as trust, credibility, facilitation and hierarchies. Local adaption and the broad social and structural resources were required for sustainability.

Conclusion

This study applied theory to explore factors that promote sustained practice of perinatal audit from the perspectives of the users. Efforts to promote and sustain MPDSR will benefit from overall good health governance, specific skill development, embedded activities, and valuing social processes related to implementation. More research using health policy and system approaches, including use of implementation theory, will further advance our understanding on how to support sustained MPDSR practice in other settings.

Implementing and Sustaining Brief Addiction Medicine Interventions with the Support of a Quality Improvement Blended-eLearning Course: Learner Experiences and Meaningful Outcomes in Kenya

Quality improvement methods could assist in achieving needed health systems improvements to address mental health and substance use, especially in low-middle-income countries (LMICs). Online learning is a promising avenue to deliver quality improvement training. This Computer-based Drug and Alcohol Training Assessment in Kenya (eDATA-K) study assessed users’ experience and outcome of a blended-eLearning quality improvement course and collaborative learning sessions. A theory of change, developed with decision-makers, identified relevant indicators of success. Data, analyzed using descriptive statistics and thematic analysis, were collected through extensive field observations, the eLearning platform, focus group discussions, and key informant interviews. The results showed that 22 community health workers and clinicians in five facilities developed competencies enabling them to form quality improvement teams and sustain the new substance-use services for the 8 months of the study, resulting in 4591 people screened, of which 575 received a brief intervention. Factors promoting course completion included personal motivation, prior positive experience with NextGenU.org’s courses, and a certificate. Significant challenges included workload and network issues. The findings support the effectiveness of the blended-eLearning model to assist health workers in sustaining new services, in a supportive environment, even in a LMIC peri-urban and rural settings.

Baseline Assessment of Evidence-Based Intrapartum Care Practices in Medical Schools in 3 States in India: A Mixed-Methods Study

INTRODUCTION

Implementation research with pre- and post-comparison was planned to improve the quality of evidence-based intrapartum care services in Indian medical schools. We present the baseline study results to assess the status of adherence to intrapartum evidence-based practices (IP-EBP) in study schools in 3 states in India and the perception of the faculty.

METHODS

A concurrent mixed-methods approach was used to conduct the baseline assessment in 9 medical schools in Rajasthan, Gujarat, and Union Territory from October 2018 to June 2019. IP-EBP among pregnant women in uncomplicated first (n=135), second (n=120), and third stage (n=120) of labor were observed using a predesigned, pretested checklist quantitatively. We conducted in-depth interviews with 33 obstetrics and gynecology faculty to understand their perceptions of intrapartum practices. Quantitative data were analyzed using SPSS (version 22). COM-B (Capability, Opportunity, and Motivation Behavior) model was used to understand the behaviors, and thematic analysis was done for the qualitative data.

FINDINGS

Unindicated augmentation of labor was done in 64.4%, fundal pressure applied in 50.8%, episiotomy done in 58.3%, and delivery in lithotomy position was performed in 86.7% of women in labor.

CONCLUSIONS

Intrapartum practices that are not recommended were routinely practiced in the study medical schools due to a lack of staff awareness of evidence-based practices and incorrect beliefs about their impact.

Sustainment of a Complex Culturally Competent Care Intervention for Hispanic Living Donor Kidney Transplantation: A Longitudinal Analysis of Adaptations

Introduction:

Sustainment refers to continued intervention delivery over time, while continuing to produce intended outcomes, often with ongoing adaptations, which are purposeful changes to the design or delivery of an intervention to improve its fit or effectiveness. The Hispanic Kidney Transplant Program (HKTP), a complex, culturally competent intervention, was implemented in two transplant programs to reduce disparities in Hispanic/Latinx living donor kidney transplant rates. This study longitudinally examined the influence of adaptations on HKTP sustainment.

Methods:

Qualitative interviews, learning collaborative calls, and telephone meetings with physicians, administrators, and staff (n = 55) were conducted over three years of implementation to identify HKTP adaptations. The Framework for Reporting Adaptations and Modifications-Expanded was used to classify adaptation types and frequency, which were compared across sites over time.

Results:

Across sites, more adaptations were made in the first year (n = 47), then fell and plateaued in the two remaining years (n = 35). Adaptations at Site-A were consistent across years (2017: n = 18, 2018: n = 17, 2019: n = 14), while Site-B made considerably fewer adaptations after the first year (2017: n = 29, 2018: n = 18, 2019: n = 21). Both sites proportionally made mostly skipping (32%), adding (20%), tweaking (20%), and substituting (16%) adaptation types. Skipping- and substituting-type adaptations were made due to institutional structural characteristics and lack of available resources, respectively. However, Site-A’s greater proportion of skipping-type adaptations was attributed to greater system complexity, and Site-B’s greater proportion of adding-type adaptation was attributed to the egalitarian team-based culture.

Conclusion:

Our findings can help prepare implementers to expect certain context-specific adaptations and preemptively avoid those that hinder sustainment.

Lessons learnt from quality improvement collaboratives in Cambodia

Currently, Cambodia uses performance-based financing (PBF) and a national quality enhancement monitoring system as key components of its strategy to achieve universal health coverage and the health-related Sustainable Development Goals. PBF is one among many strategies to improve the quality of healthcare services and its effects and limitations have been widely documented. We share lessons learnt from the use of quality improvement collaboratives, a facility-based quality improvement strategy, to amplify and complement PBF to address specific service delivery gaps, improve provider competency, and increase patient trust and satisfaction in the health system, a driver of healthcare utilisation.

How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review

BACKGROUND

A recent systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries. The review identified strategies with varying effects, including in-service training, supervision and group problem-solving. However, whether their effectiveness changed over time remained unclear. In particular, understanding whether effects decay over time is crucial to improve sustainability.

METHODS

We conducted a secondary analysis of data from the aforementioned review to explore associations between time and effectiveness. We calculated effect sizes (defined as percentage-point (%-point) changes) for HCP practice outcomes (eg, percentage of patients correctly treated) at each follow-up time point after the strategy was implemented. We estimated the association between time and effectiveness using random-intercept linear regression models with time-specific effect sizes clustered within studies and adjusted for baseline performance.

RESULTS

The primary analysis included 37 studies, and a sensitivity analysis included 77 additional studies. For training, every additional month of follow-up was associated with a 0.19 %-point decrease in effectiveness (95% CI: -0.36 to -0.03). For training combined with supervision, every additional month was associated with a 0.40 %-point decrease in effectiveness (95% CI: -0.68 to -0.12). Time trend results for supervision were inconclusive. For group problem-solving alone, time was positively associated with effectiveness, with a 0.50 %-point increase in effect per month (95% CI: 0.37 to 0.64). Group problem-solving combined with training was associated with large improvements, and its effect was not associated with time.

CONCLUSIONS

Time trends in the effectiveness of different strategies to improve HCP practices vary among strategies. Programmes relying solely on in-service training might need periodical refresher training or, better still, consider combining training with group problem-solving. Although more high-quality research is needed, these results, which are important for decision-makers as they choose which strategies to use, underscore the utility of studies with multiple post-implementation measurements so sustainability of the impact on HCP practices can be assessed.

The effectiveness of supervision strategies to improve health care provider practices in low- and middle-income countries: secondary analysis of a systematic review

BACKGROUND

Although supervision is a ubiquitous approach to support health programs and improve health care provider (HCP) performance in low- and middle-income countries (LMICs), quantitative evidence of its effects is unclear. The objectives of this study are to describe the effect of supervision strategies on HCP practices in LMICs and to identify attributes associated with greater effectiveness of routine supervision.

METHODS

We performed a secondary analysis of data on HCP practice outcomes (e.g., percentage of patients correctly treated) from a systematic review on improving HCP performance. The review included controlled trials and interrupted time series studies. We described distributions of effect sizes (defined as percentage-point [%-point] changes) for each supervision strategy. To identify attributes associated with supervision effectiveness, we performed random-effects linear regression modeling and examined studies that directly compared different approaches of routine supervision.

RESULTS

We analyzed data from 81 studies from 36 countries. For professional HCPs, such as nurses and physicians, primarily working at health facilities, routine supervision (median improvement when compared to controls: 10.7%-points; IQR: 9.9, 27.9) had similar effects on HCP practices as audit with feedback (median improvement: 10.1%-points; IQR: 6.2, 23.7). Two attributes were associated with greater mean effectiveness of routine supervision (p < 0.10): supervisors received supervision (by 8.8-11.5%-points), and supervisors participated in problem-solving with HCPs (by 14.2-20.8%-points). Training for supervisors and use of a checklist during supervision visits were not associated with effectiveness. The effects of supervision frequency (i.e., number of visits per year) and dose (i.e., the number of supervision visits during a study) were unclear. For lay HCPs, the effect of routine supervision was difficult to characterize because few studies existed, and effectiveness in those studies varied considerably. Evidence quality for all findings was low primarily because many studies had a high risk of bias.

CONCLUSIONS

Although evidence is limited, to promote more effective supervision, our study supports supervising supervisors and having supervisors engage in problem-solving with HCPs. Supervision's integral role in health systems in LMICs justifies a more deliberate research agenda to identify how to deliver supervision to optimize its effect on HCP practices.

Organizational contextual factors that predict success of a quality improvement collaborative approach to enhance integrated HIV-tuberculosis services: a sub-study of the Scaling up TB/HIV Integration trial

Background

A quality improvement (QI) collaborative approach to enhancing integrated HIV-Tuberculosis (TB) services may be effective in scaling up and improving the quality of service delivery. Little is known of the role of organizational contextual factors (OCFs) in influencing the success of QI collaboratives. This study aims to determine which OCFs were associated with improvement in a QI collaborative intervention to enhance integrated HIV-TB services delivery.

Methods

This is a nested sub-study embedded in a cluster-randomized controlled trial. Sixteen nurse supervisors (clusters) overseeing 40 clinics were randomized (1:1) to receive QI training and mentorship, or standard of care support (SOC). In the QI arm, eight nurse supervisors and 20 clinics formed a “collaborative” which aimed to improve HIV-TB process indicators, namely HIV testing, TB screening, isoniazid preventive therapy (IPT) initiations, viral load testing, and antiretroviral therapy for TB patients. OCFs measured at baseline were physical infrastructure, key staff, flexibility of clinic hours, monitoring data for improvement (MDI), and leadership support. Surveys were administered to clinic staff at baseline and month 12 to assess perceptions of supportiveness of contexts for change, and clinic organization for delivering integrated HIV-TB services. Linear mixed modelling was used to test for associations between OCFs and HIV-TB process indicators.

Results

A total of 209 clinic staff participated in the study; 97 (46.4%) and 112 (53.6%) from QI and SOC arms, respectively. There were no differences between the QI and SOC arms scores achieved for physical infrastructure (78.9% vs 64.7%; p = 0.058), key staff (95.8 vs 92; p = 0.270), clinic hours (66.9 vs 65.5; p = 0.900), MDI (63.3 vs 65; p = 0.875, leadership support (46.0 vs 57.4; p = 0.265), and perceptions of supportiveness of contexts for change (76.2 vs 79.7; p = 0.128 and clinic organization for delivering integrated HIV-TB services (74.1 vs 80.1; p = 0.916). IPT initiation was the only indicator that was significantly improved in the parent study. MDI was a significantly associated with increasing IPT initiation rates [beta coefficient (β) = 0.004; p = 0.004].

Discussion

MDI is a practice that should be fostered in public health facilities to increase the likelihood of success of future QI collaboratives to improve HIV-TB service delivery.

Trial registration

Clinicaltrials.gov, NCT02654613. Registered 01 June 2015.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01155-7.

Effectiveness of in-service training plus the collaborative improvement strategy on the quality of routine malaria surveillance data: results of a pilot study in Kayunga District, Uganda

BACKGROUND

Surveillance data are essential for malaria control, but quality is often poor. The aim of the study was to evaluate the effectiveness of the novel combination of training plus an innovative quality improvement method-collaborative improvement (CI)-on the quality of malaria surveillance data in Uganda.

METHODS

The intervention (training plus CI, or TCI), including brief in-service training and CI, was delivered in 5 health facilities (HFs) in Kayunga District from November 2015 to August 2016. HF teams monitored data quality, conducted plan-do-study-act cycles to test changes, attended periodic learning sessions, and received CI coaching. An independent evaluation was conducted to assess data completeness, accuracy, and timeliness. Using an interrupted time series design without a separate control group, data were abstracted from 156,707 outpatient department (OPD) records, laboratory registers, and aggregated monthly reports (MR) for 4 time periods: baseline-12 months, TCI scale-up-5 months; CI implementation-9 months; post-intervention-4 months. Monthly OPD register completeness was measured as the proportion of patient records with a malaria diagnosis with: (1) all data fields completed, and (2) all clinically-relevant fields completed. Accuracy was the relative difference between: (1) number of monthly malaria patients reported in OPD register versus MR, and (2) proportion of positive malaria tests reported in the laboratory register versus MR. Data were analysed with segmented linear regression modelling.

RESULTS

Data completeness increased substantially following TCI. Compared to baseline, all-field completeness increased by 60.1%-points (95% confidence interval [CI]: 46.9-73.2%) at mid-point, and clinically-relevant completeness increased by 61.6%-points (95% CI: 56.6-66.7%). A relative - 57.4%-point (95% confidence interval: - 105.5, - 9.3%) change, indicating an improvement in accuracy of malaria test positivity reporting, but no effect on data accuracy for monthly malaria patients, were observed. Cost per additional malaria patient, for whom complete clinically-relevant data were recorded in the OPD register, was $3.53 (95% confidence interval: $3.03, $4.15).

CONCLUSIONS

TCI improved malaria surveillance completeness considerably, with limited impact on accuracy. Although these results are promising, the intervention's effectiveness should be evaluated in more HFs, with longer follow-up, ideally in a randomized trial, before recommending CI for wide-scale use.

Quality of clinical assessment and child mortality: a three-country cross-sectional study

This analysis describes specific gaps in the quality of health care in Central Africa and assesses the association between quality of clinical care and mortality at age 2-59 months. Regionally representative facility and household surveys for the Democratic Republic of the Congo, Cameroon and Central African Republic were collected between 2012 and 2016. These data are novel in linking facilities with households in their catchment area. Compliance with diagnostic and danger sign protocols during sick-child visits was observed by trained assessors. We computed facility- and district-level compliance indicators for patients aged 2-59 months and used multivariate multi-level logistic regression models to estimate the association between clinical assessment quality and mortality at age 2-59 months in the catchment areas of the observed facilities. A total of 13 618 live births were analysed and 1818 sick-child visits were directly observed and used to rate 643 facilities. Eight percent of observed visits complied with 80% of basic diagnostic protocols, and 13% of visits fully adhered to select general danger sign protocols. A 10% greater compliance with diagnostic protocols was associated with a 14.1% (adjusted odds ratio (aOR) 95% CI: 0.025-0.244) reduction in the odds of mortality at age 2-59 months; a 10% greater compliance with select general danger sign protocols was associated with a 15.3% (aOR 95% CI: 0.058-0.237) reduction in the same odds. The results of this article suggest that compliance with recommended clinical protocols remains poor in many settings and improvements in mortality at age 2-59 months could be possible if compliance were improved.

Does coaching matter? Examining the impact of specific practice facilitation strategies on implementation of quality improvement interventions in the Healthy Hearts in the Heartland study

BACKGROUND

Practice facilitation is a multicomponent implementation strategy used to improve the capacity for practices to address care quality and implementation gaps. We sought to assess whether practice facilitators use of coaching strategies aimed at improving self-sufficiency were associated with improved implementation of quality improvement (QI) interventions in the Healthy Hearts in the Heartland Study.

METHODS

We mapped 27 practice facilitation activities to a framework that classifies practice facilitation strategies by the degree to which the practice develops its own process expertise (Doing Tasks, Project Management, Consulting, Teaching, and Coaching) and then used regression tree analysis to group practices by facilitation strategies experienced. Kruskal-Wallis tests were used to assess whether practice groups identified by regression tree analysis were associated with successful implementation of QI interventions and practice and study context variables.

RESULTS

There was no association between number of strategies performed by practice facilitators and number of QI interventions implemented. Regression tree analysis identified 4 distinct practice groups based on the number of Project Management and Coaching strategies performed. The median number of interventions increased across the groups. Practices receiving > 4 project management and > 6 coaching activities implemented a median of 17 of 35 interventions. Groups did not differ significantly by practice size, association with a healthcare network, or practice type. Statistically significant differences in practice location, number and duration of facilitator visits, and early study termination emerged among the groups, compared to the overall practice population.

CONCLUSIONS

Practices that engage in more coaching-based strategies with practice facilitators are more likely to implement more QI interventions, and practice receptivity to these strategies was not dependent on basic practice demographics.

Implementing an intrapartum package of interventions to improve quality of care to reduce the burden of preterm birth in Kenya and Uganda

Background

Quality of care during the intrapartum and immediate postnatal period for maternal and newborn health remains a major challenge due to the multiple health system bottlenecks in low-income countries. Reports of complex interventions that have been effective in reducing maternal and newborn mortality in these settings are usually limited in description, which inhibits learning and replication. We present a detailed account of the Preterm Birth Initiative (PTBi) implementation process, experiences and lessons learnt to inform scale-up and replication.

Methods

Using the TiDieR framework, we detail how the PTBi implemented an integrated package of interventions through a pair-matched cluster randomized control trial in 20 health facilities in Migori County, Kenya, and the Busoga region in east central Uganda from 2016 to 2019. The package aimed to improve quality of care during the intrapartum and immediate postnatal period with a focus on preterm birth. The package included data strengthening (DS) and introduction of a modified WHO Safe Childbirth Checklist (mSCC), simulation-based training and mentoring (PRONTO), and a Quality Improvement (QI) Collaborative.

Results

In 2016, DS and mSCC were introduced to improve existing data processes and increase the quality of data for measures needed to evaluate study impact. PRONTO and QI interventions were then rolled out sequentially. While package components were implemented with fidelity, some implementation processes required contextual adaptation to allow alignment with national priorities and guidelines, and flexibility to optimize uptake.

Conclusion

Lessons learned included the importance of synergy between interventions, the need for local leadership engagement, and the value of strengthening local systems and resources. Adaptations of individual elements of the package to suit the local context were important for effective implementation, and the TIDieR framework provides the guidance needed in detailed description to replicate such a complex intervention in other settings. Detailed documentation of the implementation process of a complex intervention with mutually synergistic components can help contextualize trial results and potential for scale-up. The trial is registered at ClinicalTrials.govNCT03112018, registered December 2016, posted April 2017.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00109-w.

Effect of collaborative quality improvement on stillbirths, neonatal mortality and newborn care practices in hospitals of Telangana and Andhra Pradesh, India: evidence from a quasi-experimental mixed-methods study

Background

Improving quality of care is a key priority to reduce neonatal mortality and stillbirths. The Safe Care, Saving Lives programme aimed to improve care in newborn care units and labour wards of 60 public and private hospitals in Telangana and Andhra Pradesh, India, using a collaborative quality improvement approach. Our external evaluation of this programme aimed to evaluate programme effects on implementation of maternal and newborn care practices, and impact on stillbirths, 7- and 28-day neonatal mortality rate in labour wards and neonatal care units. We also aimed to evaluate programme implementation and mechanisms of change.

Methods

We used a quasi-experimental plausibility design with a nested process evaluation. We evaluated effects on stillbirths, mortality and secondary outcomes relating to adherence to 20 evidence-based intrapartum and newborn care practices, comparing survey data from 29 hospitals receiving the intervention to 31 hospitals expected to receive the intervention later, using a difference-in-difference analysis. We analysed programme implementation data and conducted 42 semi-structured interviews in four case studies to describe implementation and address four theory-driven questions to explain the quantitative results.

Results

Only 7 of the 29 intervention hospitals were engaged in the intervention for its entire duration. There was no evidence of an effect of the intervention on stillbirths [DiD − 1.3 percentage points, 95% CI − 2.6–0.1], on neonatal mortality at age 7 days [DiD − 1.6, 95% CI − 9–6.2] or 28 days [DiD − 3.0, 95% CI − 12.9—6.9] or on adherence to target evidence-based intrapartum and newborn care practices. The process evaluation identified challenges in engaging leaders; challenges in developing capacity for quality improvement; and challenges in activating mechanisms of change at the unit level, rather than for a few individuals, and in sustaining these through the creation of new social norms.

Conclusion

Despite careful planning and substantial resources, the intervention was not feasible for implementation on a large scale. Greater focus is required on strategies to engage leadership. Quality improvement may need to be accompanied by clinical training. Further research is also needed on quality improvement using a health systems perspective.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-020-01058-z.

Perspectives on implementing a quality improvement collaborative to improve person-centered care for maternal and reproductive health in Kenya

OBJECTIVE

To understand perspectives and experiences related to participation in a quality improvement collaborative (QIC) to improve person-centered care (PCC) for maternal health and family planning (FP) in Kenya.

DESIGN AND SETTING

Semi-structured qualitative interviews were conducted with members of the QIC in four public health facilities in Kenya.

PARTICIPANTS

Clinical and nonclinical public health facility staff who had participated in the QIC were purposively sampled to participate in the semi-structured interviews.

INTERVENTION

A QIC was implemented across four public health facilities in Nairobi and Kiambu Counties in Kenya to improve PCC experiences for women seeking maternity or FP services.

MAIN OUTCOME MEASURE

Semi-structured interviews with participants of the QIC to understand perspectives and experiences associated with sensitization to and implementation of PCC behaviors in maternity and FP services.

RESULTS

Respondents reported that sensitization to PCC principles resulted in multiple perceived benefits for staff and patients alike, including improved interactions with patients and clients, deeper awareness of patient and client preferences, and improved interpersonal skills and greater job satisfaction. Respondents also highlighted system-level challenges that impeded their ability to consistently provide high-quality PCC to women, namely staff shortages and frequent turnover, high patient volumes and lack of space in their respective health facilities.

CONCLUSION

Respondents were easily able to articulate perceived benefits derived from participation in this QIC, although they were equally able to identify challenges that hindered their ability to consistently provide high-quality PCC to women seeking maternity or FP services.

Harnessing the health systems strengthening potential of quality improvement using realist evaluation: an example from southern Tanzania

Quality improvement (QI) is a problem-solving approach in which stakeholders identify context-specific problems and create and implement strategies to address these. It is an approach that is increasingly used to support health system strengthening, which is widely promoted in Sub-Saharan Africa. However, few QI initiatives are sustained and implementation is poorly understood. Here, we propose realist evaluation to fill this gap, sharing an example from southern Tanzania. We use realist evaluation to generate insights around the mechanisms driving QI implementation. These insights can be harnessed to maximize capacity strengthening in QI and to support its operationalization, thus contributing to health systems strengthening. Realist evaluation begins by establishing an initial programme theory, which is presented here. We generated this through an elicitation approach, in which multiple sources (theoretical literature, a document review and previous project reports) were collated and analysed retroductively to generate hypotheses about how the QI intervention is expected to produce specific outcomes linked to implementation. These were organized by health systems building blocks to show how each block may be strengthened through QI processes. Our initial programme theory draws from empowerment theory and emphasizes the self-reinforcing nature of QI: the more it is implemented, the more improvements result, further empowering people to use it. We identified that opportunities that support skill- and confidence-strengthening are essential to optimizing QI, and thus, to maximizing health systems strengthening through QI. Realist evaluation can be used to generate rich implementation data for QI, showcasing how it can be supported in ‘real-world’ conditions for health systems strengthening.

Malaria case management and elimination readiness in health facilities of five districts of Madagascar in 2018

BACKGROUND

Madagascar's Malaria National Strategic Plan 2018-2022 calls for progressive malaria elimination beginning in low-incidence districts (< 1 case/1000 population). Optimizing access to prompt diagnosis and quality treatment and improving outbreak detection and response will be critical to success. A malaria elimination readiness assessment (MERA) was performed in health facilities (HFs) of selected districts targeted for malaria elimination.

METHODS

A mixed methods survey was performed in September 2018 in five districts of Madagascar. Randomly selected HFs were assessed for availability of malaria commodities and frequency of training and supervision conducted. Health providers (HPs) and community health volunteers (CHVs) were interviewed, and outpatient consultations at HFs were observed. To evaluate elimination readiness, a composite score ranging from 0 to 100 was designed from all study tools and addressed four domains: (1) resource availability, (2) case management (CM), (3) data management and use, and (4) training, supervision, and technical assistance; scores were calculated for each HF catchment area and district based on survey responses. Stakeholder interviews on malaria elimination planning were conducted at national, regional and district levels.

RESULTS

A quarter of the 35 HFs surveyed had no rapid diagnostic tests (RDTs). Of 129 patients with reported or recorded fever among 300 consultations observed, HPs tested 56 (43%) for malaria. Three-quarters of the 35 HF managers reviewed data for trends. Only 68% of 41 HPs reported receiving malaria-specific training. Of 34 CHVs surveyed, 24% reported that treating fever was no longer among their responsibilities. Among treating CHVs, 13 (50%) reported having RDTs, and 11 (42%) had anti-malarials available. The average district elimination readiness score was 52 out of 100, ranging from 48 to 57 across districts. Stakeholders identified several challenges to commodity management, malaria CM, and epidemic response related to lack of training and funding disruptions.

CONCLUSION

This evaluation highlighted gaps in malaria CM and elimination readiness in Madagascar to address during elimination planning. Strategies are needed that include training, commodity provision, supervision, and support for CHVs. The MERA can be repeated to assess progress in filling identified gaps and is a feasible tool that could be used to assess elimination targets in other countries.

Effect of a quality improvement package for intrapartum and immediate newborn care on fresh stillbirth and neonatal mortality among preterm and low-birthweight babies in Kenya and Uganda: a cluster-randomised facility-based trial

Background

Although gains in newborn survival have been achieved in many low-income and middle-income countries, reductions in stillbirth and neonatal mortality have been slow. Prematurity complications are a major driver of stillbirth and neonatal mortality. We aimed to assess the effect of a quality improvement package for intrapartum and immediate newborn care on stillbirth and preterm neonatal survival in Kenya and Uganda, where evidence-based practices are often underutilised.

Methods

This unblinded cluster-randomised controlled trial was done in western Kenya and eastern Uganda at facilities that provide 24-h maternity care with at least 200 births per year. The study assessed outcomes of low-birthweight and preterm babies. Eligible facilities were pair-matched and randomly assigned (1:1) into either the intervention group or the control group. All facilities received maternity register data strengthening and a modified WHO Safe Childbirth Checklist; facilities in the intervention group additionally received provider mentoring using PRONTO simulation and team training as well as quality improvement collaboratives. Liveborn or fresh stillborn babies who weighed between 1000 g and 2500 g, or less than 3000 g with a recorded gestational age of less than 37 weeks, were included in the analysis. We abstracted data from maternity registers for maternal and birth outcomes. Follow-up was done by phone or in person to identify the status of the infant at 28 days. The primary outcome was fresh stillbirth and 28-day neonatal mortality. This trial is registered with ClinicalTrials.gov, NCT03112018.

Findings

Between Oct 1, 2016, and April 30, 2019, 20 facilities were randomly assigned to either the intervention group (n=10) or the control group (n=10). Among 5343 eligible babies in these facilities, we assessed outcomes of 2938 newborn and fresh stillborn babies (1447 in the intervention and 1491 in the control group). 347 (23%) of 1491 infants in the control group were stillborn or died in the neonatal period compared with 221 (15%) of 1447 infants in the intervention group at 28 days (odds ratio 0·66, 95% CI 0·54–0·81). No harm or adverse effects were found.

Interpretation

Fresh stillbirth and neonatal mortality among low-birthweight and preterm babies can be decreased using a package of interventions that reinforces evidence-based practices and invests in health system strengthening.

Funding

Bill & Melinda Gates Foundation.

The impacts of quality improvement on maternal and newborn health: preliminary findings from a health system integrated intervention in four Ethiopian regions

Background

Quality improvement (QI) methods are effective in improving healthcare delivery using sustainable, collaborative, and cost-effective approaches. Systems-integrated interventions offer promise in terms of producing sustainable impacts on service quality and coverage, but can also improve important data quality and information systems at scale.

Methods

This study assesses the preliminary impacts of a first phase, quasi-experimental, QI health systems intervention on maternal and neonatal health outcomes in four pilot districts in Ethiopia. The intervention identified, trained, and coached QI teams to develop and test change ideas to improve service delivery. We use an interrupted time-series approach to evaluate intervention effects over 32-months. Facility-level outcome indicators included: proportion of mothers receiving four antenatal care visits, skilled delivery, syphilis testing, early postnatal care, proportion of low birth weight infants, and measures of quality delivery of childbirth services.

Results

Following the QI health systems intervention, we found a significant increase in the rate of syphilis testing (ß = 2.41, 95% CI = 0.09,4.73). There were also large positive impacts on health worker adherence to safe child birth practices just after birth (ß = 8.22, 95% CI = 5.15, 11.29). However, there were limited detectable impacts on other facility-usage indicators. Findings indicate early promise of systems-integrated QI on the delivery of maternal health services, and increased some service coverage.

Conclusions

This study preliminarily demonstrates the feasibility of complex, low-cost, health-worker driven improvement interventions that can be adapted in similar settings around the world, though extended follow up time may be required to detect impacts on service coverage. Policy makers and health system workers should carefully consider what these findings mean for scaling QI approaches in Ethiopia and other similar settings.

How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review

BACKGROUND

Quality improvement collaboratives are widely used to improve health care in both high-income and low and middle-income settings. Teams from multiple health facilities share learning on a given topic and apply a structured cycle of change testing. Previous systematic reviews reported positive effects on target outcomes, but the role of context and mechanism of change is underexplored. This realist-inspired systematic review aims to analyse contextual factors influencing intended outcomes and to identify how quality improvement collaboratives may result in improved adherence to evidence-based practices.

METHODS

We built an initial conceptual framework to drive our enquiry, focusing on three context domains: health facility setting; project-specific factors; wider organisational and external factors; and two further domains pertaining to mechanisms: intra-organisational and inter-organisational changes. We systematically searched five databases and grey literature for publications relating to quality improvement collaboratives in a healthcare setting and containing data on context or mechanisms. We analysed and reported findings thematically and refined the programme theory.

RESULTS

We screened 962 abstracts of which 88 met the inclusion criteria, and we retained 32 for analysis. Adequacy and appropriateness of external support, functionality of quality improvement teams, leadership characteristics and alignment with national systems and priorities may influence outcomes of quality improvement collaboratives, but the strength and quality of the evidence is weak. Participation in quality improvement collaborative activities may improve health professionals' knowledge, problem-solving skills and attitude; teamwork; shared leadership and habits for improvement. Interaction across quality improvement teams may generate normative pressure and opportunities for capacity building and peer recognition.

CONCLUSION

Our review offers a novel programme theory to unpack the complexity of quality improvement collaboratives by exploring the relationship between context, mechanisms and outcomes. There remains a need for greater use of behaviour change and organisational psychology theory to improve design, adaptation and evaluation of the collaborative quality improvement approach and to test its effectiveness. Further research is needed to determine whether certain contextual factors related to capacity should be a precondition to the quality improvement collaborative approach and to test the emerging programme theory using rigorous research designs.

A condom uterine balloon device among referral facilities in Dar Es Salaam: an assessment of perceptions, barriers and facilitators one year after implementation

BACKGROUND

Postpartum hemorrhage (PPH) is the leading cause of maternal death in Tanzania. The Every Second Matters for Mothers and Babies- Uterine Balloon Tamponade (ESM-UBT) device was developed to address this problem in women with atonic uterus. The objective of this study was to understand the barriers and facilitators to optimal use of the device, in Dar es Salaam Tanzania 1 year after implementation.

METHODS

Semi-structured interviews of skilled-birth attendants were conducted between May and July 2017. Interviews were recorded, coded and analyzed for emergent themes.

RESULTS

Among the participants, overall there was a positive perception of the ESM-UBT device. More than half of participants reported the device was readily available and more than 1/3 described ease and success with initial use. Barriers included fear and lack of refresher training. Finally, participants expressed a need for training and device availability at peripheral hospitals.

CONCLUSION

The implementation and progression to optimal use of the ESM-UBT device in Tanzania is quite complex. Ease of use and the prospect of saving a life/preserving fertility strongly promoted use while fear and lack of high-level buy-in hindered utilization of the device. A thorough understanding and investigation of these facilitators and barriers are required to increase uptake of the ESM-UBT device.