How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review

Impact of hospital characteristics on implementation of a Pediatric Early Warning System in resource-limited cancer hospitals

Background

Pediatric Early Warning Systems (PEWS) aid in identification of deterioration in hospitalized children with cancer but are underutilized in resource-limited settings. Proyecto EVAT is a multicenter quality improvement (QI) collaborative in Latin America to implement PEWS. This study investigates the relationship between hospital characteristics and time required for PEWS implementation.

Methods

This convergent mixed-methods study included 23 Proyecto EVAT childhood cancer centers; 5 hospitals representing quick and slow implementers were selected for qualitative analysis. Semi-structured interviews were conducted with 71 stakeholders involved in PEWS implementation. Interviews were recorded, transcribed and translated to English, then coded using a priori and novel codes. Thematic content analysis explored the impact of hospital characteristics and QI experience on time required for PEWS implementation and was supplemented by quantitative analysis exploring the relationship between hospital characteristics and implementation time.

Results

In both quantitative and qualitative analysis, material and human resources to support PEWS significantly impacted time to implementation. Lack of resources produced various obstacles that extended time necessary for centers to achieve successful implementation. Hospital characteristics, such as funding structure and type, influenced PEWS implementation time by determining their resource-availability. Prior hospital or implementation leader experience with QI, however, helped facilitate implementation by assisting implementers predict and overcome resource-related challenges.

Conclusions

Hospital characteristics impact time required to implement PEWS in resource-limited childhood cancer centers; however, prior QI experience helps anticipate and adapt to resource challenges and more quickly implement PEWS. QI training should be a component of strategies to scale-up use of evidence-based interventions like PEWS in resource-limited settings.

Association of Tolerance of Uncertainty With Outcomes in a Quality Improvement Collaborative

BACKGROUND

Tolerance of uncertainty may influence how physicians and other providers practice and make clinical decisions. We hypothesized that increased tolerance of uncertainty would be associated with an increased uptake of a quality improvement (QI) intervention.

METHODS

We examined tolerance of uncertainty using the Physicians' Reactions to Uncertainty Scale in the context of a national QI project in the Value in Inpatient Pediatrics network. The QI project aimed to increase exclusive isotonic fluid use and decrease laboratory draws. Exposure to the intervention was measured by using the stepped wedge design with sequential implementation across a diverse group of US hospitals. Multivariable analysis was conducted by using exposure to the intervention and tolerance of uncertainty as independent variables and exclusive isotonic fluid use or laboratory testing as the dependent variable.

RESULTS

Of 106 participating hospitals, 97 contributed valid responses, with an overall mean reported tolerance of uncertainty of 3.39 (95% confidence interval: 3.27-3.50), with lower numbers on the 6-point scale indicating greater tolerance of uncertainty. Exposure to the QI intervention was significantly associated with exclusive isotonic fluid use (P <.001). Lower tolerance of uncertainty at baseline was associated with lower baseline isotonic fluid use and greater uptake of the use of isotonic fluids but not reduction in laboratory testing.

CONCLUSIONS

Contrary to our hypothesis, lower tolerance of uncertainty was associated with greater uptake of the QI intervention for the outcome of isotonic fluids. This initial association warrants further study to evaluate how tolerance of uncertainty plays a role in quality improvement science.

Feasibility, usability and acceptability of a novel digital hybrid-system for reporting of routine maternal health information in Southern Tanzania: A mixed-methods study

Health information systems are important for health planning and progress monitoring. Still, data from health facilities are often of limited quality in Low-and-Middle-Income Countries. Quality deficits are partially rooted in the fact that paper-based documentation is still the norm at facility level, leading to mistakes in summarizing and manual copying. Digitization of data at facility level would allow automatization of these procedural steps. Here we aimed to evaluate the feasibility, usability and acceptability of a scanning innovation called Smart Paper Technology for digital data processing. We used a mixed-methods design to understand users' engagement with Smart Paper Technology and identify potential positive and negative effects of this innovation in three health facilities in Southern Tanzania. Eight focus group discussions and 11 in-depth interviews with users were conducted. We quantified time used by health care providers for documentation and patient care using time-motion methods. Thematic analysis was used to analyze qualitative data. Descriptive statistics and multivariable linear models were generated to compare the difference before and after introduction and adjust for confounders. Health care providers and health care managers appreciated the forms' simple design features and perceived Smart Paper Technology as time-saving and easy to use. The time-motion study with 273.3 and 224.0 hours of observations before and after introduction of Smart Paper Technology, respectively, confirmed that working time spent on documentation did not increase (27.0% at baseline and 26.4% post-introduction; adjusted p = 0.763). Time spent on patient care was not negatively impacted (26.9% at baseline and 37.1% at post-intervention; adjusted p = 0.001). Health care providers described positive effects on their accountability for data and service provision relating to the fact that individually signed forms were filled. Health care providers perceived Smart Paper Technology as feasible, easy to integrate and acceptable in their setting, particularly as it did not add time to documentation.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.

Vignette Research Methodology: An Essential Tool for Quality Improvement Collaboratives

Variation in patient outcomes among institutions and within institutions is a major problem in healthcare. Some of this variation is due to differences in practice, termed practice variation. Some practice variation is expected due to appropriately personalized care for a given patient. However, some practice variation is due to the individual preference or style of the clinicians. Quality improvement collaboratives are commonly used to disseminate quality care on a wide scale. Practice variation is a notable barrier to any quality improvement effort. A detailed and accurate understanding of practice variation can help optimize the quality improvement efforts. The traditional survey methods do not capture the complex nuances of practice variation. Vignette methods have been shown to accurately measure the actual practice variation and quality of care delivered by clinicians. Vignette methods are cost-effective relative to other methods of measuring quality of care. This review describes our experience and lessons from implementing vignette research methods in quality improvement collaboratives in California neonatal intensive care units. Vignette methodology is an ideal tool to address practice variation in quality improvement collaboratives, actively engage a large number of participants, and support more evidence-based practice to improve outcomes.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America

BACKGROUND

Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America.

METHODS

Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact.

RESULTS

From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care.

CONCLUSIONS

Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes.

LAY SUMMARY

Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Local Dynamics of Collaboration for Maternal, Newborn and Child Health: A Social Network Analysis of Healthcare Providers and Their Managers in Gert Sibande District, South Africa

BACKGROUND

Accountability for maternal, newborn and child health (MNCH) is a collaborative endeavour and documenting collaboration dynamics may be key to understanding variations in the performance of MNCH services. This study explored the dynamics of collaboration among frontline health professionals participating in two MNCH coordination structures in a rural South African district. It examined the role and position of actors, the nature of their relationships, and the overall structure of the collaborative network in two sub-districts.

METHODS

Cross-sectional survey using a social network analysis (SNA) methodology of 42 district and sub district actors involved in MNCH coordination structures. Different domains of collaboration (eg, communication, professional support, innovation) were surveyed at key interfaces (district-sub-district, across service delivery levels, and within teams).

RESULTS

The overall network structure reflected a predominantly hierarchical mode of clustering of organisational relationships around hospitals and their referring primary healthcare (PHC) facilities. Clusters were linked through (and dependent on) a combination of district MNCH programme and line managers, identified as central connectors or boundary spanners. Overall network density remained low suggesting potential for strengthening collaborative relationships. Within cluster collaborative patterns (inter-professional and across levels) varied, highlighting the significance of small units in district functioning.

CONCLUSION

SNA provides a mechanism to uncover the nature of relationships and key actors in collaborative dynamics which could point to system strengths and weaknesses. It offers insights on the level of fragmentation within and across small units, and the need to strengthen cohesion and improve collaborative relationships, and ultimately, the delivery of health services.

Evaluating a quality improvement collaborative: a hybrid approach

PURPOSE

Quality improvement collaboratives (QICs) are a popular approach to improving healthcare services and patient outcomes. This paper evaluates a QIC implemented by a large, integrated healthcare organisation in Wales in the UK.

DESIGN/METHODOLOGY/APPROACH

This evaluation study draws on two well-established evaluation frameworks: Kirkpatrick's approach to gather data on participant satisfaction and learning and Stake's approach to gather data and form judgements about the impact of the intervention. A mixed methods approach was taken which included documentary analysis, surveys, semi-structured interviews, and observation of the QIC programme.

FINDINGS

Together the two frameworks provide a rounded interpretation of the extent to which the QIC intervention was fit-for-purpose. Broadly the evaluation of the QIC was positive with some areas of improvement identified.

RESEARCH LIMITATIONS/IMPLICATIONS

This study is limited to a QIC conducted within one organisation. Further testing of the hybrid framework is needed that extends to different designs of QICs.

PRACTICAL IMPLICATIONS

A hybrid framework is provided to assist those charged with designing and evaluating QICs.

ORIGINALITY/VALUE

Evaluation studies are limited on QICs and if present tend to adopt one framework. Given the complexities of undertaking quality improvement within healthcare, this study uniquely takes a hybrid approach.

Evaluation of the Processes and Outcomes of a Physician Leadership Program: The Continuous Feedback Loop Design

INTRODUCTION

Physicians assume leadership roles in their health care organizations and practices often without support or training. The Physicians Leadership Academy provides integrated leadership seminars, mindfulness training, and executive coaching in a 10-month curriculum to physicians across area organizations.

METHODS

Program evaluators responded to stakeholders' need for continuous program improvement by developing a continuous feedback loop evaluation design incorporating a program monitoring system and a theory-driven program evaluation. Given the size of the 2019 to 20 cohort ( n = 19), a one-group pretest/posttest design was used to assess the mechanisms of the program (mindfulness and wellbeing) along with knowledge development, emotional intelligence, and personal and professional growth. The assessments used a combination of published and administrator-developed assessments to address the unique aspects of the program. Doing such ensured continuous improvement and sustainability for the program.

RESULTS

The cohort of physicians demonstrated significant engagement and learning across the curriculum, improved mindfulness, and improved capacity of the providers to affect their health care system and communities.

CONCLUSIONS

The utility of the program was demonstrated through quantitative and qualitative analyses. Implications of the methodology for future evaluations of program developments are discussed.

Spreading a Strategy to Prevent Suicide After Psychiatric Hospitalization: Results of a Quality Improvement Spread Initiative

BACKGROUND

Suicide after psychiatric hospitalization is a major concern. Poor treatment engagement may contribute to risk. The World Health Organization Brief Intervention and Contact (BIC) Program is an evidence-based practice shown to prevent suicide after psychiatric discharge in international trials. There have been no efforts to implement BIC into routine practice in US populations.

METHODS

The authors conducted a 12-month quality improvement (QI) collaborative at six US Department of Veterans Affairs (VA) medical centers serving a large rural population. Sites had low to moderate performance on a VA quality measure of mental health postdischarge care; a measure assessing the proportion of discharged patients who achieve the required number of visits ≤ 30 days. Sites received programmatic support to implement BIC locally. Implementation was assessed using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework.

RESULTS

Overall, teams had high participation in programmatic activities and enrolled 85% of eligible patients that they approached. Among 70 enrolled patients, 81.4% achieved the VA quality measure of mental health postdischarge care, suggesting good treatment engagement. On average, patients rated BIC as excellent. Team members agreed that BIC was easy to use, implementable, possible, and doable. Factors facilitating implementation included standardized operating procedures to standardize processes. Barriers included insufficient staffing and loss to follow-up. Most sites plan to continue to enroll patients and to expand BIC to other areas.

CONCLUSION

A QI collaborative can facilitate implementation of BIC in six VA facilities that provide inpatient psychiatric treatment. BIC may appeal to patients and providers and may improve treatment engagement.

Turning evidence into action using a senior friendly hospital framework and a collaborative network

The Senior Friendly Hospital Accelerating Change Together in Ontario program linked the Collaborative Network Model and the Senior Friendly Hospital Framework in a unique multi-hospital knowledge-to-practice initiative to improve care for hospitalized older adults. The design enabled teams from 78 Ontario hospitals to close a shared skills and knowledge gap while meeting the varied needs of their diverse contexts. Results suggest that this design meant to reduce unnecessary redundancy, while preserving requisite diversity, was successful in achieving its specific objectives: to build a collaborative network and increase the confidence, knowledge, and skills of its members sufficient to lead sustainable improvements in their unique hospital settings. Findings with special relevance to process improvement specialists, health system leaders, and hospital administrators and managers are discussed.

Integrating hypertension and HIV care in Namibia: A quality improvement collaborative approach

Background

Hypertension (HTN) is highly prevalent among people with HIV (PWH) in Namibia, but screening and treatment for HTN are not routinely offered as part of HIV care delivery. We report the implementation of a quality improvement collaborative (QIC) to accelerate integration of HTN and HIV care within public-sector health facilities in Namibia.

Methods

Twenty-four facilities participated in the QIC with the aim of increasing HTN screening and treatment among adult PWH (>15 years). HTN was defined according to national treatment guidelines (i.e., systolic blood pressure >140 and/or diastolic blood pressure >90 across three measurements and at least two occasions), and decisions regarding initiation of treatment were made by physicians only. Teams from participating hospitals used quality improvement methods, monthly measurement of performance indicators, and small-scale tests of change to implement contextually tailored interventions. Coaching of sites was performed on a monthly basis by clinical officers with expertise in QI and HIV, and sites were convened as part of learning sessions to facilitate diffusion of effective interventions.

Results

Between March 2017 and March 2018, hypertension screening occurred as part of 183,043 (86%) clinical encounters at participating facilities. Among 1,759 PWH newly diagnosed with HTN, 992 (56%) were initiated on first-line treatment. Rates of treatment initiation were higher in facilities with an on-site physician (61%) compared to those without one (51%). During the QIC, facility teams identified fourteen interventions to improve HTN screening and treatment. Among barriers to implementation, teams pointed to malfunctions of blood pressure machines and stock outs of antihypertensive medications as common challenges.

Conclusions

Implementation of a QIC provided a structured approach for integrating HTN and HIV services across 24 high-volume facilities in Namibia. As rates of HTN treatment remained low despite ongoing facility-level changes, policy-level interventions—such as task sharing and supply chain strengthening—should be pursued to further improve delivery of HTN care among PWH beyond initial screening.

Improving viral load utilisation to enhance care for Kenyan adolescents with HIV

Improving the use of viral load (VL) testing for adolescents and young people living with HIV (AYPLWH) is a priority for Kenya’s Ministry of Health (MOH). Despite expansion of VL testing coverage and rollout of national policies, guidelines and training, VL result utilisation for AYPLWH remains suboptimal, with inadequate adherence to national guidelines recommending everyone on antiretroviral therapy (ART) with unsuppressed viral load (UVL) (≥401 copies/mL) receive three enhanced adherence counselling (EAC) sessions and a repeat VL test within 3 months. In March 2019, ICAP at Columbia University partnered with the MOH to launch a Quality Improvement Collaborative (QIC) at 22 health facilities in the Eastern Province to optimise management of AYPLWH on ART with UVL. Over 17 months, facility QI teams tested interventions targeting client education, workflow modifications, commodity management, community engagement and improved documentation. The QIC led to marked improvement in the proportion of clients completing three EAC sessions and repeat VL testing. Median completion rate was 16% (n=479) at baseline (from March 2018 to February 2019) and rose to 73% (n=755) during the implementation period (from March 2019 to July 2020). In the final month (July 2020), rates rose to 90% (n=31). Another success was the increase in the proportion of clients whose VL was resuppressed on repeat testing, which improved from 34% (n=273) at baseline to 62% (n=710) during the implementation period and 77% (n=44) in the final month. The QIC also led to improvement in the proportion of AYPLWH on first-line ART whose regimens were switched within 2 months of recorded UVL results, which rose from 58% (n=48) at baseline to 94% (n=128) during the implementation period. In summary, the QIC helped facility teams to identify and prioritise local, contextually appropriate innovations which led to swift improvement in three critical indicators of VL utilisation.

Core implementation strategies for improving cirrhosis care in the Veterans Health Administration

BACKGROUND AND AIMS

The Veterans Health Administration (VHA) provides care for more than 80,000 veterans with cirrhosis. This longitudinal, multimethod evaluation of a cirrhosis care quality improvement program aimed to (1) identify implementation strategies associated with evidence-based, guideline-concordant cirrhosis care over time, and (2) use qualitative interviews to operationalize strategies for a manualized intervention.

APPROACH AND RESULTS

VHA providers were surveyed annually about the use of 73 implementation strategies to improve cirrhosis care in fiscal years 2018 (FY18) and 2019 (FY19). Implementation strategies linked to guideline-concordant cirrhosis care were identified using bivariate statistics and comparative configurational methods. Semistructured interviews were conducted with 12 facilities in the highest quartile of cirrhosis care to specify the successful implementation strategies and their mechanisms of change. A total of 106 VHA facilities (82%) responded at least once over the 2-year period (FY18, n = 63; FY19, n = 100). Facilities reported using a median of 12 (interquartile range [IQR] 20) implementation strategies in FY18 and 10 (IQR 19) in FY19. Of the 73 strategies, 35 (48%) were positively correlated with provision of evidence-based cirrhosis care. Configurational analysis identified multiple strategy pathways directly linked to more guideline-concordant cirrhosis care. Across both methods, a subset of eight strategies was determined to be core to cirrhosis care improvement and specified using qualitative interviews.

CONCLUSIONS

In a national cirrhosis care improvement initiative, a multimethod approach identified a core subset of successful implementation strategy combinations. This process of empirically identifying and specifying implementation strategies may be applicable to other implementation challenges in hepatology.

Factors Affecting Quality of Care in Maternal and Child Health in Timor-Leste: A Scoping Review

Timor-Leste faces many challenges implementing quality maternal, newborn and child health (MNCH) services due to resource constraints and socio-cultural factors that disproportionately affect the health of women and children. A scoping review was conducted to map the quality of MNCH services against WHO quality standards on: 1. Provision of care, 2. Experiences of care, and 3. Cross-cutting standards. The literature search identified 1058 citations, from which 28 full-text articles met the inclusion criteria. The findings highlight health workers’ limited capacity to provide quality services and referrals. The major reasons for this are: a lack of essential supplies, poor infrastructure and transport, limited opportunities for ongoing learning, and gaps in health information systems. Provision of care standards and cross-cutting standards require attention at a broad systems level. Findings related to experiences of care highlight the importance of effective communication, respect, and emotional support, particularly for vulnerable women and children who have difficulty accessing services, and for those who have experienced violence. These experience-related standards could be addressed at an individual health worker and health service level, as well as at a systems level. This review provides direction to focus quality-improvement initiatives within local health facilities, as well as at municipal and national level.

Enhancing national audit through addressing the quality improvement capabilities of feedback recipients: a multi-phase intervention development study

Background

National audits are a common, but variably effective, intervention to improve services. This study aimed to design an intervention to increase the effectiveness of national audit.

Methods

We used interviews, documentary analysis, observations, co-design and stakeholder engagement methods. The intervention was described in an intervention manual and illustrated using a logic model. Phase 1 described the current hospital response to a national audit. Phase 2 identified potential enhancements. Phase 3 developed a strategy to implement the enhancements. Phase 4 explored the feasibility of the intervention alongside the National Audit of Dementia and refined the intervention. Phase 5 adapted the intervention to a second national audit (National Diabetes Audit). Phase 6 explored the feasibility and fidelity of the intervention alongside the National Diabetes Audit and used the findings to further refine the intervention.

Results

The developed intervention is a quality improvement collaborative (QIC), containing virtual educational workshop, virtual outreach for local team leads and virtual facilitation of a learning collaborative delivered after feedback has been received. The QIC aims to support national audit recipients to undertake improvement actions tailored to their local context. The target audience is clinical and clinical governance leaders. We found that actions from national audit were constrained by what the clinical lead perceived they deliver personally, these actions were not aligned to identified influences upon performance. We found that the hospital response could be enhanced by targeting low baseline performance, identifying and addressing influences upon to performance, developing trust and credibility, addressing recipient priorities, presenting meaningful comparisons, developing a conceptual model, involving stakeholders and considering the opportunity cost. Phase 3 found that an educational workshop and outreach strategy could support implementation of the enhancements through developing coherence and cognitive participation. We found feasibility could be increased by revising the content, re-naming the intervention, amending activities to address time commitment, incorporating a more structured analysis of influences, supporting collaboration and developing local feedback mechanisms. Phase 5 found adaptation to a second national audit involved reflecting differences in the clinical topic, context and contractual requirements. We found that the behaviour change techniques identified in the manual were delivered by facilitators. Participants reported positive attitudes towards the intervention and that the intervention was appropriate.

Conclusions

The QIC supports local teams to tailor their actions to local context and develop change commitment. Future work will evaluate the effectiveness of the intervention as an adjunct to the National Diabetes Audit.

Perioperative Care Pathways in Low- and Lower-Middle-Income Countries: Systematic Review and Narrative Synthesis

BACKGROUND

Safe and effective care for surgical patients requires high-quality perioperative care. In high-income countries (HICs), care pathways have been shown to be effective in standardizing clinical practice to optimize patient outcomes. Little is known about their use in low- and middle-income countries (LMICs) where perioperative mortality is substantially higher.

METHODS

Systematic review and narrative synthesis to identify and describe studies in peer-reviewed journals on the implementation or evaluation of perioperative care pathways in LMICs. Searches were conducted in MEDLINE, EMBASE, CINAHL Plus, WHO Global Index, Web of Science, Scopus, Global Health and SciELO alongside citation searching. Descriptive statistics, taxonomy classifications and framework analyses were used to summarize the setting, outcome measures, implementation strategies, and facilitators and barriers to implementation.

RESULTS

Twenty-seven studies were included. The majority of pathways were set in tertiary hospitals in lower-middle-income countries and were focused on elective surgery. Only six studies were assessed as high quality. Most pathways were adapted from international guidance and had been implemented in a single hospital. The most commonly reported barriers to implementation were cost of interventions and lack of available resources.

CONCLUSIONS

Studies from a geographically diverse set of low and lower-middle-income countries demonstrate increasing use of perioperative pathways adapted to resource-poor settings, though there is sparsity of literature from low-income countries, first-level hospitals and emergency surgery. As in HICs, addressing patient and clinician beliefs is a major challenge in improving care. Context-relevant and patient-centered research, including qualitative and implementation studies, would make a valuable contribution to existing knowledge.

Effectiveness of quality improvement collaboratives in improving clinical processes and patient outcomes in stroke care

Stroke remains one of the leading causes of death worldwide. In order to tackle the negative impacts of stroke, a high standard of clinical practice and a commitment to continuous quality improvement is needed across the stroke care pathway. One approach to quality improvement is the formation and implementation of quality improvement collaboratives (QIC's). However, there are several barriers to the implementation of a QIC for stroke care which may impact on their success. This article critically appraises a systematic review which assessed the effectiveness of QIC's for driving improvements in stroke care and explored the barriers to implementing a QIC's to improve care.

Exploring the sustainability of perinatal audit in four district hospitals in the Western Cape, South Africa: a multiple case study approach

Introduction

Maternal and perinatal death surveillance and response (MPDSR) is an intervention process that uses a continuous cycle of identification, notification and review of deaths to determine avoidable causes followed by actions to improve health services and prevent future deaths. This study set out to understand how and why a perinatal audit programme, a form of MPDSR, has sustained practice in South Africa from the perspectives of those engaged in implementation.

Methods

A multiple case study design was carried out in four rural subdistricts of the Western Cape with over 10 years of implementing the programme. Data were collected from October 2019 to March 2020 through non-participant observation of seven meetings and key informant interviews with 41 purposively selected health providers and managers. Thematic analysis was conducted inductively and deductively adapting the extended normalisation process theory to examine the capability, contribution, potential and capacity of the users to implement MPDSR.

Results

The perinatal audit programme has sustained practice due to integration of activities into routine tasks (capability), clear value-add (contribution), individual and collective commitment (potential), and an enabling environment to implement (capacity). The complex interplay of actors, their relationships and context revealed the underlying individual-level and organisational-level factors that support sustainability, such as trust, credibility, facilitation and hierarchies. Local adaption and the broad social and structural resources were required for sustainability.

Conclusion

This study applied theory to explore factors that promote sustained practice of perinatal audit from the perspectives of the users. Efforts to promote and sustain MPDSR will benefit from overall good health governance, specific skill development, embedded activities, and valuing social processes related to implementation. More research using health policy and system approaches, including use of implementation theory, will further advance our understanding on how to support sustained MPDSR practice in other settings.

The role of quality improvement collaboratives in general practice: a qualitative systematic review

Background

This systematic review used qualitative methodologies to examine the role of quality improvement collaboratives (QICs) in general practice. The aim was to inform implementers and participants about the utility of using or participating in QICs in general practice.

Methods

Included studies were published in English, used a QIC intervention, reported primary research, used qualitative or mixed methods, and were conducted in general practice.

A Medline search between January 1995 and February 2020 was developed and extended to include Embase, CINAHL and PsycInfo databases. Articles were sought through chaining of references and grey literature searches.

Qualitative outcome data were extracted using a framework analysis. Data were analysed using thematic synthesis. Articles were assessed for quality using a threshold approach based on the criteria described by Dixon-Woods.

Results

15 qualitative and 18 mixed-methods studies of QICs in general practice were included. Data were grouped into four analytical themes which describe the role of a collaborative in general practice: improving the target topic, developing practices and providers, developing the health system and building quality improvement capacity.

Discussion

General practice collaboratives are reported to be useful for improving target topics. They can also develop knowledge and motivation in providers, build systems and team work in local practice organisations, and improve support at a system level. Collaboratives can build quality improvement capacity in the primary care system. These roles suggest that QICs are well matched to the improvement needs of general practice.

General practice participants in collaboratives reported positive effects from effective peer interaction, high-quality local support, real engagement with data and well-designed training in quality improvement.

Strengths of this study were an inclusive search and explicit qualitative methodology. It is possible some studies were missed. Qualitative studies of collaboratives may be affected by selection bias and confirmation bias.

PROSPERO registration number

CRD4202017512.

Achieving gains in state and local child safety systems and workforce development: application of the framework for quality improvement and innovation in child safety

OBJECTIVE

This study investigated the application of the Children's Safety Network (CSN) Framework for Quality Improvement and Innovation in Child Safety through the Child Safety Learning Collaborative (CSLC).

METHODS

The CSN Framework was used by 26 state/jurisdiction teams that participated in cohort 1 of the CSLC, from November 2018 to April 2020. The aim was to strengthen child safety systems and the workforce to spread child safety evidence-based and evidence-informed strategies and programmes for children and adolescents ages <1-19 years.

PROCEDURES

Participating teams' child safety system development, workforce development, engagement in the CSLC, challenges encountered and overall satisfaction with the CSLC were assessed through ongoing CSLC participation records and an end-of-cohort survey (survey response rate: 73.1%).

RESULTS

Teams showed an average change of 2.4-fold increase in the spread of evidence-based and evidence-informed child safety strategies and programmes, indicating improvement in child safety systems. Knowledge development on CSLC tools and strategies was reported by 77.8% of teams, with 55.5% reporting CSLC tools and strategies contributed to workforce development. Over two-thirds (70.6%) reported being satisfied or very satisfied with the CSLC, but identified some challenges, including staff turnover and the need to strengthen partnerships. All teams demonstrated engagement in the CSLC, based on participation in a virtual meeting, learning session or a monthly report submission.

CONCLUSIONS

Despite challenges, teams continued to participate in the CSLC, recognising the importance of collaborative learning. The CSN Framework is helpful for state/jurisdiction teams to improve child safety systems and develop their workforce.

Strengthening capacity in hospitals to reduce perinatal morbidity and mortality through a codesigned intervention package: protocol for a realist evaluation as part of a stepped-wedge trial of the Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) in sub-Saharan Africa project

INTRODUCTION

Despite a strong evidence base for developing interventions to reduce child mortality and morbidity related to pregnancy and delivery, major knowledge-implementation gaps remain. The Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) in sub-Saharan Africa project aims to overcome these gaps through strengthening the capacity of multidisciplinary teams that provide maternity care. The intervention includes competency-based midwife training, community engagement for study design, mentoring and quality improvement cycles. The realist process evaluation of ALERT aims at identifying and testing the causal pathway through which the intervention achieves its impact.

METHODS AND ANALYSIS

This realist process evaluation complements the effectiveness evaluation and the economic evaluation of the ALERT intervention. Following the realist evaluation cycle, we will first elicit the initial programme theory on the basis of the ALERT theory of change, a review of the evidence on adoption and diffusion of innovations and the perspectives of the stakeholders. Second, we will use a multiple embedded case study design to empirically test the initial programme theory in two hospitals in each of the four intervention countries. Qualitative and quantitative data will be collected, using in-depth interviews with hospital staff and mothers, observations, patient exit interviews and (hospital) document reviews. Analysis will be guided by the Intervention-Actors-Context-Mechanism-Outcome configuration heuristic. We will use thematic coding to analyse the qualitative data. The quantitative data will be analysed descriptively and integrated in the analysis using a retroductive approach. Each case study will end with a refined programme theory (in-case analysis). Third, we will carry out a cross-case comparison within and between the four countries. Comparison between study countries should enable identifying relevant context factors that influence effectiveness and implementation, leading to a mid-range theory that may inform the scaling up the intervention.

ETHICS AND DISSEMINATION

In developing this protocol, we paid specific attention to cultural sensitivity, the do no harm principle, confidentiality and non-attribution. We received ethical approval from the local and national institutional review boards in Tanzania, Uganda, Malawi, Benin, Sweden and Belgium. Written or verbal consent of respondents will be secured after explaining the purpose, potential benefits and potential harms of the study using an information sheet. The results will be disseminated through workshops with the hospital staff and national policymakers, and scientific publications and conferences.

TRIAL REGISTRATION NUMBER

PACTR202006793783148.

Contextual Factors Affecting Implementation of Pediatric Quality Improvement Programs

OBJECTIVE

Context is a critical determinant of the effectiveness of quality improvement programs. We assessed the role of contextual factors in influencing the efforts of 5 diverse quality improvement projects as part of the Pediatric Quality Measure Program (PQMP) directed by the Agency for Health Care Research and Quality.

METHODS

We conducted a mixed methods study of 5 PQMP grantees involving semistructured interviews followed by structured worksheets to identify influential contextual factors. Semistructured interviews and worksheets were completed between August and October 2020. Participants were comprised of PQMP grantee teams (2-4 team members per team for a total of 15 participants). Coding and analysis was based on the Tailored Implementation for Chronic Diseases (TICD) framework.

RESULTS

Despite heterogeneity in the process and outcome targets of the PQMP initiatives, professional interactions, incentives and resources, and capacity for organizational change were the domains most commonly identified as influential across the grantees. While social, political, and legal factors was not commonly referenced as an important domain, payer or funder policies (a factor within this domain) was highlighted as one of the most influential factors. Overall, the incentives and resources domain was identified as the most influential.

CONCLUSIONS

We found that using a determinant framework, such as the TICD, is valuable in facilitating comparisons across heterogeneous projects, allowing us to identify key contextual factors influencing the implementation of pediatric quality measures across a diverse range of clinical topics and settings. Future quality improvement work should account for this and include resources to support infrastructure development in addition to program implementation.

Translating mental health recovery guidelines into recovery-oriented innovations: A strategy combining implementation teams and a facilitated planning process

Recovery is the focus of mental health strategies internationally. However, little translation of recovery knowledge has occurred in mental health services. The purpose of this research is to bridge the gap between recovery guidelines and practice by developing a new implementation strategy involving the formation of implementation teams made up of different stakeholders (service users, service providers, managers, knowledge users) and facilitating a 12-meeting implementation planning process. Sevenmental health organizations across Canada successfully completed the process of translating the guidelines into a recovery-oriented innovation that was implemented. Fifty-five implementation team members were interviewed upon completion of the 12-meeting process. Findings indicate that implementation team members perceived the structured planning process as positive. Nevertheless, the language of implementation science remains difficult to understand for a non-academic audience. Key elements of the 12-meeting process included the value of consensus building among implementation team members and the subsequent shifting power relationships. While working with diverse stakeholders came with certain challenges, the process in itself was a form of system transformation. This type of engaged planning process was a significant departure from the more top-down approaches to organizational change that staff were used to.

Influence of context on quality improvement priorities: a qualitative study of three facility types in Lagos State, Nigeria

Background

Quality improvement (QI) collaboratives are increasingly popular. However, there is a need for an in-depth understanding of the influence of context on its implementation. We explored the influence of context on the change concepts considered by public primary (primary health centres), public secondary (public hospitals) and private (private facilities) collaboratives established to improve maternal and newborn health outcomes in Lagos State, Nigeria.

Methods

Between February 2019 and January 2020, we conducted a qualitative study using meeting reports, key informant interviews and participant observation. Data were analysed using the high-quality health system framework for assessing health system and user experience that distinguished three quality domains: quality impacts, processes of care and health system foundations.

Results

Nineteen change concepts and 158 change ideas were observed across 28 facility QI teams. Change concepts and ideas prioritised were influenced by government and non-governmental leaders but ultimately shaped by facility QI capacity, time allocated for QI activities and availability of local data. Of the three quality domains, process of care, including patient satisfaction, received the most attention across facility types. There was considerable variation in the change concepts considered across domains. For example, more public hospitals focused on complication management because of a relatively high prevalence of and capacity to manage maternal complications; primary health centres focused more on complication referrals, while private facilities prioritised revenue generation. Problems with availability of resources were particularly highlighted in primary health centres which had relatively less financial commitment from stakeholders.

Conclusion

Our findings provide insights into QI collaboratives’ mechanism of change in which external stakeholders, including government, drove QI priorities for action but the ultimate decisions depended on local realities of facilities. Our findings underscore the need for strong QI leadership and sufficient resources to enable facility QI teams to prioritise change concepts for greater health impact.

From Theory to Implementation: Adaptations to a Quality Improvement Initiative According to Implementation Context

As countries continue to invest in quality improvement (QI) initiatives in health facilities, it is important to acknowledge the role of context in implementation. We conducted a qualitative study between February 2019 and January 2020 to explore how a QI initiative was adapted to enable implementation in three facility types: primary health centres, public hospitals and private facilities in Lagos State, Nigeria.Despite a common theory of change, implementation of the initiative needed to be adapted to accommodate the local needs, priorities and organisational culture of each facility type. Across facility types, inadequate human and capital resources constrained implementation and necessitated an extension of the initiative's duration. In public facilities, the local governance structure was adapted to facilitate coordination, but similar adaptations to governance were not possible for private facilities. Our findings highlight the importance of anticipating and planning for the local adaptation of QI initiatives according to implementation environment.

How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review

BACKGROUND

A recent systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries. The review identified strategies with varying effects, including in-service training, supervision and group problem-solving. However, whether their effectiveness changed over time remained unclear. In particular, understanding whether effects decay over time is crucial to improve sustainability.

METHODS

We conducted a secondary analysis of data from the aforementioned review to explore associations between time and effectiveness. We calculated effect sizes (defined as percentage-point (%-point) changes) for HCP practice outcomes (eg, percentage of patients correctly treated) at each follow-up time point after the strategy was implemented. We estimated the association between time and effectiveness using random-intercept linear regression models with time-specific effect sizes clustered within studies and adjusted for baseline performance.

RESULTS

The primary analysis included 37 studies, and a sensitivity analysis included 77 additional studies. For training, every additional month of follow-up was associated with a 0.19 %-point decrease in effectiveness (95% CI: -0.36 to -0.03). For training combined with supervision, every additional month was associated with a 0.40 %-point decrease in effectiveness (95% CI: -0.68 to -0.12). Time trend results for supervision were inconclusive. For group problem-solving alone, time was positively associated with effectiveness, with a 0.50 %-point increase in effect per month (95% CI: 0.37 to 0.64). Group problem-solving combined with training was associated with large improvements, and its effect was not associated with time.

CONCLUSIONS

Time trends in the effectiveness of different strategies to improve HCP practices vary among strategies. Programmes relying solely on in-service training might need periodical refresher training or, better still, consider combining training with group problem-solving. Although more high-quality research is needed, these results, which are important for decision-makers as they choose which strategies to use, underscore the utility of studies with multiple post-implementation measurements so sustainability of the impact on HCP practices can be assessed.

Factors associated with poor adherence to intrapartum fetal heart monitoring in relationship to intrapartum related death: A prospective cohort study

BACKGROUND

Poor quality of intrapartum care remains a global health challenge for reducing stillbirth and early neonatal mortality. Despite fetal heart rate monitoring (FHRM) being key to identify fetus at risk during labor, sub-optimal care prevails in low-income settings. The study aims to assess the predictors of suboptimal fetal heart rate monitoring and assess the association of sub-optimal FHRM and intrapartum related deaths.

METHOD

A prospective cohort study was conducted in 12 hospitals between April 2017 to October 2018. Pregnant women with fetal heart sound present during admission were included. Inferential statistics were used to assess proportion of sub-optimal FHRM. Multi-level logistic regression was used to detect association between sub-optimal FHRM and intrapartum related death.

RESULT

The study cohort included 83,709 deliveries, in which in more than half of women received suboptimal FHRM (56%). The sub-optimal FHRM was higher among women with obstetric complication than those with no complication (68.8% vs 55.5%, p-value<0.001). The sub-optimal FHRM was higher if partograph was not used than for whom partograph was completely filled (70.8% vs 15.9%, p-value<0.001). The sub-optimal FHRM was higher if the women had no companion during labor than those who had companion during labor (57.5% vs 49.6%, p-value<0.001). After adjusting for background characteristics and intra-partum factors, the odds of intrapartum related death was higher if FHRM was done sub-optimally in reference to women who had FHRM monitored as per protocol (aOR, 1.47; 95% CI; 1.13, 1.92).

CONCLUSION

Adherence to FHRM as per clinical standards was inadequate in these hospitals of Nepal. Furthermore, there was an increased odds of intra-partum death if FHRM had not been carried out as per clinical standards. FHRM provided as per protocol is key to identify fetuses at risk, and efforts are needed to improve the adherence of quality of care to prevent death.

The Contribution of Artificial Intelligence in Achieving the Sustainable Development Goals (SDGs): What Can Eye Health Can Learn From Commercial Industry and Early Lessons From the Application of Machine Learning in Eye Health Programmes

Achieving The United Nations sustainable developments goals by 2030 will be a challenge. Researchers around the world are working toward this aim across the breadth of healthcare. Technology, and more especially artificial intelligence, has the ability to propel us forwards and support these goals but requires careful application. Artificial intelligence shows promise within healthcare and there has been fast development in ophthalmology, cardiology, diabetes, and oncology. Healthcare is starting to learn from commercial industry leaders who utilize fast and continuous testing algorithms to gain efficiency and find the optimum solutions. This article provides examples of how commercial industry is benefitting from utilizing AI and improving service delivery. The article then provides a specific example in eye health on how machine learning algorithms can be purposed to drive service delivery in a resource-limited setting by utilizing the novel study designs in response adaptive randomization. We then aim to provide six key considerations for researchers who wish to begin working with AI technology which include collaboration, adopting a fast-fail culture and developing a capacity in ethics and data science.

Action leveraging evidence to reduce perinatal mortality and morbidity (ALERT): study protocol for a stepped-wedge cluster-randomised trial in Benin, Malawi, Tanzania and Uganda

Background

Insufficient reductions in maternal and neonatal deaths and stillbirths in the past decade are a deterrence to achieving the Sustainable Development Goal 3. The majority of deaths occur during the intrapartum and immediate postnatal period. Overcoming the knowledge-do-gap to ensure implementation of known evidence-based interventions during this period has the potential to avert at least 2.5 million deaths in mothers and their offspring annually. This paper describes a study protocol for implementing and evaluating a multi-faceted health care system intervention to strengthen the implementation of evidence-based interventions and responsive care during this crucial period.

Methods

This is a cluster randomised stepped-wedge trial with a nested realist process evaluation across 16 hospitals in Benin, Malawi, Tanzania and Uganda. The ALERT intervention will include four main components: i) end-user participation through narratives of women, families and midwifery providers to ensure co-design of the intervention; ii) competency-based training; iii) quality improvement supported by data from a clinical perinatal e-registry and iv) empowerment and leadership mentoring of maternity unit leaders complemented by district based bi-annual coordination and accountability meetings. The trial’s primary outcome is in-facility perinatal (stillbirths and early neonatal) mortality, in which we expect a 25% reduction. A perinatal e-registry will be implemented to monitor the trial. Our nested realist process evaluation will help to understand what works, for whom, and under which conditions. We will apply a gender lens to explore constraints to the provision of evidence-based care by health workers providing maternity services. An economic evaluation will assess the scalability and cost-effectiveness of ALERT intervention.

Discussion

There is evidence that each of the ALERT intervention components improves health providers’ practices and has modest to moderate effects. We aim to test if the innovative packaging, including addressing specific health systems constraints in these settings, will have a synergistic effect and produce more considerable perinatal mortality reductions.

Trial registration

Pan African Clinical Trial Registry (www.pactr.org): PACTR202006793783148. Registered on 17th June 2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07155-z.

The effectiveness of quality improvement collaboratives in improving stroke care and the facilitators and barriers to their implementation: a systematic review

Background

To successfully reduce the negative impacts of stroke, high-quality health and care practices are needed across the entire stroke care pathway. These practices are not always shared across organisations. Quality improvement collaboratives (QICs) offer a unique opportunity for key stakeholders from different organisations to share, learn and ‘take home’ best practice examples, to support local improvement efforts. This systematic review assessed the effectiveness of QICs in improving stroke care and explored the facilitators and barriers to implementing this approach.

Methods

Five electronic databases (MEDLINE, CINAHL, EMBASE, PsycINFO, and Cochrane Library) were searched up to June 2020, and reference lists of included studies and relevant reviews were screened. Studies conducted in an adult stroke care setting, which involved multi-professional stroke teams participating in a QIC, were included. Data was extracted by one reviewer and checked by a second. For overall effectiveness, a vote-counting method was used. Data regarding facilitators and barriers was extracted and mapped to the Consolidated Framework for Implementation Research (CFIR).

Results

Twenty papers describing twelve QICs used in stroke care were included. QICs varied in their setting, part of the stroke care pathway, and their improvement focus. QIC participation was associated with improvements in clinical processes, but improvements in patient and other outcomes were limited. Key facilitators were inter- and intra-organisational networking, feedback mechanisms, leadership engagement, and access to best practice examples. Key barriers were structural changes during the QIC’s active period, lack of organisational support or prioritisation of QIC activities, and insufficient time and resources to participate in QIC activities. Patient and carer involvement, and health inequalities, were rarely considered.

Conclusions

QICs are associated with improving clinical processes in stroke care; however, their short-term nature means uncertainty remains as to whether they benefit patient outcomes. Evidence around using a QIC to achieve system-level change in stroke is equivocal. QIC implementation can be influenced by individual and organisational level factors, and future efforts to improve stroke care using a QIC should be informed by the facilitators and barriers identified. Future research is needed to explore the sustainability of improvements when QIC support is withdrawn.

Trial registration

Protocol registered on PROSPERO (CRD42020193966).

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01162-8.

Evaluation of cochlear implant electrode scalar position by 3 Tesla magnet resonance imaging

The estimation of scalar electrode position is a central point of quality control during the cochlear implant procedure. Ionic radiation is a disadvantage of commonly used radiologic estimation of electrode position. Recent developments in the field of cochlear implant magnets, implant receiver magnet position, and MRI sequence usage allow the postoperative evaluation of inner ear changes after cochlear implantation. The aim of the present study was to evaluate the position of lateral wall and modiolar cochlear implant electrodes using 3 T MRI scanning. In a prospective study, we evaluated 20 patients (10× Med-El Flex 28; 5× HFMS AB and 5× SlimJ AB) with a 3 T MRI and a T2 2D Drive MS sequence (voxel size: 0.3 × 0.3 × 0.9 mm) for the estimation of the intracochlear position of the cochlear implant electrode. In all cases, MRI allowed a determination of the electrode position in relation to the basilar membrane. This observation made the estimation of 19 scala tympani electrode positions and a single case of electrode translocation possible. 3 T MRI scanning allows the estimation of lateral wall and modiolar electrode intracochlear scalar positions.

Reduction in Cesarean Delivery Rates Associated With a State Quality Collaborative in Maryland

OBJECTIVE

To assess the extent to which hospitals participating in the MDPQC (Maryland Perinatal-Neonatal Quality Care Collaborative) to reduce primary cesarean deliveries adopted policy and practice changes and the association of this adoption with state-level cesarean delivery rates.

METHODS

This prospective evaluation of the MDPQC includes 31 (97%) of the birthing hospitals in the state, which all voluntarily participated in the 30-month collaborative from June 2016 to December 2018. Hospital teams agreed to implement practices from the "Safe Reduction of Primary Cesarean Births" patient safety bundle, developed by the Council on Patient Safety in Women's Health Care. Each hospital's implementation of practices in the bundle was measured through surveys of team leaders at 12 months and 30 months. Half-yearly cesarean delivery rates were calculated from aggregate birth certificate data for each hospital, and differences in rates between the 6 months before the collaborative (baseline) and the 6 months afterward (endline) were tested for statistical significance.

RESULTS

Among the 26 bundle practices that were assessed, participating hospitals reported having a median of seven practices (range 0-23) already in place before the collaborative and implementing a median of four (range 0-17) new practices during the collaborative. Across the collaborative, the cesarean delivery rates decreased from 28.5% to 26.9% (P=.011) for all nulliparous term singleton vertex births and from 36.1% to 31.3% (P<.001) for nulliparous, term, singleton, vertex inductions. Five hospitals had a statistically significant decrease in nulliparous, term, singleton, vertex cesarean delivery rates and four had a significant increase. Nulliparous, term, singleton, vertex cesarean delivery rates were significantly lower across hospitals that implemented more practices in the "Response" domain of the bundle.

CONCLUSION

The MDPQC was associated with a statewide reduction in cesarean delivery rates for nulliparous, term, singleton, vertex births.

Organizational contextual factors that predict success of a quality improvement collaborative approach to enhance integrated HIV-tuberculosis services: a sub-study of the Scaling up TB/HIV Integration trial

Background

A quality improvement (QI) collaborative approach to enhancing integrated HIV-Tuberculosis (TB) services may be effective in scaling up and improving the quality of service delivery. Little is known of the role of organizational contextual factors (OCFs) in influencing the success of QI collaboratives. This study aims to determine which OCFs were associated with improvement in a QI collaborative intervention to enhance integrated HIV-TB services delivery.

Methods

This is a nested sub-study embedded in a cluster-randomized controlled trial. Sixteen nurse supervisors (clusters) overseeing 40 clinics were randomized (1:1) to receive QI training and mentorship, or standard of care support (SOC). In the QI arm, eight nurse supervisors and 20 clinics formed a “collaborative” which aimed to improve HIV-TB process indicators, namely HIV testing, TB screening, isoniazid preventive therapy (IPT) initiations, viral load testing, and antiretroviral therapy for TB patients. OCFs measured at baseline were physical infrastructure, key staff, flexibility of clinic hours, monitoring data for improvement (MDI), and leadership support. Surveys were administered to clinic staff at baseline and month 12 to assess perceptions of supportiveness of contexts for change, and clinic organization for delivering integrated HIV-TB services. Linear mixed modelling was used to test for associations between OCFs and HIV-TB process indicators.

Results

A total of 209 clinic staff participated in the study; 97 (46.4%) and 112 (53.6%) from QI and SOC arms, respectively. There were no differences between the QI and SOC arms scores achieved for physical infrastructure (78.9% vs 64.7%; p = 0.058), key staff (95.8 vs 92; p = 0.270), clinic hours (66.9 vs 65.5; p = 0.900), MDI (63.3 vs 65; p = 0.875, leadership support (46.0 vs 57.4; p = 0.265), and perceptions of supportiveness of contexts for change (76.2 vs 79.7; p = 0.128 and clinic organization for delivering integrated HIV-TB services (74.1 vs 80.1; p = 0.916). IPT initiation was the only indicator that was significantly improved in the parent study. MDI was a significantly associated with increasing IPT initiation rates [beta coefficient (β) = 0.004; p = 0.004].

Discussion

MDI is a practice that should be fostered in public health facilities to increase the likelihood of success of future QI collaboratives to improve HIV-TB service delivery.

Trial registration

Clinicaltrials.gov, NCT02654613. Registered 01 June 2015.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01155-7.

Identity reconciliation and knowledge mobilization in a mandated community of practice

Purpose

Communities of Practice (CoPs) are increasingly being created to facilitate knowledge mobilization in organizations. This paper aims to elucidate an underexplored aspect of participation in mandated CoPs – identity reconciliation. Specifically, the authors explore how actors reconcile their existing identities with becoming members of new knowledge mobilization CoPs.

Design/methodology/approach

The authors conducted a longitudinal qualitative case study over a 12-month period to explore identity reconciliation practices during the formation of the “ED CoP” – mandated by policymakers to mobilize knowledge between process improvement advisors and clinicians from various hospitals. Observation and interviews allowed us to uncover “front stage” and “backstage” practices of identity reconciliation.

Findings

The findings reveal two key unexpected modes of identity reconciliation – “distancing” and “peripheral lurking”. These modes resulted in different trajectories of participation of two of the key participant groups – “veteran” improvement advisors and “veteran” clinicians.

Practical implications

Different modes of identity reconciliation of different participants impact the formation of CoPs and how knowledge mobilization occurs within them. This paper offers a sensitizing lens for practitioners creating CoPs which enhances awareness of hidden identity practices, and recommendations to enable practitioners to effectively facilitate CoP formation.

Originality/value

This study suggests that identity reconciliation is an integral aspect of CoP formation, and essential for knowledge mobilization within CoPs. Whereas studies on CoPs in the knowledge management literature have mostly assumed that collaboration produces beneficial knowledge mobilization outcomes, the findings build a more nuanced picture of the processes involved in producing these outcomes.

When trust, confidence, and faith collide: refining a realist theory of how and why inter-organisational collaborations in healthcare work

BACKGROUND

Health systems are facing unprecedented socioeconomic pressures as well as the need to cope with the ongoing strain brought about by the COVID-19 pandemic. In response, the reconfiguration of health systems to encourage greater collaboration and integration has been promoted with a variety of collaborative shapes and forms being encouraged and developed. Despite this continued interest, evidence for success of these various arrangements is lacking, with the links between collaboration and improved performance often remaining uncertain. To date, many examinations of collaborations have been undertaken, but use of realist methodology may shed additional light on how and why collaboration works, and whom it benefits.

METHODS

This paper seeks to test initial context-mechanism-outcome configurations (CMOCs) of interorganisational collaboration with the view to producing a refined realist theory. This phase of the realist synthesis used case study and evaluation literature; combined with supplementary systematic searches. These searches were screened for rigour and relevance, after which CMOCs were extracted from included literature and compared against existing ones for refinement, refutation, or affirmation. We also identified demi-regularities to better explain how these CMOCs were interlinked.

RESULTS

Fifty-one papers were included, from which 338 CMOCs were identified, where many were analogous. This resulted in new mechanisms such as 'risk threshold' and refinement of many others, including trust, confidence, and faith, into more well-defined constructs. Refinement and addition of CMOCs enabled the creation of a 'web of causality' depicting how contextual factors form CMOC chains which generate outputs of collaborative behaviour. Core characteristics of collaborations, such as whether they were mandated or cross-sector, were explored for their proposed impact according to the theory.

CONCLUSION

The formulation of this refined realist theory allows for greater understanding of how and why collaborations work and can serve to inform both future work in this area and the implementation of these arrangements. Future work should delve deeper into collaborative subtypes and the underlying drivers of collaborative performance.

REVIEW REGISTRATION

This review is part of a larger realist synthesis, registered at PROSPERO with ID CRD42019149009 .

Implementation of a hospital-wide multidisciplinary blunt chest injury care bundle (ChIP): Fidelity of delivery evaluation

BACKGROUND

Ineffective intervention for patients with blunt chest wall injury results in high rates of morbidity and mortality. To address this, a blunt chest injury care bundle protocol (ChIP) was developed, and a multifaceted plan was implemented using the Behaviour Change Wheel.

OBJECTIVE

The purpose of this study was to evaluate the reach, fidelity, and dose of the ChIP intervention to discern if it was activated and delivered to patients as intended at two regional Australian hospitals.

METHODS

This is a pretest and post-test implementation evaluation study. The proportion of ChIP activations and adherence to ChIP components received by eligible patients were compared before and after intervention over a 4-year period. Sample medians were compared using the nonparametric median test, with 95% confidence intervals. Differences in proportions for categorical data were compared using the two-sample z-test.

RESULTS/FINDINGS

Over the 19-month postimplementation period, 97.1% (n = 440) of eligible patients received ChIP (reach). The median activation time was 134 min; there was no difference in time to activation between business hours and after-hours; time to activation was not associated with comorbidities and injury severity score. Compared with the preimplementation group, the postimplementation group were more likely to receive evidence-based treatments (dose), including high-flow nasal cannula use (odds ratio [OR] = 6.8 [95% confidence interval {CI} = 4.8-9.6]), incentive spirometry in the emergency department (OR = 7.5, [95% CI = 3.2-17.6]), regular analgesia (OR = 2.4 [95% CI = 1.5-3.8]), regional analgesia (OR = 2.8 [95% CI = 1.5-5.3]), patient-controlled analgesia (OR = 1.8 [95% CI = 1.3-2.4]), and multiple specialist team reviews, e.g., surgical review (OR = 9.9 [95% CI = 6.1-16.1]).

CONCLUSIONS

High fidelity of delivery was achieved and sustained over 19 months for implementation of a complex intervention in the acute context through a robust implementation plan based on theoretical frameworks. There were significant and sustained improvements in care practices known to result in better patient outcomes. Findings from this evaluation can inform future implementation programs such as ChIP and other multidisciplinary interventions in an emergency or acute care context.

How, why and under what circumstances does a quality improvement collaborative build knowledge and skills in clinicians working with people with dementia? A realist informed process evaluation

In increasingly constrained health and aged care services, strategies are needed to improve quality and translate evidence into practice. In dementia care, recent failures in quality and safety have led the WHO to prioritise the translation of known evidence into practice. While quality improvement collaboratives have been widely used in healthcare, there are few examples in dementia care.

We describe a recent quality improvement collaborative to improve dementia care across Australia and assess the implementation outcomes of acceptability and feasibility of this strategy to translate known evidence into practice. A realist-informed process evaluation was used to analyse how, why and under what circumstances a quality improvement collaborative built knowledge and skills in clinicians working in dementia care.

This realist-informed process evaluation developed, tested and refined the programme theory of a quality improvement collaborative. Data were collected pre-intervention and post-intervention using surveys and interviews with participants (n=28). A combined inductive and deductive data analysis process integrated three frameworks to examine the context and mechanisms of knowledge and skill building in participant clinicians.

A refined program theory showed how and why clinicians built knowledge and skills in quality improvement in dementia care. Six mechanisms were identified: motivation, accountability, identity, collective learning, credibility and reflective practice. These mechanisms, in combination, operated to overcome constraints, role boundaries and pessimism about improved practice in dementia care.

A quality improvement collaborative designed for clinicians in different contexts and roles was acceptable and feasible in building knowledge, skills and confidence of clinicians to improve dementia care. Supportive reflective practice and a credible, flexible and collaborative process optimised quality improvement knowledge and skills in clinicians working with people with dementia.

Trial registration number

ACTRN12618000268246.

Crossing knowledge boundaries: health care providers' perceptions and experiences of what is important to achieve more person-centered patient pathways for older people

BACKGROUND

Improving the transitional care of older people, especially hospital-to-home transitions, is a salient concern worldwide. Current research in the field highlights person-centered care as crucial; however, how to implement and enact this ideal in practice and thus achieve more person-centered patient pathways remains unclear. The aim of this study was to explore health care providers' (HCPs') perceptions and experiences of what is important to achieve more person-centered patient pathways for older people.

METHODS

This was a qualitative study. We performed individual semistructured interviews with 20 HCPs who participated in a Norwegian quality improvement collaborative. In addition, participant observation of 22 meetings in the quality improvement collaborative was performed.

RESULTS

A thematic analysis resulted in five themes which outline central elements of the HCPs' perceptions and experiences relevant to achieving more person-centered patient pathways: 1) Finding common ground through the mapping of the patient journey; 2) the importance of understanding the whole patient pathway; 3) the significance of getting to know the older patient; 4) the key role of home care providers in the patient pathway; and 5) ambiguity toward checklists and practice implementation.

CONCLUSIONS

The findings can assist stakeholders in understanding factors important to practicing person-centered transitional care for older people. Through collaborative knowledge sharing the participants developed a more shared understanding of how to achieve person-centered patient pathways. The importance of assuming a shared responsibility and a more holistic understanding of the patient pathway by merging different ways of knowing was highlighted. Checklists incorporating the What matters to you? question and the mapping of the patient journey were important tools enabling the crossing of knowledge boundaries both between HCPs and between HCPs and the older patients. Home care providers were perceived to have important knowledge relevant to providing more person-centered patient pathways implying a central role for them as knowledge brokers during the patient's journey. The study draws attention to the benefits of focusing on the older patients' way of knowing the patient pathway as well as to placing what matters to the older patient at the heart of transitional care.

Why do some inter-organisational collaborations in healthcare work when others do not? A realist review

BACKGROUND

Inter-organisational collaboration is increasingly prominent within contemporary healthcare systems. A range of collaboration types such as alliances, networks, and mergers have been proposed as a means to turnaround organisations, by reducing duplication of effort, enabling resource sharing, and promoting innovations. However, in practice, due to the complexity of the process, such efforts are often rife with difficulty. Notable contributions have sought to make sense of this area; however, further understanding is needed in order to gain a better understanding of why some inter-organisational collaborations work when others do not, to be able to more effectively implement collaborations in the future.

METHODS

Realist review methodology was used with the intention of formulating context-mechanism-outcome configurations (CMOCs) to explain how inter-organisational collaborations work and why, combining systematic and purposive literature search techniques. The systematic review encompassed searches for reviews, commentaries, opinion pieces, and case studies on HMIC, MEDLINE, PsycINFO, and Social Policy and Practice databases, and further searches were conducted using Google Scholar. Data were extracted from included studies according to relevance to the realist review.

RESULTS

Fifty-three papers were included, informing the development of programme theories of how, why, and when inter-organisational collaborations in healthcare work. Formulation of our programme theories incorporated the concepts of partnership synergy and collaborative inertia and found that it was essential to consider mechanisms underlying partnership functioning, such as building trust and faith in the collaboration to maximise synergy and thus collaborative performance. More integrative or mandated collaboration may lean more heavily on contract to drive collaborative behaviour.

CONCLUSION

As the first realist review of inter-organisational collaborations in healthcare as an intervention for improvement, this review provides actionable evidence for policymakers and implementers, enhancing understanding of mechanisms underlying the functioning and performing of inter-organisational collaborations, as well as how to configure the context to aid success. Next steps in this research will test the results against further case studies and primary data to produce a further refined theory.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42019149009.

Ethiopian Pediatric Society Quality Improvement Initiative: a pragmatic approach to facility-based quality improvement in low-resource settings

Objectives

To describe critical features of the Ethiopian Pediatric Society (EPS) Quality Improvement (QI) Initiative and to present formative research on mentor models.

Setting

General and referral hospitals in the Addis Ababa area of Ethiopia.

Participants

Eighteen hospitals selected for proximity to the EPS headquarters, prior participation in a recent newborn care training cascade and minimal experience with QI.

Interventions

Education in QI in a 2-hour workshop setting followed by implementation of a facility-based QI project with the support of virtual mentorship or in-person mentorship.

Primary and secondary outcome measures

Primary outcome—QI progress, measured using an adapted Institute for Healthcare Improvement Scale; secondary outcome—contextual factors affecting QI success as measured by the Model for Understanding Success in Quality.

Results

The dose and nature of mentoring encounters differed based on a virtual versus in-person mentoring approach. All QI teams conducted at least one large-scale change. Education of staff was the most common change implemented in both groups. We did not identify contextual factors that predicted greater QI progress.

Conclusions

The EPS QI Initiative demonstrates that education in QI paired with external mentorship can support implementation of QI in low-resource settings. This pragmatic approach to facility-based QI may be a scalable strategy for improving newborn care and outcomes. Further research is needed on the most appropriate instruments for measuring contextual factors in low/middle-income country settings.

Effect of collaborative quality improvement on stillbirths, neonatal mortality and newborn care practices in hospitals of Telangana and Andhra Pradesh, India: evidence from a quasi-experimental mixed-methods study

Background

Improving quality of care is a key priority to reduce neonatal mortality and stillbirths. The Safe Care, Saving Lives programme aimed to improve care in newborn care units and labour wards of 60 public and private hospitals in Telangana and Andhra Pradesh, India, using a collaborative quality improvement approach. Our external evaluation of this programme aimed to evaluate programme effects on implementation of maternal and newborn care practices, and impact on stillbirths, 7- and 28-day neonatal mortality rate in labour wards and neonatal care units. We also aimed to evaluate programme implementation and mechanisms of change.

Methods

We used a quasi-experimental plausibility design with a nested process evaluation. We evaluated effects on stillbirths, mortality and secondary outcomes relating to adherence to 20 evidence-based intrapartum and newborn care practices, comparing survey data from 29 hospitals receiving the intervention to 31 hospitals expected to receive the intervention later, using a difference-in-difference analysis. We analysed programme implementation data and conducted 42 semi-structured interviews in four case studies to describe implementation and address four theory-driven questions to explain the quantitative results.

Results

Only 7 of the 29 intervention hospitals were engaged in the intervention for its entire duration. There was no evidence of an effect of the intervention on stillbirths [DiD − 1.3 percentage points, 95% CI − 2.6–0.1], on neonatal mortality at age 7 days [DiD − 1.6, 95% CI − 9–6.2] or 28 days [DiD − 3.0, 95% CI − 12.9—6.9] or on adherence to target evidence-based intrapartum and newborn care practices. The process evaluation identified challenges in engaging leaders; challenges in developing capacity for quality improvement; and challenges in activating mechanisms of change at the unit level, rather than for a few individuals, and in sustaining these through the creation of new social norms.

Conclusion

Despite careful planning and substantial resources, the intervention was not feasible for implementation on a large scale. Greater focus is required on strategies to engage leadership. Quality improvement may need to be accompanied by clinical training. Further research is also needed on quality improvement using a health systems perspective.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-020-01058-z.

Perioperative management of patients with suspected or confirmed COVID-19: review and recommendations for perioperative management from a retrospective cohort study

BACKGROUND

Current guidelines for perioperative management of coronavirus disease 19 (COVID-19) are mainly based on extrapolated evidence or expert opinion. We aimed to systematically investigate how COVID-19 affects perioperative management and clinical outcomes, to develop evidence-based guidelines.

METHODS

First, we conducted a rapid literature review in EMBASE, MEDLINE, PubMed, Scopus, and Web of Science (January 1 to July 1, 2020), using a predefined protocol. Second, we performed a retrospective cohort analysis of 166 women undergoing Caesarean section at Tongji Hospital, Wuhan during the COVID-19 pandemic. Demographic, imaging, laboratory, and clinical data were obtained from electronic medical records.

RESULTS

The review identified 26 studies, mainly case reports/series. One large cohort reported greater mortality in elective surgery patients diagnosed after, rather than before surgery. Higher 30 day mortality was associated with emergency surgery, major surgery, poorer preoperative condition and surgery for malignancy. Regional anaesthesia was favoured in most studies and personal protective equipment (PPE) was generally used by healthcare workers (HCWs), but its use was poorly described for patients. In the retrospective cohort study, duration of surgery, oxygen therapy and hospital stay were longer in suspected or confirmed patients than negative patients, but there were no differences in neonatal outcomes. None of the 262 participating HCWs was infected with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) when using level 3 PPE perioperatively.

CONCLUSIONS

When COVID-19 is suspected, testing should be considered before non-urgent surgery. Until further evidence is available, HCWs should use level 3 PPE perioperatively for suspected or confirmed patients, but research is needed on its timing and specifications. Further research must examine longer-term outcomes.

CLINICAL TRIAL REGISTRATION

CRD42020182891 (PROSPERO).

Improving access and flow within Child and Adolescent Mental Health Services: a collaborative learning system approach

Long waiting times for Child and Adolescent Mental Health Services (CAMHS) have been linked to poorer outcomes for those seeking care. CAMHS teams in England have seen recent increases in referrals, resulting in challenging waiting times nationally. Although recent health policy has brought an increase in funding and staffing, it is believed that only 25% of those needing care receive it. Between trusts, there is considerable variation in waiting times, leaving many waiting longer than others waiting for care. East London Foundation Trust has been seen to have higher waiting times for CAMHS than other organisations across the country between June 2017 and September 2018, seven CAMHS teams were supported to use quality improvement (QI) as part of a collaborative learning system with the aim of improving access and flow. Each team was encouraged to understand their system using basic demand and capacity modelling alongside process mapping. From this teams created project aims, driver diagrams and used Plan Do Study Act cycles to test changes iteratively. Measurement and data were displayed on control charts to help teams learn from changes. Teams were brought together to help learn from each other and accelerate change through a facilitated collaborative learning system. Of the seven teams that began the collaborative learning system, six completed a project. Across the collaborative learning system collectively there were improvements in average waiting times for first, second and third appointments, and an improvement in the number of appointments cancelled. For the individual teams involved, three saw an improvement in their project outcome measures, two just saw improvements in their process measures and one did not see an improvement in any measure. In addition to service improvements, teams used the process to learn more about their pathway, engage with service users and staff, build QI capability and learn together.

Contextual factors favouring success in the accreditation process in Colombian hospitals: a nationwide observational study

Background

To identify context factors associated with and predicting success in the hospital accreditation process, and to contribute to the understanding of the relative relevance of context factors and their organizational level in the success of QI initiatives.

Methods

Analytical study of cases and controls in a sample of hospitals of medium and high complexity in Colombia. Cases (n = 16) are accredited hospitals by the time of preparation of the study (2016) and controls (n = 38) are similar facilities, which have not succeeded to obtain accreditation. Eligibility criteria for both groups included complexity (medium and high), having emergency services, an official quality assurance license, and being in operation for at least 15 years. Besides eligibility criteria, geographical location, and type of ownership (public/private) are used to select controls to match cases.

Context measures are assessed using a survey instrument based on the MUSIQ model (“Model for Understanding Success in Quality”) adapted and tested in Colombia. Statistical analysis includes descriptive measures for twenty-three context factors, testing for significant statistical differences between accredited and non-accredited hospitals, and assessing the influence and strength of association of context factors on the probability of success in the accreditation process. A multivariate model assesses the predictive probability of achieving accreditation.

Results

Eighteen (78.3%) of the twenty-three context factors are significantly different when comparing cases and controls hospitals, particularly at the Microsystem level; all factors are statistically significant in favor of accredited hospitals. Five context factors are strongly associated to the achievement of accreditation but in the logistic multivariable model, only two of them remain with significant OR, one in the Macrosystem, “Availability of economic resources for QI” (OR: 22.1, p: 0,005), and the other in the Microsystem, “Involvement of physicians” (OR: 4.9, p: 0,04).

Conclusion

This study has applied an instrument, based on the MUSIQ model, which allows assessing the relevance of different context factors and their organizational level in hospitals, to explain success in the accreditation process in Colombia. Internal macrosystem and microsystem seem to be more relevant than external environment factors.

Professionals' experiences of using an improvement programme: applying quality improvement work in preschool contexts

BACKGROUND

Improvement work can be used in preschools to enrich outdoor environment for children's better health. Effective improvement work can facilitate the necessary changes, but little is known about professionals' experiences of participation in improvement interventions. The aim was to evaluate how preschool staff experience quality improvement work, using the Breakthrough Series Collaborative improvement programme, to enhance outdoor environments.

METHODS

An improvement intervention using a breakthrough collaborative was performed at 9 preschools in Sweden and examined with a longitudinal mixed method design. Staff completed questionnaires on 4 occasions (n=45 participants) and interviews took place after the intervention (n=16 participants).

RESULTS

The intervention was successful in the sense that the staff were content with the learning seminars, and they had triggered physical changes in the outdoor environment. They integrated the quality improvement work with their ordinary work and increasingly involved the children. The staff tested improvement tools but did not find them entirely appropriate for their work, because they preferred existing methods for reflection.

CONCLUSIONS

The challenges in quality improvement work seem to be similar across contexts. Using the Breakthrough Series Collaborative in a public health intervention is promising but needs to be integrated with preunderstandings, current reflections and quality tools and models.