Quality collaboratives: lessons from research

Costs and economic evaluations of Quality Improvement Collaboratives in healthcare: a systematic review

BACKGROUND

In increasingly constrained healthcare budgets worldwide, efforts to improve quality and reduce costs are vital. Quality Improvement Collaboratives (QICs) are often used in healthcare settings to implement proven clinical interventions within local and national programs. The cost of this method of implementation, however, is cited as a barrier to use. This systematic review aims to identify and describe studies reporting on costs and cost-effectiveness of QICs when used to implement clinical guidelines in healthcare.

METHODS

Multiple databases (CINAHL, MEDLINE, PsycINFO, EMBASE, EconLit and ProQuest) were searched for economic evaluations or cost studies of QICs in healthcare. Studies were included if they reported on economic evaluations or costs of QICs. Two authors independently reviewed citations and full text papers. Key characteristics of eligible studies were extracted, and their quality assessed against the Consolidated Health Economic Evaluation Reporting Standards (CHEERS). Evers CHEC-List was used for full economic evaluations. Cost-effectiveness findings were interpreted through the Johanna Briggs Institute 'three by three dominance matrix tool' to guide conclusions. Currencies were converted to United States dollars for 2018 using OECD and World Bank databases.

RESULTS

Few studies reported on costs or economic evaluations of QICs despite their use in healthcare. Eight studies across multiple healthcare settings in acute and long-term care, community addiction treatment and chronic disease management were included. Five were considered good quality and favoured the establishment of QICs as cost-effective implementation methods. The cost savings to the healthcare setting identified in these studies outweighed the cost of the collaborative itself.

CONCLUSIONS

Potential cost savings to the health care system in both acute and chronic conditions may be possible by applying QICs at scale. However, variations in effectiveness, costs and elements of the method within studies, indicated that caution is needed. Consistent identification of costs and description of the elements applied in QICs would better inform decisions for their use and may reduce perceived barriers. Lack of studies with negative findings may have been due to publication bias. Future research should include economic evaluations with societal perspectives of costs and savings and the cost-effectiveness of elements of QICs.

TRIAL REGISTRATION

PROSPERO registration number: CRD42018107417.

"Navigation to prioritizing the patient" - first-line nurse managers' experiences of participating in a quality improvement collaborative

Background

First-line nurse managers are central to quality improvement work when changing work practices into better patient outcomes. Quality improvement collaboratives have been adopted widely to support quality management in healthcare services and shared learning. We have little knowledge of the first-line nurse managers’ own perspectives concerning their need for support and knowledge in quality improvement work. Therefore, the aim of this study was to gain understanding of first line nurse managers’ experiences in leading quality improvement work in their own organization when participating in a quality improvement collaborative.

Methods

An interpretive approach was chosen following Graneheim and Lundman’s qualitative content analysis. Data was collected through three focus group interviews with first-line nurse managers representing different workplaces: the local hospital, a nursing home, and a homecare service in a rural area of Norway.

Results

“Navigation to prioritizing the patient” emerged as an overarching metaphor to describe the first-line nurse managers experiences of leading quality improvement work, based on three themes: 1) fellowship for critical thinking and prioritizing the patient; 2) mastering the processes in quality improvement work; and 3) the everyday reality of leadership as a complex context.

Conclusions

A quality improvement collaborative encompassing knowledge transfer and reflection may create an important fellowship for health care leaders, encouraging and enabling quality improvement work in their own organization. It is crucial to invite all leaders from an organization to be able to share the experience and continue their collaboration with their staff in the organization. Continuity over time, following up elements of the quality improvement work at joint meetings, involvement by users, and self-development of and voluntary involvement in the quality improvement collaborative seem to be important for knowledge development in quality improvement. The supportive elements of the quality improvement collaborative fellowship were crucial to critical thinking and to the first-line nurse managers’ own development and security in mastering the quality improvement work processes. They preferred prioritizing the patients in quality improvement work, despite haste and obstructive situations in an everyday context.

Testing the Integrative Quality Care Assessment Tool (INQUAT)

PURPOSE

Identifying the factors that contribute or hinder the provision of good quality care within healthcare institutions, from the managers' perspective, is important for the success of quality improvement initiatives. The purpose of this paper is to test the Integrative Quality Care Assessment Tool (INQUAT) that was previously developed with a sample of healthcare managers in the USA.

DESIGN/METHODOLOGY/APPROACH

Written narratives of 69 good and poor quality care episodes were collected from 37 managers in Italy. A quantitative content analysis was conducted using the INQUAT coding scheme, to compare the results of the US-based study to the new Italian sample.

FINDINGS

The core frame of the INQUAT was replicated and the meta-categories showed similar distributions compared to the US data. Structure (i.e. organizational, staff and facility resources) covered 8 percent of all the coded units related to quality aspects; context (i.e. clinical factors and patient factors) 10 percent; process (i.e. communication, professional diligence, timeliness, errors and continuity of care) 49 percent; and outcome (i.e. process- and short-term outcomes) 32 percent. However, compared to the US results, Italian managers attributed more importance to different categories' subcomponents, possibly due to the specificity of each sample. For example, professional diligence, errors and continuity of care acquired more weight, to the detriment of communication. Furthermore, the data showed that process subcomponents were associated to perceived quality more than outcomes.

RESEARCH LIMITATIONS/IMPLICATIONS

The major limitation of this investigation was the small sample size. Further studies are needed to test the reliability and validity of the INQUAT.

ORIGINALITY/VALUE

The INQUAT is proposed as a tool to systematically conduct in depth analyses of successful and unsuccessful healthcare events, allowing to better understand the factors that contribute to good quality and to identify specific areas that may need to be targeted in quality improvement initiatives.

Designing Quality Improvement Collaboratives for Dissemination: Lessons from a Multiple Case Study of the Implementation of Obstetric Emergency Safety Bundles

BACKGROUND

Quality improvement collaboratives (QICs) can help to disseminate evidence-based practices, but there is limited guidance from the perspectives of QIC organizers and participants of best practices to support practice change. To address this gap, this study aimed to identify key structures and processes of QICs that support dissemination and implementation of quality improvement projects.

METHODS

Semistructured one-on-one and group interviews were conducted from December 2017 to May 2018 with project administrators (n = 28) at three QICs that had been funded to develop and disseminate obstetric emergency safety bundles in more than 300 hospitals across five states. For further study, the project leads (n = 25) at six hospitals nominated by each QIC were interviewed. A multiple case study design was used to evaluate the dissemination strategies of each of the three QICs. For the QIC interviews, questions asked about dissemination approach, and for the hospital interviews, questions asked about implementation facilitators and barriers. All interviews were transcribed, coded, and analyzed using both deductive and inductive methods.

RESULTS

A key element supporting the dissemination strategy of each QIC was leveraging existing partnerships and relationships and promoting a shared vision with participating hospitals. A robust data infrastructure to support the project was identified as a critical element to support dissemination, yet was a challenge for the QICs.

CONCLUSION

These findings highlight specific elements of a dissemination approach that QICs can deploy to support their dissemination efforts. In particular, building data infrastructure may be a useful strategy to support ongoing quality improvement projects.

Improving Maternal Safety at Scale with the Mentor Model of Collaborative Improvement

BACKGROUND

Obstetric safety bundles, consisting of action steps shown to improve outcomes, have been developed to address the most common and preventable causes of maternal morbidity and mortality. Implementing these best practices across all birthing facilities remains an important and challenging clinical and public health priority.

METHODS

The California Maternal Quality Care Collaborative (CMQCC) developed an innovative external mentor model for large-scale collaborative improvement in which participating organizations were subdivided into small teams of six to eight hospitals, led by a paired dyad of physician and nurse leaders. The mentor model preserves the active sharing that enhances improvement across a large group of facilities working on the same project while enabling individualized attention to teams. The mentor model was tested by implementing the obstetric hemorrhage safety bundle (which consists of 17 key practices in four domains) in multiple California hospitals.

RESULTS

A total of 126 hospitals were engaged to simultaneously implement the safety bundle. The adoption rates for the recommended practices in the four action domains were (1) Readiness, 78.9%; (2) Recognition and Prevention, 76.5%; (3) Response, 63.1%; and (4) Reporting and Systems Learning, 58.7%. Mentors (31/40) and participating teams (48 responses from 39/126 hospitals) provided feedback in an exit survey. Among the respondents, 64.5% of mentors and 72.9% of participants agreed that compared to a traditional collaborative structure, the mentor model was better suited for quality improvement at scale.

CONCLUSION

The mentor model was successful in providing individualized support to teams and enabled implementation of the hemorrhage safety bundle across a diverse group of 126 hospitals.

Learning Collaboratives in Medical Education: Exploring the Impact of Collaboratives' Structure and Resources and Teams' Experience

The Alliance of Independent Academic Medical Centers (AIAMC) organized and coordinated a multicenter learning collaborative, National Initiative V (NI V), focused on community health and health inequity. A pre-post descriptive study was designed to examine the outcomes of the AIAMC NI V. Data were collected from pre- and post-assessment surveys as well as a project milestone self-assessment survey. Twenty-nine institutions participated. By the conclusion of the NI, the majority of institutions had completed at least 1 of the milestones in each of the pre-work/background (65.52%), measurement (62.07%), methods (62.07%), and implement/sustain (20.69%) domains. Institutions reported a significant association between their readiness assessments prior to the start of the NI compared with their status of activities on completion. Milestone achievement is significantly associated with 3 of the assessment items. Learning collaboratives with thoughtfully integrated structure and support can be impactful on topic readiness for the participating organizations.

The effectiveness of the quality improvement collaborative strategy in low- and middle-income countries: A systematic review and meta-analysis

BACKGROUND

Quality improvement collaboratives (QICs) have been used to improve health care for decades. Evidence on QIC effectiveness has been reported, but systematic reviews to date have little information from low- and middle-income countries (LMICs).

OBJECTIVE

To assess the effectiveness of QICs in LMICs.

METHODS

We conducted a systematic review following Cochrane methods, the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach for quality of evidence grading, and the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement for reporting. We searched published and unpublished studies between 1969 and March 2019 from LMICs. We included papers that compared usual practice with QICs alone or combined with other interventions. Pairs of reviewers independently selected and assessed the risk of bias and extracted data of included studies. To estimate strategy effectiveness from a single study comparison, we used the median effect size (MES) in the comparison for outcomes in the same outcome group. The primary analysis evaluated each strategy group with a weighted median and interquartile range (IQR) of MES values. In secondary analyses, standard random-effects meta-analysis was used to estimate the weighted mean MES and 95% confidence interval (CI) of the mean MES of each strategy group. This review is registered with PROSPERO (International Prospective Register of Systematic Reviews): CRD42017078108.

RESULTS

Twenty-nine studies were included; most (21/29, 72.4%) were interrupted time series studies. Evidence quality was generally low to very low. Among studies involving health facility-based health care providers (HCPs), for "QIC only", effectiveness varied widely across outcome groups and tended to have little effect for patient health outcomes (median MES less than 2 percentage points for percentage and continuous outcomes). For "QIC plus training", effectiveness might be very high for patient health outcomes (for continuous outcomes, median MES 111.6 percentage points, range: 96.0 to 127.1) and HCP practice outcomes (median MES 52.4 to 63.4 percentage points for continuous and percentage outcomes, respectively). The only study of lay HCPs, which used "QIC plus training", showed no effect on patient care-seeking behaviors (MES -0.9 percentage points), moderate effects on non-care-seeking patient behaviors (MES 18.7 percentage points), and very large effects on HCP practice outcomes (MES 50.4 percentage points).

CONCLUSIONS

The effectiveness of QICs varied considerably in LMICs. QICs combined with other invention components, such as training, tended to be more effective than QICs alone. The low evidence quality and large effect sizes for QIC plus training justify additional high-quality studies assessing this approach in LMICs.

Improving laboratory test utilisation at the multihospital Yale New Haven Health System

Background

Waste persists in healthcare and negatively impacts patients. Clinicians have direct control over test ordering and ongoing international efforts to improve test utilisation have identified multifaceted approaches as critical to the success of interventions. Prior to 2015, Yale New Haven Health lacked a coherent strategy for laboratory test utilisation management.

Methods

In 2015, a system-wide laboratory formulary committee was formed at Yale New Haven Health to manage multiple interventions designed to improve test utilisation. We report here on specific interventions conducted between 2015 and 2017 including reduction of (1) obsolete or misused testing, (2) duplicate orders, and (3) daily routine lab testing. These interventions were driven by a combination of modifications to computerised physician order entry, test utilisation dashboards and physician education. Measurements included test order volume, blood savings and cost savings.

Results

Testing for a number of obsolete/misused analytes was eliminated or significantly decreased depending on alert rule at order entry. Hard stops significantly decreased duplicate testing and educational sessions significantly decreased daily orders of routine labs and increased blood savings but the impact waned over time for select groups. In total, we realised approximately $100 000 of cost savings during the study period.

Conclusion

Through a multifaceted approach to utilisation management, we show significant reductions in low-value clinical testing that have led to modest but significant savings in both costs and patients’ blood.

Evaluation of the Safe Care, Saving Lives (SCSL) quality improvement collaborative for neonatal health in Telangana and Andhra Pradesh, India: a study protocol

Background: The collaborative quality improvement approach proposed by the Institute for Healthcare Improvement has the potential to improve coverage of evidence-based maternal and newborn health practices. The Safe Care, Saving Lives initiative supported the implementation of 20 evidence-based maternal and newborn care practices, targeting labour wards and neonatal care units in 85 public and private hospitals in Telangana and Andhra Pradesh, India.

Objective: We present a protocol for the evaluation of this programme which aims to (a) estimate the effect of the initiative on evidence-based care practices and mortality; (b) evaluate the mechanisms leading to changes in adherence to evidence-based practices, and their relationship with contextual factors; (c) explore the feasibility of scaling-up the approach.

Methods: The mixed-method evaluation is based on a plausibility design nested within a phased implementation. The 29 non-randomly selected hospitals comprising wave II of the programme were compared to the 31 remaining hospitals where the quality improvement approach started later. We assessed mortality and adherence to evidence-based practices at baseline and endline using abstraction of registers, checklists, observations and interviews in intervention and comparison hospitals. We also explored the mechanisms and drivers of change in adherence to evidence-based practices. Qualitative methods investigated the mechanisms of change in purposefully selected case study hospitals. A readiness assessment complemented the analysis of what works and why. We used a difference-in-difference approach to estimate the effects of the intervention on mortality and coverage. Thematic analysis was used for the qualitative data.

Discussion: This is the first quality improvement collaborative targeting neonatal health in secondary and tertiary hospitals in a middle-income country linked to a government health insurance scheme. Our process evaluation is theory driven and will refine hypotheses about how this quality improvement approach contributes to institutionalization of evidence-based practices.

Inclusion of a care bundle for fever, hyperglycaemia and swallow management in a National Audit for acute stroke: evidence of upscale and spread

BACKGROUND

In the Quality in Acute Stroke Care (QASC) trial undertaken in stroke units (SUs) located in New South Wales (NSW), Australia (2005-2010), facilitated implementation of a nurse-led care bundle to manage fever, hyperglycaemia and swallowing (FeSS protocols) reduced death and disability for patients with stroke. We aimed to determine subsequent adherence to the bundled FeSS processes (reflective of the protocols) between 2013 and 2017 in Australian hospitals, and examine whether changes in adherence to these processes varied based on previous participation in the QASC trial or subsequent statewide scale-up (QASCIP-Quality in Acute Stroke Care Implementation Project) and presence of an SU.

METHODS

Cross-sectional, observational study using self-reported organisational survey and retrospective clinical audit data from the National Acute Services Stroke Audit (2013, 2015, 2017). Mixed-effects logistic regression was performed with dependent variables: (1) composite outcome measure reflecting compliance with the FeSS protocols and (2) individual FeSS processes, including the year of audit as an independent variable, adjusted for correlation of outcomes within hospital. Separate models including interaction terms between the year of audit and previous participation in QASC/QASCIP and year of audit and SU were also generated.

RESULTS

Hospital participation included the following: 2013-124 hospitals, 3741 cases; 2015-112 hospitals, 4087 cases; and 2017-117 hospitals, 4192 cases. An 80% increase in the odds of receiving the composite outcome in 2017 compared to 2013 was found (2013, 30%; 2017, 41%; OR 1.8; 95% CI 1.6, 2.0; p < 0.001). The odds of FeSS adherence from 2013 to 2017 was greater for hospitals that had participated in QASC/QASCIP relative to those that had not (participated OR 2.1; 95% CI 1.7, 2.7; not participated OR 1.6; 95% CI 1.4, 1.8; p = 0.03). Similar uptake in adherence was evident in hospitals with and without an SU between 2013 and 2017.

CONCLUSION

The use of the FeSS protocols within Australia increased from 2013 to 2017 with the inclusion of these care processes in the National Audit. Greater uptake in hospitals previously involved in QASC/QASCIP was evident. Our implementation methods may be useful for other national initiatives for improving access to evidence-based practice.

Measuring the Impact of Academic Cancer Network Development on Clinical Integration, Quality of Care, and Patient Satisfaction

PURPOSE

Many US academic centers have acquired community practices to expand their clinical care and research footprint. The objective of this assessment was to determine whether the acquisition and integration of community oncology practices by Yale/Smilow Cancer Hospital improved outcomes in quality of care, disease team integration, clinical trial accrual, and patient satisfaction at network practice sites.

METHODS

We evaluated quality of care by testing the hypothesis that core Quality Oncology Practice Initiative measures at network sites that were acquired in 2012 were significantly different after their 2016 integration into the network. Clinical and research integration were measured using the number of tumor board case presentations and total accruals in clinical trials. We used Press-Ganey scores to measure patient satisfaction pre- and postintegration.

RESULTS

Mean Quality Oncology Practice Initiative scores at Smilow Care Centers were significantly higher in 2016 than in 2012 for core measures related to improvement in tumor staging ( z = 1.33; P < .05), signed consent and documentation plans for antineoplastic treatment ( z = 2.69; P < .01; and z = 2.36; P < .05, respectively), and appropriately quantifying and addressing pain during office visits ( z = 2.95; P < .05; and z = 3.1; P < .01, respectively). A total of 493 cases were presented by care center physicians at the tumor board in 2017 compared with 45 presented in 2013. Compared with 2012, Smilow Care Center clinical trial accrual increased from 25 to 170 patients in 2017. Last, patient satisfaction has remained at greater than the 90th percentile pre- and postintegration.

CONCLUSION

The process of integration facilitates the ability to standardize cancer practice and provides a platform for quality improvement.

In-depth comparison of two quality improvement collaboratives from different healthcare areas based on registry data-possible factors contributing to sustained improvement in outcomes beyond the project time

BACKGROUND

Quality improvement collaboratives (QICs) are widely used to improve healthcare, but there are few studies of long-term sustained improved outcomes, and inconsistent evidence about what factors contribute to success. The aim of the study was to open the black box of QICs and compare characteristics and activities in detail of two differing QICs in relation to their changed outcomes from baseline and the following 3 years.

METHODS

Final reports of two QICs-one on heart failure care with five teams, and one on osteoarthritis care with seven teams, including detailed descriptions of improvement projects from each QIC's team, were analysed and coded by 18 QIC characteristics and four team characteristics. Goal variables from each team routinely collected within the Swedish Heart Failure Registry (SwedeHF) and the Better Management of Patients with OsteoArthritis Registry (BOA) at year 2013 (baseline), 2014, 2015 and 2016 were analysed with univariate statistics.

RESULTS

The two QICs differed greatly in design. The SwedeHF-QIC involved eight experts and ran for 12 months, whereas the BOA-QIC engaged three experts and ran for 6 months. There were about twice as many activities in the SwedeHF-QIC as in the BOA-QIC and they ranged from standardisation of team coordination to better information and structured follow-ups. The outcome results were heterogeneous within teams and across teams and QICs. Both QICs were highly appreciated by the participants and contributed to their learning, e.g. of improvement methods; however, several teams had already reached goal values when the QICs were launched in 2013.

CONCLUSIONS

Even though many QI activities were carried out, it was difficult to see sustained improvements on outcomes. Outcomes as specific measurable aspects of care in need of improvement should be chosen carefully. Activities focusing on adherence to standard care programmes and on increased follow-up of patients seemed to lead to more long-lasting improvements. Although earlier studies showed that data follow-up and measurement skills as well as well-functioning data warehouses contribute to sustained improvements, the present registries' functionality and QICs at this time did not support those aspects sufficiently. Further studies on QICs and their impact on improvement beyond the project time should investigate the effect of those elements in particular.

A quality improvement collaborative to build improvement capacity in regional primary care support organisations

Strong primary care is foundational for effective, efficient health systems but remains variable in health systems around the world. Increasing quality improvement capacity in primary care support organisations has potential to improve primary care and health systems. This project worked with staff from primary healthcare support organisations with the aim of improving by 20% the confidence and competence scores of participants seeking to implement a quality improvement activity. The Breakthrough Collaborative approach was used to design a programme of learning workshops, action periods, data feedback and local support. Improvement measures included confidence in quality improvement (self-rated) and competence in quality improvement (using the validated Quality Improvement Knowledge Assessment Tool). Participants were required to submit quality improvement plans and run local quality improvement projects. The programme was run three times with improvements made between each cycle. Overall, 50 teams consisting of 173 regional staff took part. They engaged a total of 341 front-line primary care services such as general practices, Aboriginal medical services and pharmacies. In the first cycle, there was no improvement in measured regional staff knowledge and skills. In response, the learning workshops were changed to increase didactic teaching and supported practice of fundamental quality improvement skills. Regional organisational leaders were consulted to decrease the turnover in participants during each collaborative cycle. In the final cohort, a 38% improvement in knowledge and skills was recorded. All teams submitted quality improvement plans and ran local workshops indicating good engagement. This programme addresses a key need for health systems that is shared around the world: the improvement of primary care. It demonstrates using the Breakthrough Collaborative methodology to increase quality improvement capacity in the sector. After initial challenges, repeated cycles recorded greater than 30% improvement in the measured competence of participants in quality improvement activities.

Quality improvement of health systems in an epidemic context: A framework based on lessons from the Ebola virus disease outbreak in West Africa

Quality improvement (QI) in health generally focuses on the provision of health services with the aim of improving service delivery. Yet QI can be applied not only to health services but also to health systems overall. This is of growing relevance considering that due to deficiencies in health systems, the main countries affected by Ebola virus disease (EVD) outbreak in West Africa (2014-2016) were insufficiently prepared for the epidemic, and according to the WHO, epidemics are increasingly becoming a threat to global health. Our objective is to analyze QI constraints in health systems during that EVD epidemic and to propose a practical framework for QI in health systems for epidemics in developing countries. We applied a framework analysis using experiences shared at the "Second International Quality Forum" organized by the University of Heidelberg and partners in July 2015 and information gathered from a systematic literature review. Empirical results revealed multiple deficiencies in the health systems. We systemized these shortfalls as well as the QI measures taken as a response during the epidemic. On the basis of these findings, we identified six specific "priority intervention areas," which ultimately resulted in the synthesis of a practical QI framework. We deem that this framework that integrates the priority intervention areas with the WHO building blocks is suitable to improve, monitor, and evaluate health system performance in epidemic contexts in developing countries.

Lessons Learned from Applying a Modified Learning Collaborative Model to Promote Change in Regional and Statewide HIV Care Systems

The Health Resources and Services Administration Special Projects of National Significance launched the Systems Linkage and Access to Care for Populations at High Risk of HIV Infection Initiative in 2011. Six state departments of health were funded to utilize a modified Learning Collaborative model to develop and/or adapt HIV testing, linkage to care and retention in care system-level interventions. More than 60 Learning Sessions were held over the course of the Learning Collaborative. A total of 22 unique interventions were tested with 18 interventions selected and scaled up. All interventions were created to impact services at a systems level, with standardized protocols developed to ensure fidelity. Our findings provide key lessons and present considerations for replication for use of a modified Learning Collaborative to achieve state-level systems change.

Dynamics of intervention adoption, implementation, and maintenance inside organizations: The case of an obesity prevention initiative

Overall impact of public health prevention interventions relies not only on the average efficacy of an intervention, but also on the successful adoption, implementation, and maintenance (AIM) of that intervention. In this study, we aim to understand the dynamics that regulate AIM of organizational level intervention programs. We focus on two well-documented obesity prevention interventions, implemented in food carry-outs and stores in low-income urban areas of Baltimore, Maryland, which aimed to improve dietary behaviour for adults by providing access to healthier foods and point-of-purchase promotions. Building on data from field observations, in-depth interviews, and data discussed in previous publications, as well as the strategy and organizational behaviour literature, we developed a system dynamics model of the key processes of AIM. With simulation analysis, we show several reinforcing mechanisms that span stakeholder motivation, communications, and implementation quality and costs can turn small changes in the process of AIM into big difference in the overall impact of the intervention. Specifically, small changes in the allocation of resources to communication with stakeholders of intervention could have a nonlinear long-term impact if those additional resources can turn stakeholders into allies of the intervention, reducing the erosion rates and enhancing sustainability. We present how the dynamics surrounding communication, motivation, and erosion can create significant heterogeneity in the overall impact of otherwise similar interventions. Therefore, careful monitoring of how those dynamics unfold, and timely adjustments to keep the intervention on track are critical for successful implementation and maintenance.

Criteria for evaluating programme theory diagrams in quality improvement initiatives: a structured method for appraisal

Background

Despite criticisms that many quality improvement (QI) initiatives fail due to incomplete programme theory, there is no defined way to evaluate how programme theory has been articulated. The objective of this research was to develop, and assess the usability and reliability of scoring criteria to evaluate programme theory diagrams.

Methods

Criteria development was informed by published literature and QI experts. Inter-rater reliability was tested between two evaluators. About 63 programme theory diagrams (42 driver diagrams and 21 action-effect diagrams) were reviewed to establish whether the criteria could support comparative analysis of different approaches to constructing diagrams.

Results

Components of the scoring criteria include: assessment of overall aim, logical overview, clarity of components, cause-effect relationships, evidence and measurement. Independent reviewers had 78% inter-rater reliability. Scoring enabled direct comparison of different approaches to developing programme theory; action-effect diagrams were found to have had a statistically significant but moderate improvement in programme theory quality over driver diagrams; no significant differences were observed based on the setting in which driver diagrams were developed.

Conclusions

The scoring criteria summarise the necessary components of programme theory that are thought to contribute to successful QI projects. The viability of the scoring criteria for practical application was demonstrated. Future uses include assessment of individual programme theory diagrams and comparison of different approaches (e.g. methodological, teaching or other QI support) to produce programme theory. The criteria can be used as a tool to guide the production of better programme theory diagrams, and also highlights where additional support for QI teams could be needed.

Successful implementation of a combined learning collaborative and mentoring intervention to improve neonatal quality of care in rural Rwanda

Background

Globally, neonatal mortality remains high despite interventions known to reduce neonatal deaths. The All Babies Count (ABC) initiative was a comprehensive health systems strengthening intervention designed by Partners In Health in collaboration with the Rwanda Ministry of Health to improve neonatal care in rural public facilities. ABC included provision of training, essential equipment, and a quality improvement (QI) initiative which combined clinical and QI mentorship within a learning collaborative. We describe ABC implementation outcomes, including development of a QI change package.

Methods

ABC was implemented over 18 months from 2013 to 2015 in two Rwandan districts of Kirehe and Southern Kayonza, serving approximately 500,000 people with 24 nurse-led health centers and 2 district hospitals. A process evaluation of ABC implementation and its impact on healthcare worker (HCW) attitudes and QI practice was done using program documents, standardized surveys and focus groups with facility QI team members attending ABC Learning Sessions. The Change Package was developed using mixed methods to identify projects with significant change according to quantitative indicators and qualitative feedback obtained during focus group discussions. Outcome measures included ABC implementation process measures, HCW-reported impact on attitudes and practice of QI, and resulting change package developed for antenatal care, delivery management and postnatal care.

Results

ABC was implemented across all 26 facilities with an average of 0.76 mentorship visits/facility/month and 118 tested QI change ideas. HCWs reported a reduction in barriers to quality care delivery related to training (p = 0.018); increased QI capacity (knowledge 37 to 89%, p <  0.001); confidence (47 to 89%, p <  0.001), QI leadership (59 to 91%, p <  0.001); and peer-to-peer learning (37 to 66%, p = 0.024). The final change package included 46 change ideas. Themes associated with higher impact changes included provision of mentorship and facility readiness support through equipment provision.

Conclusions

ABC provides a feasible model of an integrated approach to QI in rural Rwanda. This model resulted in increases in HCW and facility capacity to design and implement effective QI projects and facilitated peer-to-peer learning. ABC and the change package are being scaled to accelerate improvement in neonatal outcomes.

Quality improvement collaborative aiming for Proactive HEAlthcare of Older People in Care Homes (PEACH): a realist evaluation protocol

INTRODUCTION

This protocol describes a study of a quality improvement collaborative (QIC) to support implementation and delivery of comprehensive geriatric assessment (CGA) in UK care homes. The QIC will be formed of health and social care professionals working in and with care homes and will be supported by clinical, quality improvement and research specialists. QIC participants will receive quality improvement training using the Model for Improvement. An appreciative approach to working with care homes will be encouraged through facilitated shared learning events, quality improvement coaching and assistance with project evaluation.

METHODS AND ANALYSIS

The QIC will be delivered across a range of partnering organisations which plan, deliver and evaluate health services for care home residents in four local areas of one geographical region. A realist evaluation framework will be used to develop a programme theory informing how QICs are thought to work, for whom and in what ways when used to implement and deliver CGA in care homes. Data collection will involve participant observations of the QIC over 18 months, and interviews/focus groups with QIC participants to iteratively define, refine, test or refute the programme theory. Two researchers will analyse field notes, and interview/focus group transcripts, coding data using inductive and deductive analysis. The key findings and linked programme theory will be summarised as context-mechanism-outcome configurations describing what needs to be in place to use QICs to implement service improvements in care homes.

ETHICS AND DISSEMINATION

The study protocol was reviewed by the National Health Service Health Research Authority (London Bromley research ethics committee reference: 205840) and the University of Nottingham (reference: LT07092016) ethics committees. Both determined that the Proactive HEAlthcare of Older People in Care Homes study was a service and quality improvement initiative. Findings will be shared nationally and internationally through conference presentations, publication in peer-reviewed journals, a graphical illustration and a dissemination video.

Explication of a Behavioral Health-Primary Care Integration Learning Collaborative and Its Quality Improvement Implications

In an effort to tackle fragmented care in the US healthcare delivery system, we explored the use of learning collaborative (LC) to advance integration of behavioral health and primary care as one of the potential solutions to a holistic approach to the delivery of quality healthcare to individuals with physical and mental illness. How a diverse group of primary care and behavioral health providers formed a Community of Practice (CoP) with a common purpose and shared vision to advance integrated care using a LC approach is described. An account of their learning experience, key components of their quality improvement, practice changes, clinical processes, and improved outcomes are explained. This paper aims at describing the history, creative design, processes, roles of the CoP and impact of the LC on the advancement of integrated care practice and quality improvements for further exploration and replications.

Determinants of good and poor quality as perceived by US health care managers

Purpose The scientific literature evidences that the quality of care must be improved. However, little research has focused on investigating how health care managers - who are responsible for the implementation of quality interventions - define good and poor quality. The purpose of this paper is to develop an empirically informed taxonomy of quality care as perceived by US managers - named the Integrative Quality Care Assessment Tool (INQUAT) - that is grounded in Donabedian's structure, process and outcome model. Design/methodology/approach A revised version of the critical incident technique was used to collect 135 written narratives of good and poor quality care from 74 health care managers in the USA. The episodes were thematically analyzed. Findings In total, 804 units were coded under the 135 written narratives of care. They were grouped under structure (9 percent, n=69), including organizational, staff and facility resources; process (52 percent, n=419), entailing communication, professional diligence, timeliness, errors, and continuity of care; outcomes (32 percent, n=257), embedding process- and short-term outcomes; and context (7 percent, n=59), involving clinical and patient factors. Process-related categories tended to be described in relation to good quality (65 percent), while structure-related categories tended to be associated with poor quality (67 percent). Furthermore, the data suggested that managers did not consider their actions as important factors influencing quality, but rather tended to attribute the responsibility for quality care to front-line practitioners. Originality/value The INQUAT provides a theoretically grounded, evidence-based framework to guide health care managers in the assessment of all the components involved with the quality of care within their institutions.

Improving access to services through a collaborative learning system at East London NHS Foundation Trust

Early intervention following initial referral into healthcare services can have a significant impact on the prognosis and outcomes of patients. Long waiting times and non-attendance can have an immediate and enduring negative impact on patients and healthcare service providers. The traditional management options in reducing waiting times have largely revolved around setting performance targets, providing financial incentives or additional resourcing. This large-scale quality improvement project aimed to reduce waiting times from referral to first appointment and non-attendance for a wide range of services providing primary and secondary care mental health and community health services at East London NHS Foundation Trust (ELFT). Fifteen community-based teams across ELFT came together with the shared goal of improving access. These teams were diverse in both nature and geography and included adult community mental health teams, child and adolescent mental health services, secondary care psychological therapy services, memory services, a musculoskeletal physiotherapy service and a sickle cell service. A collaborative learning system was developed to support the teams to come together at regular intervals, share data, test and scale-up ideas through quality improvement and have access to coaching from skilled improvement advisors in the ELFT central quality improvement team. Over the course of the 2-year project, waiting time from referral to first face-to-face appointment reduced from an average of 60.6 days to 46.7 days (a 23% reduction), non-attendance at first face-to-face appointment reduced from an average of 31.7% to an average of 20.5% (a 36% reduction), while referral volume increased from an average of 1021 per month to an average of 1280 per month (a 25% increase).

Pilot to policy: statewide dissemination and implementation of evidence-based treatment for traumatized youth

BACKGROUND

A model for statewide dissemination of evidence-based treatment (EBT) for traumatized youth was piloted and taken to scale across North Carolina (NC). This article describes the implementation platform developed, piloted, and evaluated by the NC Child Treatment Program to train agency providers in Trauma-Focused Cognitive Behavioral Therapy using the National Center for Child Traumatic Stress Learning Collaborative (LC) Model on Adoption & Implementation of EBTs. This type of LC incorporates adult learning principles to enhance clinical skills development as part of training and many key implementation science strategies while working with agencies and clinicians to implement and sustain the new practice.

METHODS

Clinicians (n = 124) from northeastern NC were enrolled in one of two TF-CBT LCs that lasted 12 months each. During the LC clinicians were expected to take at least two clients through TF-CBT treatment with fidelity and outcomes monitoring by trainers who offered consultation by phone and during trainings. Participating clinicians initiated treatment with 281 clients. The relationship of clinician and client characteristics to treatment fidelity and outcomes was examined using hierarchical linear regression.

RESULTS

One hundred eleven clinicians completed general training on trauma assessment batteries and TF-CBT. Sixty-five clinicians met all mastery and fidelity requirements to meet roster criteria. One hundred fifty-six (55%) clients had fidelity-monitored assessment and TF-CBT. Child externalizing, internalizing, and post-traumatic stress symptoms, as well as parent distress levels, decreased significantly with treatment fidelity moderating child PTSD outcomes. Since this pilot, 11 additional cohorts of TF-CBT providers have been trained to these roster criteria.

CONCLUSION

Scaling up or outcomes-oriented implementation appears best accomplished when training incorporates: 1) practice-based learning, 2) fidelity coaching, 3) clinical assessment and outcomes-oriented treatment, 4) organizational skill-building to address barriers for agencies, and 5) linking clients to trained clinicians via an online provider roster. Demonstrating clinician performance and client outcomes in this pilot and subsequent cohorts led to legislative support for dissemination of a service array of EBTs by the NC Child Treatment Program.

Implementing Frontline Worker-Led Quality Improvement in Nursing Homes: Getting to "How"

BACKGROUND

Despite emerging frameworks for quality improvement (QI) implementation, little is known about how the implementation process works, particularly in nursing home settings. A study was conducted to describe "how"' a complex frontline worker-led QI program was implemented in nursing homes.

METHODS

Six focus groups were conducted in February 2017 with participants of a year-long, multicomponent, unit-level QI intervention in seven nursing homes in the Canadian province of Manitoba. Constant comparative analysis was used to examine perspectives of different groups of QI program participants-35 health care aides, health professionals, and managers.

RESULTS

Five themes important to the implementation process were identified: (1) "supportive elements of the QI program structure," (2) "navigating the workplace," (3) "negotiating relationships," (4) "developing individual skills," and (5) "observable program impact." Data on theme integration suggest that "supportive elements of the QI program structure" (Theme 1), "developing individual skills" (Theme 4), and "observable program impact" (on residents, health care aides, and leaders; Theme 5) operated as part of a reinforcing feedback loop that boosted team members' ability to navigate the workplace, negotiate relationships, and implement the QI program.

CONCLUSION

Health care aide-led QI teams are feasible. However, a leadership paradox exists whereby worker-led QI programs also must incorporate concrete mechanisms to promote strong leadership and sponsor support to teams. The findings also point to the underexplored impact of interpersonal relationships between health care aides and professional staff on QI implementation.

Assessing Collaboration in a National Research Partnership in Quality Improvement in Indigenous Primary Health Care: A Network Approach

Background: The ABCD National Research Partnership was formed in mid-2010 as a collaboration to harness the expertise, experiences and resources of Aboriginal and Torres Strait Islander community-controlled peak bodies, government and research organisations to improve the quality of Indigenous primary health care. The aim of this study was to apply social network methods to assess collaboration and functioning of the Partnership at two time-points.

Methods: A social network analysis (SNA) survey was conducted in early 2013, with a follow-up survey in mid-2014. In the two survey rounds, online surveys were emailed to one senior person of the organisation participating in the Partnership (2013: 14 organisations; 2014: 11 organisations). The surveys collected data on respondent perceptions of the Partnership as well as social network relationship data. Social network methods were used to apply standardised metrics to assess how well the partnership was functioning as a collaborative three years into its operation, and in its fourth year.

Results: Most respondents rated the Partnership as successful in progressing toward its goals. Network density and centrality scores show a well-connected partnership spanning different organisational types and states/territories (Northern Territory, Queensland, Western Australia, South Australia, and Far-West New South Wales). High centrality scores reflect high connectivity between key hubs in the network, contributing toward the shared goal of improved Indigenous primary health care. Network diagrams show key structural positions by organisational type, the frequency and intensity of interactions and the strengths and potential vulnerabilities in the partnership network, with comparisons at two time points for the partnership.

Conclusions: The study found that the Partnership was effective in securing collaboration across its partners. Partners' contribution of resources reflected their active involvement. There was a high level of agreement on the achievement of the key goals of the Partnership, showing shared sense-making amongst partners. SNA tools assisted with monitoring the network over time to develop strategies supporting connections between partners for sustaining collaborative learning. Study findings identify successful approaches for a research partnership to improve quality of care in Indigenous primary health care and provide encouragement for wider applications for research partnerships and collaborations in Australia and internationally.

Comparing and contrasting 'innovation platforms' with other forms of professional networks for strengthening primary healthcare systems for Indigenous Australians

Efforts to strengthen health systems require the engagement of diverse, multidisciplinary stakeholder networks. Networks provide a forum for experimentation and knowledge creation, information exchange and the spread of good ideas and practice. They might be useful in addressing complex issues or ‘wicked’ problems, the solutions to which go beyond the control and scope of any one agency.

Innovation platforms are proposed as a novel type of network because of their diverse stakeholder composition and focus on problem solving within complex systems. Thus, they have potential applicability to health systems strengthening initiatives, even though they have been predominantly applied in the international agricultural development sector.

In this paper, we compare and contrast the concept of innovation platforms with other types of networks that can be used in efforts to strengthen primary healthcare systems, such as communities of practice, practice-based research networks and quality improvement collaboratives. We reflect on our ongoing research programme that applies innovation platform concepts to drive large-scale quality improvement in primary healthcare for Aboriginal and Torres Strait Islander Australians and outline our plans for evaluation. Lessons from our experience will find resonance with others working on similar initiatives in global health.

Perspectives of nursing professionals and older adults differ on aspects of care for older people after a nationwide improvement program

Background

The perspectives of nursing professionals might differ from those of older adults when it comes to care for older people. This cross-sectional study compares the views of older adults with the views of nursing professionals on the quality of care after a nationwide improvement program for care for older people was implemented (2008–2016) in the Netherlands.

Methods

Questionnaire data were used from 385 nursing professionals (response rate 51%) that were part of the Nursing Staff Panel, a nationwide representative group of nursing staff, and working in home care, hospitals or general practices. Additionally, questionnaire data were used from 73 older adults (response rate 81%) who were involved in regional networks to discuss project proposals and to represent the voice of older adults in the nationwide improvement program. Participants were asked to evaluate care for older people with regard to collaboration between healthcare organizations and with regard to the tailored service, accessibility, and quality of care within their organizations and in the region in which they lived.

Results

A majority of older adults (54%) and nursing professionals (61%) felt that collaboration with others had improved over the last few years. Approximately one third of the older adults stated that care for older people was tailored to fit individual needs and was accessible most of the time or always, as opposed to approximately two thirds of the professionals. Moreover, 17% older adults thought that the quality of care was good, compared with 54% of the nursing professionals. 77% of the nursing professionals and 94% of the older adults thought that improvements were still needed in care for older people, for example better integration of the different aspects of care and a more patient-centered approach.

Conclusion

Older adults who were involved in networks of the improvement program generally gave a less positive evaluation of aspects of care for older people and its development than nursing professionals. Considering differences in the perspectives of key stakeholders is relevant for the development and evaluation of nationwide improvement programs, for a correct interpretation of findings, and for making appropriate recommendations.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3114-x) contains supplementary material, which is available to authorized users.

Building motivation to participate in a quality improvement collaborative in NHS hospital trusts in Southeast England: a qualitative participatory evaluation

OBJECTIVES

This study explores the barriers and facilitators that impact on the motivation of practitioners to participate in a quality improvement collaborative.

DESIGN

A qualitative and formative evaluation using a participatory approach, the researcher-in-residence model which embraces the concept of 'coproducing' knowledge between researchers and practitioners using a range of research methods such as participant observation, interviews and documentary analysis. The design, creation and application of newly generated evidence are facilitated by the researcher through negotiation and compromise with team members.

PARTICIPANTS

Senior and middle managers, doctors and nurses.

SETTING

Two hospitals in Southeast England participating in a Patient Safety Improvement Collaborative and the facilitator (host) of the collaborative, based in Central London.

RESULTS

The evaluation has revealed facilitators and barriers to motivation categorised under two main themes: (1) inherent motivation and (2) factors that influence motivation, interorganisational and intraorganisational features as well as external factors. Facilitators included collaborative 'champions,' individuals who drove the quality improvement agenda at a local level, raising awareness and inspiring colleagues. The collaborative itself acted as a facilitator, promoting shared learning as well as building motivation for participation. A key barrier was the lack of board engagement in the participating National Health Service organisations which may have affected motivation among front-line staff.

CONCLUSIONS

Collaboratives maybe an important way of engaging practitioners in quality improvement initiatives. This study highlights that despite a challenging healthcare environment in the UK, there remains motivation among individuals to participate in quality improvement programmes as they recognise that improvement approaches may facilitate positive change in local clinical processes and systems. Collaboratives can harness this individual motivation to facilitate spread and adoption of improvement methodology and build engagement across their membership.

Transferring skills in quality collaboratives focused on improving patient logistics

Background

A quality improvement collaborative, often used by the Institute for Healthcare Improvement, is used to educate healthcare professionals and improve healthcare at the same time. However, no prior research has been done on the knowledge and skills healthcare professionals need to achieve improvements or the extent to which quality improvement collaboratives help enhance both knowledge and skills. Our research focused on quality improvement collaboratives aiming to improve patient logistics and tried to identify which knowledge and skills are required and to what extent these were enhanced during the QIC.

Methods

We defined skills important for logistic improvements in a three-phase Delphi study. Based on the Delphi results we made a questionnaire. We surveyed participants in a national quality improvement collaborative to assess the skills rated as 1) important, 2) available and 3) improved during the collaborative. At two sense-making meetings, experts reflected on our findings and hypothesized on how to improve (logistics) collaboratives.

Results

The Delphi study found 18 skills relevant for reducing patient access time and 21 for reducing throughput time. All skills retrieved from the Delphi study were scored as ‘important’ in the survey. Teams especially lacked soft skills connected to project and change management. Analytical skills increased the most, while more reflexive skills needed for the primary goal of the collaborative (reduce access and throughput times) increased modestly.

At two sense-making meetings, attendees suggested four improvements for a quality improvement collaborative: 1) shift the focus to project- and change management skills; 2) focus more on knowledge transfer to colleagues; 3) teach participants to adapt the taught principles to their own situations; and 4) foster intra-project reflexive learning to translate gained insights to other projects (inter-project learning).

Conclusions

Our findings seem to suggest that Quality collaboratives could benefit if more attention is paid to the transfer of ‘soft skills’ (e.g. change, project management and communication skills) and reflexive skills (e.g. adjusting logistics principles to specific situations and inter-project translation of experiences).

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3051-8) contains supplementary material, which is available to authorized users.

The right care, every time: improving adherence to evidence-based guidelines

Guidelines are integral to reducing variation in paediatric care by ensuring that children receive the right care, every time. However, for reasons discussed in this paper, clinicians do not always follow evidence-based guidelines. Strategies to improve guideline usage tend to focus on dissemination and education. These approaches, however, do not address some of the more complex factors that influence whether a guideline is used in clinical practice. In this article, part of the Equipped Quality Improvement series, we outline the literature on barriers to guideline adherence and present practical solutions to address these barriers. Examples outlined include the use of care bundles, integrated care pathways and quality improvement collaboratives. A sophisticated information technology system can improve the use of evidence-based guidelines and provide organisations with valuable data for learning and improvement. Key to success is the support of an organisation that places reliability of service delivery as the way business is done. To do this requires leadership from clinicians in multidisciplinary teams and a system of continual improvement. By learning from successful approaches, we believe that all healthcare organisations can ensure the right care for each patient, every time.

Preventing Pressure Ulcers in the Veterans Health Administration Using a Virtual Breakthrough Series Collaborative

The Veterans Health Administration implemented a Virtual Breakthrough Series to prevent pressure ulcers. The pressure ulcer rate decreased from 1.2 to 0.9 per 1000 bed days of care (P = .017). The most common interventions were education (N = 26; 68%), improved documentation (N = 23; 61%), and the use of equipment and supplies (N = 21; 55%). In summary, this project helped improve pressure ulcer rates in the Veterans Health Administration and presents a promising model for implementing a virtual model for improvement.

Achieving a 'top-down' change agenda by driving and supporting a collaborative 'bottom-up' process: case study of a large-scale enhanced recovery programme

There is increasing recognition that organisations need to look beyond their boundaries for new innovations. However, the introduction and implementation of best practice that has been developed externally may need different processes of implementation if a successful change process is going to be achieved. Using an enhanced recovery programme as an example, we report a case study that combines the best of a top-down approach with the principles of bottom-up collaborative working to successfully embed a large-scale quality improvement programme that was commissioned to improve the adoption of enhanced recovery in elective surgery. We describe a large-scale change programme that was established, coordinated and driven from within a central ‘top’ organisation but delivered and owned locally by individual organisations working collaboratively across southeast region of England. We discuss why we believe our methodology of implementing this programme was successful, the important triggers for success and the lessons we learned from the programme.

Are quality improvement collaboratives effective? A systematic review

Background

Quality improvement collaboratives (QIC) have proliferated internationally, but there is little empirical evidence for their effectiveness.

Method

We searched Medline, Embase, CINAHL, PsycINFO and the Cochrane Library databases from January 1995 to December 2014. Studies were included if they met the criteria for a QIC intervention and the Cochrane Effective Practice and Organisation of Care (EPOC) minimum study design characteristics for inclusion in a review. We assessed study bias using the EPOC checklist and the quality of the reported intervention using a subset of SQUIRE 1.0 standards.

Results

Of the 220 studies meeting QIC criteria, 64 met EPOC study design standards for inclusion. There were 10 cluster randomised controlled trials, 24 controlled before-after studies and 30 interrupted time series studies. QICs encompassed a broad range of clinical settings, topics and populations ranging from neonates to the elderly. Few reports fully described QIC implementation and methods, intensity of activities, degree of site engagement and important contextual factors. By care setting, an improvement was reported for one or more of the study’s primary effect measures in 83% of the studies (32/39 (82%) hospital based, 17/20 (85%) ambulatory care, 3/4 nursing home and a sole ambulance QIC). Eight studies described persistence of the intervention effect 6 months to 2 years after the end of the collaborative. Collaboratives reporting success generally addressed relatively straightforward aspects of care, had a strong evidence base and noted a clear evidence-practice gap in an accepted clinical pathway or guideline.

Conclusions

QICs have been adopted widely as an approach to shared learning and improvement in healthcare. Overall, the QICs included in this review reported significant improvements in targeted clinical processes and patient outcomes. These reports are encouraging, but most be interpreted cautiously since fewer than a third met established quality and reporting criteria, and publication bias is likely.

Domains associated with successful quality improvement in healthcare - a nationwide case study

Background

There is a distinct difference between what we know and what we do in healthcare: a gap that is impairing the quality of the care and increasing the costs. Quality improvement efforts have been made worldwide by learning collaboratives, based on recognized continual improvement theory with limited scientific evidence. The present study of 132 quality improvement projects in Norway explores the conditions for improvement from the perspectives of the frontline healthcare professionals, and evaluates the effectiveness of the continual improvement method.

Methods

An instrument with 25 questions was developed on prior focus group interviews with improvement project members who identified features that may promote or inhibit improvement. The questionnaire was sent to 189 improvement projects initiated by the Norwegian Medical Association, and responded by 70% (132) of the improvement teams. A sub study of their final reports by a validated instrument, made us able to identify the successful projects and compare their assessments with the assessments of the other projects. A factor analysis with Varimax rotation of the 25 questions identified five domains. A multivariate regression analysis was used to evaluate the association with successful quality improvements.

Results

Two of the five domains were associated with success: Measurement and Guidance (p = 0.011), and Professional environment (p = 0.015). The organizational leadership domain was not associated with successful quality improvements (p = 0.26).

Conclusion

Our findings suggest that quality improvement projects with good guidance and focus on measurement for improvement have increased likelihood of success. The variables in these two domains are aligned with improvement theory and confirm the effectiveness of the continual improvement method provided by the learning collaborative. High performing professional environments successfully engaged in patient-centered quality improvement if they had access to: (a) knowledge of best practice provided by professional subject matter experts, (b) knowledge of current practice provided by simple measurement methods, assisted by (c) improvement knowledge experts who provided useful guidance on measurement, and made the team able to organize the improvement efforts well in spite of the difficult resource situation (time and personnel). Our findings may be used by healthcare organizations to develop effective infrastructure to support improvement and to create the conditions for making quality and safety improvement a part of everyone’s job.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2454-2) contains supplementary material, which is available to authorized users.

A 'movement for improvement'? A qualitative study of the adoption of social movement strategies in the implementation of a quality improvement campaign

Given the difficulties of implementing 'top-down' quality improvements, health service leaders have turned to methods that empower clinicians to co-produce 'bottom-up' improvements. This has involved the adoption of strategies and activities associated with social movements, with clinicians encouraged to participate in collective action towards the shared goal of improvement. This paper examines the adoption of social movement methods by hospital managers as a strategy for implementing a quality improvement 'campaign'. Our case study suggests that, despite the claim of empowering clinicians to develop 'bottom-up' improvements, the use of social movement methods can be more narrowly concerned with engaging clinicians in pre-determined programmes of 'top-down' change. It finds a prominent role for 'hybrid' clinical leaders and other staff representatives in the mobilisation of the campaign, especially for enrolling clinicians in change activities. The work of these 'hybrids' suggests some degree of creative mediation between clinical and managerial interests, but more often alignment with the aspirations of management. The study raises questions about the translation of social movement's theories as a strategy for managing change and re-inventing professionalism.

Healthcare professionals' views of the enhanced recovery after surgery programme: a qualitative investigation

BACKGROUND

The Enhanced Recovery After Surgery (ERAS) programme is an approach to the perioperative care of patients which aims to improve outcomes and speed up recovery after surgery. Although the evidence base appears strong for this programme, the implementation of ERAS has been slow. This study aimed to gain an understanding of the facilitating factors and challenges of implementing the programme with a view to providing additional contextual information to aid implementation. The study had a particular focus on the nutritional elements as these have been highlighted as important.

METHODS

The study employed qualitative research methods, guided by the Normalisation Process Theory (NPT) to explore the experiences and opinions of 26 healthcare professionals from a range of disciplines implementing the programme.

RESULTS

This study identified facilitating factors to the implementation of ERAS: alignment with evidence based practice, standardising practice, drawing on the evidence base of other specialties, leadership, teamwork, ERAS meetings, patient involvement and education, a pre-operative assessment unit, staff education, resources attached to obtaining The Commissioning for Quality and Innovation (CQUIN) money, the ward layout, data collection and feedback, and adapting the care pathway. A number of implementation challenges were also identified: resistance to change, standardisation affecting personalised patient care, the buy-in of relevant stakeholders, keeping ERAS visible, information provision to patients, resources, palatability of nutritional drinks, aligning different ward cultures, patients going to non-ERAS departments, spreading the programme within the hospital, differences in health issue, and utilising a segmental approach.  CONCLUSIONS: The findings presented here provide useful contextual information from diverse surgical specialties to inform healthcare providers when implementing ERAS in practice. Addressing the challenges and utilising the facilitating factors identified in this study, could speed up the rate at which ERAS is adopted, implemented and embedded.

The Effect of a Continuous Quality Improvement Intervention on Retention-In-Care at 6 Months Postpartum in a PMTCT Program in Northern Nigeria: Results of a Cluster Randomized Controlled Study

BACKGROUND

Retention in care is critical for improving HIV-infected maternal outcomes and reducing vertical transmission. Health systems' interventions such as continuous quality improvement (CQI) may support health services to address factors that affect the delivery of HIV-related care and thereby influence rates of retention-in-care.

METHODOLOGY

We evaluated the effect of a CQI intervention on retention-in-care at 6 months postpartum of pregnant women and mothers living with HIV who had been started on lifelong antiretroviral treatment. Thirty-two health care facilities were randomized to either implement the intervention or not. We considered women fully retained in care when they attended the 6-month postpartum visit and did not miss any previous scheduled visit by more than 30 days.

RESULTS

Five hundred eleven women living with HIV attending antenatal clinics at 26 facilities were included in the analysis. Median age at enrolment was 27 years and gestational age was 20 weeks. Seventy-one percent of women were seen at 6-month postpartum irrespective of missing any scheduled visit. However, 43% of women were fully retained at 6-month postpartum and did not miss any scheduled visit based on our stringent study definition of retention. There was no significant difference in retention at 6 months between the intervention and control arms [44% vs. 41%, relative risk: 1.08; 95% confidence interval (CI): 0.78 to 1.49]. Initiation of ARV prophylaxis among infants within 72 hours was not different by study arm (66.0% vs. 74.7%, relative risk = 0.95; 95% CI: 0.84 to 1.07) but rates of early infant testing at 4-6 weeks were higher in intervention sites (48.8% vs. 25.3%, adjusted relative risk: 1.76; 95% CI: 1.27 to 2.42).

CONCLUSIONS

CQI as implemented in this study did not differ across study arms in the rates of retention. Several intervention design or implementation issues or other contextual constraints may explain the absence of effect.

Spreading improvements for advanced COPD care through a Canadian Collaborative

BACKGROUND

A year-long pan-Canadian quality improvement collaborative (QIC) led by the Canadian Foundation for Healthcare Improvement (CFHI) supported the spread of the successful Halifax, Nova Scotia-based INSPIRED COPD Outreach Program™ to 19 teams in the 10 Canadian provinces. We describe QIC results, addressing two main questions: 1) Can the results of the Nova Scotia INSPIRED model be replicated elsewhere in Canada? 2) How did the teams implement and evaluate their versions of the INSPIRED program?

METHODS

Collaborative faculty selected measures that were evidence-based, relatively simple to collect, and relevant to local context. Chosen process and outcome measures are related to four quality domains: 1) patient- and family-centeredness, 2) coordination, 3) efficiency, and 4) appropriateness. Evaluation of a complex intervention followed a mixed-methods approach.

RESULTS

Most participants were nurse managers and/or COPD educators. Only 8% were physicians. Fifteen teams incorporated all core INSPIRED interventions. All teams carried out evaluation. Thirteen teams actively involved patients and families in customized, direct care planning, eg, asking them to complete evaluative surveys and/or conducting interviews. Patients consistently reported greater self-confidence in symptom management, a return to daily activities, and improvements to quality of life. Twelve teams collected data on care transitions using the validated three-item Care Transitions Measure (CTM-3). Twelve teams used the Lung Information Needs Questionnaire (LINQ). Admissions, emergency room visits, and patient-related costs fell substantially for two teams described in detail (combined enrollment 208 patients). Most teams reported gaining deeper knowledge around complexities of COPD care, optimizing patient care through action plans, self-management support, psychosocial support, advance care planning, and coordinating community partnerships.

CONCLUSION

Quality-of-care gains are achievable in the short term among different teams across diverse geographical and social contexts. A well-designed, adequately funded public-private partnership can deliver widespread beneficial outcomes for the health care system and for those living with advanced COPD.

A National Quality Improvement Collaborative for the clinical use of outcome measurement in specialised mental healthcare: results from a parallel group design and a nested cluster randomised controlled trial

BACKGROUND

Although the importance and advantages of measurement-based care in mental healthcare are well established, implementation in daily practice is complex and far from optimal.

AIMS

To accelerate the implementation of outcome measurement in routine clinical practice, a government-sponsored National Quality Improvement Collaborative was initiated in Dutch-specialised mental healthcare.

METHOD

To investigate the effects of this initiative, we combined a matched-pair parallel group design (21 teams) with a cluster randomised controlled trial (RCT) (6 teams). At the beginning and end, the primary outcome 'actual use and perceived clinical utility of outcome measurement' was assessed.

RESULTS

In both designs, intervention teams demonstrated a significant higher level of implementation of outcome measurement than control teams. Overall effects were large (parallel group d=0.99; RCT d=1.25).

CONCLUSIONS

The National Collaborative successfully improved the use of outcome measurement in routine clinical practice.

DECLARATION OF INTEREST

None.

COPYRIGHT AND USAGE

© The Royal College of Psychiatrists 2017. This is an open access article distributed under the terms of the Creative Commons Non-Commercial, No Derivatives (CC BY-NC-ND) license.

Are Brief Alcohol Interventions Adequately Embedded in UK Primary Care? A Qualitative Study Utilising Normalisation Process Theory

Despite substantial evidence for their effectiveness, the adoption of alcohol screening and brief interventions (ASBI) in routine primary care remains inconsistent. Financial incentive schemes were introduced in England between 2008 and 2015 to encourage their delivery. We used Normalisation Process Theory-informed interviews to understand the barriers and facilitators experienced by 14 general practitioners (GPs) as they implemented ASBI during this period. We found multiple factors shaped provision. GPs were broadly cognisant and supportive of preventative alcohol interventions (coherence) but this did not necessarily translate into personal investment in their delivery (cognitive participation). This lack of investment shaped how GPs operationalised such “work” in day-to-day practice (collective action), with ASBI mostly delegated to nurses, and GPs reverting to “business as usual” in their management and treatment of problem drinking (reflexive monitoring). We conclude there has been limited progress towards the goal of an effectively embedded preventative alcohol care pathway in English primary care. Future policy should consider screening strategies that prioritise patients with conditions with a recognised link with excessive alcohol consumption, and which promote more efficient identification of the most problematic drinkers. Improved GP training to build skills and awareness of evidence-based ASBI tools could also help embed best practice over time.

Triple aim improvement for individuals, services and society in dementia care : The DementiaNet collaborative care approach

Background

A redesigning of primary care is required to meet dementia patients’ needs. In the Netherlands, current dementia care still falls short in areas including ad hoc collaboration, lack of feedback on quality to professionals involved, and insufficient implementation of established multidisciplinary guidelines.

Objective

DementiaNet is a collaborative care approach, which aims to reduce the burden of the disease on individuals, healthcare services and society via network-based care that encourages collaboration, enhances knowledge and skills and stimulates quality improvement cycles.

Material and methods

DementiaNet was developed to support primary care networks through implementation of five core processes: network-based care, clinical leadership, quality improvement cycles, interprofessional practice-based training and communication support tools, following a stepwise tailor-made approach. Alongside this, a mixed method study was designed to evaluate innovation and effectiveness.

Results

Currently, 18 networks have been formed. These vary in quality of care and strength of collaboration due to local circumstances. Initial activities and goals of each network also vary, ranging from acquaintance to shared care plans. Ongoing research will identify barriers, facilitators and merits of the approach in increasing quality of care and ultimately improving outcomes for patient, carer, health service and society.

Conclusion

Initial results show that clinical practice varies and the DementiaNet approach can lead to quality improvement. Complexity and variety of local care requires complex interventions and evaluation methods that account for this in order to safeguard the value for practice. Strict methodology lessens external validity.

Collaborative leadership and the implementation of community-based fall prevention initiatives: a multiple case study of public health practice within community groups

Background

Falls among community-dwelling older adults are a serious public health concern. While evidence-based fall prevention strategies are available, their effective implementation requires broad cross-sector coordination that is beyond the capacity of any single institution or organization. Community groups comprised of diverse stakeholders that include public health, care providers from the public and private sectors and citizen volunteers are working to deliver locally-based fall prevention. These groups are examples of collective impact and are important venues for public health professionals (PHPs) to deliver their mandate to work collaboratively towards achieving improved health outcomes. This study explores the process of community-based group work directed towards fall prevention, and it focuses particular attention on the collaborative leadership practices of PHPs, in order to advance understanding of the competencies required for collective impact.

Methods

Four community groups, located in Ontario, Canada, were studied using an exploratory, retrospective, multiple case study design. The criteria for inclusion were presence of a PHP, a diverse membership and the completion of an initiative that fit within the scope of the World Health Organization Fall Prevention Model. Data were collected using interviews (n = 26), focus groups (n = 4), and documents. Cross-case synthesis was conducted by a collaborative team of researchers.

Results

The community groups differed by membership, the role of the PHP and the type of fall prevention initiatives. Seven practice themes emerged: (1) tailoring to address context; (2) making connections; (3) enabling communication; (4) shaping a vision; (5) skill-building to mobilize and take action; (6) orchestrating people and projects; and (7) contributing information and experience. The value of recognized leadership competencies was underscored and the vital role of institutional supports was highlighted.

Conclusion

To align stakeholders working towards fall prevention for community-dwelling older adults and establish a foundation for collective impact, public health professionals employed practices that reflected a collaborative leadership style. Looking ahead, public health professionals will want to shift their focus to evaluating the effectiveness of their group work within communities. They will also need to assess outcomes and evaluate whether the anticipated reductions in fall rates among community-dwelling older adults is being achieved.

Can Learning Collaboratives Support Implementation by Rewiring Professional Networks?

This study examined how a learning collaborative focusing on trauma-focused CBT (TF-CBT) impacted advice-seeking patterns between clinicians and three key learning sources: (1) training experts who share technical knowledge about TF-CBT, (2) peers from other participating organizations who share their implementation experiences, and (3) colleagues from their own agency who provide social and professional support. Based on surveys administered to 132 clinicians from 32 agencies, participants' professional networks changed slightly over time by forming new advice-seeking relationships with training experts. While small, these changes at the clinician-level yielded substantial changes in the structure of the regional advice network.

Collaboratively Improving Diabetes Care in Sweden Using a National Quality Register: Successes and Challenges-A Case Study

BACKGROUND

Since 1996, the Swedish National Diabetes Register (NDR) enabled health care providers to monitor their clinical performance over time and compare it with the national average. All health systems of Swedish county councils report data. By 2014, the NDR included data from 360 000 patients. Comparisons among county councils show significant variations in clinical outcomes and in adherence to evidence-based national guidelines. The purpose of this study was to evaluate whether and how a quality improvement collaborative could influence clinical practice and outcomes.

METHODS

Twenty-three diabetes teams from all over Sweden, both primary care units and internal medicine departments, joined a quality improvement collaborative. The project was inspired by the Breakthrough Collaborative Model and lasted for 20 months. Evaluation data were collected from the teams' final reports and the NDR throughout the study period.

RESULTS AND CONCLUSION

The teams reported improved patient outcomes significantly compared with the national average for systolic blood pressure and low-density lipoprotein levels. In contrast, glycated hemoglobin A1c levels deteriorated in the whole NDR population. Five themes of changes in practice were tested and implemented. Success factors included improved teamwork, with active use of register data, and testing new ideas and learning from others.