The effectiveness of continuous quality improvement for developing professional practice and improving health care outcomes: a systematic review

Process evaluation of a data-driven quality improvement program within a cluster randomised controlled trial to improve coronary heart disease management in Australian primary care

BACKGROUND

This study evaluates primary care practices' engagement with various features of a quality improvement (QI) intervention for patients with coronary heart disease (CHD) in four Australian states.

METHODS

Twenty-seven practices participated in the QI intervention from November 2019 -November 2020. A combination of surveys, semi-structured interviews and other materials within the QUality improvement in primary care to prevent hospitalisations and improve Effectiveness and efficiency of care for people Living with heart disease (QUEL) study were used in the process evaluation. Data were summarised using descriptive statistical and thematic analyses for 26 practices.

RESULTS

Sixty-four practice team members and Primary Health Networks staff provided feedback, and nine of the 63 participants participated in the interviews. Seventy-eight percent (40/54) were either general practitioners or practice managers. Although 69% of the practices self-reported improvement in their management of heart disease, engagement with the intervention varied. Forty-two percent (11/26) of the practices attended five or more learning workshops, 69% (18/26) used Plan-Do-Study-Act cycles, and the median (Interquartile intervals) visits per practice to the online SharePoint site were 170 (146-252) visits. Qualitative data identified learning workshops and monthly feedback reports as the key features of the intervention.

CONCLUSION

Practice engagement in a multi-featured data-driven QI intervention was common, with learning workshops and monthly feedback reports identified as the most useful features. A better understanding of these features will help influence future implementation of similar interventions.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) number ACTRN12619001790134.

Continuous Quality Improvement in the Substance Abuse and Mental Health Services Administration's Technology Transfer Center Network: A Process Evaluation

In healthcare and related fields, there is often a gap between research and practice. Scholars have developed frameworks to support dissemination and implementation of best practices, such as the Interactive Systems Framework for Dissemination and Implementation, which shows how scientific innovations are conveyed to practitioners through tools, training, and technical assistance (TA). Underpinning those aspects of the model are evaluation and continuous quality improvement (CQI). However, a recent meta-analysis suggests that the approaches to and outcomes from CQI in healthcare vary considerably, and that more evaluative work is needed. Therefore, this paper describes an assessment of CQI processes within the Substance Abuse and Mental Health Services Administration's (SAMHSA) Technology Transfer Center (TTC) Network, a large TA/TTC system in the United States comprised of 39 distinct centers. We conducted key informant interviews (n = 71 representing 28 centers in the Network) and three surveys (100% center response rates) focused on CQI, time/effort allocation, and Government Performance and Results Act (GPRA) measures. We used data from each of these study components to provide a robust picture of CQI within a TA/TTC system, identifying Network-specific concepts, concerns about conflation of the GPRA data with CQI, and principles that might be studied more generally.

How consistent are the key recommendations, and what is the quality of guidelines and expert consensus regarding paediatric cow's milk protein allergy?

The objective of this study was to assess the quality and consistency of recommendations in clinical practice guidelines (CPGs) and expert consensus on paediatric cow's milk protein allergy (CMPA) to serve as a foundation for future revisions and enhancements of clinical guidelines and consensus documents. We conducted a comprehensive literature search across several databases, including the Chinese Biomedical Literature Database (CBM), PubMed, Embase, Web of Science, UpToDate, ClinicalKey, DynaMed Plus and BMJ Best Practice. We spanned the search period from the inception of each database through October 1, 2023. We integrated subject headings (MeSH/Emtree) and keywords into the search strategy, used the search methodologies of existing literature and developed it in collaboration with a librarian. Two trained researchers independently conducted the literature screening and data extraction. We evaluated methodological quality and recommendations by using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) and AGREE-Recommendations for Excellence (AGREE-REX) tools. Moreover, we compared and summarized key recommendations from high-quality CPGs. Our study included 27 CPGs and expert consensus documents on CMPA. Only four CPGs (14.8%) achieved a high-quality AGREE II rating. The four high-quality CPGs consistently provided recommendations for CMPA. The highest scoring domains for AGREE II were 'scope and purpose' (77 ± 12%) and 'clarity of presentation' (75 ± 22%). The lowest scoring domains were 'stakeholder involvement' (49 ± 21%), 'rigor of development' (34 ± 20%) and 'applicability' (12 ± 20%). Evaluation with AGREE-REX generally demonstrated low scores across its domains.   Conclusion: Recommendations within high-quality CPGs for the paediatric CMPA showed fundamental consistency. Nevertheless, the methodology and recommendation content of CPGs and the expert consensus exhibited low quality, thus indicating a substantial scope for enhancement. Guideline developers should rigorously follow the AGREE II and AGREE-REX standards in creating CPGs or expert consensuses to guarantee their clinical efficacy in managing paediatric CMPA. What is Known: • The quality of clinical practice guidelines and expert consensus on paediatric cow's milk protein allergy (CMPA) remains uncertain. • There is a lack of clarity regarding the consistency of crucial recommendations for CMPA management. What is New: • Improving the methodological quality of guidelines and consensus on CMPA requires greater emphasis on stakeholder engagement, rigorous development processes, and practical applicability. • The recommendations from four high-quality guidelines align. However, addressing clinical applicability, integrating values and preferences, and ensuring actionable implementation are critical to improving the quality of all guidelines.

Identifying the contributors to nursing caring success stories

AIMS

To (a) seek examples of nursing caring success stories and (b) identify the common contributors to these successes. By focusing on the successes of nursing care rather than critically examining failures, this research seeks to provide examples of proven and feasible approaches and processes for improving care.

DESIGN

This study used a narrative inquiry design.

METHODS

Data were collected through group interviews. Four interviews were conducted with a total of 20 nurse participants working in inpatient settings in South Australian hospitals. A thematic analysis approach was used to analyse the data.

RESULTS

Two dominant themes concerning the contributors to caring success were identified. These contributors were (1) the provision of holistic care and (2) the influence of the caring community, which includes family members and other patients. The findings also indicated that the definition of caring success according to nurses is not aligned with organisational performance indicators but is more closely represented by caring values.

CONCLUSION

Success, according to nurses, is not exclusively defined by patient outcomes but includes the approach to, and process of, care delivery.

IMPLICATIONS FOR THE PROFESSION AND/OR PATIENT CARE

Nurses value the caring process while working in an environment that primarily values clinical and systems-level outcomes. Nurses want patients and their families, allied health professionals and hospital executives to be involved and invested in the process of care.

IMPACT

This study addressed a gap in the current literature to identify commonalities in nursing success stories, the contributors informing these successes and how these contributors can facilitate improved patient care. Understanding nursing definitions of caring success provides an opportunity to expand upon current accepted industry definitions and perspectives such as key performance indicators.

REPORTING METHOD

Consolidated Criteria for Reporting Qualitative Research (COREQ) checklist.

PATIENT OR PUBLIC CONTRIBUTION

No direct patient or public contribution.

Doctors' perspectives on the quality of medical imaging in public hospitals in eThekwini District

Background

There is a paucity of literature on perspectives of referring doctors about the quality of medical imaging services and this study closes this gap in literature.

Aim

This quality assurance (QA) study aimed to explore the perspectives of doctors on the quality of medical imaging services in selected regional hospitals within eThekwini District of KwaZulu-Natal.

Setting

The study was conducted in four public regional hospitals.

Methods

An exploratory descriptive qualitative research design involving 30 min-45 min of in-depth individual interviews was used. A purposive sampling technique was used to select research participants and hospitals to ensure adequate responses to the research questions. The sample involved nine participants and was guided by data saturation. Responses were recorded through notes and voice recordings and thematic analysis was used to analyse data.

Results

Three main themes (timeliness of examinations, communication and radiology reports and image quality) and eight subthemes (waiting times, shortage of radiographers, workload, communication between doctors and radiographers, requisition forms, unavailability of radiology reports, clarity of images and image acquisition protocols) emerged from the data. Challenges experienced were exacerbated by high workload and shortage of radiologists and radiographers. Doctors in the data collection sites were mainly dissatisfied with services provided by the medical imaging departments.

Conclusion

Regular engagements between medical imaging departments and doctors are important in enhancing the provision of quality care to patients. In-service training of radiographers and employment of additional radiographers and finding solutions to mitigate shortage of radiologists are recommended.

Contribution

This quality assurance (QA) study focused on experiences of doctors while many other medical imaging QA studies in South Africa are equipment based. In-service training of radiographers is recommended to improve image quality and communication skills.

Hospital-Based Pediatric Quality Improvement Interventions and Health Disparities: A Scoping Review of the Literature

BACKGROUND AND OBJECTIVES

Quality improvement (QI) has the potential to reduce health disparities through multiple mechanisms, including by standardizing care and addressing social barriers to health. National organizations require that hospital systems integrate equity into quality efforts, but effective approaches remain unclear. We aimed to examine the association of hospital-based pediatric QI interventions and racial and ethnic, language, and socioeconomic disparities in health outcomes.

METHODS

Quantitative studies from January 1, 2000 to December 11, 2023 reporting the effects of pediatric hospital-based QI were selected from PubMed and Embase. Studies were excluded if outcomes were not stratified by race and ethnicity, language, or socioeconomic status. Studies were reviewed in duplicate for inclusion and by 1 author for data extraction.

RESULTS

A total of 22 studies were included. Most studies (n = 19, 86%) revealed preexisting disparities, and 68% of those (n = 13) found disparities reductions post-intervention. Studies with disparity-focused objectives or interventions more commonly found reduced disparities than studies of general QI (85% vs 33%). Hospital-based process standardization was associated with reduced disparities in provider practices. Most interventions associated with reduced disparities in patient-facing outcomes involved community/ambulatory partnership. Limitations included potential exclusion of relevant studies, topic heterogenity, and risk of bias.

CONCLUSIONS

Although the authors of few published hospital-based QI initiatives assessed their equity effect, intentionally designed QI studies were associated with reduced disparities. Interventions focused on care standardization may reduce disparities in care quality, although multilevel interventions are likely needed to affect the health care structures that influence more significant patient outcomes.

A scoping review of continuous quality improvement in healthcare system: conceptualization, models and tools, barriers and facilitators, and impact

BACKGROUND

The growing adoption of continuous quality improvement (CQI) initiatives in healthcare has generated a surge in research interest to gain a deeper understanding of CQI. However, comprehensive evidence regarding the diverse facets of CQI in healthcare has been limited. Our review sought to comprehensively grasp the conceptualization and principles of CQI, explore existing models and tools, analyze barriers and facilitators, and investigate its overall impacts.

METHODS

This qualitative scoping review was conducted using Arksey and O'Malley's methodological framework. We searched articles in PubMed, Web of Science, Scopus, and EMBASE databases. In addition, we accessed articles from Google Scholar. We used mixed-method analysis, including qualitative content analysis and quantitative descriptive for quantitative findings to summarize findings and PRISMA extension for scoping reviews (PRISMA-ScR) framework to report the overall works.

RESULTS

A total of 87 articles, which covered 14 CQI models, were included in the review. While 19 tools were used for CQI models and initiatives, Plan-Do-Study/Check-Act cycle was the commonly employed model to understand the CQI implementation process. The main reported purposes of using CQI, as its positive impact, are to improve the structure of the health system (e.g., leadership, health workforce, health technology use, supplies, and costs), enhance healthcare delivery processes and outputs (e.g., care coordination and linkages, satisfaction, accessibility, continuity of care, safety, and efficiency), and improve treatment outcome (reduce morbidity and mortality). The implementation of CQI is not without challenges. There are cultural (i.e., resistance/reluctance to quality-focused culture and fear of blame or punishment), technical, structural (related to organizational structure, processes, and systems), and strategic (inadequate planning and inappropriate goals) related barriers that were commonly reported during the implementation of CQI.

CONCLUSIONS

Implementing CQI initiatives necessitates thoroughly comprehending key principles such as teamwork and timeline. To effectively address challenges, it's crucial to identify obstacles and implement optimal interventions proactively. Healthcare professionals and leaders need to be mentally equipped and cognizant of the significant role CQI initiatives play in achieving purposes for quality of care.

Collaborative implementation of an evidence-based package of integrated primary mental healthcare using quality improvement within a learning health systems approach: Lessons from the Mental health INTegration programme in South Africa

Introduction

The treatment gap for mental health disorders persists in low- and middle-income countries despite overwhelming evidence of the efficacy of task-sharing mental health interventions. Key barriers in the uptake of these innovations include the absence of policy to support implementation and diverting of staff from usual routines in health systems that are already overstretched. South Africa enjoys a conducive policy environment; however, strategies for operationalizing the policy ideals are lacking. This paper describes the Mental health INTegration Programme (MhINT), which adopted a health system strengthening approach to embed an evidence-based task-sharing care package for depression to integrate mental health care into chronic care at primary health care (PHC).

Methods

The MhINT care package consisting of psycho-education talks, nurse-led mental health assessment, and a structured psychosocial counselling intervention provided by lay counsellors was implemented in Amajuba district in KwaZulu-Natal over a 2-year period. A learning health systems approach was adopted, using continuous quality improvement (CQI) strategies to facilitate embedding of the intervention.MhINT was implemented along five phases: the project phase wherein teams to drive implementation were formed; the diagnostic phase where routinely collected data were used to identify system barriers to integrated mental health care; the intervention phase consisting of capacity building and using Plan-Do-Study-Act cycles to address implementation barriers and the impact and sustaining improvement phases entailed assessing the impact of the program and initiation of system-level interventions to sustain and institutionalize successful change ideas.

Results

Integrated planning and monitoring were enabled by including key mental health service indicators in weekly meetings designed to track the performance of noncommunicable diseases and human immunovirus clinical programmes. Lack of standardization in mental health screening prompted the validation of a mental health screening tool and testing feasibility of its use in centralized screening stations. A culture of collaborative problem-solving was promoted through CQI data-driven learning sessions. The province-level screening rate increased by 10%, whilst the district screening rate increased by 7% and new patients initiated to mental health treatment increased by 16%.

Conclusions

The CQI approach holds promise in facilitating the attainment of integrated mental health care in resource-scarce contexts. A collaborative relationship between researchers and health system stakeholders is an important strategy for facilitating the uptake of evidence-based innovations. However, the lack of interventions to address healthcare workers' own mental health poses a threat to integrated mental health care at PHC.

How social networks influence the local implementation of initiatives developed in quality improvement collaboratives in health care: A qualitative process study

BACKGROUND

Quality improvement collaboratives (QICs) have facilitated cross-organizational knowledge exchange in health care. However, the local implementation of many quality improvement (QI) initiatives continues to fail, signaling a need to better understand the contributing factors. Organizational context, particularly the role of social networks in facilitating or hindering implementation within organizations, remains a potentially critical yet underexplored area to addressing this gap.

PURPOSE

We took a dynamic process perspective to understand how QI project managers' social networks influence the local implementation of QI initiatives developed through QICs.

METHODOLOGY

We explored the case of a QIC by triangulating data from an online survey, semistructured interviews, and archival documents from 10 organizations. We divided implementation into four stages and employed qualitative text analysis to examine the relationship between three characteristics of network structure (degree centrality, network density, and betweenness centrality) and the progress of each QI initiative.

RESULTS

The progress of QI initiatives varied considerably among organizations. The transition between stages was influenced by all three network characteristics to varying degrees, depending on the stage. Project managers whose QI initiatives progressed to advanced stages of implementation had formed ad hoc clusters of colleagues passionate about the initiatives.

CONCLUSION

Implementing QI initiatives appears to be facilitated by the formation of clusters of supportive individuals within organizations; this formation requires high betweenness centrality and high network density.

PRACTICE IMPLICATIONS

Flexibly modifying specific network characteristics depending on the stage of implementation may help project managers advance their QI initiatives, achieving more uniform results from QICs.

Decoding the persistence of delayed hospital discharge: An in-depth scoping review and insights from two decades

OBJECTIVE

This article addresses the persistent challenge of Delayed Hospital Discharge (DHD) and aims to provide a comprehensive overview, synthesis, and actionable, sustainable plan based on the synthesis of the systematic review articles spanning the past 24 years. Our research aims to comprehensively examine DHD, identifying its primary causes and emphasizing the significance of effective communication and management in healthcare settings.

METHODS

We conducted the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) method for synthesizing findings from 23 review papers published over the last two decades, encompassing over 700 studies. In addition, we employed a practical and comprehensive framework to tackle DHD. Rooted in Linderman's model, our approach focused on continuous process improvement (CPI), which highlights senior management commitment, technical/administrative support, and social/transitional care. Our proposed CPI method comprised several stages: planning, implementation, data analysis, and adaptation, all contributing to continuous improvement in healthcare delivery. This method provided valuable insights and recommendations for addressing DHD challenges.

FINDINGS

Our DHD analysis revealed crucial insights across multiple dimensions. Firstly, examining causes and interventions uncovered issues such as limited discharge destinations, signaling unsustainable solutions, and inefficient care coordination. The second aspect explored the patient and caregiver experience, emphasizing challenges linked to staff uncertainty and negative physical environments, with notable attention to the underexplored area of caregiver experience. The third theme explored organizational and individual factors, including cognitive impairment and socioeconomic influences. The findings emphasized the importance of incorporating patients' data, recognizing its complexity and current avoidance. Finally, the role of transitional and social care and financial strategies was scrutinized, emphasizing the need for multicomponent, context-specific interventions to address DHD effectively.

CONCLUSION

This study addresses gaps in the literature, challenges prevailing solutions, and offers practical pathways for reducing DHD, contributing significantly to healthcare quality and patient outcomes. The synthesis introduces the vital CPI stage, enhancing Linderman's work and providing a pragmatic framework to eradicate delayed discharge. Future efforts will address practitioner consultations to enhance perspectives and further enrich the study.

PATIENT OR PUBLIC CONTRIBUTION

Our scoping review synthesizes and analyzes existing systematic review articles and emphasizes offering practical, actionable solutions. While our approach does not directly engage patients, it strategically focuses on extracting insights from the literature to create a CPI framework. This unique aspect is intentionally designed to yield tangible benefits for patients, service users, caregivers, and the public. Our actionable recommendations aim to improve hospital discharge processes for better healthcare outcomes and experiences. This detailed analysis goes beyond theoretical considerations and provides a practical guide to improve healthcare practices and policies.

Traditional Chinese medicine for insomnia: Recommendation mapping of the global clinical guidelines

ETHNOPHARMACOLOGICAL RELEVANCE

Traditional Chinese Medicine (TCM) represents a rich repository of empirically-developed traditional medicines. The findings call for more rigorous study into the efficacy, safety, and mechanisms of action of TCM remedies to strengthen the evidence base.

AIM OF THE STUDY

To systematically review the quality of insomnia clinical practice guidelines that involve TCM recommendations and to summarize the certainty of evidence supporting the recommendations, strength, and consistency of recommendations, providing valuable research references for the development of future insomnia guidelines.

MATERIALS AND METHODS

We systematically searched PubMed, Web of Science, Embase, CNKI, Wanfang, Chinese Biomedical Literature Database, Chinese Medical Association, Chinese Sleep Research Society, Medsci, Medlive, British National Institute of Health and Clinical Excellence (NICE), and the International Guidelines Collaboration Network (GIN) for clinical practice guidelines on insomnia from inception to March 5, 2023. Four evaluators conducted independent assessments of the quality of the guidelines by employing the AGREE II tool. Subsequently, the guideline recommendations were consolidated and presented as evidence maps.

RESULTS

Thirteen clinical practice guidelines addressing insomnia, encompassing 211 recommendations (consisting of 127 evidence-based and 84 expert consensus recommendations), were deemed eligible for inclusion in our analysis. The evaluation results revealed an overall suboptimal quality, with the "scope and purpose" domain achieving the highest score (58.1%), while the "applicability" domain garnered the lowest score (13.0%). Specifically, it was observed that 74.8% (n = 95) of the evidence-based recommendations were supported by evidence of either very low or low certainty, in contrast to the expert consensus recommendations, which accounted for 61.9% (n = 52). We subsequently synthesized 44 recommendations into four evidence maps, focusing on proprietary Chinese medicines, Chinese medicine prescriptions, acupuncture, and massage, respectively. Notably, Chinese herbal remedies and acupuncture exhibited robust support, substantiated by high-certainty evidence, exemplified by interventions such as Xuefu Zhuyu decoction, spleen decoction, body acupuncture, and ear acupuncture, resulting in solid recommendations. Conversely, proprietary Chinese medicines needed more high-certainty evidence, predominantly yielding weak recommendations. As for other therapies, the level of certainty was predominantly categorized as low or very low. Recommendations about magnetic therapy, bathing, and fumigation relied primarily on expert consensus, needing more substantive clinical research evidence, consequently forming weak recommendations. Hot ironing and acupoint injection recommendations were weakly endorsed, primarily based on observational studies. Furthermore, interventions like qigong, gua sha, and moxibustion displayed a relatively limited number of clinical studies, necessitating further exploration to ascertain their efficacy.

CONCLUSIONS

Our analysis revealed a need for substantial improvement in the quality of all the included guidelines related to insomnia. Notably, recommendations for Traditional Chinese Medicine (TCM) treatments predominantly rely on low-certainty evidence. This study represents a pioneering effort in the utilization of recommendation mapping to both present and identify existing gaps in the evidence landscape within TCM therapies, thus setting the stage for future research initiatives. The evidence supporting TCM therapy recommendations must be fortified to achieve a more substantial level of recommendation and higher certainty. Consequently, there exists a critical and pressing demand for high-quality clinical investigations dedicated to TCM, with a specific focus on ascertaining its long-term efficacy, safety, and potential side effects in the context of insomnia treatment. These endeavors are poised to establish a robust scientific foundation to inform the development of TCM therapy recommendations within the insomnia guidelines.

Experiences in Improving the Quality of Community-Based Fever Management from Three Malaria-Endemic African Countries

The WHO affirms that trained, supervised, and supported community health workers (CHWs) can deliver high-quality health services effectively and has called for documentation of enabling factors, needs, and implementation strategies of successful CHW programs. In response, the U.S. President's Malaria Initiative Impact Malaria Project conducted a study to document implementation approaches, best practices, and lessons learned for quality improvement (QI) of community-based fever management in Madagascar, Malawi, and Mali. The team conducted 10 key informant interviews (KIIs) with individuals at national, regional, and district levels using an open-ended interview guide tailored to each level, and a desk review of documents and materials related to community-based QI. Each country's community health landscape and QI approaches were summarized into four categories identified during the KIIs (training, supervision, coaching/mentoring, and review meetings) and compared. Results found that Madagascar, Malawi, and Mali all had well-defined community health strategies that include QI, but countries could not extend their full package of community-based QI approaches to all CHWs as a result of limited human and financial resources. Vertical funding for health programs limits the scope and coverage of QI approaches, especially at the community level. Recommendations from key informants for strengthening community-based QI included integrating QI approaches to improve cost efficiency, to define roles and responsibilities more clearly, to engage communities and all health system levels in implementation, and to digitize QI tools. Increased financial and skilled human resources are needed for community-based QI activities to achieve their intended effect.

Model for Doctor of Nursing Practice Projects Based on Cross-Fertilization Between Improvement and Implementation Sciences: Protocol for Quality Improvement and Program Evaluation Studies

BACKGROUND

Hundreds of nursing professionals graduate each year from Doctor of Nursing Practice (DNP) programs, entrusted with roles as practice scholars and leaders. Graduates are tasked to lead multidisciplinary knowledge implementation projects to improve safety, quality, and key performance metrics. Nevertheless, there is a continued lack of agreement and faculty dissatisfaction with the format, focus, and results of the DNP graduation projects. The use of a wide range of models and methodologies from different sciences for knowledge implementation introduces challenges to DNP students; affects the scientific rigor of the projects; and results in the overuse, superficial use, or misuse of the models. Quality improvement (QI) and program evaluation studies are substantial investments that may lead to waste and even harm if not well conducted. Traditional QI methodologies, commonly used in DNP projects, were found to be uncertain in improving health care outcomes. The complexity of health care systems calls for cross-fertilization between improvement and implementation sciences to improve health care outcomes.

OBJECTIVE

This study describes the development, implementation, and evaluation of a hybrid model for QI and program evaluation studies to guide scholarship in the DNP program.

METHODS

The hybrid model was based on cross-fertilization between improvement and implementation sciences. The model adapted the Getting to Outcome (GTO) and Knowledge to Action (KTA) models as the overarching process models for knowledge implementation. Within each phase of the GTO and KTA models, expected barriers and facilitators for the implementation and adoption of innovation were identified based on the CFIR (Consolidated Framework for Implementation Research). Accordingly, strategies to facilitate the implementation and adoption of innovations were identified based on a refined list of implementation strategies and QI tools. The choice of these models was based on the top 5 criteria for selecting implementation science theories and frameworks. Seven DNP students used the hybrid model to conduct QI projects. Students evaluated their experiences by responding to a Qualtrics survey.

RESULTS

The hybrid model encouraged a comprehensive systematic way of thinking, provided tools essential to implementation success, emphasized the need for adaptability in implementation, maintained rigor in QI, and guided the sustainability of change initiatives. Some of the challenges faced by students included finding reliable and valid measures, attaining and maintaining staff buy-in, and competing organizational priorities.

CONCLUSIONS

Cross-fertilization between improvement and implementation sciences provided a roadmap and systematic thinking for successful QI projects in the DNP program. The integration of the CFIR with the GTO or KTA process models, enforced by the use of evidence-based implementation strategies and QI tools, reflected the complexity of health care systems and emphasized the need for adaptability in implementation.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR1-10.2196/54213.

Advancements in Understanding and Classifying Chronic Orofacial Pain: Key Insights from Biopsychosocial Models and International Classifications (ICHD-3, ICD-11, ICOP)

In exploring chronic orofacial pain (COFP), this review highlights its global impact on life quality and critiques current diagnostic systems, including the ICD-11, ICOP, and ICHD-3, for their limitations in addressing COFP's complexity. Firstly, this study outlines the global burden of chronic pain and the importance of distinguishing between different pain types for effective treatment. It then delves into the specific challenges of diagnosing COFP, emphasizing the need for a more nuanced approach that incorporates the biopsychosocial model. This review critically examines existing classification systems, highlighting their limitations in fully capturing COFP's multifaceted nature. It advocates for the integration of these systems with the DSM-5's Somatic Symptom Disorder code, proposing a unified, multidisciplinary diagnostic approach. This recommendation aims to improve chronic pain coding standardization and acknowledge the complex interplay of biological, psychological, and social factors in COFP. In conclusion, here, we highlight the need for a comprehensive, universally applicable classification system for COFP. Such a system would enable accurate diagnosis, streamline treatment strategies, and enhance communication among healthcare professionals. This advancement holds potential for significant contributions to research and patient care in this challenging field, offering a broader perspective for scientists across disciplines.

Developing contents for a digital adherence tool: A formative mixed-methods study among children and adolescents living with HIV in Tanzania

Optimal adherence (>95%) to antiretroviral treatment (ART) remains a challenge among children and adolescents living with HIV (CALHIV). Digital adherence tools (DAT) with reminder cues have proven feasible among adult people living with HIV (PLHIV), with some concerns about the risk of HIV status disclosure. We aimed to assess the needs, contents and acceptability of an SMS-based DAT among CALHIV. We first conducted a survey to understand potential barriers to using DAT among CALHIV, then tested the DAT intervention among purposively selected participants. The DAT intervention included using the Wisepill device, receiving daily reminder SMS and receiving adherence reports on how they had taken medication in the past month. The content of the reminder SMS differed over time from asking if the medication was taken to a more neutral SMS like "take care". Afterwards, we conducted exit interviews, in-depth interviews, and focus-group discussions. We analysed quantitative findings descriptively and used thematic content analysis for qualitative data. We included 142 children and 142 adolescents in the survey, and 20 of each used the intervention. Eighty-five percent (121/142) of surveyed participants indicated they would like to receive reminder SMS. Most of them (97/121-80%) of children and 94/121(78%) of adolescents would prefer to receive daily reminders. Participants who used the DAT mentioned to be happy to use the device. Ninety percent of them had good experience with receiving reminders and agreed that the SMS made them take medication. However, 25% experienced network problems. Participants preferred neutral reminder SMSs that did not mention the word 'medication', but preserved confidentiality. The provided adherence reports inspired participants to improve their adherence. None of the participants experienced unwanted disclosure or stigmatisation due to DAT. However, 5% of adolescents were concerned about being monitored daily. This study showed that DAT is acceptable and provided insight of the needed SMS content for a customized DAT for CALHIV.

The Use of Quality Improvement in the Physical Therapy Literature: A Scoping Review

INTRODUCTION

Quality improvement (QI) is a useful methodology for improving healthcare, often through iterative changes. There is no prior review on the application of QI in physical therapy (PT).

PURPOSE AND RELEVANCE

To characterize and evaluate the quality of the QI literature in PT.

METHODS

We searched four electronic databases from inception through September 1, 2022. Included publications focused on QI and included the practice of PT. Quality was assessed using the 16-point QI Minimum Quality Criteria Set (QI-MQCS) appraisal tool.

RESULTS

Seventy studies were included in the review, 60 of which were published since 2014 with most ( n = 47) from the United States. Acute care ( n = 41) was the most prevalent practice setting. Twenty-two studies (31%) did not use QI models or approaches and only nine studies referenced Revised Standards for QI Reporting Excellence guidelines. The median QI-MQCS score was 12 (range 7-15).

CONCLUSIONS/IMPLICATIONS

Quality improvement publications in the PT literature are increasing, yet there is a paucity of QI studies pertaining to most practice settings and a lack of rigor in project design and reporting. Many studies were of low-to-moderate quality and did not meet minimum reporting standards. We recommend use of models, frameworks, and reporting guidelines to improve methodologic rigor and reporting.

Development of a bilingual interdisciplinary scale assessing self-efficacy for participating in Medical Assistance in Dying

Medical Assistance in Dying (MAiD) is a complex process involving the person seeking care and their relatives. MAiD involves physical, psychosocial and spiritual needs, and consequently the involvement of an interdisciplinary team is beneficial. Therefore, updating the knowledge and skills of healthcare and social services professionals is critical. An interdisciplinary team from Laval University (Quebec, Canada) has developed a continuous training program for all health care and social services professionals who could be involved in the care of persons who request MAiD and their loved ones. It is crucial to assess whether the objectives of the continuous training program are being met, especially since this new training addresses several complex issues (legal, ethical, and clinical). Bandura's self-efficacy theory has been widely used to develop scales for assessing the impact of training programs and identifying knowledge gaps. Bandura's theory states that feeling secure in one's self-efficacy leads to self-determined motivation. Although there are various scales intended to measure self-efficacy in palliative care, none include self-efficacy for participating in the process surrounding MAiD. As a result, we aim to create a bilingual (English-French) interdisciplinary scale to assess self-efficacy for participating in the process surrounding MAiD. The scale will allow decision-makers and researchers to identify current knowledge gaps. It will also be useful for assessing the impact of current and future training programs addressing this end-of-life practice. In this work in progress, we briefly introduce the training program and the future steps in the development and validation of the scale.

Measuring quality of facility-based ITN distribution in Ghana

BACKGROUND

Continuous distribution channels are effective methods to deliver malaria interventions such as insecticide treated nets (ITNs) to pregnant women attending antenatal care clinics and children under five attending immunization visits. Facility-based and provider-based checklists were used during supportive supervision visits to measure the quality of facility-based services and interventions. This study looks at ITN distributions at health facilities in Ghana, with the aim of providing insights on how quality can be measured and monitored.

METHODS

Various quality improvement approaches for malaria services occur in Ghana. Selected indicators were analysed to highlight the similarities and differences of how the approaches measured how well the channel was doing. Generally, the approaches assessed (1) service data management, (2) logistics data management, and (3) observation of service provision (ITN issuance, malaria education, ITN use and care education). Two approaches used a binary (Yes/No) scale, and one used a Likert scale.

RESULTS

Results showed that most data reported to the national HMIS is accurate. Logistics data management remained an issue at health facilities, as results showed scores below average across facility stores, antenatal care, and immunization. Though the supervision approaches differed, overall results indicated that almost all eligible clients received ITNs, data were recorded accurately and reported on-time, and logistics was the largest challenge to optimal distribution through health facilities.

CONCLUSION

The supervision approaches provided valuable insights into the quality of facility-based ITN distribution. Ghana should continue to implement supportive supervision in their malaria agenda, with additional steps needed to improve reporting of collected data and increase the number of facilities visited for supportive supervision and the frequency. There were various supervision approaches used with no clear guidance on how to measure quality of facility-based ITN distribution, so there is also need for the global community to agree on standardized indicators and approaches to measuring quality of facility-based ITN distribution. Additionally, future studies can review the effect of multiple rounds of supervision visits on the quality of ITN distribution as well as understand the facilitators and barriers to scaling up supervision of facility-based ITN distribution.

Development and evaluation of a continuous quality improvement programme for antimicrobial stewardship in six hospitals in Uganda

BACKGROUND

Appropriate antimicrobial use is essential for antimicrobial stewardship (AMS). Ugandan hospitals are making efforts to improve antibiotic use, but improvements have not been sufficiently documented and evaluated.

METHODS

Six Ugandan hospitals implemented AMS interventions between June 2019 and July 2022. We used the WHO AMS toolkit to set-up hospital AMS programmes and implemented interventions using continuous quality improvement (CQI) techniques and targeting conditions commonly associated with antibiotic misuse, that is, urinary tract infections (UTIs), upper respiratory tract infections (URTIs) and surgical antibiotic prophylaxis (SAP). The interventions included training, mentorship and provision of clinical guidelines to support clinical decision-making. Quarterly antibiotic use surveys were conducted.

RESULTS

Data were collected for 7037 patients diagnosed with UTIs. There was an increase in the proportion of patients receiving one antibiotic for the treatment of UTI from 48% during the pre-intervention to 73.2%, p<0.01. There was a 19.2% reduction in the number of antimicrobials per patient treated for UTI p<0.01. There was an increase in use of nitrofurantoin, the first-line drug for the management of UTI. There was an increase in the use of Access antibiotics for managing UTIs from 50.4% to 53.8%. The proportion of patients receiving no antimicrobials for URTI increased from 26.3% at pre-intervention compared with 53.4% at intervention phase, p<0.01. There was a 20.7% reduction in the mean number of antimicrobials per patient for URTI from the pre-intervention to the intervention phase, from 0.8 to 0.6, respectively, p<0.001 and reduction in the number of treatment days, p=0.0163. Among patients undergoing surgery, 49.5% (2212) received SAP during the pre-intervention versus 50.5% (2169) during the intervention.

CONCLUSIONS

Using CQI approaches to focus on specific causes of inappropriate antibiotic use led to desirable overall reductions in antibiotic use for URTI and UTI.

Impact of externally facilitated continuous quality improvement cohorts on Advanced Access to support primary healthcare teams: protocol for a quasi-randomized cluster trial

BACKGROUND

Improving access to primary health care is among top priorities for many countries. Advanced Access (AA) is one of the most recommended models to improve timely access to care. Over the past 15 years, the AA model has been implemented in Canada, but the implementation of AA varies substantially among providers and clinics. Continuous quality improvement (CQI) approaches can be used to promote organizational change like AA implementation. While CQI fosters the adoption of evidence-based practices, knowledge gaps remain, about the mechanisms by which QI happens and the sustainability of the results. The general aim of the study is to analyse the implementation and effects of CQI cohorts on AA for primary care clinics. Specific objectives are: 1) Analyse the process of implementing CQI cohorts to support PHC clinics in their improvement of AA. 2) Document and compare structural organisational changes and processes of care with respect to AA within study groups (intervention and control). 3) Assess the effectiveness of CQI cohorts on AA outcomes. 4) Appreciate the sustainability of the intervention for AA processes, organisational changes and outcomes.

METHODS

Cluster-controlled trial allowing for a comprehensive and rigorous evaluation of the proposed intervention 48 multidisciplinary primary care clinics will be recruited to participate. 24 Clinics from the intervention regions will receive the CQI intervention for 18 months including three activities carried out iteratively until the clinic's improvement objectives are achieved: 1) reflective sessions and problem priorisation; 2) plan-do-study-act cycles; and 3) group mentoring. Clinics located in the control regions will receive an audit-feedback report on access. Complementary qualitative and quantitative data reflecting the quintuple aim will be collected over a period of 36 months.

RESULTS

This research will contribute to filling the gap in the generalizability of CQI interventions and accelerate the spread of effective AA improvement strategies while strengthening local QI culture within clinics. This research will have a direct impact on patients' experiences of care.

CONCLUSION

This mixed-method approach offers a unique opportunity to contribute to the scientific literature on large-scale CQI cohorts to improve AA in primary care teams and to better understand the processes of CQI.

TRIAL REGISTRATION

Clinical Trials: NCT05715151.

Analyzing a Multifactorial Fall Prevention Program Using ARIMA Models

BACKGROUND

Preventing inpatient falls is challenging for hospitals to improve and often leads to patient injury.

PURPOSE

To describe multifactorial patient-tailored interventions and to evaluate whether they were associated with a sustained decline in total and injury falls.

METHODS

A multifactorial fall prevention program was instituted over the course of several years. An interrupted time series design was used to assess the effect of each intervention on total and injury fall rates. ARIMA models were built to assess the step and ramp change.

RESULTS

Total fall rates decreased from 4.3 to 3.6 falls per 1000 patient days (16.28% decrease), and injury fall rates decreased from 1.02 to 0.8 falls per 1000 patient days (21.57% decrease). All the interventions contributed to fall reduction, with specific interventions contributing more than others.

CONCLUSIONS

Using multiple interventions that are sustained long enough to demonstrate success reduced the total fall rate and injury fall rate.

Quality improvement tools to manage deceased organ donation processes: a scoping review

OBJECTIVE

To collate and summarise the literature on the quality improvement tools that have been developed for deceased organ donation processes after circulatory determination of death and neurological determination of death.

DESIGN

Scoping review using the Joanna Briggs Institute framework.

DATA SOURCES

We searched for published (MEDLINE, Embase, PsycINFO, CINAHL, Web of Science) and unpublished literature (organ donation organisation websites worldwide). The search was initially conducted on 17 July 2021 and updated on 1 June 2022. Included articles discussed the creation and/or use of quality improvement tools to manage deceased organ donation processes. Two independent reviewers screened the references, extracted and analysed the data.

RESULTS

40 references were included in this review, and most records were written in English (n=38), originated in Canada (n=21), published between 2016 and 2022 (n=22), and were specific for donation after neurological determination of death (n=20). The tools identified included checklists, algorithms, flow charts, charts, pathways, decision tree maps and mobile apps. These tools were applied in the following phases of the organ donation process: (1) potential donor identification, (2) donor referral, (3) donor assessment and risk, (4) donor management, (5) withdrawal of life-sustaining measures, (6) death determination, (7) organ retrieval and (8) overall organ donation process.

CONCLUSIONS

We conducted a thorough investigation of the available quality improvement tools for deceased organ donation processes. The existing evidence lacks details in the report of methods used for development, testing and impact of these tools, and we could not locate tools specific for some phases of the organ donation process. Lastly, by mapping existing tools, we aim to facilitate both clinician choices among available tools, as well as research work building on existing knowledge.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.

Improving curriculum delivery: Using a results informed quality improvement model for teen behavioral health education

Adolescence is a critical developmental stage to establish healthy decision-making processes and behavior patterns. Many interventions such as evidence-based curricula have been implemented to guide adolescents to avoid risk-taking behaviors and improve health and medical knowledge and outcomes. This study presents a participatory approach informed by the three-stage (3S) quality improvement process model to improve the quality of curriculum delivery, based on the results indicating outcomes achieved, needs for improvement, and quality assurance for maintaining the expected outcomes of an evidence-based curricula. Tests were conducted before and after the intervention. Using threshold levels and measures of change in the tests, instructors participated in guided discussion and analysis of the data to identify where and how instructional improvements should be made and where outcomes were being achieved as expected. This method was used to diagnose variation in the results and delivery and identify root causes informing actions to improve curriculum delivery and outcomes. After the facilitated discussions, pre- and post-tests from subsequent classes were analyzed. The results showed improved test item scores ranging from 2 to 69.5% and seven of 18 items obtained statistical significance following the implementation of the model described. Overall, an increase in the mean percent correct of 17.1% was found.

The Influence of Context on Implementation and Improvement: Protocol for a Mixed Methods, Secondary Analyses Study

Background

Caring for the well-being of older adults is one of the greatest challenges in modern societies. Improving the quality of care and life for older adults and the work lives of their care providers calls for effective knowledge translation of evidence-based best practices.

Objective

This study’s purpose is to contribute to knowledge translation by better understanding the roles of organizational context (workplace environment) and facilitation (process or role) in implementation and improvement success. Our study has 2 goals: (1) to advance knowledge translation science by further developing and testing the Promoting Action on Research Implementation in Health Services framework (which outlines how implementation relies on the interplay of context, facilitation, and evidence) and (2) to advance research by optimizing implementation success via tailoring of modifiable elements of organizational context and facilitation.

Methods

This is secondary analyses of 15 years of longitudinal data from the Translating Research in Elder Care (TREC) program’s multiple data sources. This research is ongoing in long-term care (LTC) homes in western Canada. TREC data include the following: 5 waves of survey collection, 2 clinical trials, and regular ongoing outcome data for LTC residents. We will use a sequential exploratory and confirmatory mixed methods design. We will analyze qualitative and quantitative data holdings in an iterative process: (1) comprehensive reanalysis of qualitative data to derive hypotheses, (2) quantitative modeling to test hypotheses, and (3) action cycles to further refine and integrate qualitative and quantitative analyses. The research team includes 4 stakeholder panels: (1) system decision- and policy makers, (2) care home managers, (3) direct care staff, and (4) a citizen engagement group of people living with dementia and family members of LTC residents. A fifth group is our panel of external scientific advisors. Each panel will engage periodically, providing their perspectives on project direction and findings.

Results

This study is funded by the Canadian Institutes of Health Research. Ethics approval was obtained from the University of Alberta (Pro00096541). The results of the secondary analyses are expected by the end of 2023.

Conclusions

The project will advance knowledge translation science by deepening our understanding of the roles of context, the interactions between context and facilitation, and their influence on resident and staff quality outcomes. Importantly, findings will inform understanding of the mechanisms by which context and facilitation affect the success of implementation and offer insights into factors that influence the implementation success of interventions in nursing homes.

International Registered Report Identifier (IRRID)

DERR1-10.2196/40611

Evaluation of the introduction of QOF quality improvement modules in English general practice: early findings from a rapid, qualitative exploration of implementation

Background

A 2018 review of the English primary care pay-for-performance scheme, the Quality and Outcomes Framework, suggested that it should evolve to better support holistic, patient-centred care and leadership for quality improvement (QI). From 2019, as part of the vision of change, financially incentivised QI cycles (initially in prescribing safety and end-of-life care), were introduced into the scheme.

Objectives

To conduct a rapid evaluation of general practice staff attitudes, experiences and plans in relation to the implementation of the first two QI modules. This study was commissioned by NHS England and will inform development of the QI programme.

Methods

Semistructured telephone interviews were conducted with 25 practice managers from a range of practices across England. Interviews were audio recorded with consent and transcribed verbatim. Anonymised data were reflexively thematically analysed using the framework method of analysis to identify common themes across the interviews.

Results

Participants reported broadly favourable views of incentivised QI, suggesting the prescribing safety module was easier to implement than the end-of-life module. Additional staff time needed and challenges of reviewing activities with other practices were reported as concerns. Some highlighted that local flexibility and influence on subject matter may improve the effectiveness of QI. Several questioned the choices of topic, recognising greater need and potential for improving quality of care in other clinical areas.

Conclusion

Practices supported the idea of financial incentivisation of QI, however, it will be important to ensure that focus on QI cycles in specific clinical areas does not have unintended effects. A key issue will be keeping up momentum with the introduction of new modules each year which are time consuming to carry out for time poor General Practitioners (GPs)/practices.

How successful was the use of a community of practice for the implementation of evidence-based practices for heart failure within the United States Department of Veterans Affairs: Insights from a formative evaluation

Background

Communities of Practice (CoPs) are a promising approach to facilitate the implementation of evidence-based practices (EBPs) to improve care for chronic conditions like heart failure (HF). CoPs involve a complex process of acquiring and converting both explicit and tacit knowledge into clinical activities. This study describes the conceptualization, creation, capacity-building and dissemination of a CoP sustained over 9 years, and evaluates its value and impact on EBP.

Methods

In July 2006, a CoP called the Heart Failure Provider Network (HF Network) was established within the United States Department of Veterans Affairs (VA) with the overarching goal of improving the quality of care for HF patients. We assessed (formative) the HF Network in terms of its various activities (inputs) and proximal impacts (mediators) at the individual level, and its distal impacts (outcomes) at the site level including implementation of new/improved EBPs at the systemwide level.

Results

The HF Network membership grew steadily over the 9 years. The CoP has involved a total of 1341 multidisciplinary and multilevel members at all 144 VA Health Care Systems (sites). Most members were practising clinicians (n = 891, 66.4%), followed by administrators (n = 342, 25.5%), researchers (n = 70, 5.2%) and others (n = 38, 2.8%). Participation was assessed to be “active” for 70.6% versus “passive” for 29.4% of members. The distribution of active members (clinicians 64.7%, administrators 21.6%) was similar to the distribution of overall membership.

Conclusions

Survey respondents perceived the HF Network as useful in terms of its varied activities and resources relevant for patient care. Strong evidence shows that these members, particularly those who considered themselves influential in improving quality of care, noted multiple benefits of membership, which included confirmation of their own clinical practices, evidence-based changes to their practice and help in understanding facilitators and barriers in setting up or running HF clinics and other programmes. Such CoPs have strong impacts on the quality of care being delivered for both mandated and non-mandated initiatives.

Methodological Rigor and Transparency in Clinical Practice Guidelines for Nutrition Care in Critically Ill Adults: A Systematic Review Using the AGREE II and AGREE-REX Tools

Background: To evaluate the methodological quality of (1) clinical practice guidelines (CPGs) that inform nutrition care in critically ill adults using the AGREE II tool and (2) CPG recommendations for determining energy expenditure using the AGREE-REX tool. Methods: CPGs by a professional society or academic group, intended to guide nutrition care in critically ill adults, that used a systematic literature search and rated the evidence were included. Four databases and grey literature were searched from January 2011 to 19 January 2022. Five investigators assessed the methodological quality of CPGs and recommendations specific to energy expenditure determination. Scaled domain scores were calculated for AGREE II and a scaled total score for AGREE-REX. Data are presented as medians (interquartile range). Results: Eleven CPGs were included. Highest scoring domains for AGREE II were clarity of presentation (82% [76–87%]) and scope and purpose (78% [66–83%]). Lowest scoring domains were applicability (37% [32–42%]) and stakeholder involvement (46% [33–51%]). Eight (73%) CPGs provided recommendations relating to energy expenditure determination; scores were low overall (37% [36–40%]) and across individual domains. Conclusions: Nutrition CPGs for critically ill patients are developed using systematic methods but lack engagement with key stakeholders and guidance to support application. The quality of energy expenditure determination recommendations is low.

Linking resilience and regulation across system levels in healthcare – a multilevel study

Background

The Quality Improvement Regulation was introduced to the Norwegian healthcare system in 2017 as a new national regulatory framework to support local quality and safety efforts in hospitals. A research-based response to this, was to develop a study with the overall research question: How does a new healthcare regulation implemented across three system levels contribute to adaptive capacity in hospital management of quality and safety? Based on development and implementation of the Quality Improvement Regulation, this study aims to synthesize findings across macro, meso, and micro-levels in the Norwegian healthcare system.

Methods

The multilevel embedded case study collected data by documents and interviews. A synthesizing approach to findings across subunits was applied in legal dogmatic and qualitative content analysis. Setting: three governmental macro-level bodies, three meso-level County Governors and three micro-level hospitals. Participants: seven macro-level regulators, 12 meso-level chief county medical officers/inspectors and 20 micro-level hospital managers/quality advisers.

Results

Based on a multilevel investigation, three themes were discovered. All system levels considered the Quality Improvement Regulation to facilitate adaptive capacity and recognized contextual flexibility as an important regulatory feature. Participants agreed on uncertainty and variation to hamper the ability to plan and anticipate risk. However, findings identified conflicting views amongst inspectors and hospital managers about their collaboration, with different perceptions of the impact of external inspection. The study found no changes in management- or clinical practices, nor substantial change in the external inspection approach due to the new regulatory framework.

Conclusions

The Quality Improvement Regulation facilitates adaptive capacity, contradicting the assumption that regulation and resilience are “hopeless opposites”. However, governmental expectations to implementation and external inspection were not fully linked with changes in hospital management. Thus, the study identified a missing link in the current regime. We suggest that macro, meso and micro-levels should be considered collaborative partners in obtaining system-wide adaptive capacity, to ensure efficient risk regulation in quality improvement and patient safety processes. Further studies on regulatory processes could explore how hospital management and implementation are influenced by regulators’, inspectors’, and managers’ professional backgrounds, positions, and daily trade-offs to adapt to changes and maintain high quality care.

Translating mental health recovery guidelines into recovery-oriented innovations: A strategy combining implementation teams and a facilitated planning process

Recovery is the focus of mental health strategies internationally. However, little translation of recovery knowledge has occurred in mental health services. The purpose of this research is to bridge the gap between recovery guidelines and practice by developing a new implementation strategy involving the formation of implementation teams made up of different stakeholders (service users, service providers, managers, knowledge users) and facilitating a 12-meeting implementation planning process. Sevenmental health organizations across Canada successfully completed the process of translating the guidelines into a recovery-oriented innovation that was implemented. Fifty-five implementation team members were interviewed upon completion of the 12-meeting process. Findings indicate that implementation team members perceived the structured planning process as positive. Nevertheless, the language of implementation science remains difficult to understand for a non-academic audience. Key elements of the 12-meeting process included the value of consensus building among implementation team members and the subsequent shifting power relationships. While working with diverse stakeholders came with certain challenges, the process in itself was a form of system transformation. This type of engaged planning process was a significant departure from the more top-down approaches to organizational change that staff were used to.

Lessons learnt from quality improvement collaboratives in Cambodia

Currently, Cambodia uses performance-based financing (PBF) and a national quality enhancement monitoring system as key components of its strategy to achieve universal health coverage and the health-related Sustainable Development Goals. PBF is one among many strategies to improve the quality of healthcare services and its effects and limitations have been widely documented. We share lessons learnt from the use of quality improvement collaboratives, a facility-based quality improvement strategy, to amplify and complement PBF to address specific service delivery gaps, improve provider competency, and increase patient trust and satisfaction in the health system, a driver of healthcare utilisation.

How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review

BACKGROUND

A recent systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries. The review identified strategies with varying effects, including in-service training, supervision and group problem-solving. However, whether their effectiveness changed over time remained unclear. In particular, understanding whether effects decay over time is crucial to improve sustainability.

METHODS

We conducted a secondary analysis of data from the aforementioned review to explore associations between time and effectiveness. We calculated effect sizes (defined as percentage-point (%-point) changes) for HCP practice outcomes (eg, percentage of patients correctly treated) at each follow-up time point after the strategy was implemented. We estimated the association between time and effectiveness using random-intercept linear regression models with time-specific effect sizes clustered within studies and adjusted for baseline performance.

RESULTS

The primary analysis included 37 studies, and a sensitivity analysis included 77 additional studies. For training, every additional month of follow-up was associated with a 0.19 %-point decrease in effectiveness (95% CI: -0.36 to -0.03). For training combined with supervision, every additional month was associated with a 0.40 %-point decrease in effectiveness (95% CI: -0.68 to -0.12). Time trend results for supervision were inconclusive. For group problem-solving alone, time was positively associated with effectiveness, with a 0.50 %-point increase in effect per month (95% CI: 0.37 to 0.64). Group problem-solving combined with training was associated with large improvements, and its effect was not associated with time.

CONCLUSIONS

Time trends in the effectiveness of different strategies to improve HCP practices vary among strategies. Programmes relying solely on in-service training might need periodical refresher training or, better still, consider combining training with group problem-solving. Although more high-quality research is needed, these results, which are important for decision-makers as they choose which strategies to use, underscore the utility of studies with multiple post-implementation measurements so sustainability of the impact on HCP practices can be assessed.

Integration of Medication Safety Training and Development of a Culture of Safety in Pharmacy Education

Medication safety events with the potential for patient harm do occur in health care settings. Pharmacists are regularly tasked with utilizing their medication knowledge to optimize the medication use process and reduce the likelihood of error. To prepare for these responsibilities in professional practice, it is important to introduce patient safety principles during educational experiences. The Accreditation Council for Pharmacy Education (ACPE) and the American Society of Health-System Pharmacists (ASHP) have set forth accreditation standards focused on the management of medication use processes to ensure these competencies during pharmacy didactic learning and postgraduate training. The experience described here provides perspective on educational and experiential opportunities across the continuum of pharmacy education, with a focus on a relationship between a college of pharmacy and healthcare system. Various activities, including discussions, medication event reviews, audits, and continuous quality improvement efforts, have provided the experiences to achieve standards for these pharmacy learners. These activities support a culture of safety from early training.

The effectiveness of quality improvement collaboratives in improving stroke care and the facilitators and barriers to their implementation: a systematic review

Background

To successfully reduce the negative impacts of stroke, high-quality health and care practices are needed across the entire stroke care pathway. These practices are not always shared across organisations. Quality improvement collaboratives (QICs) offer a unique opportunity for key stakeholders from different organisations to share, learn and ‘take home’ best practice examples, to support local improvement efforts. This systematic review assessed the effectiveness of QICs in improving stroke care and explored the facilitators and barriers to implementing this approach.

Methods

Five electronic databases (MEDLINE, CINAHL, EMBASE, PsycINFO, and Cochrane Library) were searched up to June 2020, and reference lists of included studies and relevant reviews were screened. Studies conducted in an adult stroke care setting, which involved multi-professional stroke teams participating in a QIC, were included. Data was extracted by one reviewer and checked by a second. For overall effectiveness, a vote-counting method was used. Data regarding facilitators and barriers was extracted and mapped to the Consolidated Framework for Implementation Research (CFIR).

Results

Twenty papers describing twelve QICs used in stroke care were included. QICs varied in their setting, part of the stroke care pathway, and their improvement focus. QIC participation was associated with improvements in clinical processes, but improvements in patient and other outcomes were limited. Key facilitators were inter- and intra-organisational networking, feedback mechanisms, leadership engagement, and access to best practice examples. Key barriers were structural changes during the QIC’s active period, lack of organisational support or prioritisation of QIC activities, and insufficient time and resources to participate in QIC activities. Patient and carer involvement, and health inequalities, were rarely considered.

Conclusions

QICs are associated with improving clinical processes in stroke care; however, their short-term nature means uncertainty remains as to whether they benefit patient outcomes. Evidence around using a QIC to achieve system-level change in stroke is equivocal. QIC implementation can be influenced by individual and organisational level factors, and future efforts to improve stroke care using a QIC should be informed by the facilitators and barriers identified. Future research is needed to explore the sustainability of improvements when QIC support is withdrawn.

Trial registration

Protocol registered on PROSPERO (CRD42020193966).

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01162-8.

Transitioning to Telehealth Services in a Pediatric Diabetes Clinic During COVID-19: An Interdisciplinary Quality Improvement Initiative

COVID-19 necessitated a rapid shift to telehealth for psychologists offering consultation-liaison services in pediatric medical settings. However, little is known about how psychologists providing these services adapted to using telehealth service delivery formats. This report details how our interdisciplinary team identified declining psychosocial screener completion and psychology consultation rates as primary challenges following a shift to telehealth within a pediatric diabetes clinic. We utilized the Plan-Do-Study-Act (PDSA) quality improvement framework to improve screening and consultation rates, which initially declined during the telehealth transition. Screening and consultation rates dropped initially, but recovered to nearly pre-pandemic levels following three PDSA intervention cycles. During implementation, challenges arose related to the feasibility of patient interactions, interdisciplinary collaboration, patient engagement, and ethical issues. Clinics shifting psychology consultation-liaison services to telehealth should prioritize interdisciplinary communication, elicit perspectives from all clinic professionals, leverage the electronic health record, and develop procedures for warm handoffs and navigating ethical issues.

Important Quality Metrics and Standardization in Endoscopy

Quality metrics and standardization has become critical as the Affordable Care Act mandates that the Center for Medicare and Medicaid Services change reimbursement from volume to a value-based system. While the most commonly used quality indicators are related to that of colonoscopy, quality metrics for other procedures and endoscopy units have been developed mainly by the American College of Gastroenterology and the American Society of Gastrointestinal Endoscopy. Data to show that these quality metrics, especially in the field of advanced endoscopy as well as in the era of COVID-19 pandemic, can improve patient outcomes, are anticipated.

Development, characteristics and impact of quality improvement casebooks: a scoping review

Background

Quality improvement (QI) casebooks, compilations of QI experiences, are one way to share experiential knowledge that healthcare policy-makers, managers and professionals can adapt to their own contexts. However, QI casebook use, characteristics and impact are unknown. We aimed to synthesize published research on QI prevalence, development, characteristics and impact.

Methods

We conducted a scoping review by searching MEDLINE, EMBASE, CINAHL and SCOPUS from inception to 4 February 2021. We extracted data on study characteristics and casebook definitions, development, characteristics (based on the WIDER [Workgroup for Intervention Development and Evaluation Research] framework) and impact. We reported findings using summary statistics, text and tables.

Results

We screened 2999 unique items and included five articles published in Canada from 2011 to 2020 describing three studies. Casebooks focused on promoting positive weight-related conversations with children and parents, coordinating primary care-specialist cancer management, and showcasing QI strategies for cancer management. All defined casebooks similarly described real-world experiences of developing and implementing QI strategies that others could learn from, emulate or adapt. In all studies, casebook development was a multistep, iterative, interdisciplinary process that engages stakeholders in identifying, creating and reviewing content. While casebooks differed in QI topic, level of application and scope, cases featured common elements: setting or context, QI strategy details, impacts achieved, and additional tips for implementing strategies. Cases were described with a blend of text, graphics and tools. One study evaluated casebook impact, and found that it enhanced self-efficacy and use of techniques to improve clinical care. Although details about casebook development and characteristics were sparse, we created a template of casebook characteristics, which others can use as the basis for developing or evaluating casebooks.

Conclusion

Future research is needed to optimize methods for developing casebooks and to evaluate their impact. One approach is to assess how the many QI casebooks available online were developed. Casebooks should be evaluated alone or in combination with other interventions that support QI on a range of outcomes.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-021-00777-z.

Aligning implementation science with improvement practice: a call to action

Background

In several recent articles, authors have called for aligning the fields of implementation and improvement science. In this paper, we call for implementation science to also align with improvement practice. Multiple implementation scholars have highlighted the importance of designing implementation strategies to fit the existing culture, infrastructure, and practice of a healthcare system. Worldwide, healthcare systems are adopting improvement models as their primary approach to improving healthcare delivery and outcomes. The prevalence of improvement models raises the question of how implementation scientists might best align their efforts with healthcare systems’ existing improvement infrastructure and practice.

Main body

We describe three challenges and five benefits to aligning implementation science and improvement practice. Challenges include (1) use of different models, terminology, and methods, (2) a focus on generalizable versus local knowledge, and (3) limited evidence in support of the effectiveness of improvement tools and methods. We contend that implementation science needs to move beyond these challenges and work toward greater alignment with improvement practice. Aligning with improvement practice would benefit implementation science by (1) strengthening research/practice partnerships, (2) fostering local ownership of implementation, (3) generating practice-based evidence, (4) developing context-specific implementation strategies, and (5) building practice-level capacity to implement interventions and improve care. Each of these potential benefits is illustrated in a case study from the Centers for Disease Control and Prevention’s Cancer Prevention and Control Research Network.

Conclusion

To effectively integrate evidence-based interventions into routine practice, implementation scientists need to align their efforts with the improvement culture and practice that is driving change within healthcare systems worldwide. This paper provides concrete examples of how researchers have aligned implementation science with improvement practice across five implementation projects.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00201-1.

Recommendations for strengthening the role of embedded researchers to accelerate implementation in health systems: Findings from a state-of-the-art (SOTA) conference workgroup

BACKGROUND

Traditional research approaches do not promote timely implementation of evidence-based innovations (EBIs) to benefit patients. Embedding research within health systems can accelerate EBI implementation by blending rigorous methods with practical considerations in real-world settings. A state-of-the-art (SOTA) conference was convened in February 2019 with five workgroups that addressed five facets of embedded research and its potential to impact healthcare. This article reports on results from the workgroup focused on how embedded research programs can be implemented into heath systems for greatest impact.

METHODS

Based on a pre-conference survey, participants indicating interest in accelerating implementation were invited to participate in the SOTA workgroup. Workgroup participants (N = 26) developed recommendations using consensus-building methods. Ideas were grouped by thematic clusters and voted on to identify top recommendations. A summary was presented to the full SOTA membership. Following the conference, the workgroup facilitators (LJD, CDH, NR) summarized workgroup findings, member-checked with workgroup members, and were used to develop recommendations.

RESULTS

The workgroup developed 12 recommendations to optimize impact of embedded researchers within health systems. The group highlighted the tension between "ROI vs. R01" goals-where health systems focus on achieving return on their investments (ROI) while embedded researchers focus on obtaining research funding (R01). Recommendations are targeted to three key stakeholder groups: researchers, funders, and health systems. Consensus for an ideal foundation to support optimal embedded research is one that (1) maximizes learning; (2) aligns goals across all 3 stakeholders; and (3) implements EBIs in a consistent and timely fashion.

CONCLUSIONS

Four cases illustrate a variety of ways that embedded research can be structured and conducted within systems, by demonstrating key embedded research values to enable collaborations with academic affiliates to generate actionable knowledge and meaningfully accelerate implementation of EBIs to benefit patients.

IMPLICATIONS

Embedded research approaches have potential for transforming health systems and impacting patient health. Accelerating embedded research should be a focused priority for funding agencies to maximize a collective return on investment.

Lean Management and Hospital Performance: Adoption vs. Implementation

BACKGROUND

The Lean management system is being adopted and implemented by an increasing number of US hospitals. Yet few studies have considered the impact of Lean on hospitalwide performance.

METHODS

A multivariate analysis was performed of the 2017 National Survey of Lean/Transformational Performance Improvement in Hospitals and 2018 publicly available data from the Agency for Healthcare Research and Quality and the Center for Medicare & Medicaid Services on 10 quality/appropriateness of care, cost, and patient experience measures.

RESULTS

Hospital adoption of Lean was associated with higher Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) patient experience scores (b = 3.35, p < 0.0001) on a scale of 100-300 but none of the other 9 performance measures. The degree of Lean implementation measured by the number of units throughout the hospital using Lean was associated with lower adjusted inpatient expense per admission (b = -38.67; p < 0.001), lower 30-day unplanned readmission rate (b = -0.01, p < 0.007), a score above the national average on appropriate use of imaging-a measure of low-value care (odds ratio = 1.04, p < 0.042), and higher HCAHPS patient experience scores (b = 0.12, p < 0.012). The degree of Lean implementation was not associated with any of the other 6 performance measures.

CONCLUSION

Lean is an organizationwide sociotechnical performance improvement system. As such, the actual degree of implementation throughout the organization as opposed to mere adoption is, based on the present findings, more likely to be associated with positive hospital performance on at least some measures.

Developing a regional transmural care database: A roadmap

INTRODUCTION

In primary care health care systems, primary care physicians (PCPs) provide most basic care services, and if necessary, refer to secondary care for specialized work-up and treatment. If hospital care is required, agreement between PCPs and secondary care physicians (SCPs) on the conditions for patient referral and back-referral are considered crucial to providing high quality patient care. The regional healthcare network of Utrecht, a region in the Netherlands, developed a set of collaborative patient care agreements (CPCAs) for specific chronic conditions. Even though these CPCA are endorsed by all relevant regional health care organisations, the adoption of these agreements in practice remains substandard. In this project, through linkage of routine care data, as registered in daily practice by PCPs and SCPs, a regional transmural care database (RTD) was developed for monitoring the use of the CPCAs. Its data was transformed into' mirror data' used to support PCPs and SCPs in discussing and improving current practice and to support a learning healthcare system within the region.

METHODS

The development of the RTD is part of a larger action research project on joint care, called ZOUT (an acronym which is translated as "The right care at the right place in the Utrecht region"). The RTD includes data from three regional hospitals, and about 70 affiliated primary care practices which are united in the Julius General Practitioners Network (JGPN). These data were extracted, linked and presented in the form of mirror data, following simple methods to allow replication of our approach. CPCAs addressing transmural care for three chronic conditions were selected. Data from the primary care practices and the hospitals were linked by an independent trusted third party. This enabled relevant hospital data to be added to the primary care dataset, thereby providing transmural routine care data for individual patients.

RESULTS

During the development of the RTD, a roadmap was created including a detailed step-by-step checklist of the organizational, administrative, technical and legal arrangements which needed to be made. Legal and administrative challenges proved most challenging. Also, incompleteness of data and the impossibility to translate several agreements into extractable data limited the potential for providing a comprehensive overview of the extent to which agreements in the CPCA were adhered to in daily care.

DISCUSSION

We present a systematic, comprehensive (technical as well as practical) and reproducible roadmap to developing a regional transmural care database suitable for generating mirror data on joint transmural care between PCPs and SCPs. This approach includes all technical steps in data selection and linkage, as well as the substantive steps that need to be taken in the analysis and application of the results. The mirror data, which reflects the follow-up of agreements formulated in the CPCAs, enabled shared reflection and discussion between PCPs and SCPs. This supports the search for bottlenecks and potentialities for improving daily collaborative care, thereby showing great potential to serve a learning regional healthcare system.

Improving Medication Access within Integrated Treatment for Individuals with Co-Occurring Disorders in Substance Use Treatment Agencies

BACKGROUND

The best approach to provide comprehensive care for individuals with co-occurring disorders (CODs) related to substance use and mental health is to address both disorders through an integrated treatment approach. However, only 25% of behavioral health agencies offer integrated care and less than 7% of individuals who need integrated treatment receive it. A project used a cluster-randomized waitlist control group design to evaluate the effectiveness of Network for the Improvement of Addiction Treatment (NIATx) implementation strategies to improve access to addiction and psychotropic medications.

METHODS

This study represents a secondary analysis of data from the NIATx project. Forty-nine agencies were randomized to Cohort1 (active implementation group, receiving the NIATx strategy [n=25]) or Cohort2 (waitlist control group [n=24]). Data were collected at three time points (Baseline, Year1 and Year2). A two-level (patient within agency) multinomial logistic regression model investigated the effects of implementation strategy condition on one of four medication outcomes: both medication types, only psychotropic medication, only addiction medication, or neither medication type. A per-protocol analysis included time, NIATx fidelity, and agency focus as predictors.

RESULTS

The intent-to-treat analysis found a statistically significant change in access to addiction versus neither medication, but Cohort1 compared to Cohort2 at Year1 showed no differences. Changes were associated with the experimental intervention and occurred in the transition from Year 1 to Year 2, where greater increases were seen for agencies in Cohort2 versus Cohort1. The per-protocol analysis showed increased access to both medications and addiction medications from pre- to post-intervention for agencies in both cohorts; however, differences in change between high- and low-implementation agencies were not significant.

CONCLUSIONS

Access to integrated services for people with CODs is a long-standing problem. NIATx implementation strategies had limited effectiveness in improving medication access for individuals with CODs. Implementation strategy adherence is associated with increased medication access.

Learning and improving in long-term care internationally: the International Prevalence Measurement of Care Quality (LPZ)

Long-term care (LTC) for older adults is an essential part of how health and social care systems respond to population ageing. Different long-term care systems in different countries have taken differing approaches to quality assurance, ranging from inspection-based regulatory systems to data and reporting-based regulatory systems. The significant variability in the ability of long-term care facilities to respond to the COVID-19 pandemic has led to increased recognition of the role of standardized data in informing structured approaches to quality assurance. The International Prevalence Measurement of Care Quality (in Dutch: Landelijke Prevalentiemeting Zorgkwaliteit – LPZ) was developed to guide continuous quality improvement in long-term care facilities. This special article describes the LPZ tool, developed to provide input for the learning and improvement cycle of multidisciplinary teams in the LTC sector and to help improve care quality.

Protocol: examining the effectiveness of an adaptive implementation intervention to improve uptake of the VA suicide risk identification strategy: a sequential multiple assignment randomized trial

Background

In 2018, the Veterans Health Administration (VHA) mandated implementation of a national suicide risk identification strategy (Risk ID). The goal of Risk ID is to improve the detection and management of suicide risk by standardizing suicide risk screening and evaluation enterprise-wide. In order to ensure continuous quality improvement (QI), ongoing evaluation and targeted interventions to improve implementation of Risk ID are needed. Moreover, given that facilities will vary with respect to implementation needs and barriers, the dose and type of intervention needed may vary across facilities. Thus, the objective of this study is to examine the effectiveness of an adaptive implementation strategy to improve the uptake of suicide risk screening and evaluation in VHA ambulatory care settings. In addition, this study will examine specific factors that may impact the uptake of suicide risk screening and evaluation and the adoption of different implementation strategies. This protocol describes the stepped implementation approach and proposed evaluation plan.

Methods

Using a sequential multiple assignment randomized trial (SMART) design, two evidence-based implementation strategies will be evaluated: (1) audit and feedback (A&F); (2) A&F plus external facilitation (A&F + EF). Implementation outcomes of interest include uptake of secondary suicide risk screening and uptake of comprehensive suicide risk evaluation (stages 2 and 3 of Risk ID). Secondary outcomes include rates of other clinical outcomes (i.e., safety planning) and organizational factors that may impact Risk ID implementation (i.e., leadership climate and leadership support).

Discussion

This national QI study will use a SMART design to evaluate whether an adaptive implementation strategy is effective in improving uptake of a mandated VHA-wide suicide risk screening and evaluation initiative. If this study finds that the proposed stepped implementation strategy is effective at increasing uptake and maintaining performance improvements, this approach may be used as an overarching QI strategy for other national suicide prevention programs.

Trial registration

ClinicalTrials.gov NCT04243330. Registered 28 January 2020