Letting Go: Conceptualizing Intervention De-implementation in Public Health and Social Service Settings

Interventions for adolescent mental, sexual and reproductive health in West Africa: A scoping review

Objectives

A quarter of West Africa's population are adolescents 10-19 years. Their mental, sexual, and reproductive health is inter-related. We therefore aimed to examine published evidence on effectiveness of interventions for adolescent mental, sexual and reproductive health in the Economic Community of West African States (ECOWAS) to inform development, implementation and de-implementation of policies and programs.

Study design

The study design was a scoping review.

Methods

We considered all qualitative and quantitative research designs that included adolescents 10-19 years in any type of intervention evaluation that included adolescent mental, sexual and reproductive health. Outcomes were as defined by the researchers. PubMed/Medline, APA PsycINFO, CAIRN, and Google Scholar databases were searched for papers published between January 2000 and November 9, 2023.1526 English and French language papers were identified. After eliminating duplicates, screening abstracts and then full texts, 27 papers from studies in ECOWAS were included.

Results

Interventions represented three categories: service access, quality, and utilization; knowledge and information access and intersectionality and social determinants of adolescent health. Most studies were small-scale intervention research projects and interventions focused on sexual and reproductive or mental health individually rather than synergistically. The most common evaluation designs were quasi-experimental (13/27) followed by observational studies (8/27); randomized, and cluster randomized controlled trials (5/27), and one realist evaluation. The studies that evaluated policies and programs being implemented at scale used observational designs.

Conclusion

Research with robust evaluation designs on synergistic approaches to adolescent mental, sexual and reproductive health policies, interventions, implementation and de-implementation is urgently needed to inform adolescent health policies and programs.

A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022

BACKGROUND

Studies of implementation strategies range in rigor, design, and evaluated outcomes, presenting interpretation challenges for practitioners and researchers. This systematic review aimed to describe the body of research evidence testing implementation strategies across diverse settings and domains, using the Expert Recommendations for Implementing Change (ERIC) taxonomy to classify strategies and the Reach Effectiveness Adoption Implementation and Maintenance (RE-AIM) framework to classify outcomes.

METHODS

We conducted a systematic review of studies examining implementation strategies from 2010-2022 and registered with PROSPERO (CRD42021235592). We searched databases using terms "implementation strategy", "intervention", "bundle", "support", and their variants. We also solicited study recommendations from implementation science experts and mined existing systematic reviews. We included studies that quantitatively assessed the impact of at least one implementation strategy to improve health or health care using an outcome that could be mapped to the five evaluation dimensions of RE-AIM. Only studies meeting prespecified methodologic standards were included. We described the characteristics of studies and frequency of implementation strategy use across study arms. We also examined common strategy pairings and cooccurrence with significant outcomes.

FINDINGS

Our search resulted in 16,605 studies; 129 met inclusion criteria. Studies tested an average of 6.73 strategies (0-20 range). The most assessed outcomes were Effectiveness (n=82; 64%) and Implementation (n=73; 56%). The implementation strategies most frequently occurring in the experimental arm were Distribute Educational Materials (n=99), Conduct Educational Meetings (n=96), Audit and Provide Feedback (n=76), and External Facilitation (n=59). These strategies were often used in combination. Nineteen implementation strategies were frequently tested and associated with significantly improved outcomes. However, many strategies were not tested sufficiently to draw conclusions.

CONCLUSION

This review of 129 methodologically rigorous studies built upon prior implementation science data syntheses to identify implementation strategies that had been experimentally tested and summarized their impact on outcomes across diverse outcomes and clinical settings. We present recommendations for improving future similar efforts.

Sustaining health obesity prevention programs: Lessons from real-world population settings

Current understanding of what sustains public health programs is derived primarily from evaluations of programs delivered for only a few years. To improve program planning and knowledge on program sustainment, we examined real-world population programs that have been delivered for >2 years. Our focus was physical activity and nutrition programs for obesity prevention. We identified programs through published literature and searched through publicly available information on the theoretical factors determining sustainment. We reviewed 90 programs and explored intervention characteristics, provider, delivery and process level factors, and the outer environment influences. Programs were sustained on average 15 years and more frequently characterised as behavioural change skills programs targeting children, funded by non-government organisations and delivered by community organisations. Most programs had undergone some modification (n = 55). Differences between programs were observed across key factors: Programs sustained 15+ years were mainly behaviour skills programs (n = 21); and characterised by interactive designs (i.e., face-to-face or digital) over static innovations (i.e., print material) compared with those sustained <15 years (p = 0.024). While government funding supported many of the programs (n = 45;), those sustained 15+ years were more likely to have been commercially funded (p = 0.044); and were less likely to have current community involvement (p = 0.013). Differences in ownership and funding were also observed across countries. While multiple factors may influence program sustainment, longer delivered programs where distinguished by their program characteristics and outer contextual factors, suggesting such factors may have an important role in sustaining programs in the longer-term.

Enhancing Impact: A Call to Action for Equitable Implementation Science

Despite investments in evidence-based interventions and Implementation Science, most evidence-based interventions are not widely or routinely adopted, delivered, or sustained in many real-world community and healthcare settings. This gap is even greater in settings and populations experiencing numerous social and structural barriers to health, with important implications for persistent patterns in health inequities. In this Viewpoint, as part of a Special Issue on Advancing the Adaptability of Chronic Disease Prevention and Management through Implementation Science, we outline seven calls to action for the field of Implementation Science, with the goal of encouraging researchers, practitioners, and funders to be more intentional and accountable in applying Implementation Science to have greater impact on promoting health equity. Calls to action include (1) enhance public health, community, and multi-sectoral partnerships to promote health equity and equitable implementation; (2) revisit and build the evidence base needed to promote health equity and impact at multiple levels; (3) prioritize focus on policy development, dissemination, and implementation; (4) be agile and responsive in application of Implementation Science frameworks, processes, and methods; (5) identify and redefine meaningful metrics for equity and impact; (6) disseminate scientific evidence and research to a diverse range of partners and potential beneficiaries; and (7) extend focus on de-implementation, mis-implementation, and sustainability which are central to enhancing health equity. Additionally, we outline why a focus on prevention and public health is essential to making progress towards health equity in Implementation Science, summarize important advancements that the field has made towards making equity more foundational, and pose important research questions to enhance equitable impact of work in this area.

Mis-implementation of evidence-based behavioural health practices in primary care: lessons from randomised trials in Federally Qualified Health Centers

Background

Implementing evidence-based practices (EBPs) within service systems is critical to population-level health improvements - but also challenging, especially for complex behavioral health interventions in low-resource settings. "Mis-implementation" refers to poor outcomes from an EBP implementation effort; mis-implementation outcomes are an important, but largely untapped, source of information about how to improve knowledge exchange.

Aims and objectives

We present mis-implementation cases from three pragmatic trials of behavioral health EBPs in U.S. Federally Qualified Health Centers (FQHCs).

Methods

We adapted the Consolidated Framework for Implementation Research and its Outcomes Addendum into a framework for mis-implementation and used it to structure the case summaries with information about the EBP and trial, mis-implementation outcomes, and associated determinants (barriers and facilitators). We compared the three cases to identify shared and unique mis-implementation factors.

Findings

Across cases, there was limited adoption and fidelity to the interventions, which led to eventual discontinuation. Barriers contributing to mis-implementation included intervention complexity, low buy-in from overburdened providers, lack of alignment between providers and leadership, and COVID-19-related stressors. Mis-implementation occurred earlier in cases that experienced both patient- and provider-level barriers, and that were conducted during the COVID-19 pandemic.

Discussion and conclusion

Multi-level determinants contributed to EBP mis-implementation in FQHCs, limiting the ability of these health systems to benefit from knowledge exchange. To minimize mis-implementation, knowledge exchange strategies should be designed around common, core barriers but also flexible enough to address a variety of site-specific contextual factors and should be tailored to relevant audiences such as providers, patients, and/or leadership.

Behavioral Strategies in Diagnostic Stewardship

Diagnostic stewardship refers to the responsible and judicious use of diagnostic tests to reduce low value care and improve patient outcomes. This article provides an overview of behavioral strategies, their relevance to diagnostic stewardship and highlights behavioral determinants that drive diagnostic testing behavior, drawing on theoretic frameworks. Additionally, we provide concrete examples of evidence-based behavioral strategies for promoting appropriate diagnostic testing while acknowledging associated challenges. Finally, we highlight the significance of evaluating these strategies and provide an overview of evaluation frameworks and methods.

Advancing healthcare equity through dissemination and implementation science

OBJECTIVE

To provide guiding principles and recommendations for how approaches from the field of dissemination and implementation (D&I) science can advance healthcare equity.

DATA SOURCES AND STUDY SETTING

This article, part of a special issue sponsored by the Agency for Healthcare Research and Quality (AHRQ), is based on an outline drafted to support proceedings of the 2022 AHRQ Health Equity Summit and further revised to reflect input from Summit attendees.

STUDY DESIGN

This is a narrative review of the current and potential applications of D&I approaches for understanding and advancing healthcare equity, followed by discussion and feedback with Summit attendees.

DATA COLLECTION/EXTRACTION METHODS

We identified major themes in narrative and systematic reviews related to D&I science, healthcare equity, and their intersections. Based on our expertise, and supported by synthesis of published studies, we propose recommendations for how D&I science is relevant for advancing healthcare equity. We used iterative discussions internally and at the Summit to refine preliminary findings and recommendations.

PRINCIPAL FINDINGS

We identified four guiding principles and three D&I science domains with strong promise for accelerating progress toward healthcare equity. We present eight recommendations and more than 60 opportunities for action by practitioners, healthcare leaders, policy makers, and researchers.

CONCLUSIONS

Promising areas for D&I science to impact healthcare equity include the following: attention to equity in the development and delivery of evidence-based interventions; the science of adaptation; de-implementation of low-value care; monitoring equity markers; organizational policies for healthcare equity; improving the economic evaluation of implementation; policy and dissemination research; and capacity building.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol

BACKGROUND

More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment.

METHODS

We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies.

DISCUSSION

This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.

Revisiting the policy ecology framework for implementation of evidence-based practices in mental health settings

BACKGROUND

Over the past three decades, policy actors and actions have been highly influential in supporting the implementation of evidence-based practices (EBPs) in mental health settings. An early examination of these actions resulted in the Policy Ecology Framework (PEF), which was originally developed as a tactical primer for state and local mental health regulators in the field of child mental health. However, the policy landscape for implementation has evolved significantly since the original PEF was published. An interrogation of the strategies originally proposed in the PEF is necessary to provide an updated menu of strategies to improve our understanding of the mechanisms of policy action and promote system improvement.

OBJECTIVES

This paper builds upon the original PEF to address changes in the policy landscape for the implementation of mental health EBPs between 2009 and 2022. We review the current state of policy strategies that support the implementation of EBPs in mental health care and outline key areas for policy-oriented implementation research. Our review identifies policy strategies at federal, state, agency, and organizational levels, and highlights developments in the social context in which EBPs are implemented. Furthermore, our review is organized around some key changes that occurred across each PEF domain that span organizational, agency, political, and social contexts along with subdomains within each area.

DISCUSSION

We present an updated menu of policy strategies to support the implementation of EBPs in mental health settings. This updated menu of strategies considers the broad range of conceptual developments and changes in the policy landscape. These developments have occurred across the organizational, agency, political, and social contexts and are important for policymakers to consider in the context of supporting the implementation of EBPs. The updated PEF expands and enhances the specification of policy levers currently available, and identifies policy targets that are underdeveloped (e.g., de-implementation and sustainment) but are becoming visible opportunities for policy to support system improvement. The updated PEF clarifies current policy efforts within the field of implementation science in health to conceptualize and better operationalize the role of policy in the implementation of EBPs.

De-implementation of Low-Value Practices for Autism Spectrum Disorder

Due to a variety of factors, Autism Spectrum Disorder (ASD) has long been tethered to use of low-value practice (LVP), arguably moreso than any other psychiatric or neurodevelopmental condition. Although dissemination of empirically supported treatments (EST) for autistic individuals has expanded markedly over the past decade, there has not been concomitant reduction in the use of LVP. It is critical that clinicians and scientists not only promote the implementation of EST, but also facilitate the de-implementation (abandonment and/or divestment) of ineffective or harmful practices. In this review, we describe a data-driven approach that can be used to identify LVP, drawing from established criteria for identification of evidence-based treatments (e.g., APA Division 12, National Clearinghouse on Autism Evidence and Practice; SAMHSA), as well as broader considerations such as social validity, cost, and parsimony. Herein, a data-based approach to LVP identification is proposed with a goal of improving quality of service access. Within an implementation science framework, we identify specific facilitators that sustain LVP use, and recommendations for subsequent de-implementation strategies are offered.

Toward the Deimplementation of Computed Tomography Urogram for Patients With Low- to Intermediate-risk Microscopic Hematuria: A Mixed-method Study of Factors Influencing Continued Use

INTRODUCTION

Citing high costs, limited diagnostic benefit, and ionizing radiation-associated risk from CT urogram, in 2020 the AUA revised its guidelines from recommending CT urogram for all patients with microscopic hematuria to a deintensified risk-stratified approach, including the deimplementation of low-value CT urogram (ie, not recommending CT urogram for patients with low- to intermediate-risk microscopic hematuria). Adherence to revised guidelines and reasons for continued low-value CT urogram are unknown.

METHODS

With the overarching objective of improving guideline implementation, we used a mixed-method convergent explanatory design with electronic health record data for a retrospective cohort at a single academic tertiary medical center in the southeastern United States and semistructured interviews with urology and nonurology providers to describe determinants of low-value CT urogram following guideline revision.

RESULTS

Of 391 patients with microscopic hematuria, 198 (51%) had a low-value CT urogram (136 [69%] pre-guideline revision, 62 [31%] postrevision). The odds of ordering a low-value CT urogram were lower after guideline revisions, but the change was not statistically significant (OR: 0.44, P = .08); odds were 1.89 higher (P = .06) among nonurology providers than urology providers, but the difference was not statistically significant. Provider interviews suggested low-value CT urogram related to nonurology providers' limited awareness of revised guidelines, the role of clinical judgment in microscopic hematuria evaluation, and professional and patient influences.

CONCLUSIONS

Our findings suggest low-value CT urogram deimplementation may be improved with guidelines and implementation support directed at both urology and nonurology providers and algorithms to support guideline-concordant microscopic hematuria evaluation approaches. Future studies should test these strategies.

Testing Theory-Based Messages to Encourage Women at Average Risk for Breast Cancer to Consider Biennial Mammography Screening

BACKGROUND

The US Preventive Services Task Force does not recommend routine annual mammography screening for women aged 40-49 at average risk. Little research has been done to develop theory-based communication interventions to facilitate informed decision-making about reducing potentially low-value mammography screening.

PURPOSE

Evaluate the effects of theory-based persuasive messages on women's willingness to consider delaying screening mammography until age 50 or have mammograms biennially.

METHODS

We conducted a randomized controlled communication experiment online with a population-based sample of U.S. women aged 40-49 (N = 383) who screened to be at average risk for breast cancer. Women were randomly assigned to the following messaging summaries: annual mammography risks in 40s (Arm 1, n = 124), mammography risks plus family history-based genetic risk (Arm 2, n = 120), and mammography risks, genetic risk, and behavioral alternatives (Arm 3, n = 139). Willingness to delay screening or reduce screening frequency was assessed post-experiment by a set of 5-point Likert scale items.

RESULTS

Women in Arm 3 reported significantly greater willingness to delay screening mammography until age 50 (mean = 0.23, SD = 1.26) compared with those in Arm 1 (mean = -0.17, SD = 1.20; p = .04). There were no significant arm differences in willingness to reduce screening frequency. Exposure to the communication messages significantly shifted women's breast cancer-related risk perceptions without increasing unwarranted cancer worry across all three arms.

CONCLUSIONS

Providing women with screening information and options may help initiate challenging discussions with providers about potentially low-value screening.

The societal costs and health impacts on obesity of BMI report cards in US schools

OBJECTIVE

This study aimed to estimate the 10-year cost-effectiveness of school-based BMI report cards, a commonly implemented program for childhood obesity prevention in the US where student BMI is reported to parents/guardians by letter with nutrition and physical activity resources, for students in grades 3 to 7.

METHODS

A microsimulation model, using data inputs from evidence reviews on health impacts and costs, estimated: how many students would be reached if the 15 states currently measuring student BMI (but not reporting to parents/guardians) implemented BMI report cards from 2023 to 2032; how many cases of childhood obesity would be prevented; expected changes in childhood obesity prevalence; and costs to society.

RESULTS

BMI report cards were projected to reach 8.3 million children with overweight or obesity (95% uncertainty interval [UI]: 7.7-8.9 million) but were not projected to prevent any cases of childhood obesity or significantly decrease childhood obesity prevalence. Ten-year costs totaled $210 million (95% UI: $30.5-$408 million) or $3.33 per child per year with overweight or obesity (95% UI: $3.11-$3.68).

CONCLUSIONS

School-based BMI report cards are not cost-effective childhood obesity interventions. Deimplementation should be considered to free up resources for implementing effective programs.

Implementation research priorities for addressing the maternal health crisis in the USA: results from a modified Delphi study among researchers

BACKGROUND

Maternal health outcomes in the USA are far worse than in peer nations. Increasing implementation research in maternity care is critical to addressing quality gaps and unwarranted variations in care. Implementation research priorities have not yet been defined or well represented in the plans for maternal health research investments in the USA.

METHODS

This descriptive study used a modified Delphi method to solicit and rank research priorities at the intersection of implementation science and maternal health through two sequential web-based surveys. A purposeful, yet broad sample of researchers with relevant subject matter knowledge was identified through searches of published articles and grant databases. The surveys addressed five implementation research areas in maternal health: (1) practices to prioritize for broader implementation, (2) practices to prioritize for de-implementation, (3) research questions about implementation determinants, (4) research questions about implementation strategies, and (5) research questions about methods/measures.

RESULTS

Of 160 eligible researchers, 82 (51.2%) agreed to participate. Participants were predominantly female (90%) and White (75%). Sixty completed at least one of two surveys. The practices that participants prioritized for broader implementation were improved postpartum care, perinatal and postpartum mood disorder screening and management, and standardized management of hypertensive disorders of pregnancy. For de-implementation, practices believed to be most impactful if removed from or reduced in maternity care were cesarean delivery for low-risk patients and routine discontinuation of all psychiatric medications during pregnancy. The top methodological priorities of participants were improving the extent to which implementation science frameworks and measures address equity and developing approaches for involving patients in implementation research.

CONCLUSIONS

Through a web-based Delphi exercise, we identified implementation research priorities that researchers consider to have the greatest potential to improve the quality of maternity care in the USA. This study also demonstrates the feasibility of using modified Delphi approaches to engage researchers in setting implementation research priorities within a clinical area.

Evaluating the effectiveness of a multifaceted intervention to reduce low-value care in adults hospitalized following trauma: a protocol for a pragmatic cluster randomized controlled trial

BACKGROUND

While simple Audit & Feedback (A&F) has shown modest effectiveness in reducing low-value care, there is a knowledge gap on the effectiveness of multifaceted interventions to support de-implementation efforts. Given the need to make rapid decisions in a context of multiple diagnostic and therapeutic options, trauma is a high-risk setting for low-value care. Furthermore, trauma systems are a favorable setting for de-implementation interventions as they have quality improvement teams with medical leadership, routinely collected clinical data, and performance-linked to accreditation. We aim to evaluate the effectiveness of a multifaceted intervention for reducing low-value clinical practices in acute adult trauma care.

METHODS

We will conduct a pragmatic cluster randomized controlled trial (cRCT) embedded in a Canadian provincial quality assurance program. Level I-III trauma centers (n = 30) will be randomized (1:1) to receive simple A&F (control) or a multifaceted intervention (intervention). The intervention, developed using extensive background work and UK Medical Research Council guidelines, includes an A&F report, educational meetings, and facilitation visits. The primary outcome will be the use of low-value initial diagnostic imaging, assessed at the patient level using routinely collected trauma registry data. Secondary outcomes will be low-value specialist consultation, low-value repeat imaging after a patient transfer, unintended consequences, determinants for successful implementation, and incremental cost-effectiveness ratios.

DISCUSSION

On completion of the cRCT, if the intervention is effective and cost-effective, the multifaceted intervention will be integrated into trauma systems across Canada. Medium and long-term benefits may include a reduction in adverse events for patients and an increase in resource availability. The proposed intervention targets a problem identified by stakeholders, is based on extensive background work, was developed using a partnership approach, is low-cost, and is linked to accreditation. There will be no attrition, identification, or recruitment bias as the intervention is mandatory in line with trauma center designation requirements, and all outcomes will be assessed with routinely collected data. However, investigators cannot be blinded to group allocation and there is a possibility of contamination bias that will be minimized by conducting intervention refinement only with participants in the intervention arm.

TRIAL REGISTRATION

This protocol has been registered on ClinicalTrials.gov (February 24, 2023, # NCT05744154 ).

Not too fast, not too slow: A review of historical trends in vaginal breech time management

PROBLEM

A lack of consistent professional guidance on when to intervene during emergence (buttocks and anus visible at the introitus to birth of the head) in vaginal breech birth (VBB).

BACKGROUND

Hypoxia and asphyxia are common complications of VBB, especially due to umbilical cord compression around the time of emergence.

AIM

To gain insight into VBB time management trends, the evidence behind these practices and how they may have influenced outcomes.

METHODS

Literature review of obstetric textbooks published between 1960 and 2000 contained in the Wellcome Collection and Royal College of Obstetricians and Gynaecologists Library in London.

FINDINGS

90 textbooks were reviewed. Recommendations for 'safe' intervals between birth of the umbilicus and the head ranged from 5 to 20 min. Many sources focused only on the time required to deliver the head, with 'up to 10 min' being the most common interval described. The review found no mention of cord compression causing concern earlier in breech births than once the umbilicus itself is delivered, nor any evidence to support the recommendations.

DISCUSSION

These findings demonstrate a long-term pattern across the second half of the 20th century, whereby birth attendants were urged not to rush emergence nor delay intervention but were given little clear guidance on optimal timings.

CONCLUSION

Clear, evidence-based guidance should be provided in breech training materials to avoid unnecessary hypoxic injuries, and this guidance should be rigorously evaluated.

De-implementing public health policies: a qualitative study of the process of implementing and then removing body mass index (BMI) report cards in Massachusetts public schools

BACKGROUND

This study explored reasons for the adoption of a policy to distribute report cards to parents about children's weight status ("BMI report cards") in Massachusetts (MA) public schools in 2009 and the contextual factors influencing the policy removal in 2013.

METHODS

We conducted semi-structured, qualitative interviews with 15 key decision-makers and practitioners involved with implementing and de-implementing the MA BMI report card policy. We analyzed interview data using a thematic analytic approach guided by the Consolidated Framework for Implementation Research (CFIR) 2.0.

RESULTS

Primary themes were that (1) factors other than scientific evidence mattered more for policy adoption, (2) societal pressure spurred policy adoption, (3) problems with the policy design contributed to inconsistent implementation and dissatisfaction, and (4) media coverage, societal pressure, and organizational politics and pressure largely prompted de-implementation.

CONCLUSIONS

Numerous factors contributed to the de-implementation of the policy. An orderly process for the de-implementation of a policy in public health practice that manages drivers of de-implementation may not yet exist. Public health research should further focus on how to de-implement policy interventions when evidence is lacking or there is potential for harm.

To screen or not to screen: Are we asking the right question? In response to considering de-implementation of universal perinatal depression screening

This Editorial is a response to the Canadian Task Force on Preventive Health Care's recent recommendation "against instrument-based depression screening using a questionnaire with cut-off score to distinguish 'screen positive' and 'screen negative' administered to all individuals during pregnancy and the postpartum period (up to 1 year after childbirth)." While we acknowledge the gaps and limitations in research on perinatal mental health screening, we have concerns regarding the potential impact of a recommendation against screening and for "de-implementation" of existing perinatal depression screening practices, particularly if there is not careful attention to the specificity as well as limitations of the recommendation, or if there are not clear alternative systems put in place to support the detection of perinatal depression. In this manuscript, we highlight some of our key concerns and suggest considerations for perinatal mental health practitioners and researchers.

Using the Exploration, Preparation, Implementation, and Sustainment (EPIS) Framework to Advance the Science and Practice of Healthy Food Retail

Although healthy food retail strategies are widely used, there appears to be a limited understanding of the processes and determinants for successful adoption, implementation, and sustainment. To fill this gap, we recommend the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework to be used to advance the science and practice of healthy food retail. In this perspective, we: (1) introduce EPIS and describe why it was chosen as a recommended implementation science framework for healthy food retail, (2) highlight healthy food retail evidence supporting EPIS, and (3) discuss research and practice needs moving forward.

Beyond implementation: Uncovering the parallels between de-implementation and antimicrobial stewardship

De-implementation is defined as the process of discontinuing, removing, reducing, or replacing a harmful, ineffective, or low-value clinical practice or intervention. The goal of de-implementation strategies is to minimize patient harm, maximize use of resources, and reduce healthcare costs and inequities. Both antibiotic and diagnostic stewardship programs focus on reducing low-value interventions (tests or antimicrobials). Stewardship interventions commonly involve de-implementation and deprescribing strategies. This commentary explores unique aspects of deimplementing low-value testing and unnecessary antimicrobial use, similarities between de-implementation and stewardship approaches, multilevel factors that impact de-implementation, and opportunities for future research.

Development and psychometric evaluation of the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool: a study protocol

INTRODUCTION

The need for quantitative criteria to appraise the quality of implementation research has recently been highlighted to improve methodological rigour. The Implementation Science Research development (ImpRes) tool and supplementary guide provide methodological guidance and recommendations on how to design high-quality implementation research. This protocol reports on the development of the Implementation Science Research Project Appraisal Criteria (ImpResPAC) tool, a quantitative appraisal tool, developed based on the structure and content of the ImpRes tool and supplementary guide, to evaluate the conceptual and methodological quality of implementation research.

METHODS AND ANALYSIS

This study employs a three-stage sequential mixed-methods design. During stage 1, the research team will map core domains of the ImpRes tool, guidance and recommendations contained in the supplementary guide and within the literature, to ImpResPAC. In stage 2, an international multidisciplinary expert group, recruited through purposive sampling, will inform the refinement of ImpResPAC, including content, scoring system and user instructions. In stage 3, an extensive psychometric evaluation of ImpResPAC, that was created in stage 1 and refined in stage 2, will be conducted. The scaling assumptions (inter-item and item-total correlations), reliability (internal consistency, inter-rater) and validity (construct and convergent validity) will be investigated by applying ImpResPAC to 50 protocols published in Implementation Science. We envisage developing ImpResPAC in this way will provide implementation research stakeholders, primarily grant reviewers and educators, a comprehensive, transparent and fair appraisal of the conceptual and methodological quality of implementation research, increasing the likelihood of funding research that will generate knowledge and contribute to the advancement of the field.

ETHICS AND DISSEMINATION

This study will involve human participants. This study has been registered and minimal risk ethical clearance granted by The Research Ethics Office, King's College London (reference number MRA-20/21-20807). Participants will receive written information on the study via email and will provide e-consent if they wish to participate. We will use traditional academic modalities of dissemination (eg, conferences and publications).

Developing criteria for research translation decision-making in community settings: a systematic review and thematic analysis informed by the Knowledge to Action Framework and community input

Background

There is a pressing need to translate empirically supported interventions, products, and policies into practice to prevent and control prevalent chronic diseases. According to the Knowledge to Action (K2A) Framework, only those interventions deemed “ready” for translation are likely to be disseminated, adopted, implemented, and ultimately institutionalized. Yet, this pivotal step has not received adequate study. The purpose of this paper was to create a list of criteria that can be used by researchers, in collaboration with community partners, to help evaluate intervention readiness for translation into community and/or organizational settings.

Methods

The identification and selection of criteria involved reviewing the K2A Framework questions from the “decision to translate” stage, conducting a systematic review to identify characteristics important for research translation in community settings, using thematic analysis to select unique research translation decision criteria, and incorporating researcher and community advisory board feedback.

Results

The review identified 46 published articles that described potential criteria to decide if an intervention appears ready for translation into community settings. In total, 17 unique research translation decision criteria were identified. Of the 8 themes from the K2A Framework that were used to inform the thematic analysis, all 8 were included in the final criteria list after research supported their importance for research translation decision-making. Overall, the criteria identified through our review highlighted the importance of an intervention’s public health, cultural, and community relevance. Not only are intervention characteristics (e.g., evidence base, comparative effectiveness, acceptability, adaptability, sustainability, cost) necessary to consider when contemplating introducing an intervention to the “real world,” it is also important to consider characteristics of the target setting and/or population (e.g., presence of supporting structure, support or buy-in, changing sociopolitical landscape).

Conclusions

Our research translation decision criteria provide a holistic list for identifying important barriers and facilitators for research translation that should be considered before introducing an empirically supported intervention into community settings. These criteria can be used for research translation decision-making on the individual and organizational level to ensure resources are not wasted on interventions that cannot be effectively translated in community settings to yield desired outcomes.

Applying concepts from "rapid" and "agile" implementation to advance implementation research

Background

The translation of research findings into practice can be improved to maximize benefits more quickly and with greater flexibility. To expedite translation, researchers have developed innovative approaches to implementation branded as “rapid” and “agile” implementation. Rapid implementation has roots in precision medicine and agile implementation has roots in systems engineering and software design. Research has shown that innovation often derives from learning and applying ideas that have impacted other fields.

Implications for implementation researchers

This commentary examines “rapid” and “agile” approaches to implementation and provides recommendations to implementation researchers stemming from these approaches. Four key ideas are synthesized that may be broadly applicable to implementation research, including (1) adopting a problem orientation, (2) applying lessons from behavioral economics, (3) using adaptive study designs and adaptive interventions, and (4) using multi-level models to guide implementation. Examples are highlighted from the field where researchers are applying these key ideas to illustrate their potential impact.

Conclusions

“Rapid” and “agile” implementation approaches to implementation stem from diverse fields. Elements of these approaches show potential for advancing implementation research, although adopting them may entail shifting scientific norms in the field.

Acceptability of Deimplementing High-Flow Nasal Cannula in Pediatric Bronchiolitis

BACKGROUND AND OBJECTIVES

High-flow nasal cannula (HFNC) in children hospitalized with bronchiolitis does not significantly improve clinical outcomes but can increase costs and intensive care unit use. Given widespread HFNC use, it is imperative to reduce use. However, there is limited information on key factors that affect deimplementation. To explore acceptability of HFNC deimplementation, perceptions of HFNC benefits, and identify barriers and facilitators to deimplementation.

METHODS

We conducted a study of health care providers that included quantitative survey data supplemented by semistructured interviews. Data were analyzed using univariate tests and thematic content analysis.

RESULTS

A total of 152 (39%) providers completed the survey; 9 participated in interviews. Eighty-three (55%) providers reported feeling positively about deimplementing HFNC. Reports of feeling positively increased as perceived familiarity with evidence increased (P = .04). Physicians were more likely than nurses and respiratory therapists to report feeling positively (P = .003). Hospital setting and years of clinical experience were not associated with feeling positively (P = .98 and .55, respectively). One hundred (66%) providers attributed nonevidence-based clinical benefits to HFNC. Barriers to deimplementation included discomfort with not intervening, perception that HFNC helps, and variation in risk tolerance and clinical experience. Facilitators promoting deimplementation include staff education, a culture of safely doing less, and enhanced multidisciplinary communication.

CONCLUSIONS

Deimplementation of HFNC in children with bronchiolitis is acceptable among providers. Hospital leaders should educate staff, create a culture for safely doing less, and enhance multidisciplinary communication to facilitate deimplementation.

De-Implementation of Detrimental Feeding Practices in Childcare: Mixed Methods Evaluation of Community Partner Selected Strategies

This pilot evaluated strategies to decrease detrimental feeding practices in early care and education, which are hypothesized to compete with evidence-based feeding and obesity prevention practices. This study made two key comparisons: (1) a between-site comparison of sites receiving (a) no implementation or de-implementation strategies (i.e., Basic Support; B), (b) implementation strategies only (i.e., Enhanced Support; E), and (c) implementation and de-implementation strategies (i.e., De-implementation + Enhanced Support; D + E) and (2) a within-site pre-post comparison among sites with D + E. At nutrition lessons, the D + E group had more Positive Comments (Hedege’s g = 0.60) and higher Role Model fidelity (Hedege’s g = 1.34) compared to the E group. At meals, assistant teachers in the D + E group had higher Positive Comments than in the B group (g = 0.72). For within-group comparisons, the D + E group decreased Negative Comments (t(19) = 2.842, p = 0.01), increased Positive Comments (t(20) = 2.314, p = 0.031), and improved use of the program mascot at nutrition lessons (t(21) = 3.899, p = 0.001). At meals, lead teachers’ Negative Comments decreased (t(22) = 2.73, p = 0.01). Qualitative data identified strengths and opportunities for iteration. Despite a COVID interruption, mid-point comparisons and qualitative feedback suggest promise of the de-implementation strategy package.

Early intervention service systems for youth mental health: integrating pluripotentiality, clinical staging, and transdiagnostic lessons from early psychosis

Challenges associated with operationalising services for the at-risk mental state for psychosis solely in that same diagnostic silo are increasingly well recognised-namely, the differential risk for psychosis being a function of sampling enrichment strategies, declining transition rates to psychosis, questions regarding the validity of transition as an outcome, and the frequent development of non-psychotic disorders. However, recent epidemiological and clinical research suggests that not all threshold-level psychoses are likely to occur homotypically; early-stage non-psychotic syndromes might exhibit heterotypic shifts to a first episode of psychosis, without an identifiable at-risk mental state. These findings, along with the relevance of outcomes beyond traditional diagnoses or syndromes, have substantive implications for developing next-generation early intervention infrastructures. Along with the idea of general at-risk clinics for early-stage pluripotential syndromes, we examine how this reality might affect service design, such as the need for close linkage with centres of expertise for threshold-level disorders when transitions to later stages occur, the balance between generic and specific interventions amid the need for person-centred care, and the challenges this reorientation might pose for broader mental health systems.

Policy Makers' Priorities for Addressing Youth Substance Use and Factors That Influence Priorities

OBJECTIVE

Understanding public policy makers' priorities for addressing youth substance use and the factors that influence these priorities can inform the dissemination and implementation of strategies that promote evidence-based decision making. This study characterized the priorities of policy makers in substance use agencies of U.S. states and counties for addressing youth substance use, the factors that influenced these priorities, and the differences in priorities and influences between state and county policy makers.

METHODS

In 2020, a total of 122 substance use agency policy makers from 35 states completed a Web-based survey (response rate=22%). Respondents rated the priority of 14 issues related to youth substance use and the extent to which nine factors influenced these priorities. Data were analyzed as dichotomous and continuous variables and for state and county policy makers together and separately.

RESULTS

The highest priorities for youth substance use were social determinants of substance use (87%), adverse childhood experiences and childhood trauma (85%), and increasing access to school-based substance use programs (82%). The lowest priorities were increasing access to naloxone for youths (49%), increasing access to medications for opioid use disorder among youths (49%), and deimplementing non-evidence-based youth substance use programs (41%). The factors that most influenced priorities were budget issues (80%) and state legislature (69%), federal (67%), and governor priorities (65%). Issues related to program implementation and deimplementation were significantly higher priorities for state than for county policy makers.

CONCLUSIONS

These findings can inform the tailoring of dissemination and implementation strategies to account for the inner- and outer-setting contexts of substance use agencies.

De-implementing low-value care in cancer care delivery: a systematic review

BACKGROUND

Accumulating evidence suggests that interventions to de-implement low-value services are urgently needed. While medical societies and educational campaigns such as Choosing Wisely have developed several guidelines and recommendations pertaining to low-value care, little is known about interventions that exist to de-implement low-value care in oncology settings. We conducted this review to summarize the literature on interventions to de-implement low-value care in oncology settings.

METHODS

We systematically reviewed the published literature in PubMed, Embase, CINAHL Plus, and Scopus from 1 January 1990 to 4 March 2021. We screened the retrieved abstracts for eligibility against inclusion criteria and conducted a full-text review of all eligible studies on de-implementation interventions in cancer care delivery. We used the framework analysis approach to summarize included studies' key characteristics including design, type of cancer, outcome(s), objective(s), de-implementation interventions description, and determinants of the de-implementation interventions. To extract the data, pairs of authors placed text from included articles into the appropriate cells within our framework. We analyzed extracted data from each cell to describe the studies and findings of de-implementation interventions aiming to reduce low-value cancer care.

RESULTS

Out of 2794 studies, 12 met our inclusion criteria. The studies covered several cancer types, including prostate cancer (n = 5), gastrointestinal cancer (n = 3), lung cancer (n = 2), breast cancer (n = 2), and hematologic cancers (n = 1). Most of the interventions (n = 10) were multifaceted. Auditing and providing feedback, having a clinical champion, educating clinicians through developing and disseminating new guidelines, and developing a decision support tool are the common components of the de-implementation interventions. Six of the de-implementation interventions were effective in reducing low-value care, five studies reported mixed results, and one study showed no difference across intervention arms. Eleven studies aimed to de-implement low-value care by changing providers' behavior, and 1 de-implementation intervention focused on changing the patients' behavior. Three studies had little risk of bias, five had moderate, and four had a high risk of bias.

CONCLUSIONS

This review demonstrated a paucity of evidence in many areas of the de-implementation of low-value care including lack of studies in active de-implementation (i.e., healthcare organizations initiating de-implementation interventions purposefully aimed at reducing low-value care).

"It's good to feel like you're doing something": a qualitative study examining state health department employees' views on why ineffective programs continue to be implemented in the USA

Background

Mis-implementation, the inappropriate continuation of programs or policies that are not evidence-based or the inappropriate termination of evidence-based programs and policies, can lead to the inefficient use of scarce resources in public health agencies and decrease the ability of these agencies to deliver effective programs and improve population health. Little is known about why mis-implementation occurs, which is needed to understand how to address it. This study sought to understand the state health department practitioners’ perspectives about what makes programs ineffective and the reasons why ineffective programs continue.

Methods

Eight state health departments (SHDs) were selected to participate in telephone-administered qualitative interviews about decision-making around ending or continuing programs. States were selected based on geographic representation and on their level of mis-implementation (low and high) categorized from our previous national survey. Forty-four SHD chronic disease staff participated in interviews, which were audio-recorded and transcribed verbatim. Transcripts were consensus coded, and themes were identified and summarized. This paper presents two sets of themes, related to (1) what makes a program ineffective and (2) why ineffective programs continue to be implemented according to SHD staff.

Results

Participants considered programs ineffective if they were not evidence-based or if they did not fit well within the population; could not be implemented well due to program restraints or a lack of staff time and resources; did not reach those who could most benefit from the program; or did not show the expected program outcomes through evaluation. Practitioners described several reasons why ineffective programs continued to be implemented, including concerns about damaging the relationships with partner organizations, the presence of program champions, agency capacity, and funding restrictions.

Conclusions

The continued implementation of ineffective programs occurs due to a number of interrelated organizational, relational, human resources, and economic factors. Efforts should focus on preventing mis-implementation since it limits public health agencies’ ability to conduct evidence-based public health, implement evidence-based programs effectively, and reduce the high burden of chronic diseases. The use of evidence-based decision-making in public health agencies and supporting adaptation of programs to improve their fit may prevent mis-implementation. Future work should identify effective strategies to reduce mis-implementation, which can optimize public health practice and improve population health.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00252-4.

Challenges to sustainability of pediatric early warning systems (PEWS) in low-resource hospitals in Latin America

Background

Sustainability, or continued use of evidence-based interventions for long-term patient benefit, is the least studied aspect of implementation science. In this study, we evaluate sustainability of a Pediatric Early Warning System (PEWS), an evidence-based intervention to improve early identification of clinical deterioration in hospitalized children, in low-resource settings using the Clinical Capacity for Sustainability Framework (CCS).

Methods

We conducted a secondary analysis of a qualitative study to identify barriers and enablers to PEWS implementation. Semi-structured interviews with PEWS implementation leaders and hospital directors at 5 Latin American pediatric oncology centers sustaining PEWS were conducted virtually in Spanish from June to August 2020. Interviews were recorded, professionally transcribed, and translated into English. Exploratory thematic content analysis yielded staff perceptions on PEWS sustainability. Coded segments were analyzed to identify participant perception about the current state and importance of sustaining PEWS, as well as sustainability successes and challenges. Identified sustainability determinants were mapped to the CCS to evaluate its applicability.

Results

We interviewed 71 staff including physicians (45%), nurses (45%), and administrators (10%). Participants emphasized the importance of sustaining PEWS for continued patient benefits. Identified sustainability determinants included supportive leadership encouraging ongoing interest in PEWS, beneficial patient outcomes enhancing perceived value of PEWS, integrating PEWS into the routine of patient care, ongoing staff turnover creating training challenges, adequate material resources to promote PEWS use, and the COVID-19 pandemic. While most identified factors mapped to the CCS, COVID-19 emerged as an additional external sustainability challenge. Together, these challenges resulted in multiple impacts on PEWS sustainment, ranging from a small reduction in PEWS quality to complete disruption of PEWS use and subsequent loss of benefits to patients. Participants described several innovative strategies to address identified challenges and promote PEWS sustainability.

Conclusion

This study describes clinician perspectives on sustainable implementation of evidence-based interventions in low-resource settings, including sustainability determinants and potential sustainability strategies. Identified factors mapped well to the CCS, however, external factors, such as the COVID pandemic, may additionally impact sustainability. This work highlights an urgent need for theoretically-driven, empirically-informed strategies to support sustainable implementation of evidence-based interventions in settings of all resource-levels.

A scoping review of de-implementation frameworks and models

BACKGROUND

Reduction or elimination of inappropriate, ineffective, or potentially harmful healthcare services and public health programs can help to ensure limited resources are used effectively. Frameworks and models (FM) are valuable tools in conceptualizing and guiding the study of de-implementation. This scoping review sought to identify and characterize FM that can be used to study de-implementation as a phenomenon and identify gaps in the literature to inform future model development and application for research.

METHODS

We searched nine databases and eleven journals from a broad array of disciplines (e.g., healthcare, public health, public policy) for de-implementation studies published between 1990 and June 2020. Two raters independently screened titles and abstracts, and then a pair of raters screened all full text records. We extracted information related to setting, discipline, study design, methodology, and FM characteristics from included studies.

RESULTS

The final search yielded 1860 records, from which we screened 126 full text records. We extracted data from 27 articles containing 27 unique FM. Most FM (n = 21) were applicable to two or more levels of the Socio-Ecological Framework, and most commonly assessed constructs were at the organization level (n = 18). Most FM (n = 18) depicted a linear relationship between constructs, few depicted a more complex structure, such as a nested or cyclical relationship. Thirteen studies applied FM in empirical investigations of de-implementation, while 14 articles were commentary or review papers that included FM.

CONCLUSION

De-implementation is a process studied in a broad array of disciplines, yet implementation science has thus far been limited in the integration of learnings from other fields. This review offers an overview of visual representations of FM that implementation researchers and practitioners can use to inform their work. Additional work is needed to test and refine existing FM and to determine the extent to which FM developed in one setting or for a particular topic can be applied to other contexts. Given the extensive availability of FM in implementation science, we suggest researchers build from existing FM rather than recreating novel FM.

REGISTRATION

Not registered.

Evidence-Based Policymaking: What Human Service Agencies Can Learn from Implementation Science and Integrated Data Systems

The evidence-based policymaking movement compels government leaders and agencies to rely on the best available research evidence to inform policy and program decisions, yet how to do this effectively remains a challenge. This paper demonstrates how the core concepts from two emerging fields-Implementation Science (IS) and Integrated Data Systems (IDS)-can help human service agencies and their partners realize the aims of the evidence-based policymaking movement. An IS lens can help agencies address the role of context when implementing evidence-based practices, complement other quality and process improvement efforts, simultaneously study implementation and effectiveness outcomes, and guide de-implementation of ineffective policies. The IDS approach offers governance frameworks to support ethical and legal data use, provides high-quality administrative data for in-house analyses, and allows for more time-sensitive analyses of pressing agency needs. Ultimately, IS and IDS can support human service agencies in more efficiently using government resources to deliver the best available programs and policies to the communities they serve. Although this paper focuses on examples within the United States context, key concepts and guidance are intended to be broadly applicable across geographies, given that IS, IDS, and the evidence-based policymaking movement are globally relevant.

A Health Systems Ethical Framework for De-implementation in Health Care

INTRODUCTION

Unnecessary health care not only drive up costs, but also contribute to avoidable patient harms, underscoring an ethical obligation to eliminate practices which are harmful, lack evidence, and prevent spending on more beneficial services. To date, de-implementation ethics discussions have been limited and focused on clinical ethics principles. An analysis of de-implementation ethics in the broader context of the health care system is lacking.

METHODS

To better understand the ethical considerations of de-implementation, recognizing it as a health care systems issue, we applied Krubiner and Hyder's bioethical framework for health systems activity. We examine ethics principles relevant to de-implementation, which either call for or facilitate the reduction of low value surgery.

RESULTS AND DISCUSSION

From 11 health systems principles proposed by Krubiner and Hyder, we identified the 5 principles most pertinent to the topic of de-implementation: evidence and effectiveness, transparency and public engagement, efficiency, responsiveness, and collaboration. An analysis of de-implementation through the lens of these principles not only supports de-implementation but proves an obligation at the health system level to eliminate low value care. Recognizing the challenge of defining "value," the proposed framework may increase the legitimacy and objectivity of de-implementation.

CONCLUSIONS

While there is no single ideal ethical framework from which to approach de-implementation, a health systems framework allows for consideration of the systems-level factors impacting de-implementation. Framing de-implementation as a health systems issue with systems-wide ethical implications empowers providers to think about new ways to approach potential roadblocks to reducing low-value care.

Reliability and validity of a Spanish-language measure assessing clinical capacity to sustain Paediatric Early Warning Systems (PEWS) in resource-limited hospitals

BACKGROUND

Paediatric Early Warning Systems (PEWSs) improve identification of deterioration, however, their sustainability has not been studied. Sustainability is critical to maximise impact of interventions like PEWS, particularly in low-resource settings. This study establishes the reliability and validity of a Spanish-language Clinical Sustainability Assessment Tool (CSAT) to assess clinical capacity to sustain interventions in resource-limited hospitals.

METHODS

Participants included PEWS implementation leadership teams of 29 paediatric cancer centres in Latin America involved in a collaborative to implement PEWS. The CSAT, a sustainability assessment tool validated in high-resource settings, was translated into Spanish and distributed to participants as an anonymous electronic survey. Psychometric, confirmatory factor analysis (CFA), and multivariate analyses were preformed to assess reliability, structure and initial validity. Focus groups were conducted after participants reviewed CSAT reports to assess their interpretation and utility.

RESULTS

The CSAT survey achieved an 80% response rate (n=169) with a mean score of 4.4 (of 5; 3.8-4.8 among centres). The CSAT had good reliability with an average internal consistency of 0.77 (95% CI 0.71 to 0.81); and CFAs supported the seven-domain structure. CSAT results were associated with respondents' perceptions of the evidence for PEWS, its implementation and use in their centre, and their assessment of the hospital culture and implementation climate. The mean CSAT score was higher among respondents at centres with longer time using PEWS (p<0.001). Focus group participants noted the CSAT report helped assess their centre's clinical capacity to sustain PEWS and provided constructive feedback for improvement.

CONCLUSIONS

We present information supporting the reliability and validity of the CSAT tool, the first Spanish-language instrument to assess clinical capacity to sustain evidence-based interventions in hospitals of variable resource levels. This assessment demonstrates a high capacity to sustain PEWS in these resource-limited centres with improvement over time from PEWS implementation.

De-implementation and substitution of clinical care processes: stakeholder perspectives on the transition to primary human papillomavirus (HPV) testing for cervical cancer screening

Background

New cervical cancer screening guidelines recommend primary human papillomavirus (HPV) testing for women age 30–65 years. Healthcare organizations are preparing to de-implement the previous recommended strategies of Pap testing or co-testing (Pap plus HPV test) and substitute primary HPV testing. However, there may be significant challenges to the replacement of this entrenched clinical practice, even with an evidence-based substitution. We sought to identify stakeholder-perceived barriers and facilitators to this substitution within a large healthcare system, Kaiser Permanente Southern California.

Methods

We conducted semi-structured qualitative interviews with clinician, administrative, and patient stakeholders regarding (a) acceptability and feasibility of the planned substitution; (b) perceptions of barriers and facilitators, with an emphasis on those related to the de-implementation/implementation cycle of substitution; and (c) perceived readiness to change. Our interview guide was informed by the Consolidated Framework for Implementation Research (CFIR). Using a team coding approach, we developed an initial coding structure refined during iterative analysis; the data were subsequently organized thematically into domains, key themes, and sub-themes using thematic analysis, followed by framework analysis informed by CFIR.

Results

We conducted 23 interviews: 5 patient and 18 clinical/administrative. Clinicians perceived that patients feel more tests equals better care, and clinicians and patients expressed fear of missed cancers (“…it’ll be more challenging convincing the patient that only one test is…good enough to detect cancer.”). Patients perceived practice changes resulting in “less care” are driven by the desire to cut costs. In contrast, clinicians/administrators viewed changing from two tests to one as acceptable and a workflow efficiency (“…It’s very easy and half the work.”). Stakeholder-recommended strategies included focusing on the increased efficacy of primary HPV testing and developing clinician talking points incorporating national guidelines to assuage “cost-cutting” fears.

Conclusions

Substitution to replace an entrenched clinical practice is complex. Leveraging available facilitators is key to ease the process for clinical and administrative stakeholders—e.g., emphasizing the efficiency of going from two tests to one. Identifying and addressing clinician and patient fears regarding cost-cutting and perceived poorer quality of care is critical for substitution. Multicomponent and multilevel strategies for engagement and education will be required.

Trial registration

ClinicalTrials.gov, #NCT04371887

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00211-z.

Dissemination and Implementation Science in Cardiothoracic Surgery: A Review and Case Study

Dissemination and implementation (D&I) science is the practice of taking evidence-based interventions (EBI) and sustainably incorporating them in routine clinical practice. As a relatively young field, D&I techniques are underutilized in cardiothoracic surgery. This review offers an overview of D&I science from the context of the cardiothoracic surgeon. First, we provide a general introduction to D&I science and basic terminology that is used in the field. Second, to illustrate D&I techniques in a real-world example, we discuss a case study for implementing lung protective management (LPM) strategies for lung donor optimization nationally. Finally, we discuss challenges to successful implementation that are unique to cardiothoracic surgery and give several examples of EBIs that have been poorly implemented into surgical practice. We also provide examples of successful D&I interventions - including de-implementation strategies - from other surgical subspecialties. We hope that this review offers additional tools for cardiothoracic surgeons to explore when introducing EBIs into routine practice.

Approaches for Ending Ineffective Programs: Strategies From State Public Health Practitioners

Background: Public health agencies are increasingly concerned with ensuring they are maximizing limited resources by delivering evidence-based programs to enhance population-level chronic disease outcomes. Yet, there is little guidance on how to end ineffective programs that continue in communities. The purpose of this analysis is to identify what strategies public health practitioners perceive to be effective in de-implementing, or reducing the use of, ineffective programs. Methods: From March to July 2019, eight states were selected to participate in qualitative interviews from our previous national survey of US state health department (SHD) chronic disease practitioners on program decision making. This analysis examined responses to a question about "…advice for others who want to end an ineffective program." Forty-five SHD employees were interviewed via phone. Interviews were audio-recorded, and the conversations were transcribed verbatim. All transcripts were consensus coded, and themes were identified and summarized. Results: Participants were program managers or section directors who had on average worked 11 years at their agency and 15 years in public health. SHD employees provided several strategies they perceived as effective for de-implementation. The major themes were: (1) collect and rely on evaluation data; (2) consider if any of the programs can be saved; (3) transparently communicate and discuss program adjustments; (4) be tactful and respectful of partner relationships; (5) communicate in a way that is meaningful to your audience. Conclusions: This analysis provides insight into how experienced SHD practitioners recommend ending ineffective programs which may be useful for others working at public health agencies. As de-implementation research is limited in public health settings, this work provides a guiding point for future researchers to systematically assess these strategies and their effects on public health programming.

De-implementing low-value care in endocrinology

Low-value care exposes patients to ineffective, costly, and potentially harmful care. In endocrinology, low-value care practices are common in the care of patients with highly prevalent conditions. There is an urgent need to move past the identification of these practices to an active process of de-implementation. However, clinicians, researchers, and other stakeholders might lack familiarity with the frameworks and processes that can help guide successful de-implementation. To address this gap and support the de-implementation of low-value care, we provide a summary of low-value care practices in endocrinology and a primer on the fundamentals of de-implementation science. Our goal is to increase awareness of low-value care within endocrinology and suggest a path forward for addressing low-value care using principles of de-implementation science.

Dissemination and Implementation Science in Plastic and Reconstructive Surgery: Perfecting, Protecting, and Promoting the Innovation That Defines Our Specialty

SUMMARY

Plastic and reconstructive surgery has an illustrious history of innovation. The advancement, if not the survival, of the specialty depends on the continual development and improvement of procedures, practices, and technologies. It follows that the safe adoption of innovation into clinical practice is also paramount. Traditionally, adoption has relied on the diffusion of new knowledge, which is a consistent but slow and passive process. The emerging field of dissemination and implementation science promises to expedite the spread and adoption of evidence-based interventions into clinical practice. The field is increasingly recognized as an important function of academia and is a growing priority for major health-related funding institutions. The authors discuss the contemporary challenges of the safe implementation and dissemination of new innovations in plastic and reconstructive surgery, and call on their colleagues to engage in this growing field of dissemination and implementation science.

Leveraging implementation science to increase the translation of deprescribing evidence into practice

Implementation science may address some of the limitations that impede the translation of deprescribing recommendations into practice and policy. Application of principles and standard terminologies from implementation science could improve understanding and interpretation of deprescribing research findings. As such, in this commentary we propose three main avenues to help achieve this. These include: The application of these concepts derived from implementation science could help inform future deprescribing needs for clinicians and researchers. Ultimately, this could help ensure the quality use of medications and examination of meaningful outcomes in deprescribing studies. This could result in more consistent and widespread translation of deprescribing evidence into practice and policy across various healthcare settings.

Persistence of inefficient HIV prevention interventions: a mixed-method analysis of the reasons why

Growing evidence suggests that public health organizations continue to provide inefficient interventions even when better intervention options may be available. Factors informing an organization's decision to continue providing inefficient interventions are unclear. We present an analysis of HIV service organizations to understand factors influencing organizations to continue or end interventions. Between 2017 and 2019, HIV service organizations were recruited from the Center for Disease Control and Prevention's (CDC) website gettested.org, in the 20 metropolitan areas with the highest HIV incidence. Organizations were eligible to participate if they had provided at least one of 37 HIV prevention interventions identified as inefficient by the CDC. 877 organizations were recruited, with a response rate of 66%, (n = 578). Thirty-eight percent (n = 213) of organizations met the eligibility criteria, and 188 organizations completed the survey asking about reasons for continuing or ending interventions. Funding status (41%, n = 79) and client demand for interventions (60%, n = 116) were reported as the primary driving factors why organizations continued ineffective interventions. Scientific evidence was a rarely reported reason for ending an inefficient intervention (12%, n = 23). Qualitative responses indicated interventions were continued if clients demanded interventions they found useful or if staff perceived interventions as improving client behavior and health outcomes. Conversely, interventions were ended if client demand or retention was low, not relevant to the target population or funding ended. The decision to continue or end inefficient interventions is influenced by a number of factors-most often by funding and client interest but not scientific evidence.

A cluster randomized stepped-wedge trial to de-implement unnecessary post-operative antibiotics in children: the optimizing perioperative antibiotic in children (OPerAtiC) trial

BACKGROUND

Antibiotic-resistant infections have become a public health crisis that is driven by the inappropriate use of antibiotics. In the USA, antibiotic stewardship programs (ASP) have been established and are required by regulatory agencies to help combat the problem of antibiotic resistance. Post-operative antibiotic use in surgical cases deemed low-risk for infection is an area with significant overuse of antibiotics in children. Consensus among leading public health organizations has led to guidelines eliminating post-operative antibiotics in low-risk surgeries. However, the best strategies to de-implement these inappropriate antibiotics in this setting are unknown.

METHODS/DESIGN

A 3-year stepped wedge cluster randomized trial will be conducted at nine US Children's Hospitals to assess the impact of two de-implementation strategies, order set change and facilitation training, on inappropriate post-operative antibiotic prescribing in low risk (i.e., clean and clean-contaminated) surgical cases. The facilitation training will amplify order set changes and will involve a 2-day workshop with antibiotic stewardship teams. This training will be led by an implementation scientist expert (VRM) and a pediatric infectious diseases physician with antibiotic stewardship expertise (JGN). The primary clinical outcome will be the percentage of surgical cases receiving unnecessary post-operative antibiotics. Secondary clinical outcomes will include the rate of surgical site infections and the rate of Clostridioides difficile infections, a common negative consequence of antibiotic use. Monthly semi-structured interviews at each hospital will assess the implementation process of the two strategies. The primary implementation outcome is penetration, which will be defined as the number of order sets changed or developed by each hospital during the study. Additional implementation outcomes will include the ASP team members' assessment of the acceptability, appropriateness, and feasibility of each strategy while they are being implemented.

DISCUSSION

This study will provide important information on the impact of two potential strategies to de-implement unnecessary post-operative antibiotic use in children while assessing important clinical outcomes. As more unnecessary medical practices are identified, de-implementation strategies, including facilitation, need to be rigorously evaluated. Along with this study, other rigorously designed studies evaluating additional strategies are needed to further advance the burgeoning field of de-implementation.

TRIAL REGISTRATION

NCT04366440. Registered April 28, 2020, https://clinicaltrials.gov/ct2/show/NCT04366440 .

Theory and practical guidance for effective de-implementation of practices across health and care services: a realist synthesis

Background

Health-care systems across the globe are facing increased pressures to balance the efficient use of resources and at the same time provide high-quality care. There is greater requirement for services to be evidence based, but practices that are of limited clinical effectiveness or cost-effectiveness still occur.

Objectives

Our objectives included completing a concept analysis of de-implementation, surfacing decision-making processes associated with de-implementing through stakeholder engagement, and generating an evidence-based realist programme theory of ‘what works’ in de-implementation.

Design

A realist synthesis was conducted using an iterative stakeholder-driven four-stage approach. Phase 1 involved scoping the literature and conducting stakeholder interviews to develop the concept analysis and an initial programme theory. In Phase 2, systematic searches of the evidence were conducted to test and develop this theory, expressed in the form of contingent relationships. These are expressed as context–mechanism–outcomes to show how particular contexts or conditions trigger mechanisms to generate outcomes. Phase 3 consisted of validation and refinement of programme theories through stakeholder interviews. The final phase (i.e. Phase 4) formulated actionable recommendations for service leaders.

Participants

In total, 31 stakeholders (i.e. user/patient representatives, clinical managers, commissioners) took part in focus groups and telephone interviews.

Data sources

Using keywords identified during the scoping work and concept analysis, searches of bibliographic databases were conducted in May 2018. The databases searched were the Cochrane Library, Campbell Collaboration, MEDLINE (via EBSCOhost), the Cumulative Index to Nursing and Allied Health Literature (via EBSCOhost), the National Institute for Health Research Journals Library and the following databases via the ProQuest platform: Applied Social Sciences Index and Abstracts, Social Services Abstracts, International Bibliography of the Social Sciences, Social Sciences Database and Sociological Abstracts. Alerts were set up for the MEDLINE database from May 2018 to December 2018. Online sources were searched for grey literature and snowballing techniques were used to identify clusters of evidence.

Results

The concept analysis showed that de-implementation is associated with five main components in context and over time: (1) what is being de-implemented, (2) the issues driving de-implementation, (3) the action characterising de-implementation, (4) the extent that de-implementation is planned or opportunistic and (5) the consequences of de-implementation. Forty-two papers were synthesised to identify six context–mechanism–outcome configurations, which focused on issues ranging from individual behaviours to organisational procedures. Current systems can perpetuate habitual decision-making practices that include low-value treatments. Electronic health records can be designed to hide or remove low-value treatments from choice options, foregrounding best evidence. Professionals can be made aware of their decision-making strategies through increasing their attention to low-value practice behaviours. Uncertainty about diagnosis or patients’ expectations for certain treatments provide opportunities for ‘watchful waiting’ as an active strategy to reduce inappropriate investigations and prescribing. The emotional component of clinician–patient relationships can limit opportunities for de-implementation, requiring professional support through multimodal educational interventions. Sufficient alignment between policy, public and professional perspectives is required for de-implementation success.

Limitations

Some specific clinical issues (e.g. de-prescribing) dominate the de-implementation evidence base, which may limit the transferability of the synthesis findings. Any realist inquiry generates findings that are essentially cumulative and should be developed through further investigation that extends the range of sources into, for example, clinical research and further empirical studies.

Conclusions

This review contributes to our understanding of how de-implementation of low-value procedures and services can be improved within health-care services, through interventions that make professional decision-making more accountable and the prominence of a whole-system approach to de-implementation. Given the whole-system context of de-implementation, a range of different dissemination strategies will be required to engage with different stakeholders, in different ways, to change practice and policy in a timely manner.

Study registration

This study is registered as PROSPERO CRD42017081030.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 2. See the NIHR Journals Library website for further project information.

Barriers and Facilitators to Guideline-Adherent Pulse Oximetry Use in Bronchiolitis

OBJECTIVE

Continuous pulse oximetry monitoring (cSpO2) in children with bronchiolitis does not improve clinical outcomes and has been associated with increased resource use and alarm fatigue. It is critical to understand the factors that contribute to cSpO2 overuse in order to reduce overuse and its associated harms.

METHODS

This multicenter qualitative study took place in the context of the Eliminating Monitor Overuse (EMO) SpO2 study, a cross-sectional study to establish rates of cSpO2 in bronchiolitis. We conducted semistructured interviews, informed by the Consolidated Framework for Implementation Research, with a purposive sample of stakeholders at sites with high and low cSpO2 use rates to identify barriers and facilitators to addressing cSpO2 overuse. Interviews were audio recorded and transcribed. Analyses were conducted using an integrated approach.

RESULTS

Participants (n = 56) included EMO study site principal investigators (n = 12), hospital administrators (n = 8), physicians (n = 15), nurses (n = 12), and respiratory therapists (n = 9) from 12 hospitals. Results suggest that leadership buy-in, clear authoritative guidelines for SpO2 use incorporated into electronic order sets, regular education about cSpO2 in bronchiolitis, and visual reminders may be needed to reduce cSpO2 utilization. Parental perceptions and individual clinician comfort affect cSpO2 practice.

CONCLUSION

We identified barriers and facilitators to deimplementation of cSpO2 for stable patients with bronchiolitis across children's hospitals with high- and low-cSpO2 use. Based on these data, future deimplementation efforts should focus on clear protocols for cSpO2, EHR changes, and education for hospital staff on bronchiolitis features and rationale for reducing cSpO2.

Provision of Defect-Free Care: Implementation Science in Surgical Patient Safety

Implementation science is the study of the translation of evidence-based practices to real-world clinical environments. Implementation is measured with specific outcomes including acceptability, adoption, appropriateness, feasibility, fidelity, penetration, sustainability, and implementation cost. There are defined frameworks and models that outline implementation strategies and assist researchers in identifying barriers and facilitators to achieve implementation and conduct implementation research using methods such as qualitative analysis, parallel group, pre-/postintervention, interrupted time series, and cluster or stepped-wedge randomized trials. Deimplementation is the study of how to remove ineffective or unnecessary practices from the clinical setting and is an equally important component of implementation science.