A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study

Conditions of successful treatment referral practices with justice-involved youth: Qualitative insights from probation and service provider staff involved in JJ-TRIALS

INTRODUCTION

Compared to the general U.S. adolescent population, young people involved in the juvenile justice system are at greater risk of experiencing substance use (SU) issues. There are critical opportunities across the juvenile justice continuum, at points of interface with community-based treatment services, to screen and assess for SU issues, identify unmet treatment needs, and refer those in need to treatment. The treatment referral process is, however, complex, and contingent on a seamless nexus between juvenile justice operations and the wider treatment provider landscape. Given the lack of successful SU referrals among justice-involved youth and the variable referral rates across jurisdictions, this study's aim is to provide a qualitative, explanatory understanding of the conditions that together contribute to successful referring practices.

METHODS

The study is based on an analysis of a qualitative dataset comprising focus group data with probation and community-based behavioral health treatment staff working in 31 sites in 6 different states as part of the clustered randomized trial of an organizational change intervention known as JJ-TRIALS (Juvenile Justice Translational Research on Interventions for Adolescents in the Legal System). The data contain respondents' narratives on the achievements, successes, and challenges with implementing the intervention. The data were analyzed through a combination of strategies to identify the conditions that both facilitate and impede referral processes between probation offices and community-based SU treatment providers.

RESULTS

Participants across sites discussed the positive impacts that the JJ-TRIALS intervention had on their improved ability to communicate, collaborate, and collect data. From the interviews, seven main conditions were observed to contribute to successful SU treatment referral practices: (1) communication (inter-organizational); (2) collaboration; (3) data-driven practices; (4) family engagement; (5) institutionalized policy and referral documentation; (6) efficient referral policies and procedures; and (7) suitable and accessible system of treatment providers.

CONCLUSION

Findings highlight the value of a holistic understanding of successful treatment referrals for justice-involved youth and help inform research and practice efforts to identify and measure the many dimensions of referral-making at the interface of juvenile probation and behavioral health services.

Five recommendations to advance implementation science for humanitarian settings: the next frontier of humanitarian research

Challenges in delivering evidence-based programming in humanitarian crises require new strategies to enhance implementation science for better decision-making. A recent scoping review highlights the scarcity of peer-reviewed studies on implementation in conflict zones. In this commentary, we build on this scoping review and make five recommendations for advancing implementation science for humanitarian settings. These include (1) expanding existing frameworks and tailoring them to humanitarian dynamics, (2) utilizing hybrid study designs for effectiveness-implementation studies, (3) testing implementation strategies, (4) leveraging recent methodological advancements in social and data science, and (5) enhancing training and community engagement. These approaches aim to address gaps in understanding intervention effectiveness, scale, sustainability, and equity in humanitarian settings. Integrating implementation science into humanitarian research is essential for informed decision-making and improving outcomes for affected populations.

The core functions and forms paradigm throughout EPIS: designing and implementing an evidence-based practice with function fidelity

There are numerous frameworks for implementing evidence-based practices (EBPs) in novel settings to achieve "fidelity." However, identifying appropriate referents for fidelity poses a challenge. The Core Functions and Forms paradigm offers a model that can inform adaptation decisions throughout all phases of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. We applied the Core Functions-Forms paradigm throughout the Exploration and Preparation phases of EPIS in the design of two EBPs targeting family protective factors among Latinos in San Diego, as well as describe plans for its use in Implementation and Sustainment. We employed a distinct approach for each intervention element to contrast adaptation decisions that prioritize adherence to either form or function fidelity. We describe our application of the functions-forms paradigm within the EPIS framework, focusing on the Preparation phase. We also provide functions-forms matrices that map out the relationship between individual intervention components (forms) and the essential processes (functions) by which components are theorized to exert their impact. This case study of how the core functions-forms framework can be mapped onto EPIS can support a conceptual shift from prioritizing form fidelity to also focusing on function fidelity. This might allow interventionists to target appropriate fidelity referents when adapting an EBP, rather than defaulting to maintaining fidelity to forms as described in the protocol. We see great promise for using this framework for guiding actions throughout all EPIS phases and informing future applications of this paradigm to foster more robust fidelity to function.

Adapting a community pharmacy intervention to improve medication safety

BACKGROUND

Community pharmacies are an ideal location to address challenges of over-the-counter medication safety, yet many successful interventions are only tested in a few pharmacies without expansion, creating unrealized opportunities to improve patient care on a larger scale. Scaling up to numerous pharmacies can be challenging because each community pharmacy has unique needs and layouts and requires individualized adaptation.

OBJECTIVES

This paper reports techniques for (a) adapting a community pharmacy intervention to fit the unique physical layout and patient needs of health system pharmacy sites without increasing staff workload, (b) identifying strategies to gather feedback on adaptations from stakeholders, and (c) developing materials to share with pharmacy champions for them to independently implement and sustain the intervention in their organization.

PRACTICE DESCRIPTION

The study team collaborated with Aurora Pharmacy, Inc to develop an intervention designed to increase awareness of safe over-the-counter medication use for older adults.

PRACTICE INNOVATION

Senior Safe, a community pharmacy-based intervention, was designed, implemented, and tested using the Exploration, Preparation, Implementation, and Sustainment implementation framework.

EVALUATION METHODS

Senior Safe was adapted through pilot testing and a randomized control trial. Feedback was collected from key stakeholders, including pharmacy staff, older adults, and a research advisory group.

RESULTS

A finalized version of Senior Safe, as well as an implementation package, was provided to Aurora Pharmacy to integrate into all 63 sites.

CONCLUSION

This multiphase study illustrated that refining an intervention is possible and welcomed by pharmacy staff, but it requires time, resources, and funds to create an impactful, sustainable community pharmacy intervention.

Enhancing healthcare at home for older people in rural and regional Australia: A protocol for co-creation to design and implement system change

BACKGROUND

World-wide, health service providers are moving towards innovative models of clinical home-based care services as a key strategy to improve equity of access and quality of care. To optimise existing and new clinical home-based care programs, evidence informed approaches are needed that consider the complexity of the health care system across different contexts.

METHODS

We present a protocol for working with health services and their partners to perform rapid identification, prioritisation, and co-design of content-appropriate strategies to optimise the delivery of healthcare at home for older people in rural and regional areas. The protocol combines Systems Thinking and Implementation Science using a Consensus Mapping and Co-design (CMC) process delivered over five workshops.

DISCUSSION

The protocol will be implemented with rural and regional healthcare providers to identify digital and non-digital solutions that have the potential to inform models of service delivery, improve patient experience, and optimise health outcomes. The combination of system and implementation science is a unique approach for optimising healthcare at home for older populations, especially in the rural context where need is high. This is the first protocol to integrate the use of systems and implementation science into one process and articulating these methods will help with replicating this in future practice. Results of the design phase will translate into practice through standard health service planning methods to enhance implementation and sustainability. The delivery of the protocol will include building capacity of health service workers to embed the design, implementation, and evaluation approach into normal practice. This protocol forms part of the DELIVER (Delivering Enhanced heaLthcare at home through optImising Virtual tools for oldEr people in Rural and regional Australia) Project. Funded by Australia's Medical Research Future Fund, DELIVER involves a collaboration with public health services of Western Victoria, Australia.

Rapid implementation mapping to identify implementation determinants and strategies for cervical cancer control in Nigeria

Background

Cervical cancer constitutes a huge burden among women in Nigeria, particularly HIV-infected women. However, the provision and uptake of cervical cancer screening and treatment is limited in Nigeria. Understanding implementation determinants is essential for the effective translation of such evidence-based interventions into practice, particularly in low-resource settings. COVID-19 pandemic necessitated online collaboration making implementation mapping challenging in some ways, while providing streamlining opportunities. In this study, we describe the use of a virtual online approach for implementation mapping (steps 1-3) to identify implementation determinants, mechanisms, and strategies to implement evidence-based cervical cancer screening and treatment in existing HIV infrastructure in Nigeria.

Methods

This study used a mixed methods study design with a virtual modified nominal group technique (NGT) process aligning with Implementation Mapping steps 1-3. Eleven stakeholders (six program staff and five healthcare providers and administrators) participated in a virtual NGT process which occurred in two phases. The first phase utilized online surveys, and the second phase utilized an NGT and implementation mapping process. The Exploration, Preparation, Implementation and Sustainment (EPIS) framework was used to elicit discussion around determinants and strategies from the outer context (i.e., country and regions), inner organizational context of existing HIV infrastructure, bridging factors that relate to bi-directional influences, and the health innovation to be implemented (in this case cervical cancer screening and treatment). During the NGT, the group ranked implementation barriers and voted on implementation strategies using Mentimeter.

Results

Eighteen determinants to integrating cervical cancer screening and treatment into existing comprehensive HIV programs were related to human resources capacity, access to cervical cancer services, logistics management, clinic, and client-related factors. The top 3 determinants included gaps in human resources capacity, poor access to cervical cancer services, and lack of demand for services resulting from lack of awareness about the disease and servicesA set of six core implementation strategies and two enhanced implementation strategies were identified.

Conclusions

Rapid Implementation Mapping is a feasible and acceptable approach for identifying and articulating implementation determinants, mechanisms, and strategies for complex healthcare interventions in LMICs.

Ten years of implementation outcomes research: a scoping review

BACKGROUND

Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes.

METHODS

Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome).

RESULTS

Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health.

CONCLUSIONS

Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.

Protocol for WeExPAnd: a prospective, mixed-methods pilot demonstration study to increase access to pre-exposure prophylaxis among women vulnerable to HIV infection in the Southern USA

INTRODUCTION

African American women (AA), particularly those living in the Southeastern USA, experience disproportionately high rates of HIV infection. Pre-exposure prophylaxis (PrEP) is a highly effective HIV prevention tool that may circumvent barriers to traditional HIV prevention tools, such as condom use; however, very little is known about how to improve PrEP access and uptake among AA women who may benefit from PrEP use. This project aims to understand how to increase PrEP access among AA women in the rural Southern USA, which may ultimately affect HIV incidence in this population.

METHODS AND ANALYSIS

The goal of the current study is to systematically adapt a patient-provider communication tool to increase PrEP uptake among AA women receiving care at a federally qualified health centre in Alabama. We will use an iterative implementation process, by assessing the feasibility, acceptability and preliminary impact of the tool on PrEP uptake, using a pilot preintervention/postintervention design (N=125). We will evaluate women's reasons for declining a referral to a PrEP provider, reasons for incomplete referrals, reasons for not initiating PrEP after a successful referral and ongoing PrEP use at 3 and 12 months after PrEP initiation among our sample. The proposed work will significantly contribute to our understanding of factors impacting PrEP uptake and use among AA women, particularly in underserved areas in the Deep South that are heavily impacted by the HIV epidemic and experience worse HIV-related health outcomes relative to other areas in the USA.

ETHICS AND DISSEMINATION

This protocol has been approved by the Institutional Review Board (IRB) at University of Alabama at Birmingham (Birmingham, AL; protocol 300004276). All participants will review a detailed informed consent form approved by the IRB and will provide written or verbal informed consent prior to enrolment. Results will be disseminated through peer-reviewed manuscripts, reports, and local, national and international presentations.

TRIAL REGISTRATION NUMBER

NCT04373551.

Defining re-implementation

BACKGROUND

The first attempt to implement a new tool or practice does not always lead to the desired outcome. Re-implementation, which we define as the systematic process of reintroducing an intervention in the same environment, often with some degree of modification, offers another chance at implementation with the opportunity to address failures, modify, and ultimately achieve the desired outcomes. This article proposes a definition and taxonomy for re-implementation informed by case examples in the literature.

MAIN BODY

We conducted a scoping review of the literature for cases that describe re-implementation in concept or practice. We used an iterative process to identify our search terms, pilot testing synonyms or phrases related to re-implementation. We searched PubMed and CINAHL, including articles that described implementing an intervention in the same environment where it had already been implemented. We excluded articles that were policy-focused or described incremental changes as part of a rapid learning cycle, efforts to spread, or a stalled implementation. We assessed for commonalities among cases and conducted a thematic analysis on the circumstance in which re-implementation occurred. A total of 15 articles representing 11 distinct cases met our inclusion criteria. We identified three types of circumstances where re-implementation occurs: (1) failed implementation, where the intervention is appropriate, but the implementation process is ineffective, failing to result in the intended changes; (2) flawed intervention, where modifications to the intervention itself are required either because the tool or process is ineffective or requires tailoring to the needs and/or context of the setting where it is used; and (3) unsustained intervention, where the initially successful implementation of an intervention fails to be sustained. These three circumstances often co-exist; however, there are unique considerations and strategies for each type that can be applied to re-implementation.

CONCLUSIONS

Re-implementation occurs in implementation practice but has not been consistently labeled or described in the literature. Defining and describing re-implementation offers a framework for implementation practitioners embarking on a re-implementation effort and a starting point for further research to bridge the gap between practice and science into this unexplored part of implementation.

Addressing the Know-Do Gap in Adolescent HIV: Framing and Measuring Implementation Determinants, Outcomes, and Strategies in the AHISA Network

Implementation science (IS) uses systematic methods to close gaps between research and practice by identifying and addressing barriers to implementation of evidence-based interventions (EBIs). To reach UNAIDS HIV targets, IS can support programs to reach vulnerable populations and achieve sustainability. We studied the application of IS methods in 36 study protocols that were part of the Adolescent HIV Prevention and Treatment Implementation Science Alliance (AHISA). Protocols focused on youth, caregivers, or healthcare workers in high HIV-burden African countries and evaluated medication, clinical and behavioral/social EBIs. All studies measured clinical outcomes and implementation science outcomes; most focused on early implementation outcomes of acceptability (81%), reach (47%), and feasibility (44%). Only 53% used an implementation science framework/theory. Most studies (72%) evaluated implementation strategies. Some developed and tested strategies, while others adapted an EBI/strategy. Harmonizing IS approaches allows cross study learning and optimization of delivery of EBIs and could support attainment of HIV goals.

Tailoring dissemination strategies to increase evidence-informed policymaking for opioid use disorder treatment: study protocol

BACKGROUND

Policy is a powerful tool for systematically altering healthcare access and quality, but the research to policy gap impedes translating evidence-based practices into public policy and limits widespread improvements in service and population health outcomes. The US opioid epidemic disproportionately impacts Medicaid members who rely on publicly funded benefits to access evidence-based treatment including medications for opioid use disorder (MOUD). A myriad of misaligned policies and evidence-use behaviors by policymakers across federal agencies, state Medicaid agencies, and managed care organizations limit coverage of and access to MOUD for Medicaid members. Dissemination strategies that improve policymakers' use of current evidence are critical to improving MOUD benefits and reducing health disparities. However, no research describes key determinants of Medicaid policymakers' evidence use behaviors or preferences, and few studies have examined data-driven approaches to developing dissemination strategies to enhance evidence-informed policymaking. This study aims to identify determinants and intermediaries that influence policymakers' evidence use behaviors, then develop and test data-driven tailored dissemination strategies that promote MOUD coverage in benefit arrays.

METHODS

Guided by the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework, we will conduct a national survey of state Medicaid agency and managed care organization policymakers to identify determinants and intermediaries that influence how they seek, receive, and use research in their decision-making processes. We will use latent class methods to empirically identify subgroups of agencies with distinct evidence use behaviors. A 10-step dissemination strategy development and specification process will be used to tailor strategies to significant predictors identified for each latent class. Tailored dissemination strategies will be deployed to each class of policymakers and assessed for their acceptability, appropriateness, and feasibility for delivering evidence about MOUD benefit design.

DISCUSSION

This study will illuminate key determinants and intermediaries that influence policymakers' evidence use behaviors when designing benefits for MOUD. This study will produce a critically needed set of data-driven, tailored policy dissemination strategies. Study results will inform a subsequent multi-site trial measuring the effectiveness of tailored dissemination strategies on MOUD benefit design and implementation. Lessons from dissemination strategy development will inform future research about policymakers' evidence use preferences and offer a replicable process for tailoring dissemination strategies.

Advancing research on teams and team effectiveness in implementation science: An application of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework

Background

Effective teams are essential to high-quality healthcare. However, teams, team-level constructs, and team effectiveness strategies are poorly delineated in implementation science theories, models, and frameworks (TMFs), hindering our understanding of how teams may influence implementation. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework is a flexible and accommodating framework that can facilitate the application of team effectiveness approaches in implementation science.

Main Text

We define teams and provide an overview of key constructs in team effectiveness research. We describe ways to conceptualize different types of teams and team constructs relevant to implementation within the EPIS framework. Three case examples illustrate the application of EPIS to implementation studies involving teams. Within each study, we describe the structure of the team and how team constructs influenced implementation processes and outcomes.

Conclusions

Integrating teams and team constructs into the EPIS framework demonstrates how TMFs can be applied to advance our understanding of teams and implementation. Implementation strategies that target team effectiveness may improve implementation outcomes in team-based settings. Incorporation of teams into implementation TMFs is necessary to facilitate application of team effectiveness research in implementation science.

The comparative effectiveness of Core versus Core+Enhanced implementation strategies in a randomized controlled trial to improve substance use treatment receipt among justice-involved youth

BACKGROUND

Most justice-involved youth are supervised in community settings, where assessment and linkage to substance use (SU) treatment services are inconsistent and fragmented. Only 1/3 of youth with an identified SU need receive a treatment referral and even fewer initiate services. Thus, improving identification and linkage to treatment requires coordination across juvenile justice (JJ) and behavioral health (BH) agencies. The current study examines the comparative effectiveness of two bundled implementation intervention strategies for improving SU treatment initiation, engagement, and continuing care among justice-involved youth supervised in community settings. Exploration, Preparation, Implementation, Sustainment (EPIS) served as the conceptual framework for study design and selection/timing of implementation intervention components, and the BH Services Cascade served as the conceptual and measurement framework for identifying and addressing gaps in service receipt.

METHODS

Part of a larger Juvenile-Justice Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) Cooperative, this study involved a multisite, cluster-randomized control trial where sites were paired then randomly assigned to receive Core (training teams on the BH Services Cascade and data-driven decision making; supporting goal selection) or Core+Enhanced (external facilitation of implementation teams) intervention components. Youth service records were collected from 20 JJ community supervision agencies (in five states) across five study phases (baseline, pre-randomization, early experiment, late experiment, maintenance). Implementation teams comprised of JJ and BH staff collaboratively identified goals along the BH Cascade and used data-driven decision-making to implement change.

RESULTS

Results suggest that Core intervention components were effective at increasing service receipt over time relative to baseline, but differences between Core and Core+Enhanced conditions were non-significant. Time to service initiation was shorter among Core+Enhanced sites, and deeper Cascade penetration occurred when external facilitation (of implementation teams) was provided. Wide variation existed in the degree and nature of change across service systems.

CONCLUSIONS

Findings demonstrate the criticality of early EPIS phases, demonstrating that strategies provided during the formative exploration and preparation phases produced some improvement in service receipt, whereas implementation-focused activities produced incremental improvement in moving youth farther along the Cascade.

Where is "policy" in dissemination and implementation science? Recommendations to advance theories, models, and frameworks: EPIS as a case example

BACKGROUND

Implementation science aims to accelerate the public health impact of evidence-based interventions. However, implementation science has had too little focus on the role of health policy - and its inseparable politics, polity structures, and policymakers - in the implementation and sustainment of evidence-based healthcare. Policies can serve as determinants, implementation strategies, the evidence-based "thing" to be implemented, or another variable in the causal pathway to healthcare access, quality, and patient outcomes. Research describing the roles of policy in dissemination and implementation (D&I) efforts is needed to resolve persistent knowledge gaps about policymakers' evidence use, how evidence-based policies are implemented and sustained, and methods to de-implement policies that are ineffective or cause harm. Few D&I theories, models, or frameworks (TMF) explicitly guide researchers in conceptualizing where, how, and when policy should be empirically investigated. We conducted and reflected on the results of a scoping review to identify gaps of existing Exploration, Preparation, Implementation, and Sustainment (EPIS) framework-guided policy D&I studies. We argue that rather than creating new TMF, researchers should optimize existing TMF to examine policy's role in D&I. We describe six recommendations to help researchers optimize existing D&I TMF. Recommendations are applied to EPIS, as one example for advancing TMF for policy D&I.

RECOMMENDATIONS

(1) Specify dimensions of a policy's function (policy goals, type, contexts, capital exchanged). (2) Specify dimensions of a policy's form (origin, structure, dynamism, outcomes). (3) Identify and define the nonlinear phases of policy D&I across outer and inner contexts. (4) Describe the temporal roles that stakeholders play in policy D&I over time. (5) Consider policy-relevant outer and inner context adaptations. (6) Identify and describe bridging factors necessary for policy D&I success.

CONCLUSION

Researchers should use TMF to meaningfully conceptualize policy's role in D&I efforts to accelerate the public health impact of evidence-based policies or practices and de-implement ineffective and harmful policies. Applying these six recommendations to existing D&I TMF advances existing theoretical knowledge, especially EPIS application, rather than introducing new models. Using these recommendations will sensitize researchers to help them investigate the multifaceted roles policy can play within a causal pathway leading to D&I success.

Supporting immigrant caregivers during the COVID-19 pandemic: Continuous adaptation and implementation of an early childhood digital engagement program

Digital messaging programs have the potential to be a powerful, low-cost, technological tool to support multiple facets of caregivers' knowledge, and implementation of developmentally appropriate caregiver-child activities among diverse immigrant populations. However, involving caregivers and community stakeholders in the cultural and linguistic tailoring of interventions to optimize utilization and engagement may be critical to ensuring messaging programs' usability and acceptability. The purpose of this mixed-method study was to use the dynamic adaptation process (DAP) within an Exploration, Preparation, Implementation, Sustainment (EPIS) framework to examine the implementation of a digital messaging program, developed at the beginning of the COVID-19 pandemic, aimed at providing Spanish-, English-, and Mandarin-speaking immigrant caregivers with caregiver-child activities that supported children's development and caregivers' knowledge. Building upon the EPIS framework, using DAP, we assessed the feasibility and acceptability of a messaging program via short message service or multimedia message service, WeChat, and Remind and webinar program during the COVID-19 pandemic. The study illustrated how a digital messaging program is a feasible mechanism for sharing developmentally and culturally appropriate information with immigrant caregivers. In addition, the use of the DAP and the EPIS framework allowed us to continuously track the process of cultural adaptation, identify barriers and facilitators of the outreach program, and examine how implementation unfolded across all three groups of caregivers.

Do the Expert Recommendations for Implementing Change (ERIC) strategies adequately address sustainment?

Background

Sustainability science is an emerging area within implementation science. There is limited evidence regarding strategies to best support the continued delivery and sustained impact of evidence-based interventions (EBIs). To build such evidence, clear definitions, and ways to operationalize strategies specific and/or relevant to sustainment are required. Taxonomies and compilations such as the Expert Recommendations for Implementing Change (ERIC) were developed to describe and organize implementation strategies. This study aimed to adapt, refine, and extend the ERIC compilation to incorporate an explicit focus on sustainment. We also sought to classify the specific phase(s) of implementation when the ERIC strategies could be considered and applied.

Methods

We used a two-phase iterative approach to adapt the ERIC. This involved: (1) adapting through consensus (ERIC strategies were mapped against barriers to sustainment as identified via the literature to identify if existing implementation strategies were sufficient to address sustainment, needed wording changes, or if new strategies were required) and; (2) preliminary application of this sustainment-explicit ERIC glossary (strategies described in published sustainment interventions were coded against the glossary to identify if any further amendments were needed). All team members independently reviewed changes and provided feedback for subsequent iterations until consensus was reached. Following this, and utilizing the same consensus process, the Exploration, Preparation, Implementation and Sustainment (EPIS) Framework was applied to identify when each strategy may be best employed across phases.

Results

Surface level changes were made to the definitions of 41 of the 73 ERIC strategies to explicitly address sustainment. Four additional strategies received deeper changes in their definitions. One new strategy was identified: Communicate with stakeholders the continued impact of the evidence-based practice. Application of the EPIS identified that at least three-quarters of strategies should be considered during preparation and implementation phases as they are likely to impact sustainment.

Conclusion

A sustainment-explicit ERIC glossary is provided to help researchers and practitioners develop, test, or apply strategies to improve the sustainment of EBIs in real-world settings. Whilst most ERIC strategies only needed minor changes, their impact on sustainment needs to be tested empirically which may require significant refinement or additions in the future.

Effectiveness and sustainment of a tailored over-the-counter medication safety intervention in community pharmacies: A randomized controlled trial

INTRODUCTION

The Senior Section is a continuation of a previous intervention that aims to address a gap in medication safety, specifically related to older adult selection and use of over-the-counter medications. The purpose of this paper is to describe the protocol of this study.

METHODS

This study will occur in three phases: an adaptation phase, an effectiveness phase using a randomized controlled trial, and a sustainment phase. This study will take place in conjunction with administrative leadership and pharmacy sites of a regional Midwest integrated health system. Eye tracking technology will inform the adaptation of the intervention and demonstrate effectiveness in the randomized controlled trial. Following the randomized controlled trial, the health system will implement the intervention without research team support. Fidelity and long-term effectiveness outcomes will be collected to demonstrate sustainment.

DISCUSSION

The potential implications of this study are a complete and sustained redesign of the pharmacy setting to include educational and directional materials on medication safety, leading to a decrease in over-the-counter medication misuse in older adults. This project could provide a road map for pharmacy organizations to tailor and adopt the Senior Section, to ultimately reduce inappropriate over-the-counter medication use in older adults.

Understanding implementation research collaborations from a co-creation lens: Recommendations for a path forward

Increasing calls within the field of implementation science (IS) research seek to promote active engagement of diverse and often disenfranchised stakeholder voices to increase buy-in, fidelity, outcome relevance, and sustainment of evidence-based practices (EBPs). Including such voices requires cultural humility and the integration of multiple perspectives and values among organizations, groups, and individuals. However, the IS field lacks guidance for researchers on structuring collaborative approaches to promote a co-created process (i.e., synergistic approach to goal attainment). We contend that improved operationalization of co-created implementation collaborations is critical to sparking synergy and addressing differentials based on power, privilege, knowledge, and access to resources among stakeholders. These differentials can undermine future implementation and sustainment efforts if not addressed early in the research effort. An insufficient understanding of the guiding principles of co-created implementation collaborations may limit the scientific value of evaluation processes, and researchers' ability to replicate outcomes. We propose a perspective foregrounded in the concept of co-creation to guide the structuring of implementation collaboratives through five principles. We offer three case examples informed by the Exploration, Preparation, Implementation, Sustainment (EPIS) Framework to illustrate the application of these co-creation principles. Lastly, we offer recommendations for promoting co-creation in IS research moving forward.

Barriers to drug treatment in police diversion programs and drug courts: A qualitative analysis

Drug treatment courts and police diversion programs are designed to divert people away from incarceration and into drug treatment. This article explores barriers in linking people who use drugs (PWUD) into drug treatment facilities in urban, suburban, and rural areas of Connecticut, Kentucky, and Wisconsin. Between December 2018 and March 2020, study teams in the three states conducted in-depth, semistructured interviews with key informants involved in programs to divert PWUD from criminal justice involvement including police, lawyers, judges, and others who work in drug treatment courts, and substance use disorder treatment providers who received referrals from and worked with police diversion programs or drug courts. Police diversion programs and drug treatment courts showed intraprogram variation in the structure of their programs in the three states and in different counties within the states. Structural barriers to successfully linking PWUD to treatment included a lack of resources, for example, a limited number of treatment facilities available, difficulties in funding mandated treatment, particularly in Wisconsin where Medicaid expansion has not occurred, and PWUDs' need for additional services such as housing. Many police officers, judges, and others within drug treatment court, including drug treatment specialists, hold stigmatizing attitudes toward medications to treat opioid use disorder (MOUD) and are unlikely to recommend or actively refer to MOUD treatment. Drug courts and police diversion programs offer a welcome shift from prior emphases on criminalization of drug use. However, for such programs to be effective, more resources must be dedicated to their success. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Using structured implementation interventions to improve referral to substance use treatment among justice-involved youth: Findings from a multisite cluster randomized trial

INTRODUCTION

Youth involved in the justice system have high rates of alcohol and other drug use, but limited treatment engagement. JJ-TRIALS tested implementation activities with community supervision (CS) and behavioral health (BH) agencies to improve screening, identification of substance use service need, referral, and treatment initiation and engagement, guided by the BH Services Cascade and EPIS frameworks. This paper summarizes intervention impacts on referrals to treatment among youth on CS.

METHODS

This multisite cluster-randomized trial involved 18 matched pairs of sites in 36 counties in seven states randomly assigned to core or enhanced conditions after implementing the core intervention at all sites for six months. Enhanced sites received external facilitation for local change team activities to reduce unmet treatment needs; Core sites were encouraged to form interagency workgroups. The dependent variable was percentage referred to treatment among youth in need (N = 14,012). Two-level Bayesian regression assessed factors predicting referral across all sites and time periods. Generalized linear mixed models using logit transformation tested two hypotheses: (H1) referrals will increase from baseline to the experimental period, (H2) referral increases will be larger in enhanced sites than in core sites.

RESULTS

Although the intervention significantly increased referral, condition did not significantly predict referral across all time periods. Youth who tested drug positive, had an alcohol/other drug-related or felony charge, were placed in secure detention or assigned more intensive supervision, or who were White were more likely to be referred. H1 (p < .05) and H2 (p < .0001) were both significant in the hypothesized direction. Interaction analyses comparing site pair differences showed that findings were not consistent across sites.

CONCLUSIONS

The percentage of youth referred to treatment increased compared with baseline overall, and enhanced sites showed larger increases in referrals over time. However, variations in effects suggest that site-level differences were important. Researchers should carry out mixed methods studies to further understand reasons for the inconsistent findings within randomized site pairs, and how to further improve treatment referrals across CS and BH systems. Findings also highlight that even when CS agencies work collaboratively with BH providers to improve referrals, most justice-involved youth who need SU services are not referred.

Interprofessional Collaborative Practice Improves Access to Care and Healthcare Quality to Advance Health Equity

ABSTRACT

Healthcare disparites exist in cardiovascular care, including heart failure. Care that is not equitable can lead to higher incidence of heart failure, increased readmissions, and poorer outcomes. The Heart Failure Transitional Care Services for Adults Clinic is an interprofessional collaborative practice that provides guideline-directed medical therapy and education to underserved patients with heart failure. Little is known regarding healthcare equity and quality metrics in relation to interprofessional teams. Thus, the purpose of this study was to examine if an interprofessional collaborative practice care delivery model can affect access to care and healthcare quality outcomes in underserved patients with heart failure. As evidenced by control charts over a two and a half year period, the Heart Failure Transitional Care Services for Adults Clinic was able to show improvements in access to care and quality metrics results without variation. An interprofessional collaborative practice can be an effective delivery model to address health equity and quality of care outcomes.

Methods to improve the translation of evidence-based interventions: A primer on dissemination and implementation science for occupational safety and health researchers and practitioners

Objective

A limited focus on dissemination and implementation (D&I) science has hindered the uptake of evidence-based interventions (EBIs) that reduce workplace morbidity and mortality. D&I science methods can be used in the occupational safety and health (OSH) field to advance the adoption, implementation, and sustainment of EBIs for complex workplaces. These approaches should be responsive to contextual factors, including the needs of partners and beneficiaries (such as employers, employees, and intermediaries).

Methods

By synthesizing seminal literature and texts and leveraging our collective knowledge as D&I science and/or OSH researchers, we developed a D&I science primer for OSH. First, we provide an overview of common D&I terminology and concepts. Second, we describe several key and evolving issues in D&I science: balancing adaptation with intervention fidelity and specifying implementation outcomes and strategies. Next, we review D&I theories, models, and frameworks and offer examples for applying these to OSH research. We also discuss widely used D&I research designs, methods, and measures. Finally, we discuss future directions for D&I science application to OSH and provide resources for further exploration.

Results

We compiled a D&I science primer for OSH appropriate for practitioners and evaluators, especially those newer to the field.

Conclusion

This article fills a gap in the OSH research by providing an overview of D&I science to enhance understanding of key concepts, issues, models, designs, methods and measures for the translation into practice of effective OSH interventions to advance the safety, health and well-being of workers.

Using Implementation Science to Promote Integration and Sustainability of Community Health Workers in the HIV Workforce

BACKGROUND

Community health worker (CHW) interventions are an evidence-based practice adopted by health care settings to increase retention in care and viral suppression for people living with HIV (PLWH) from racial/ethnic minority communities. However, disparate funding, unclear roles vis a vis other care team members, limited training and promotion opportunities, and a lack of standards for wages and tasks limit the ability to effectively use CHWs as part of the health care team. Guided by the Exploration, Preparation, Implementation, and Sustainment and Reach, Effectiveness, Adoption, Implementation, and Maintenance frameworks, this study describes the key determinants for CHW integration and sustainability at 3 agencies in Shelby County, TN, to improve viral suppression and reduce disparities among rural and urban people living with HIV.

SETTING

Memphis Transitional Grant Area (TGA) which includes 8 rural and urban counties in west Tennessee, Arkansas, and Mississippi.

METHODS

Seventeen key informants were identified using purposeful and snowball sampling techniques, including community and agency leadership staff, frontline staff, and faith leaders.

RESULTS

Key determinants of CHW integration include establishing clear and standardized CHW roles within and across organizations, facilitating interorganizational networks, and leveraging funds for livable CHW wages and sustainable positions. Training strategies that strengthen the CHW workforce include content related to trauma-informed care, managing stress, and cultural humility.

CONCLUSION

Several inner and outer settings and innovation and bridging factors affect CHW positions. Data collected will inform the implementation and sustainment of future policies and interventions intended to improve HIV care continuum outcomes and reduce disparities for PLWH.

Profile of the Portfolio of NIH-Funded HIV Implementation Research Projects to Inform Ending the HIV Epidemic Strategies

BACKGROUND

The US government created an initiative to end the HIV epidemic in the United States by the year 2030 (EHE). This multiagency initiative was structured around four pillars: Prevent, Diagnose, Treat, and Respond to improve HIV programs, resources, and service delivery infrastructure. In support of its research mission, the National Institutes of Health (NIH) has funded implementation research (IR) projects by addressing the four pillars and encouraging investigators to collaborate with local partners and Health and Human Services (HHS) grantees in 57 priority jurisdictions.

METHODS

This paper analyzed data from the NIH funded CFAR/ARC supplement projects from 2019 to 2021. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework was used to characterize projects by stage of implementation.

RESULTS

The Prevent pillar was most frequently studied, with Pre-Exposure Prophylaxis (PrEP) being the most studied intervention. The most common partners were health departments, community-based organizations (CBOs), and Federally Qualified Health Centers (FQHCs). The Consolidated Framework for Implementation Research (CFIR) framework was the most utilized to investigate implementation determinants, followed by the RE-AIM framework and Proctor model to assess implementation outcomes.

CONCLUSION

Monitoring the projects resulting from NIH investments is fundamental to understanding the response to EHE, and achieving these results requires systematic and continuous effort that can support the generalizable implementation knowledge emerging from individual studies. There are some remaining gaps in the project portfolio, including geographical coverage, range of implementation outcomes being measured, and interventions still requiring further research to ensure equitable scale-up of evidence based interventions and achieve EHE goals.

Legislatively mandated implementation of medications for opioid use disorders in jails: A qualitative study of clinical, correctional, and jail administrator perspectives

BACKGROUND

Individuals with legal involvement and opioid use disorders (OUD) are at an increased risk of overdose and premature death. Yet, few correctional systems provide all FDA approved medications for OUD (MOUD) to all qualifying incarcerated individuals. We report on the implementation of MOUD in seven Massachusetts' jails following a state legislative mandate to provide access to all FDA-approved MOUD and to connect with treatment upon release.

METHODS/PARTICIPANTS

Based on the Exploration, Preparation, Implementation, and Sustainment framework, 61 clinical, corrections, and senior jail administrators participated in semi-structured interviews and focus groups between December 2019 and January 2020. Qualitative analyses focused on external and internal contexts and bridging factors.

FINDINGS

Participants detailed how the outer context (i.e., legislative mandate) drove acceptance of MOUD and assisted with continuity of care. Salient inner context factors included decision-making around administration of agonist medications, staff perceptions and training, and changes to infrastructure and daily routines. Leadership was critical in flattening standard hierarchies and advocating for flexibility. System-based characteristics of incarcerated individuals, specifically those who were pre-sentenced, presented challenges with treatment initiation. Inter- and intra-agency bridging factors reduced duplication of effort and led to quick, innovative solutions.

CONCLUSIONS

Implementation of MOUD in jails requires collaboration with and reliance on external agencies. Preparation for implementation should involve systematic reviews of available resources and connections. Implementation requires flexibility from institutional systems that are inherently rigid. Accordingly, leaders and policymakers must recognize the cultural shift inherent in such programs and allow for resources and education to assure program success.

Translating Medicaid policy into practice: policy implementation strategies from three US states' experiences enhancing substance use disorder treatment

BACKGROUND

Despite the important upstream impact policy has on population health outcomes, few studies in implementation science in health have examined implementation processes and strategies used to translate state and federal policies into accessible services in the community. This study examines the policy implementation strategies and experiences of Medicaid programs in three US states that responded to a federal prompt to improve access to evidence-based practice (EBP) substance use disorder (SUD) treatment.

METHODS

Three US state Medicaid programs implementing American Society of Addiction Medicine (ASAM) Criteria-driven SUD services under Section 1115 waiver authority were used as cases. We conducted 44 semi-structured interviews with Medicaid staff, providers and health systems partners in California, Virginia, and West Virginia. Interviews were triangulated with document review of state readiness and implementation plans. The Exploration, Preparation, Implementation, Sustainment Framework (EPIS) guided qualitative theme analysis. The Expert Recommendations for Implementing Change and Specify It criteria were used to create a taxonomy of policy implementation strategies used by policymakers to promote providers' uptake of statewide EBP SUD care continuums.

RESULTS

Four themes describe states' experiences and outcomes implementing a complex EBP SUD treatment policy directive: (1) Medicaid agencies adapted their inner/outer contexts to align with EBPs and adapted EBPs to fit their local context; (2) enhanced financial reimbursement arrangements were inadequate bridging factors to achieve statewide adoption of new SUD services; (3) despite trainings, service providers and managed care organizations demonstrated poor fidelity to the ASAM Criteria; and (4) successful policy adoption at the state level did not guarantee service providers' uptake of EBPs. States used 29 implementation strategies to implement EBP SUD care continuums. Implementation strategies were used in the Exploration (n=6), Preparation (n=10), Implementation (n=19), and Sustainment (n=6) phases, and primarily focused on developing stakeholder interrelationships, evaluative and iterative approaches, and financing.

CONCLUSIONS

This study enhances our understanding of statewide policy implementation outcomes in low-resource, public healthcare settings. Themes highlight the need for additional pre-implementation and sustainment focused implementation strategies. The taxonomy of detailed policy implementation strategies employed by policymakers across states should be tested in future policy implementation research.

How do Lay Health Worker Engage Caregivers? A Qualitative Study to Enhance Equity in Evidence-Based Parenting Programs

Engaging caregivers in their children's mental health treatment is critical for delivering high quality, evidence-based care, particularly for young children with externalizing behaviors. Lay health workers (LHWs), including peer providers and promotoras de salud, have been identified as important workforces in addressing structural and stigma-related barriers to engagement in mental health services. Importantly, research has suggested that LHWs may be integral in efforts to address engagement disparities in evidence-based behavioral parent training programs (BPTs) for Latinx caregivers. The purpose of the study was to understand how different LHW workforces engage caregivers within their usual services, in order to inform strategies that improve access to and engagement in BPTs. Qualitative interviews were conducted with two different LHW workforces: volunteer LHWs (i.e., promotoras de salud) (n = 14), who were part of a community-embedded network, and paid LHWs (i.e., parent support partners, home visitors) (n = 9) embedded within children's mental health agencies. Participants were predominately Latinx (79%) and female (96%). Qualitative analyses revealed three primary themes related to engagement strategies used by LHWs to address barriers to care: 1.) Building Trust, 2.) Empowerment, 3.) Increasing Access. Although the majority of themes and sub-themes were consistent across the two LHW workforces, agency-embedded LHWs often discussed having the means to provide resources through their organizations, whereas community-embedded LHWs discussed acting as a bridge to services by providing information and conducting outreach. Findings have implications for partnering with different workforces of LHWs to increase equity in access to BPTs.

Implementation of Evidence-Based Practices to Reduce Youth HIV Transmission and Improve Self-Management: A Survey of Key Stakeholder Perspectives

Understanding the implementation process is critical to disseminating effective interventions that reduce HIV risk and improve self-management in youth populations. As part of a multi-center implementation study, providers (N = 128) from 13 HIV prevention and care sites were surveyed to capture their perspectives on evidence-based practices (EBPs) and their discharge. We employ a descriptive analysis of their perspectives before implementation as defined by the Exploration, Preparation, Implementation, and Sustainment (EPIS) model, with comparisons between organizational role and study site. Factors of interest included the following: attitudes toward EBPs, perceptions of organizational climate, perceptions of leadership behavior, implementation climate, and provider views on organizational support. These factors were assessed using scales with 5-point Likert response options. Attitudinal domains such as Appeal (α = 3.24), Fit (α = 3.31), and Requirements (α = 3.20), were positive. Similarly, providers on average perceived organizational support efforts meant to facilitate EBP implementation (α = 2.74). Our findings point to provider attitudes, perceptions of work climate, general organizational support, and leadership as impacting adoption and sustainment of EBPs. Secondary analysis indicates that some perceptions and attitudes differ by site and by professional role in some assessment domains. Our study highlights factors such as provider attitudes and perspectives on the organizational and implementation climates and on leadership behaviors as impacting EPB implementation.

Alliances to disseminate addiction prevention and treatment (ADAPT): A statewide learning health system to reduce substance use among justice-involved youth in rural communities

BACKGROUND

Youth in the justice system (YJS) are more likely than youth who have never been arrested to have mental health and substance use problems. However, a low percentage of YJS receive SUD services during their justice system involvement. The SUD care cascade can identify potential missed opportunities for treatment for YJS. Steps along the continuum of the cascade include identification of treatment need, referral to services, and treatment engagement. To address gaps in care for YJS, we will (1) implement a learning health system (LHS) to develop, or improve upon, alliances between juvenile justice (JJ) agencies and community mental health centers (CMHC) and (2) present local cascade data during continuous quality improvement cycles within the LHS alliances.

METHODS/DESIGN

ADAPT is a hybrid Type II effectiveness implementation trial. We will collaborate with JJ and CMHCs in eight Indiana counties. Application of the EPIS (exploration, preparation, implementation, and sustainment) framework will guide the implementation of the LHS alliances. The study team will review local cascade data quarterly with the alliances to identify gaps along the continuum. The study will collect self-report survey measures longitudinally at each site regarding readiness for change, implementation climate, organizational leadership, and program sustainability. The study will use the Stages of Implementation Completion (SIC) tool to assess the process of implementation across interventions. Additionally, the study team will conduct focus groups and qualitative interviews with JJ and CMHC personnel across the intervention period to assess for impact.

DISCUSSION

Findings have the potential to increase SUD need identification, referral to services, and treatment for YJS.

Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review

A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.

Barriers and facilitators to implementing a motivational interviewing-based intervention: a multi-site study of organizations caring for youth living with HIV

Understanding possible barriers and facilitators to effective implementation of evidence-based interventions to help high-risk youth prevent and manage HIV is crucial for their scale-up. This manuscript analyzes qualitative interview data collected during the early phase implementation of a motivational interviewing (MI) based intervention at 10 HIV care clinics in the United States providing services to youth. Using the Exploration-Preparation-Implementation-Sustainment (EPIS) framework to understand the implementation and the dynamic adaptation process (DAP) model to balance notions of intervention fidelity and flexibility, providers and stakeholders at each site (N = 97) were interviewed prior to implementation to gather their perspectives on organizational readiness for the intervention, as well as provider and client characteristics. The interviewers summarized their experience with rapid feedback forms (RFFs). Data extracted from the RFFs highlighted anticipated barriers to and facilitators of the proposed MI-based intervention, with the EPIS framework used to organize these findings. Study findings illustrate the inner and outer contextual factors that affect implementation and denote the points at which the MI-based intervention may be tailored to fit the unique context of a clinic while remaining faithful to the intervention's original design.

A mixed methods evaluation of the large-scale implementation of a school- and community-based parenting program to reduce violence against children in Tanzania: a study protocol

BACKGROUND

Despite the rapid dissemination of parenting programs aiming to reduce and prevent violence against children (VAC) worldwide, there is limited knowledge about and evidence of the implementation of these programs at scale. This study addresses this gap by assessing the quality of delivery and impact of an evidence-based parenting program for parents/caregivers and their adolescent girls aged 9 to 14-Parenting for Lifelong Health Teens (PLH-Teens), known locally as Furaha Teens-on reducing VAC at scale in Tanzania. The study will explore participating family and staff perspectives on program implementation and examine factors associated with implementation and how implementation quality is associated with intervention outcomes when the program is delivered to approximately 50,000 parent-child dyads (N = 100,000) in schools and community centers across eight districts of Tanzania.

METHODS

This mixed-methods study will answer the following research questions: (1) what is the implementation quality and fidelity of PLH-Teens at scale in Tanzania; (2) what factors are associated with the quality of delivery and implementation fidelity of PLH-Teens; (3) how are implementation quality and fidelity associated with intervention outcomes; (4) what are participant and implementing staff perspectives on the acceptability, appropriateness, feasibility, benefits, and challenges of delivering PLH-Teens in their schools and communities; (5) what is the impact of PLH-Teens on VAC and participant well-being; and (6) how much does it cost to deliver PLH-Teens at scale? Qualitative and quantitative data will be collected directly from implementers, parents/caregivers, and adolescents using pre-post questionnaires, observational assessments, cost surveys, focus groups, and interviews. Qualitative data will be analyzed thematically with the aid of NVIVO software. Quantitative data will be cleaned and analyzed using methods such as correlation, regression, and structural equation models using Stata and R. COREQ and TREND guidelines will be used, where appropriate.

DISCUSSION

Findings will provide vital insights into some of the factors related to quality implementation at scale. Lessons learned regarding the implementation of PLH-Teens at scale will be applied in Tanzania, and also in the delivery of PLH parenting programs globally.

Integrated knowledge translation to advance noncommunicable disease policy and practice in South Africa: application of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework

Background

In response to the “know–do” gap, several initiatives have been implemented to enhance evidence-informed decision-making (EIDM). These include individual training, organizational culture change management, and legislative changes. The importance of relationships and stakeholder engagement in EIDM has led to an evolution of models and approaches including integrated knowledge translation (IKT). IKT has emerged as a key strategy for ensuring that engagement is equitable, demand-driven, and responsive. As a result, the African-German Collaboration for Evidence-Based Healthcare and Public Health in Africa (CEBHA+) incorporated an IKT approach to influence noncommunicable diseases (NCD) policy and practice. We documented the phased process of developing, implementing, and monitoring the IKT approach in South Africa; and explored the appropriateness of using the exploration, preparation, implementation, and sustainment (EPIS) framework for this purpose.

Methods

We mapped the South Africa IKT approach onto the EPIS framework using a framework analysis approach. Notes of team meetings, stakeholder matrices, and engagement strategies were analysed and purposefully plotted against the four phases of the framework in order to populate the different constructs. We discussed and finalized the analysis in a series of online iterations until consensus was reached.

Results

The mapping exercise revealed an IKT approach that was much more iterative, dynamic, and engaging than initially thought. Several constructs (phase-agnostic) remained important and stable across EPIS phases: stable and supportive funding; committed and competent leadership; skilled and dedicated IKT champions; diverse and established personal networks; a conducive and enabling policy environment; and boundary-spanning intermediaries. Constructs such as “innovations” constantly evolved and adapted to the changing inner and outer contexts (phase-specific).

Conclusions

Using the EPIS framework to interrogate, reflect on, and document our IKT experiences proved extremely relevant and useful. Phase-agnostic constructs proved critical to ensure resilience and agility of NCD deliberations and policies in the face of highly dynamic and changing local contexts, particularly in view of the current coronavirus disease 2019 (COVID-19) pandemic. Bridging IKT with a framework from implementation science helps to reflect on this process and can guide the development and planning of similar interventions and strategies.

An Interprofessional Collaborative Practice Can Reduce Heart Failure Hospital Readmissions and Costs in an Underserved Population

BACKGROUND

Heart failure is a leading cause of hospitalization among adults in the United States. Nurse-led interprofessional clinics have been shown to improve heart failure outcomes in patients with heart failure, specifically decreasing readmission rates. Yet, there is little information on the impact of nurse-led interprofessional collaborative practice within an underserved population with heart failure. Thus, the purpose of this study was to compare the differences in readmission days and cost in patients followed by an interprofessional collaborative practice clinic (both engaged and not engaged) and those who did not establish care with the clinic.

METHODS AND RESULTS

Demographic, clinical, and readmission data were compared among patients with heart failure (59% African American; 72% male; mean age, 49 years) stratified into 3 groups: engaged patients (n = 170), not-engaged patients (n = 103), and not-established patients (n = 111) who had an initial appointment to clinic but did not establish care. Patients with 6 months of data before and after the scheduled clinic visit were included in the study. Differences in baseline characteristics, frequency and length of hospital admissions, and costs were analyzed using analysis of variance, Wilcoxon matched-pairs testing, multivariate analysis of variance, logistic regression, and financial analytics. Overall, the number of inpatient hospital days decreased in the engaged group compared with those in the not-engaged and not-established groups (P < .001). The total cost savings were significantly greater in the engaged group ($1,987,379) (P < .001).

CONCLUSIONS

The findings of this study may steer health care providers to incorporate interprofessional collaborative practice into heart failure management with a particular focus on underserved populations.

Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study

Autism spectrum disorder (ASD) is a highly prevalent neurodevelopmental disorder. ASD community-based organizations (ASD-CBOs) underutilize or inconsistently utilize evidence-based practices (ASD-EBPs) despite numerous available EBPs to treat ASD. Nonetheless, ASD-CBOs implement changes to practices regularly. Understanding ASD-CBO's implementation-as-usual (IAU) processes may assist to develop strategies to facilitate ASD-EBP adoption, implementation and sustainment. A convergent mixed methods (quan + QUAL) design was utilized. Twenty ASD-CBO agency leaders (ALs) and 26 direct providers (DPs), from 21 ASD-CBOs, completed the Autism Model of Implementation Survey Battery, including demographic and agency IAU process questions. Surveys were analyzed through descriptive and content analyses. A subset of 10 ALs provided qualitative interview data that were analyzed using coding, consensus and comparison methods to allow for a more comprehensive understanding of the IAU process within their ASD-CBOs. Quantitative analyses and qualitative coding were merged utilizing a joint display and compared. Results suggest that the IAU process follows some phases identified in the Exploration, Preparation, Implementation, Sustainment (EPIS) framework but were conducted in an informal manner-lacking specificity, structure and consistency across and within ASD-CBOs. Moreover, data suggest adding a specific adoption decision phase to the framework. Nonetheless, most ALs felt previous implementation efforts were successful. IAU processes were explored to determine whether the implementation process may be an area for intervention to increase ASD-EBP utilization in ASD-CBOs. Developing a systematized implementation process may facilitate broader utilization of high quality ASD-EBPs within usual care settings, and ultimately improve the quality of life for individuals with ASD and their families.

Professionals' management of the fidelity-adaptation dilemma in the use of evidence-based interventions-an intervention study

Background

Evidence-based interventions (EBIs) can be effective tools for the prevention of disease and health promotion. However, their implementation often requires a delicate balance between the need to adjust the intervention to the context in which it is implemented and the need to keep the core components that make the intervention effective. This so-called dilemma between fidelity and adaptation is often handled by health professionals in the sustainment phase of an implementation (i.e., once the intervention has been adopted and institutionalized in an organization), but not much is known about how and to what extent health professionals are affected by this dilemma. Focusing on the sustainment phase, this project aims to study (1) how fidelity and adaptation are managed by professionals using an EBI, (2) how the fidelity–adaptation dilemma affects professionals’ psychosocial working conditions, and (3) how a structured decision support influences professionals’ management of the dilemma and their psychosocial working conditions.

Methods

The study is set in Sweden, and the EBI in focus is a parental program (All Children in Focus). A longitudinal within-person intervention design is used, combined with a cross-sectional survey design. Data sources include web-based questionnaires, brief interviews, fidelity ratings, paper-and-pen questionnaires, and written documentation, collected at multiple time points with both group leaders and parents as respondents.

Discussion

This project approaches fidelity and adaptation from the perspective of the professionals that manage EBIs during the sustainment phase of implementation. Although it is well known that EBIs continue to change over time, it remains to be understood how the fidelity–adaptation dilemma can be managed so that the effectiveness of interventions is retained or improved, not diluted. Moreover, the project adds to the literature by presenting an occupational health perspective on the fidelity–adaptation dilemma. It is acknowledged that fidelity and adaptation may have consequences for not only clients but also the occupational wellbeing of the professionals managing the dilemma, and subsequently, their willingness and ability to deliver EBIs in a sustainable way.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00131-y.

A systematic review of evidence-based practice implementation in drug and alcohol settings: applying the consolidated framework for implementation research framework

Background

There is a paucity of translational research programmes to improve implementation of evidence-based care in drug and alcohol settings. This systematic review aimed to provide a synthesis and evaluation of the effectiveness of implementation programmes of treatment for patients with drug and alcohol problems using the Consolidated Framework for Implementation Research (CFIR).

Methods

A comprehensive systematic review was conducted using five online databases (from inception onwards). Eligible studies included clinical trials and observational studies evaluating strategies used to implement evidence-based psychosocial treatments for alcohol and substance use disorders. Extracted data were qualitatively synthesised for common themes according to the CFIR. Primary outcomes included the implementation, service system or clinical practice. Risk of bias of individual studies was appraised using appropriate tools. A protocol was registered with (PROSPERO) (CRD42019123812) and published previously (Louie et al. Systematic 9:2020).

Results

Of the 2965 references identified, twenty studies were included in this review. Implementation research has employed a wide range of strategies to train clinicians in a few key evidence-based approaches to treatment. Implementation strategies were informed by a range of theories, with only two studies using an implementation framework (Baer et al. J Substance Abuse Treatment 37:191-202, 2009) used Context-Tailored Training and Helseth et al. J Substance Abuse Treatment 95:26-34, 2018) used the CFIR). Thirty of the 36 subdomains of the CFIR were evaluated by included studies, but the majority were concerned with the Characteristics of Individuals domain (75%), with less than half measuring Intervention Characteristics (45%) and Inner Setting constructs (25%), and only one study measuring the Outer Setting and Process domains. The most common primary outcome was the effectiveness of implementation strategies on treatment fidelity. Although several studies found clinician characteristics influenced the implementation outcome (40%) and many obtained clinical outcomes (40%), only five studies measured service system outcomes and only four studies evaluated the implementation.

Conclusions

While research has begun to accumulate in domains such as Characteristics of Individuals and Intervention Characteristics (e.g. education, beliefs and attitudes and organisational openness to new techniques), this review has identified significant gaps in the remaining CFIR domains including organisational factors, external forces and factors related to the process of the implementation itself. Findings of the review highlight important areas for future research and the utility of applying comprehensive implementation frameworks.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01090-7.

Recidivism Treatment for Justice-Involved Veterans: Evaluating Adoption and Sustainment of Moral Reconation Therapy in the US Veterans Health Administration

Moral Reconation Therapy (MRT), an evidence-based intervention to reduce risk for criminal recidivism among justice-involved adults, was developed and primarily tested in correctional settings. Therefore, a better understanding of the implementation potential of MRT within non-correctional settings is needed. To address this gap in the literature, we evaluated the adoption and sustainment of MRT in the US Veterans Health Administration (VHA) following a national training initiative in fiscal years 2016 and 2017. In February 2019, surveys with 66 of the 78 VHA facilities that participated in the training were used to estimate the prevalence of MRT adoption and sustainment, and qualitative interviews with key informants from 20 facilities were used to identify factors associated with sustainment of MRT groups. Of the 66 facilities surveyed, the majority reported adopting (n = 52; 79%) and sustaining their MRT group until the time of the survey (n = 38; 58%). MRT sustainment was facilitated by strong intra-facility (e.g., between veterans justice and behavioral health services) and inter-agency collaborations (e.g., between VHA and criminal justice system stakeholders), which provided a reliable referral source to MRT groups, external incentives for patient engagement, and sufficient staffing to maintain groups. Additional facilitators of MRT sustainment were adaptations to the content and delivery of MRT for patients and screening of referrals to the groups. The findings provide guidance to clinics and healthcare systems that are seeking to implement MRT with justice-involved patient populations, and inform development of implementation strategies to be formally tested in future trials.

Train-to-Sustain: Predictors of Sustainment in a Large-Scale Implementation of Parent-Child Interaction Therapy

Sustainment of evidence-based practices is necessary to ensure their public health impact. The current study examined predictors of sustainment of Parent-Child Interaction Therapy (PCIT) within a large-scale system-driven implementation effort in Los Angeles County. Data were drawn from PCIT training data and county administrative claims between January 2013 and March 2018. Participants included 241 therapists from 61 programs. Two sustainment outcomes were examined at the therapist- and program-levels: 1) PCIT claim volume and 2) PCIT claim discontinuation (discontinuation of claims during study period; survival time of claiming in months). Predictors included therapist- and program-level caseload, training, and workforce characteristics. On average, therapists and programs continued claiming to PCIT for 17.7 and 32.3 months, respectively. Across the sustainment outcomes, there were both shared and unshared significant predictors. For therapists, case-mix fit (higher proportions of young child clients with externalizing disorders) and participation in additional PCIT training activities significantly predicted claims volume. Furthermore, additional training activity participation was associated with lower likelihood of therapist PCIT claim discontinuation in the follow-up period. Programs with therapists eligible to be internal trainers were significantly less likely to discontinue PCIT claiming. Findings suggest that PCIT sustainment may be facilitated by implementation strategies including targeted outreach to ensure eligible families in therapist caseloads, facilitating therapist engagement in advanced trainings, and building internal infrastructure through train-the-trainer programs.

Massachusetts Justice Community Opioid Innovation Network (MassJCOIN)

A major driver of the U.S. opioid crisis is limited access to effective medications for opioid use disorder (MOUD) that reduce overdose risks. Traditionally, jails and prisons in the U.S. have not initiated or maintained MOUD for incarcerated individuals with OUD prior to their return to the community, which places them at high risk for fatal overdose. A 2018 law (Chapter 208) made Massachusetts (MA) the first state to mandate that five county jails deliver all FDA-approved MOUDs (naltrexone [NTX], buprenorphine [BUP], and methadone). Chapter 208 established a 4-year pilot program to expand access to all FDA-approved forms of MOUD at five jails, with two more MA jails voluntarily joining this initiative. The law stipulates that MOUD be continued for individuals receiving it prior to detention and be initiated prior to release among sentenced individuals where appropriate. The jails must also facilitate continuation of MOUD in the community on release. The Massachusetts Justice Community Opioid Innovation Network (MassJCOIN) partnered with these seven diverse jails, the MA Department of Public Health, and community treatment providers to conduct a Type 1 hybrid effectiveness-implementation study of Chapter 208. We will: (1) Perform a longitudinal treatment outcome study among incarcerated individuals with OUD who receive NTX, BUP, methadone, or no MOUD in jail to examine postrelease MOUD initiation, engagement, and retention, as well as fatal and nonfatal opioid overdose and recidivism; (2) Conduct an implementation study to understand systemic and contextual factors that facilitate and impede delivery of MOUDs in jail and community care coordination, and strategies that optimize MOUD delivery in jail and for coordinating care with community partners; (3) Calculate the cost to the correctional system of implementing MOUD in jail, and conduct an economic evaluation from state policy-maker and societal perspectives to compare the value of MOUD prior to release from jail to no MOUD among matched controls. MassJCOIN made significant progress during its first six months until the COVID-19 pandemic began in March 2020. Participating jail sites restricted access for nonessential personnel, established other COVID-19 mitigation policies, and modified MOUD programming. MassJCOIN adapted research activities to this new reality in an effort to document and account for the impacts of COVID-19 in relation to each aim. The goal remains to produce findings with direct implications for policy and practice for OUD in criminal justice settings.

Bridging Systems to Implement HIV/STI Programming Within the Juvenile Justice System: Strengths and Challenges of a Local Change Team Approach

Justice-involved youth are at risk for HIV/STIs but do not access services. The complex challenges of improving the delivery of health-related services within juvenile justice (JJ) settings warrant exploration of strategies to close this service gap. This study describes the successes and challenges of utilizing a local change team (LCT) strategy comprising JJ and health agency staff to implement HIV/STI programming in JJ settings, across six counties in six states in the U.S. Five focus groups comprising n = 28 JJ and health agency staff who served as LCT members were conducted. Results demonstrated the structured nature of the collaborative process and strength of commitment among LCT members were necessary for successful implementation of HIV/STI programming. The use of LCTs comprising membership of JJ and (behavioral) health systems has broader applicability to other health and behavioral health issues faced by youth on probation that JJ staff may feel ill equipped to address.

Assessment of primary care practitioners' attitudes and interest in pharmacogenomic testing

Aims: Identify the attitudes and interests of primary care providers (PCPs) in applying clinical pharmacogenomics (PGx) test results. Materials & methods: A questionnaire was designed and then disseminated to PCPs across the MedStar Health System. Results: Ninety of 312 (29%) PCPs responded and were included in analyses. Seventy-six (84%) had heard of PGx and 12 (13%) previously ordered PGx testing. Most, 68 (76%), believed PGx can improve care; however, a minority, 23 (26%), reported confidence in using PGx in prescribing decisions. Sixty-four (70%) wanted a pharmacist consultation. PCPs desired PGx for antidepressants (75%), proton pump inhibitors (72%) and other medications. Conclusion: Most PCPs felt unprepared to interpret PGx results and desired pharmacist consultations. These data can inform future PGx implementations with PCPs.

Making change happen in criminal justice settings: leveraging implementation science to improve mental health care

BACKGROUND

It is a constitutional right to receive health care, including mental health care, while incarcerated. Yet, even basic evidence-based mental health care practices have not been routinely integrated into criminal justice (CJ) settings. Strategies from implementation science, or the study of methods for integrating evidence-based practices into routine care, can accelerate uptake of established interventions within low-resource, high-need settings such as prisons and jails. However, most studies of mental health practices in CJ settings do not use implementation frameworks to guide efforts to integrate treatments, systematically select or report implementation strategies, or evaluate the effectiveness of strategies used.

CASE PRESENTATIONS

After introducing implementation science and articulating the rationale for its application within CJ settings, we provide two illustrative case examples of efforts to integrate mental health interventions within CJ settings. Each case example demonstrates how an implementation framework either was applied or could have been applied to promote intervention adoption. The first focuses on poor implementation of a mental health screener in a county jail, retrospectively highlighting how use of a determinants framework (e.g., the Consolidated Framework for Implementation Research [CFIR]) could help staff identify factors that led to the implementation failure. The second describes an investigator-initiated research study that used a process framework (the Exploration, Preparation, Implementation, Sustainment [EPIS] framework) to systematically investigate and document the factors that led to successful implementation of a psychotherapy group for survivors of sexual violence in a women's community corrections center. Both are presented in accessible language, as our goal is that this article can be used as a primer for justice health researchers, community partners, and correctional leadership who are unfamiliar with implementation science.

CONCLUSIONS

Scientific research on the application of implementation science to justice settings is growing, but lags behind the work done in health systems. Given the tremendous need for mental and behavioral health intervention across the full spectrum of justice settings, information on how to successfully implement evidence-based intervention and prevention efforts is sorely needed but possible to obtain with greater integration of knowledge from implementation science.

Ten recommendations for using implementation frameworks in research and practice

Background

Recent reviews of the use and application of implementation frameworks in implementation efforts highlight the limited use of frameworks, despite the value in doing so. As such, this article aims to provide recommendations to enhance the application of implementation frameworks, for implementation researchers, intermediaries, and practitioners.

Discussion

Ideally, an implementation framework, or multiple frameworks should be used prior to and throughout an implementation effort. This includes both in implementation science research studies and in real-world implementation projects. To guide this application, outlined are ten recommendations for using implementation frameworks across the implementation process. The recommendations have been written in the rough chronological order of an implementation effort; however, we understand these may vary depending on the project or context: (1) select a suitable framework(s), (2) establish and maintain community stakeholder engagement and partnerships, (3) define issue and develop research or evaluation questions and hypotheses, (4) develop an implementation mechanistic process model or logic model, (5) select research and evaluation methods (6) determine implementation factors/determinants, (7) select and tailor, or develop, implementation strategy(s), (8) specify implementation outcomes and evaluate implementation, (9) use a framework(s) at micro level to conduct and tailor implementation, and (10) write the proposal and report. Ideally, a framework(s) would be applied to each of the recommendations. For this article, we begin by discussing each recommendation within the context of frameworks broadly, followed by specific examples using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

Summary

The use of conceptual and theoretical frameworks provides a foundation from which generalizable implementation knowledge can be advanced. On the contrary, superficial use of frameworks hinders being able to use, learn from, and work sequentially to progress the field. Following the provided ten recommendations, we hope to assist researchers, intermediaries, and practitioners to improve the use of implementation science frameworks.

A System-Level Intervention to Encourage Collaboration Between Juvenile Justice and Public Health Agencies to Promote HIV/STI Testing

Justice-involved youth are at high risk for HIV and STIs, and justice agencies are uniquely poised to offer HIV/STI testing. However, testing in these settings is not routine and represents a missed opportunity. This study describes a system-level implementation intervention designed to increase access to HIV/STI testing through juvenile justice (JJ) and public health agency collaboration across six counties in six states in the United States. Local change teams, active facilitation, and training were utilized to facilitate agency partnerships and development of HIV/STI practice change protocols. Five counties established health and JJ partnerships and four counties successfully implemented their protocols. Sites with HIV/STI education and testing protocols behaviorally screened 98.5% of youth and tested 41.2% of those youth; 0% were HIV+ and 43.2% had an STI. The intervention provides a feasible, scalable solution, through promoting partnerships between JJ and health agencies, to link youth to testing and treatment services.

Improving Substance Use Services for Juvenile Justice-Involved Youth: Complexity of Process Improvement Plans in a Large Scale Multi-site Study

Despite the high prevalence of substance use disorders among juvenile offenders, most do not receive services. System-level process improvement plans to address unmet service needs can be optimized by combining data-driven decisions and facilitated meetings with behavioral health stakeholders. This paper operationalizes and analyzes the level of specified complexity among process improvement plans evident within 36 juvenile probation and drug courts across 7 states. To inform more effective implementation strategies, this analysis identifies and prioritizes promising courses of agency enhancement toward addressing unmet substance use needs.

Ten recommendations for using implementation frameworks in research and practice

Background

Recent reviews of the use and application of implementation frameworks in implementation efforts highlight the limited use of frameworks, despite the value in doing so. As such, this article aims to provide recommendations to enhance the application of implementation frameworks, for implementation researchers, intermediaries, and practitioners.

Discussion

Ideally, an implementation framework, or multiple frameworks should be used prior to and throughout an implementation effort. This includes both in implementation science research studies and in real-world implementation projects. To guide this application, outlined are ten recommendations for using implementation frameworks across the implementation process. The recommendations have been written in the rough chronological order of an implementation effort; however, we understand these may vary depending on the project or context: (1) select a suitable framework(s), (2) establish and maintain community stakeholder engagement and partnerships, (3) define issue and develop research or evaluation questions and hypotheses, (4) develop an implementation mechanistic process model or logic model, (5) select research and evaluation methods (6) determine implementation factors/determinants, (7) select and tailor, or develop, implementation strategy(s), (8) specify implementation outcomes and evaluate implementation, (9) use a framework(s) at micro level to conduct and tailor implementation, and (10) write the proposal and report. Ideally, a framework(s) would be applied to each of the recommendations. For this article, we begin by discussing each recommendation within the context of frameworks broadly, followed by specific examples using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

Summary

The use of conceptual and theoretical frameworks provides a foundation from which generalizable implementation knowledge can be advanced. On the contrary, superficial use of frameworks hinders being able to use, learn from, and work sequentially to progress the field. Following the provided ten recommendations, we hope to assist researchers, intermediaries, and practitioners to improve the use of implementation science frameworks.

Leveraging implementation science to reduce inequities in Children's mental health care: highlights from a multidisciplinary international colloquium

BACKGROUND AND PURPOSE

Access to evidence-based mental health care for children is an international priority. However, there are significant challenges to advancing this public health priority in an efficient and equitable manner. The purpose of this international colloquium was to convene a multidisciplinary group of health researchers to build an agenda for addressing disparities in mental health care access and treatment for children and families through collaboration among scholars from the United States and Europe engaged in innovative implementation science and mental health services research.

KEY HIGHLIGHTS

Guided by the Exploration, Preparation, Implementation, and Sustainment (EPIS) Framework, presentations related to inner, outer, and bridging context factors that impact the accessibility and quality of mental health evidence-based practices (EBPs) for children and families. Three common topics emerged from the presentations and discussions from colloquium participants, which included: 1) the impact of inner and outer context factors that limit accessibility to EBPs across countries, 2) strategies to adapt EBPs to improve their fit in different settings, 3) the potential for implementation science to address emerging clinical and public health concerns.

IMPLICATIONS

The common topics discussed underscored that disparities in access to evidence-based mental health care are prevalent across countries. Opportunities for cross-country and cross-discipline learnings and collaborations can help drive solutions to address these inequities, which relate to the availability of a trained and culturally appropriate workforce, insurance reimbursement policies, and designing interventions and implementation strategies to support sustained use of evidence-based practices.

Validation of a pragmatic measure of implementation citizenship behavior in substance use disorder treatment agencies

The organizational context in which substance use disorder treatment (SUDT) evidence-based practices (EBPs) are implemented plays a critical role in successful implementation. Employee behaviors that go above and beyond typical job requirements to support EBP implementation have been suggested to facilitate the likelihood of overall implementation success. The current study explored the psychometric properties of the Implementation Citizenship Behavior Scale (ICBS) within SUDT settings. Utilizing a sample of 322 direct service providers and 60 of their respective supervisors from three SUDT agencies, results from a confirmatory factor analysis and construct validity analysis support the use of the ICBS in the SUDT context. Validation of the ICBS provides a useful, pragmatic tool for both researchers and practitioners to assess employee citizenship behavior to support EBP implementation. The ICBS can provide critical insights into how providers respond to organizational context that may facilitate EBP implementation.