A systematic review of empirical studies examining mechanisms of implementation in health

A sequential, multiple assignment randomized trial comparing web-based education to mobile video interpreter access for improving provider interpreter use in primary care clinics: the mVOCAL hybrid type 3 study protocol

BACKGROUND

Individuals who use a language other than English for medical care are at risk for disparities related to healthcare safety, patient-centered care, and quality. Professional interpreter use decreases these disparities but remains underutilized, despite widespread access and legal mandates. In this study, we compare two discrete implementation strategies for improving interpreter use: (1) enhanced education targeting intrapersonal barriers to use delivered in a scalable format (interactive web-based educational modules) and (2) a strategy targeting system barriers to use in which mobile video interpreting is enabled on providers' own mobile devices.

METHODS

We will conduct a type 3 hybrid implementation-effectiveness study in 3-5 primary care organizations, using a sequential multiple assignment randomized trial (SMART) design. Our primary implementation outcome is interpreter use, calculated by matching clinic visits to interpreter invoices. Our secondary effectiveness outcome is patient comprehension, determined by comparing patient-reported to provider-documented visit diagnosis. Enrolled providers (n = 55) will be randomized to mobile video interpreting or educational modules, plus standard interpreter access. After 9 months, providers with high interpreter use will continue as assigned; those with lower use will be randomized to continue as before or add the alternative strategy. After another 9 months, both strategies will be available to enrolled providers for 9 more months. Providers will complete 2 surveys (beginning and end) and 3 in-depth interviews (beginning, middle, and end) to understand barriers to interpreter use, based on the Theoretical Domains Framework. Patients who use a language other than English will be surveyed (n = 648) and interviewed (n = 75) following visits with enrolled providers to understand their experiences with communication. Visits will be video recorded (n = 100) to assess fidelity to assigned strategies. We will explore strategy mechanism activation to refine causal pathway models using a quantitative plus qualitative approach. We will also determine the incremental cost-effectiveness of each implementation strategy from a healthcare organization perspective, using administrative and provider survey data.

DISCUSSION

Determining how these two scalable strategies, alone and in sequence, perform for improving interpreter use, the mechanisms by which they do so, and at what cost, will provide critical insights for addressing a persistent cause of healthcare disparities.

TRIAL REGISTRATION

NCT05591586.

Theorizing is for everybody: Advancing the process of theorizing in implementation science

There has been a call to shift from treating theories as static products to engaging in a process of theorizing that develops, modifies, and advances implementation theory through the accumulation of knowledge. Stimulating theoretical advances is necessary to improve our understanding of the causal processes that influence implementation and to enhance the value of existing theory. We argue that a primary reason that existing theory has lacked iteration and evolution is that the process for theorizing is obscure and daunting. We present recommendations for advancing the process of theorizing in implementation science to draw more people in the process of developing and advancing theory.

Strategies to reduce low-value care - An applied behavior analysis using a single-case design

Introduction

Implementation science has traditionally focused on the implementation of evidence-based practices, but the field has increasingly recognized the importance of addressing de-implementation (i.e., the process of reducing low-value care). Most studies on de-implementation strategies have used a combination of strategies without addressing factors that sustain the use of LVC and there is a lack of information about which strategies are most effective and what mechanisms of change might underlie these strategies. Applied behavior analysis is an approach that could be a potential method to gain insights into the mechanisms of de-implementation strategies to reduce LVC. Three research questions are addressed in this study: What contingencies (three-term contingencies or rule-governing behavior) related to the use of LVC can be found in a local context and what strategies can be developed based on an analysis of these contingencies?; Do these strategies change targeted behaviors?; How do the participants describe the strategies' contingencies and the feasibility of the applied behavior analysis approach?

Materials and methods

In this study, we used applied behavior analysis to analyze contingencies that maintain behaviors related to a chosen LVC, the unnecessary use of x-rays for knee arthrosis within a primary care center. Based on this analysis, strategies were developed and evaluated using a single-case design and a qualitative analysis of interview data.

Results

Two strategies were developed: a lecture and feedback meetings. The results from the single-case data were inconclusive but some of the findings may indicate a behavior change in the expected direction. Such a conclusion is supported by interview data showing that participants perceived an effect in response to both strategies.

Conclusion

The findings illustrate how applied behavior analysis can be used to analyze contingencies related to the use of LVC and to design strategies for de-implementation. It also shows an effect of the targeted behaviors even though the quantitative results are inconclusive. The strategies used in this study could be further improved to target the contingencies better by structuring the feedback meetings better and including more precise feedback.

Changing Hearts and Minds in the Equestrian World One Behaviour at a Time

Equestrianism is currently facing a range of pressing challenges. These challenges, which are largely based on evolving attitudes to ethics and equine wellbeing, have consequences for the sport's social licence to operate. The factors that may have contributed to the current situation include overarching societal trends, specific aspects of the equestrian sector, and factors rooted in human nature. If equestrianism is to flourish, it is evident that much needs to change, not the least, human behaviour. To this end, using established behaviour change frameworks that have been scientifically validated and are rooted in practice-most notably, Michie et al.'s COM-B model and Behaviour Change Wheel-could be of practical value for developing and implementing equine welfare strategies. This review summarises the theoretical underpinnings of some behaviour change frameworks and provides a practical, step-by-step approach to designing an effective behaviour change intervention. A real-world example is provided through the retrospective analysis of an intervention strategy that aimed to increase the use of learning theory in (educational) veterinary practice. We contend that the incorporation of effective behaviour change interventions into any equine welfare improvement strategy may help to safeguard the future of equestrianism.

How to not revert to type: Complexity-informed learnings from the pandemic response for health system reform and universal access to integrated care

This article is part of the Research Topic 'Health Systems Recovery in the Context of COVID-19 and Protracted Conflict'.

Background

COVID-19 has highlighted existing health inequalities and health system deficiencies both in Ireland and internationally; however, understanding of the critical opportunities for health system change that have arisen during the pandemic is still emerging and largely descriptive. This research is situated in the Irish health reform context of Sláintecare, the reform programme which aims to deliver universal healthcare by strengthening public health, primary and community healthcare functions as well as tackling system and societal health inequities.

Aims and objectives

This study set out to advance understanding of how and to what extent COVID-19 has highlighted opportunities for change that enabled better access to universal, integrated care in Ireland, with a view to informing universal health system reform and implementation.

Methods

The study, which is qualitative, was underpinned by a co-production approach with Irish health system leadership. Semi-structured interviews were conducted with sixteen health system professionals (including managers and frontline workers) from a range of responses to explore their experiences and interpretations of social processes of change that enabled (or hindered) better access to universal integrated care during the pandemic. A complexity-informed approach was mobilized to theorize the processes that impacted on access to universal, integrated care in Ireland in the COVID-19 context.

Findings

A range of circumstances, strategies and mechanisms that created favorable system conditions in which new integrated care trajectories emerged during the crisis. Three key learnings from the pandemic response are presented: (1) nurturing whole-system thinking through a clear, common goal and shared information base; (2) harnessing, sharing and supporting innovation; and (3) prioritizing trust and relationship-building in a social, human-centered health system. Policy and practice implications for health reform are discussed.

Improving Patient Blood Management Programs: An Implementation Science Approach

Organized patient blood management (PBM) programs function in numerous hospitals and health systems around the world contributing to improved patient outcomes as well as increased patient engagement, decreased resource use, and reductions in health care costs. PBM "programming" ranges from the implementation of single strategies/initiatives to comprehensive programs led by dedicated clinicians and PBM committees, employing the use of multiple PBM strategies. Frontline health care professionals play an important role in leading, implementing, operationalizing, measuring, and sustaining successful PBM programs. In this article, we provide practical implementation guidance to support key clinical, administrative, leadership, and structural elements required for the safe and comprehensive delivery of care in PBM programs at the local level.

Implementation of physical activity interventions in a community-based youth mental healthcare service: A case study of context, strategies, and outcomes

AIMS

Physical activity interventions are recommended for community-based youth mental health services to prevent physical health disparities. Implementation is challenging, and studies focusing on the methods to achieve change are needed. This study aims to identify the context, implementation strategies, and implementation outcomes that illustrate how physical activity interventions were implemented within an early intervention service in Australia.

METHODS

A theoretically informed case study was undertaken. Data from a community-based youth mental health service that delivers an early psychosis programme were collected between July and November 2020. Three data sources were accessed (1) interviews with service managers, mental health clinicians and exercise physiologists; (2) document review of organizational policies and procedures; and (3) survey using the Program Sustainability Assessment Tool. The implementation outcomes investigated were acceptability, fidelity, penetration, and sustainability. Framework analysis was used, and a logic model developed guided by an established template, to interpret findings.

RESULTS

Forty-three contextual factors and 43 implementation strategies were identified. The data suggests that creating a new clinical team and auditing and feedback are critical for implementation. High levels of acceptability and sustainability were described, while fidelity of implementation was difficult to establish, and penetration was low.

CONCLUSIONS

The relationship between constructs suggests several mechanisms underpinned implementation. These include changing professional beliefs, establishing new organizational norms, augmenting existing work processes, and aligning physical activity with priorities of the mental healthcare system and existing work tasks. This case study provides direction for future health service planning of physical activity interventions in community-based youth mental health service.

Strategies for implementing the interRAI home care frailty scale with home-delivered meal clients

Introduction

Frailty is a complex condition that is highly associated with health decline and the loss of independence. Home-delivered meal programs are designed to provide older adults with health and nutritional support that can attenuate the risk of frailty. However, home-delivered meal agencies do not routinely assess frailty using standardized instruments, leading to uncertainty over the longitudinal impact of home-delivered meals on frailty levels. Considering this knowledge gap, this study aimed to facilitate home-delivered meal staff's implementation of a standardized frailty instrument with meal clients as part of routine programming. This article (a) describes the use of Implementation Mapping principles to develop strategies supporting frailty instrument implementation in one home-delivered meal agency and (b) examines the degree to which a combination of strategies influenced the feasibility of frailty instrument use by home-delivered meal staff at multiple time points.

Methods and materials

This retrospective observational study evaluated staff's implementation of the interRAI Home Care Frailty Scale (HCFS) with newly enrolled home-delivered meal clients at baseline-, 3-months, and 6-months. The process of implementing the HCFS was supported by five implementation strategies that were developed based on tenets of Implementation Mapping. Rates of implementation and reasons clients were lost to 3- and 6-month follow-up were evaluated using univariate analyses. Client-level data were also examined to identify demographic factors associated with attrition at both follow-up time points.

Results

Staff implemented the HCFS with 94.8% (n = 561) of eligible home-delivered meal clients at baseline. Of those clients with baseline HCFS data, staff implemented the follow-up HCFS with 43% of clients (n = 241) at 3-months and 18.0% of clients (n = 101) at 6-months. Insufficient client tracking and documentation procedures complicated staff's ability to complete the HCFS at follow-up time points.

Discussion

While the HCFS assesses important frailty domains that are relevant to home-delivered meal clients, its longitudinal implementation was complicated by several agency- and client-level factors that limited the extent to which the HCFS could be feasibly implemented over multiple time points. Future empirical studies are needed to design and test theoretically derived implementation strategies to support frailty instrument use in the home- and community-based service setting.

Exposure to exposure: A protocol for leveraging exposure principles during training to address therapist-level barriers to exposure implementation

BACKGROUND

Exposure therapy is a highly effective but underutilized treatment for anxiety disorders. A primary contributor to its underutilization is therapist-level negative beliefs about its safety and tolerability for patients. Given functional similarities between anxious beliefs among patients and negative beliefs among therapists, the present protocol describes how exposure principles can be leveraged during training to target and reduce therapist negative beliefs.

METHODS

The study will take place in two phases. First, is a case-series analysis to fine-tune training procedures that is already complete, and the second is an ongoing randomized trial that tests the novel exposure to exposure (E2E) training condition against a passive didactic approach. A precision implementation framework will be applied to evaluate the mechanism(s) by which training influences aspects of therapist delivery following training.

ANTICIPATED RESULTS

It is hypothesized that the E2E training condition will produce greater reductions in therapists' negative beliefs about exposure during training relative to the didactic condition, and that greater reduction in negative beliefs will be associated with higher quality exposure delivery as measured by coding of videotaped delivery with actual patients.

CONCLUSION

Implementation challenges encountered to date are discussed along with recommendations for future training interventions. Considerations for expansion of the E2E training approach are also discussed within the context of parallel treatment and training processes that may be tested in future training trials.

The comparative effectiveness of Core versus Core+Enhanced implementation strategies in a randomized controlled trial to improve substance use treatment receipt among justice-involved youth

BACKGROUND

Most justice-involved youth are supervised in community settings, where assessment and linkage to substance use (SU) treatment services are inconsistent and fragmented. Only 1/3 of youth with an identified SU need receive a treatment referral and even fewer initiate services. Thus, improving identification and linkage to treatment requires coordination across juvenile justice (JJ) and behavioral health (BH) agencies. The current study examines the comparative effectiveness of two bundled implementation intervention strategies for improving SU treatment initiation, engagement, and continuing care among justice-involved youth supervised in community settings. Exploration, Preparation, Implementation, Sustainment (EPIS) served as the conceptual framework for study design and selection/timing of implementation intervention components, and the BH Services Cascade served as the conceptual and measurement framework for identifying and addressing gaps in service receipt.

METHODS

Part of a larger Juvenile-Justice Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) Cooperative, this study involved a multisite, cluster-randomized control trial where sites were paired then randomly assigned to receive Core (training teams on the BH Services Cascade and data-driven decision making; supporting goal selection) or Core+Enhanced (external facilitation of implementation teams) intervention components. Youth service records were collected from 20 JJ community supervision agencies (in five states) across five study phases (baseline, pre-randomization, early experiment, late experiment, maintenance). Implementation teams comprised of JJ and BH staff collaboratively identified goals along the BH Cascade and used data-driven decision-making to implement change.

RESULTS

Results suggest that Core intervention components were effective at increasing service receipt over time relative to baseline, but differences between Core and Core+Enhanced conditions were non-significant. Time to service initiation was shorter among Core+Enhanced sites, and deeper Cascade penetration occurred when external facilitation (of implementation teams) was provided. Wide variation existed in the degree and nature of change across service systems.

CONCLUSIONS

Findings demonstrate the criticality of early EPIS phases, demonstrating that strategies provided during the formative exploration and preparation phases produced some improvement in service receipt, whereas implementation-focused activities produced incremental improvement in moving youth farther along the Cascade.

The MOHMQuit (Midwives and Obstetricians Helping Mothers to Quit Smoking) Trial: protocol for a stepped-wedge implementation trial to improve best practice smoking cessation support in public antenatal care services

BACKGROUND

Smoking during pregnancy is the most important preventable cause of adverse pregnancy outcomes, yet smoking cessation support (SCS) is inconsistently provided. The MOMHQUIT intervention was developed to address this evidence-practice gap, using the Behaviour Change Wheel method by mapping barriers to intervention strategies. MOHMQuit includes systems, leadership and clinician elements. This implementation trial will determine the effectiveness and cost-effectiveness of MOHMQuit in improving smoking cessation rates in pregnant women in public maternity care services in Australia; test the mechanisms of action of the intervention strategies; and examine implementation outcomes.

METHODS

A stepped-wedge cluster-randomised design will be used. Implementation of MOHMQuit will include reinforcing leadership investment in SCS as a clinical priority, strengthening maternity care clinicians' knowledge, skills, confidence and attitudes towards the provision of SCS, and clinicians' documentation of guideline-recommended SCS provided during antenatal care. Approximately, 4000 women who report smoking during pregnancy will be recruited across nine sites. The intervention and its implementation will be evaluated using a mixed methods approach. The primary outcome will be 7-day point prevalence abstinence at the end of pregnancy, among pregnant smokers, verified by salivary cotinine testing. Continuous data collection from electronic medical records and telephone interviews with postpartum women will occur throughout 32 months of the trial to assess changes in cessation rates reported by women, and SCS documented by clinicians and reported by women. Data collection to assess changes in clinicians' knowledge, skills, confidence and attitudes will occur prior to and immediately after the intervention at each site, and again 6 months later. Questionnaires at 3 months following the intervention, and semi-structured interviews at 6 months with maternity service leaders will explore leaders' perceptions of acceptability, adoption, appropriateness, feasibility, adaptations and fidelity of delivery of the MOHMQuit intervention. Structural equation modelling will examine causal linkages between the strategies, mediators and outcomes. Cost-effectiveness analyses will also be undertaken.

DISCUSSION

This study will provide evidence of the effectiveness of a multi-level implementation intervention to support policy decisions; and evidence regarding mechanisms of action of the intervention strategies (how the strategies effected outcomes) to support further theoretical developments in implementation science.

TRIAL REGISTRATION

ACTRN12622000167763, registered February 2nd 2022.

Understanding How Newly Implemented Rehabilitation Best Practices Are Sustained: A Realist Review

OBJECTIVE

We conducted a realist review to understand how (mechanism) and in what circumstances (context) evidence-based practices are sustained in rehabilitation (outcome).

DATA SOURCES

MEDLINE, Embase, reference lists, and targeted websites.

STUDY SELECTION

Two independent reviewers calibrated study selection; then 1 reviewer screened all titles and abstracts, while the second reviewer screened a random 20%. We repeated this process for full texts. We included 115 documents representing 61 implementation projects (8.9% of identified documents). Included documents described implementation projects in which physical therapists, occupational therapists, and/or speech-language pathologists were the target users of an evidence-based practice.

DATA EXTRACTION

Two reviewers repeated the independent process described in study selection to extract basic study and sustainability characteristics as well as context, mechanism, outcome, and strategy text.

DATA SYNTHESIS

Using basic numerical analyses, we found that only 54% of evidence-based practices in rehabilitation are sustained. Furthermore, while authors who reported sustainability planning sustained the practice 94% of the time, sustainability planning in rehabilitation is rare (only reported 26% of the time). Extracted text was synthesized using the realist technique of inductive and deductive retroduction in which context, mechanism, outcome, and strategy text are combined into narrative explanations of how sustainability works. To inform these explanations, we applied normalization process theory and the theory of planned behavior. Collectively, the 52 identified narratives provide evidence for 3 patterns: (1) implementation and sustainability phases are interconnected, (2) continued use of the evidence-based practice can be interpreted as the ultimate sustainability outcome, and (3) intermediate sustainability outcomes (ie, fit/alignment, financial support, benefits, expertise) can become contextual features influencing other sustainability outcomes.

CONCLUSIONS

Implementation teams can use the narrative explanations generated in this review to optimize sustainability planning. This can sustain practice changes and improve quality of care and patient outcomes. Future research should seek to iteratively refine the proposed narrative explanations.

Conducting Implementation Research in Stroke Rehabilitation: A Case Example and Considerations for Study Design

As neurorehabilitation research continues to grow, the field must ensure its scientific discoveries are implemented into routine clinical care. Without targeted efforts to increase the implementation of evidence into practice, patients may never see the benefits of interventions, assessments, and technologies developed in the confines of empirical studies. This article serves as a response to Lynch et al's 2018 Point of View piece in Neurorehabilitation and Neural Repair that underscored the urgent need for implementation studies to expedite the application of neurorehabilitation evidence in practice. To address this need, we provide the following 4 considerations investigators should contemplate when designing their own studies at the intersection of implementation and neurorehabilitation research: (a) consideration of guiding theories, models, and frameworks, (b) consideration of implementation strategies, (c) considerations of target outcomes, and (d) consideration of hybrid effectiveness-implementation designs. To conclude, we also provide a study exemplar to depict how these considerations can be integrated into the neurorehabilitation research field to narrow the evidence-to-practice gap.

Mechanisms of change for a family intervention in Kenya: An Integrated Clinical and Implementation Mapping approach

To increase cultural relevance and maximize access for historically underserved populations, there is a need to explore mechanisms underlying treatment outcomes during piloting. We developed a mixed-method approach, Integrated Clinical and Implementation Mapping (ICIM), to explore clinical and implementation mechanisms to inform improvements in content and delivery. We applied ICIM in a pilot of Tuko Pamoja, a lay counselor-delivered family intervention in Kenya (10 families with adolescents ages 12-17). ICIM is a 3-phase process to triangulate data sources to analyze how and why change occurs within individual cases and across cases. We synthesized data from session and supervision transcripts, fidelity and clinical skills ratings, surveys, and interviews. Outputs included a comprehensive narrative and visual map depicting how content and implementation factors influenced change. For Tuko Pamoja, ICIM results showed common presenting problems, including financial strain and caregivers' distress, triggering negative interactions and adolescent distress. ICIM demonstrated that active treatment ingredients included communication skills and facilitated, prescribed time together. Families improved communication, empathy, and hope, facilitated improved family functioning and mental health. Key implementation mechanisms included provider clinical competencies, alliance-building, treatment-aligned adaptations, and consistent attendance. Results guided manual and training refinements and generated hypotheses about mechanisms to test in larger trials.

Influence of implementation strategies on implementation outcomes in a statewide dissemination of Faith, Activity, and Nutrition (FAN)

Faith-based organizations are promising settings for implementation science because they can reach populations bearing a disproportionate burden of chronic disease. This study examined how implementation strategies influenced implementation outcomes in Faith, Activity, and Nutrition (FAN) statewide dissemination. Ninety-three (9%) of 985 invited churches enrolled; 91 (98%) and 83 (89%) completed baseline and 12-month assessments. Community Health Advisors trained and provided phone technical assistance to church committees, led by a FAN coordinator. Church committees were charged with developing plans and installing healthy eating (HE) and physical activity (PA) policies, opportunities, messages and pastor support (implementation outcomes). Structural equation modeling examined how implementation strategies influenced implementation outcomes. Nearly all (99%) FAN coordinators and 60% of pastors attended training, 57% of committees submitted program plans and 51%/54% (HE/PA) of committees met 'every few months'. Statistically significant (P < 0.05) model paths showed positive influences of strategies on implementation outcomes: pastor training on HE and PA pastor support; plan completion on HE and PA messages, PA policies and opportunities as well as FAN committee meetings and committee meetings on HE pastor support, HE policies, PA opportunities and HE and PA messages. This study advances implementation science and provides a model applicable to organizations such as worksites and schools.

Conceptual tensions and practical trade-offs in tailoring implementation interventions

Tailored interventions have been shown to be effective and tailoring is a popular process with intuitive appeal for researchers and practitioners. However, the concept and process are ill-defined in implementation science. Descriptions of how tailoring has been applied in practice are often absent or insufficient in detail. This lack of transparency makes it difficult to synthesize and replicate efforts. It also hides the trade-offs for researchers and practitioners that are inherent in the process. In this article we juxtapose the growing prominence of tailoring with four key questions surrounding the process. Specifically, we ask: (1) what constitutes tailoring and when does it begin and end?; (2) how is it expected to work?; (3) who and what does the tailoring process involve?; and (4) how should tailoring be evaluated? We discuss these questions as a call to action for better reporting and further research to bring clarity, consistency, and coherence to tailoring, a key process in implementation science.

Do the Expert Recommendations for Implementing Change (ERIC) strategies adequately address sustainment?

Background

Sustainability science is an emerging area within implementation science. There is limited evidence regarding strategies to best support the continued delivery and sustained impact of evidence-based interventions (EBIs). To build such evidence, clear definitions, and ways to operationalize strategies specific and/or relevant to sustainment are required. Taxonomies and compilations such as the Expert Recommendations for Implementing Change (ERIC) were developed to describe and organize implementation strategies. This study aimed to adapt, refine, and extend the ERIC compilation to incorporate an explicit focus on sustainment. We also sought to classify the specific phase(s) of implementation when the ERIC strategies could be considered and applied.

Methods

We used a two-phase iterative approach to adapt the ERIC. This involved: (1) adapting through consensus (ERIC strategies were mapped against barriers to sustainment as identified via the literature to identify if existing implementation strategies were sufficient to address sustainment, needed wording changes, or if new strategies were required) and; (2) preliminary application of this sustainment-explicit ERIC glossary (strategies described in published sustainment interventions were coded against the glossary to identify if any further amendments were needed). All team members independently reviewed changes and provided feedback for subsequent iterations until consensus was reached. Following this, and utilizing the same consensus process, the Exploration, Preparation, Implementation and Sustainment (EPIS) Framework was applied to identify when each strategy may be best employed across phases.

Results

Surface level changes were made to the definitions of 41 of the 73 ERIC strategies to explicitly address sustainment. Four additional strategies received deeper changes in their definitions. One new strategy was identified: Communicate with stakeholders the continued impact of the evidence-based practice. Application of the EPIS identified that at least three-quarters of strategies should be considered during preparation and implementation phases as they are likely to impact sustainment.

Conclusion

A sustainment-explicit ERIC glossary is provided to help researchers and practitioners develop, test, or apply strategies to improve the sustainment of EBIs in real-world settings. Whilst most ERIC strategies only needed minor changes, their impact on sustainment needs to be tested empirically which may require significant refinement or additions in the future.

Advancing climate change health adaptation through implementation science

To date, there are few examples of implementation science studies that help guide climate-related health adaptation. Implementation science is the study of methods to promote the adoption and integration of evidence-based tools, interventions, and policies into practice to improve population health. These studies can provide the needed empirical evidence to prioritise and inform implementation of health adaptation efforts. This Personal View discusses five case studies that deployed disease early warning systems around the world. These cases studies illustrate challenges to deploying early warning systems and guide recommendations for implementation science approaches to enhance future research. We propose theory-informed approaches to understand multilevel barriers, design strategies to overcome those barriers, and analyse the ability of those strategies to advance the uptake and scale-up of climate-related health interventions. These findings build upon previous theoretical work by grounding implementation science recommendations and guidance in the context of real-world practice, as detailed in the case studies.

Precision Implementation: An Approach to Mechanism Testing in Implementation Research

Advancing mechanism-focused research in implementation science is a priority given its potential to improve tailoring and efficiency of implementation strategies. Experimental therapeutics, or experimental medicine, offers an approach for mechanism testing that has been promoted by the NIH Science of Behavior Change and endorsed by the National Institute for Mental Health. This approach has been applied across the translational spectrum - with initial applications to biological research and more recent applications to psychosocial treatment development research. We describe further advancement of experimental therapeutics along the translational spectrum and describe how it is ideally suited to inform precision experimental tests of implementation strategy mechanisms, which we term precision implementation. Such an approach to mechanism testing will allow for identification of causal dose-response relationships between implementation strategies, presumed mechanisms, and implementation outcomes. We discuss the tension between the scientific rigor required to conduct mechanism-focused research using experimental therapeutics and the "real world" conditions in which implementation research takes place. We provide a series of example studies that show "beginning to end" application of this framework in research focused on provider implementation of an evidence-based intervention in routine clinical care settings.

"We start where we are": a qualitative study of barriers and pragmatic solutions to the assessment and reporting of implementation strategy fidelity

BACKGROUND

Fidelity measurement of implementation strategies is underdeveloped and underreported, and the level of reporting is decreasing over time. Failing to properly measure the factors that affect the delivery of an implementation strategy may obscure the link between a strategy and its outcomes. Barriers to assessing and reporting implementation strategy fidelity among researchers are not well understood. The aims of this qualitative study were to identify barriers to fidelity measurement and pragmatic pathways towards improvement.

METHODS

We conducted in-depth interviews among researchers conducting implementation trials. We utilized a theory-informed interview approach to elicit the barriers and possible solutions to implementation strategy fidelity assessment and reporting. Reflexive-thematic analysis guided coding and memo-writing to determine key themes regarding barriers and solutions.

RESULTS

Twenty-two implementation researchers were interviewed. Participants agreed that implementation strategy fidelity was an essential element of implementation trials and that its assessment and reporting should improve. Key thematic barriers focused on (1) a current lack of validated fidelity tools with the need to assess fidelity in the short term, (2) the complex nature of some implementation strategies, (3) conceptual complications when assessing fidelity within mechanisms-focused implementation research, and (4) structural issues related to funding and publishing. Researchers also suggested pragmatic solutions to overcome each barrier. Respondents reported using specification and tracking data in the short term until validated tools become available. Participants suggested that researchers with strategy-specific content expertise lead the way in identifying core components and setting fidelity requirements for them. Addressing the third barrier, participants provided examples of what pragmatic prospective and retrospective fidelity assessments might look like along a mechanistic pathway. Finally, researchers described approaches to minimize costs of data collection, as well as more structural accountability like adopting and enforcing reporting guidelines or changing the structure of funding opportunities.

DISCUSSION

We propose short- and long-term priorities for improving the assessment and reporting of implementation strategy fidelity and the quality of implementation research.

CONCLUSIONS

A better understanding of the barriers to implementation strategy fidelity assessment may pave the way towards pragmatic solutions.

Identifying core strategies and mechanisms for spreading a national medicines optimisation programme across England-a mixed-method study applying qualitative thematic analysis and Qualitative Comparative Analysis

Background

Achieving widespread adoption of innovations across health systems remains a challenge. Past efforts have focused on identifying and classifying strategies to actively support innovation spread (replicating an innovation across sites), but we lack an understanding about the mechanisms which such strategies draw on to deliver successful spread outcomes. There is also no established methodology to identify core strategies or mechanisms which could be replicated with fidelity in new contexts when spreading innovations. We aimed to understand which strategies and mechanisms are connected with successful spread using the case of a national medicines optimisation programme in England.

Methods

The study applied a comparative mixed-method case study approach. We compared spread activity in 15 Academic Health Science Networks (AHSN) in England, applied to one innovation case, Transfers of Care Around Medicines (TCAM). We followed two methodological steps: (1) qualitative thematic analysis of primary data collected from 18 interviews with AHSN staff members to identify the strategies and mechanisms and related contextual determinants and (2) Qualitative Comparative Analysis (QCA) combining secondary quantitative data on spread outcome and qualitative themes from step 1 to identify the core strategies and mechanisms.

Results

We identified six common spread strategy-mechanism constructs that AHSNs applied to spread the TCAM national spread programme: (1) the unique intermediary position of the AHSN as “honest broker” and local networking organisation, (2) the right capacity and position of the spread facilitator, (3) an intersectoral and integrated stakeholder engagement approach, (4) the dynamic marriage of the innovation with local health and care system needs and characteristics, (5) the generation of local evidence, and (6) the timing of TCAM. The QCA resulted in the core strategy/mechanism of a timely start into the national spread programme in combination with the employment of a local, senior pharmacist as an AHSN spread facilitator.

Conclusions

By qualitatively comparing experiences of spreading one innovation across different contexts, we identified common strategies, causal mechanisms, and contextual determinants. The QCA identified one core combination of two strategies/mechanisms. The identification of core strategies/mechanisms and common pre-conditional and mediating contextual determinants of a specific innovation offers spread facilitators and implementers a priority list for tailoring spread activities.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00364-5.

The mechanics of implementation strategies and measures: advancing the study of implementation mechanisms

BACKGROUND

There is a fundamental gap in understanding the causal mechanisms by which strategies for implementing evidence-based practices address local barriers to effective, appropriate service delivery. Until this gap is addressed, scientific knowledge and practical guidance about which implementation strategies to use in which contexts will remain elusive. This research project aims to identify plausible strategy-mechanism linkages, develop causal models for mechanism evaluation, produce measures needed to evaluate such linkages, and make these models, methods, and measures available in a user-friendly website. The specific aims are as follows: (1) build a database of strategy-mechanism linkages and associated causal pathway diagrams, (2) develop psychometrically strong, pragmatic measures of mechanisms, and (3) develop and disseminate a website of implementation mechanisms knowledge for use by diverse stakeholders.

METHODS

For the first aim, a combination of qualitative inquiry, expert panel methods, and causal pathway diagramming will be used to identify and confirm plausible strategy-mechanism linkages and articulate moderators, preconditions, and proximal and distal outcomes associated with those linkages. For the second aim, rapid-cycle measure development and testing methods will be employed to create reliable, valid, pragmatic measures of six mechanisms of common strategies for which no high-quality measures exist. For the third aim, we will develop a user-friendly website and searchable database that incorporates user-centered design, disseminating the final product using social marketing principles.

DISCUSSION

Once strategy-mechanism linkages are identified using this multi-method approach, implementation scientists can use the searchable database to develop tailored implementation strategies and generate more robust evidence about which strategies work best in which contexts. Moreover, practitioners will be better able to select implementation strategies to address their specific implementation problems. New horizons in implementation strategy development, optimization, evaluation, and deployment are expected to be more attainable as a result of this research, which will lead to enhanced implementation of evidence-based interventions for cancer control, and ultimately improvements in patient outcomes.

Required sample size to detect mediation in 3-level implementation studies

Background

Statistical tests of mediation are important for advancing implementation science; however, little research has examined the sample sizes needed to detect mediation in 3-level designs (e.g., organization, provider, patient) that are common in implementation research. Using a generalizable Monte Carlo simulation method, this paper examines the sample sizes required to detect mediation in 3-level designs under a range of conditions plausible for implementation studies.

Method

Statistical power was estimated for 17,496 3-level mediation designs in which the independent variable (X) resided at the highest cluster level (e.g., organization), the mediator (M) resided at the intermediate nested level (e.g., provider), and the outcome (Y) resided at the lowest nested level (e.g., patient). Designs varied by sample size per level, intraclass correlation coefficients of M and Y, effect sizes of the two paths constituting the indirect (mediation) effect (i.e., X→M and M→Y), and size of the direct effect. Power estimates were generated for all designs using two statistical models—conventional linear multilevel modeling of manifest variables (MVM) and multilevel structural equation modeling (MSEM)—for both 1- and 2-sided hypothesis tests.

Results

For 2-sided tests, statistical power to detect mediation was sufficient (≥0.8) in only 463 designs (2.6%) estimated using MVM and 228 designs (1.3%) estimated using MSEM; the minimum number of highest-level units needed to achieve adequate power was 40; the minimum total sample size was 900 observations. For 1-sided tests, 808 designs (4.6%) estimated using MVM and 369 designs (2.1%) estimated using MSEM had adequate power; the minimum number of highest-level units was 20; the minimum total sample was 600. At least one large effect size for either the X→M or M→Y path was necessary to achieve adequate power across all conditions.

Conclusions

While our analysis has important limitations, results suggest many of the 3-level mediation designs that can realistically be conducted in implementation research lack statistical power to detect mediation of highest-level independent variables unless effect sizes are large and 40 or more highest-level units are enrolled. We suggest strategies to increase statistical power for multilevel mediation designs and innovations to improve the feasibility of mediation tests in implementation research.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01235-2.

Program adaptation by health departments

Introduction

The dissemination of evidence-based interventions (i.e., programs, practices, and policies) is a core function of US state health departments (SHDs). However, interventions are originally designed and tested with a specific population and context. Hence, adapting the intervention to meet the real-world circumstances and population's needs can increase the likelihood of achieving the expected health outcomes for the target population from the implemented intervention. This study identified how SHD employees decide to adapt public health programs and what influences decisions on how to adapt them.

Materials and methods

SHD employees (n = 45) were interviewed using a qualitative semi-structured interview guide. Telephone interviews were audio-recorded and transcribed verbatim. The transcripts were consensus-coded and themes were identified using thematic analysis. Several themes aligned with the Model for Adaptation Design and Impact.

Results

Data, outcomes, and health department evaluations influenced decisions to adapt a program (pre-adaptation), and reasons to adapt a program included organizational and sociopolitical contextual factors. SHD middle-level managers, program managers and staff, and local agencies were involved in the decisions to adapt the programs. Finally, the goals for adapting a program included enhancing effectiveness/outcomes, reach and satisfaction with the program; funding; and partner engagement. After SHD employees decided to adapt a program, data and evidence guided the changes. Program staff and evaluators were engaged in the adaptation process. Program managers consulted partners to gather ideas on how best to adapt a program based on partners' experiences implementing the program and obtaining community input. Lastly, program managers also received input on adapting content and context from coalition meetings and periodic technical assistance calls.

Discussion

The findings related to decisions to adapt public health programs provide practitioners with considerations for adapting them. Findings reaffirm the importance of promoting public health competencies in program evaluation and adaptation, as well as systematically documenting and evaluating the adaptation processes. In addition, the themes could be studied in future research as mechanisms, mediators, and moderators to implementation outcomes.

Qualitative evaluation of the Systems Analysis and Improvement Approach as a strategy to increase HIV testing in family planning clinics using the Consolidated Framework for Implementation Research and the Implementation Outcomes Framework

BACKGROUND

Significant gaps remain in HIV testing and counseling (HTC) in family planning (FP) clinics. To address these gaps, our group tested an implementation strategy called the Systems Analysis and Improvement Approach (SAIA), an evidenced-based multi-component implementation strategy focused on improving entire care cascades. In a cluster randomized trial of 24 FP clinics in Mombasa County, Kenya, SAIA led to a significant increase in HTC in intervention clinics compared to control clinics. The objective of this manuscript was to evaluate SAIA using the Consolidated Framework for Implementation Research (CFIR) and assess the Implementation Outcomes Framework outcomes of acceptability, appropriateness, and feasibility.

METHODS

This qualitative assessment was nested within the cluster-randomized trial. Data collection included questionnaires to assess modifiable and non-modifiable health system factors related to HTC and in-depth interviews to query clinic norms, priorities, communication strategies, and readiness for change. The primary outcomes of interest were feasibility, appropriateness, and acceptability of SAIA. Data on inner setting and structural characteristics of FP clinics were collected to inform how context may impact outcomes. All interviews were recorded and analyzed using a rapid assessment approach.

RESULTS

Of the 12 intervention clinics, 6 (50%) were public facilities. Availability of resources varied by clinic. Most clinics had a positive implementation climate, engaged leadership, and access to resources and information. While not all clinics identified HTC as a clinic priority, most reported a strong culture of embracing change and recognition of the importance of HIV testing within FP clinics. Interviews highlighted very high acceptability, appropriateness, and feasibility of SAIA. The implementation strategy was not complicated and fit well into existing clinic processes. In particular, staff appreciated that SAIA allowed clinic staff to generate contextually relevant solutions that they implemented.

CONCLUSIONS

SAIA was implemented in FP clinics of varying sizes, capacity, and management support and was found to be acceptable, appropriate, and feasible. The agency that clinic staff felt in proposing and implementing their own solutions was likely part of SAIA's success. We anticipate this will continue to be a mechanism of SAIA's success when it is scaled up to more clinics in future trials.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT02994355) registered 16 December 2016.

Implementation lessons learnt when trialling palliative care interventions in the intensive care unit: relationships between determinants, implementation strategies, and models of delivery-a systematic review protocol

BACKGROUND

Heterogeneity amongst palliative care interventions in the intensive care unit (ICU) and their outcomes has meant that, even when found to be effective, translation of evidence into practice is hindered. Previous evidence reviews have suggested that the field of ICU-based palliative care would benefit from well-designed, targeted interventions, with explicit knowledge translation research demonstrating valid implementation strategies. Reviewing effectiveness studies alongside process evaluations for these interventions will give insight into the implementation barriers or constraints identified, and the implementation strategies adopted.

METHODS

A systematic review to identify and synthesise knowledge on how models of integrating palliative care into the ICU have been implemented and provide critical recommendations for successful future development and implementation of complex interventions in the field. The search will be carried out using MEDLINE, Embase, Cochrane, CINAHL, and PsycINFO. The search strategy will combine terms related to palliative care, intensive care, and implementation. Only full-text articles will be considered and conference abstracts excluded. There will be no date or language restrictions. The Implementation Research Logic Model will be used as a framework for synthesis. Findings will be reported following the Preferred Reporting Items of Systematic Reviews and Meta-Analyses (PRISMA) guidelines.

DISCUSSION

This review will provide understanding of implementation facilitators, barriers, and strategies, when employing palliative care interventions within the ICU. This will provide valuable recommendations for successful future development of complex interventions using implementation frameworks or theories. This can increase the potential for sustained change in practice, reduce heterogeneity in interventions, and therefore help produce measurable and comparable outcomes.

SYSTEMATIC REVIEW REGISTRATION

International Prospective Register of Systematic reviews PROSPERO (CRD42022311052).

Implementation Science: Increasing the Public Health Impact of Audiology Research

PURPOSE

Implementation science aims to facilitate the use of evidence-based programs, practices, and policies in routine care settings. In audiology, as in other health disciplines, there is a persistent research-to-practice gap. Improving the adoption, reach, implementation, and sustainment of effective interventions in audiology would increase their public health impact, ensuring that all individuals needing hearing health care services could benefit from innovations and evidence-based best practices. This tutorial provides an introductory overview of implementation science relevant to the field of audiology, including Internet-based practices and interventions.

METHOD

Major concepts and themes of implementation science are presented, including implementation outcomes, implementation science frameworks, implementation strategies, current topics in implementation science, and study design considerations. Recent publications in audiology are highlighted to illustrate implementation science concepts and themes. The relevance of each topic to the use of evidence-based programs, practices, and policies in audiology is highlighted with reference to recent research in the field.

CONCLUSIONS

Challenges in the widespread delivery of evidence-based audiological practices and interventions limit their public health impact. The application of implementation science principles and methods in audiology research, as demonstrated in other areas of health research, can increase our focus on ensuring that effective practices are widely available, accessible, equitable, and sustainable to improve the lives of those who need them.

A randomized controlled trial in schools aimed at exploring mechanisms of change of a multifaceted implementation strategy for promoting mental health at the workplace

Background

This study will explore implementation mechanisms through which a single implementation strategy and a multifaceted implementation strategy operate to affect the implementation outcome, which is fidelity to the Guideline For The Prevention of Mental Ill Health within schools. The guideline gives recommendations on how workplaces can prevent mental ill health among their personnel by managing social and organizational risks factors in the work environment. Schools are chosen as the setting for the study due to the high prevalence of mental ill health among teachers and other personnel working in schools. The study builds on our previous research, in which we compared the effectiveness of the two strategies on fidelity to the guideline. Small improvements in guideline adherence were observed for the majority of the indicators in the multifaceted strategy group. This study will focus on exploring the underlying mechanisms of change through which the implementation strategies may operate to affect the implementation outcome.

Methods

We will conduct a cluster-randomized-controlled trial among public schools (n=55 schools) in Sweden. Schools are randomized (1:1 ratio) to receive a multifaceted strategy (implementation teams, educational meeting, ongoing training, Plan-Do-Study-Act cycles) or a single strategy (implementation teams, educational meeting). The implementation outcome is fidelity to the guideline. Hypothesized mediators originate from the COM-B model. A mixed-method design will be employed, entailing a qualitative study of implementation process embedded within the cluster-randomized controlled trail examining implementation mechanisms. The methods will be used in a complementary manner to get a full understanding of the implementation mechanisms.

Discussion

This implementation study will provide valuable knowledge on how implementation strategies work (or fail) to affect implementation outcomes. The knowledge gained will aid the selection of effective implementation strategies that fit specific determinants, which is a priority for the field. Despite recent initiatives to advance the understanding of implementation mechanisms, studies testing these mechanisms are still uncommon.

Trial registration

ClinicalTrials.org dr.nr 2020-01214.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01230-7.

Developing an implementation research logic model: using a multiple case study design to establish a worked exemplar

Background

Implementation science frameworks explore, interpret, and evaluate different components of the implementation process. By using a program logic approach, implementation frameworks with different purposes can be combined to detail complex interactions. The Implementation Research Logic Model (IRLM) facilitates the development of causal pathways and mechanisms that enable implementation. Critical elements of the IRLM vary across different study designs, and its applicability to synthesizing findings across settings is also under-explored. The dual purpose of this study is to develop an IRLM from an implementation research study that used case study methodology and to demonstrate the utility of the IRLM to synthesize findings across case sites.

Method

The method used in the exemplar project and the alignment of the IRLM to case study methodology are described. Cases were purposely selected using replication logic and represent organizations that have embedded exercise in routine care for people with cancer or mental illness. Four data sources were selected: semi-structured interviews with purposely selected staff, organizational document review, observations, and a survey using the Program Sustainability Assessment Tool (PSAT). Framework analysis was used, and an IRLM was produced at each case site. Similar elements within the individual IRLM were identified, extracted, and re-produced to synthesize findings across sites and represent the generalized, cross-case findings.

Results

The IRLM was embedded within multiple stages of the study, including data collection, analysis, and reporting transparency. Between 33-44 determinants and 36-44 implementation strategies were identified at sites that informed individual IRLMs. An example of generalized findings describing “intervention adaptability” demonstrated similarities in determinant detail and mechanisms of implementation strategies across sites. However, different strategies were applied to address similar determinants. Dependent and bi-directional relationships operated along the causal pathway that influenced implementation outcomes.

Conclusions

Case study methods help address implementation research priorities, including developing causal pathways and mechanisms. Embedding the IRLM within the case study approach provided structure and added to the transparency and replicability of the study. Identifying the similar elements across sites helped synthesize findings and give a general explanation of the implementation process. Detailing the methods provides an example for replication that can build generalizable knowledge in implementation research.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00337-8.

Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem

BACKGROUND

Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers.

MAIN BODY

Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches.

CONCLUSION

We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

Study protocol for a cluster-randomized trial of a bundle of implementation support strategies to improve the fidelity of implementation of schoolwide Positive Behavioral Interventions and Supports in rural schools

Background

Improving the implementation of evidence-based interventions is important for population-level impacts. Positive Behavioral Interventions and Supports (PBIS) is effective for improving school climate and students’ behavioral outcomes, but rural schools often lag behind urban and suburban schools in implementing such initiatives.

Methods/Design

This paper describes a Type 3 hybrid implementation-effectiveness trial of Rural School Support Strategies (RS3), a bundle of implementation support strategies selected to improve implementation outcomes in rural schools. In this two-arm parallel group trial, 40 rural public schools are randomized to receive: 1) a series of trainings about PBIS; or 2) an enhanced condition with training plus RS3. The trial was planned for two years, but due to the pandemic has been extended another year. RS3 draws from the Interactive Systems Framework, with a university-based team (support system) that works with a team at each school (school-based delivery system), increasing engagement through strategies such as: providing technical assistance, facilitating school team functioning, and educating implementers. The primary organizational-level outcome is fidelity of implementation, with additional implementation outcomes of feasibility, acceptability, appropriateness, and cost. Staff-level outcomes include perceived climate and self-reported adoption of PBIS core components. Student-level outcomes include disciplinary referrals, academic achievement, and perceived climate. Mediators being evaluated include organizational readiness, school team functioning, and psychological safety.

Discussion

The study tests implementation strategies, with strengths including a theory-based design, mixed methods data collection, and consideration of mediational mechanisms. Results will yield knowledge about how to improve implementation of universal prevention initiatives in rural schools.

Understanding dynamic complexity in context-Enriching contextual analysis in implementation science from a constructivist perspective

Context in implementation science includes not only characteristics of a setting in which an intervention will be delivered, but also social systems (e.g., interrelationships). Context is dynamic and interacts with both, the intervention and its implementation. Therefore, contextual analysis is recognized as an indispensable part of implementation science methodology: it provides the foundation for successful and sustainable implementation projects. Yet, driven by the prevailing post-positivist understanding of context, contextual analysis typically focuses on individual characteristics of context i.e., contextual dynamics and interactions go unnoticed. Conducting contextual analysis from a constructivist perspective promotes a multilayered approach, building a more comprehensive understanding of context, and thus facilitating successful implementation. In this article, we highlight the limitations of prevailing perspectives on context and approaches to contextual analysis. We then describe how contextual analysis can be enriched by working from a constructivist perspective. We finish with a discussion of the methodological and practical implications the proposed changes would entail. Emerging literature attempts to address both the concept of context and methods for contextual analysis. Various theories, models and frameworks consider context, however, many of these are reductionistic and do not acknowledge the dynamic nature of context or interactions within it. To complement recent conceptualizations of context, we suggest consider the following five constructivist concepts: 1) social space; 2) social place; 3) agency; 4) sensation; and 5) embodiment. We demonstrate the value of these concepts using COVID-19 vaccination uptake as an example and integrate the concepts in the Context and Implementation of Complex Interventions (CICI) framework-an implementation science framework that pays ample attention to context. To study context from a constructivist perspective, we also suggest additional considerations in view of methodologies for data collection and analysis, e.g., rapid ethnographic methods. A constructivist perspective contributes to a stronger conceptualization of contextual analysis. Considering the five constructivist concepts helps to overcome contextual analysis' current shortcomings, while revealing complex dynamics that usually go unnoticed. Thus, more comprehensive understanding of context can be developed to inform subsequent phases of an implementation project, thereby maximizing an intervention's uptake and sustainability.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Understanding the Role of Clinical Champions and Their Impact on Clinician Behavior Change: The Need for Causal Pathway Mechanisms

Background

The clinical champion approach is a highly utilized implementation strategy used to mitigate barriers and improve outcomes of implementation efforts. Clinical champions are particularly effective at addressing provider-level barriers and promoting provider-behavior change. Yet, the specific causal pathways that explain how clinical champions impact provider behavior change have not been well-explicated. The current paper applies behavior change models to develop potential causal pathway mechanisms.

Methods

The proposed mechanisms are informed by previous literature involving clinical champions and empirically supported behavior change models. These models are applied to link specific attributes to different stages of behavior change and barriers for providers.

Results

Two unique pathway mechanisms were developed, one that explicates how providers develop intention to use EBPs, while the other explicates how providers transition to EBP use and sustainment. Clinical champions may promote intention development through behavioral modeling and peer buy-in. In contrast, champions promote behavioral enactment through skill building and peer mentorship.

Conclusion

Clinical champions likely play a critical role in reducing provider implementation barriers for providers across various phases of behavior change. The proposed pathways provide potential explanations for how clinical champions promote provider behavior change. Future research should prioritize empirically testing causal pathway mechanisms.

Expanding access to medications for opioid use disorder in primary care clinics: an evaluation of common implementation strategies and outcomes

BACKGROUND

To combat the opioid epidemic in the USA, unprecedented federal funding has been directed to states and territories to expand access to prevention, overdose rescue, and medications for opioid use disorder (MOUD). Similar to other states, California rapidly allocated these funds to increase reach and adoption of MOUD in safety-net, primary care settings such as Federally Qualified Health Centers. Typical of current real-world implementation endeavors, a package of four implementation strategies was offered to all clinics. The present study examines (i) the pre-post effect of the package of strategies, (ii) whether/how this effect differed between new (start-up) versus more established (scale-up) MOUD practices, and (iii) the effect of clinic engagement with each of the four implementation strategies.

METHODS

Forty-one primary care clinics were offered access to four implementation strategies: (1) Enhanced Monitoring and Feedback, (2) Learning Collaboratives, (3) External Facilitation, and (4) Didactic Webinars. Using linear mixed effects models, RE-AIM guided outcomes of reach, adoption, and implementation quality were assessed at baseline and at 9 months follow-up.

RESULTS

Of the 41 clinics, 25 (61%) were at MOUD start-up and 16 (39%) were at scale-up phases. Pre-post difference was observed for the primary outcome of percent of patient prescribed MOUD (reach) (β_time = 3.99; 0.73 to 7.26; p = 0.02). The largest magnitude of change occurred in implementation quality (ES = 0.68; 95% CI = 0.66 to 0.70). Baseline MOUD capability moderated the change in reach (start-ups 22.60%, 95% CI = 16.05 to 29.15; scale-ups -4.63%, 95% CI = -7.87 to -1.38). Improvement in adoption and implementation quality were moderately associated with early prescriber engagement in Learning Collaboratives (adoption: ES = 0.61; 95% CI = 0.25 to 0.96; implementation quality: ES = 0.55; 95% CI = 0.41 to 0.69). Improvement in adoption was also associated with early prescriber engagement in Didactic Webinars (adoption: ES = 0.61; 95% CI = 0.20 to 1.05).

CONCLUSIONS

Rather than providing an all-clinics-get-all-components package of implementation strategies, these data suggest that it may be more efficient and effective to tailor the provision of implementation strategies based on the needs of clinic. Future implementation endeavors could benefit from (i) greater precision in the provision of implementation strategies based on contextual determinants, and (ii) the inclusion of strategies targeting engagement.

To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth

Mental health organizations that serve youth are under pressure to adopt measurement-based care (MBC), defined as the continuous collection of client-report data used to support clinical decision-making as part of standard care. However, few frameworks exist to help leadership ascertain how to select an MBC approach for a clinical setting. This paper seeks to define how an MBC approach can display clinical utility to provide such a framework. Broadly, we define clinical utility as evidence that an MBC approach assists stakeholders in fulfilling clinical goals related to care quality (i.e., improve client-clinician alliance and clinical outcomes) at the client (i.e., youth and caregiver), clinician, supervisor, and administrator levels. More specifically, our definition of clinical utility is divided into two categories relevant to the usability and usefulness of an MBC approach for a specific setting: (a) implementability (i.e., evidence indicating ease of use in a clinical setting) and (b) usefulness in aiding clinical activities (i.e., evidence indicating the potential to improve communication and make clinical activities related to care quality easier or more effective). These categories provide valuable information about how easy an MBC approach is to use and the potential benefits that the MBC data will confer. To detail how we arrived at this definition, we review prior definitions of clinical utility, discuss how previous definitions inform our definition of clinical utility for MBC, and provide examples of how the concept of clinical utility can be applied to MBC. We finish with a discussion of future research directions.

Management strategies to de-implement low-value care-an applied behavior analysis

BACKGROUND

There is a lack of knowledge about management strategies being used to de-implement low-value care (LVC). Furthermore, it is not clear from the current literature what mechanisms are involved in such strategies and how they can change physicians' behaviors. Understanding the mechanisms is important for determining a strategy's potential impact. Applied behavior analysis focuses on processes involved in increasing and decreasing behaviors. Therefore, the aim of this study is to understand what management strategies are being used to de-implement LVC and the possible mechanisms involved in those strategies, using concepts from applied behavior analysis.

METHOD

We applied a qualitative study design using an inductive approach to understand what management strategies are in use and then employed applied behavior analysis concepts to deductively analyze the mechanisms involved in them.

RESULTS

We identified eight different management strategies intended to influence LVC. Five of the strategies were developed at a regional level and had the potential to influence physicians' LVC-related behaviors either by functioning as rules on which LVC to de-implement or by initiating local strategies in each health care center that in turn could influence LVC practices. The local strategies had a stronger potential for influencing de-implementation.

CONCLUSION

Both strategies at a systemic level (regional) and on a local level (health care centers) must be considered to influence LVC-related behaviors. Strategies at the center level have a specific opportunity to impact LVC-related behaviors because they can be tailored to specific circumstances, even though some of them probably were initiated as an effect of strategies on a regional level. Using applied behavior analysis to understand these circumstances can be helpful for tailoring strategies to reduce LVC use.

Translational framework for implementation evaluation and research: Protocol for a qualitative systematic review of studies informed by Normalization Process Theory (NPT) [version 1; peer review: 2 approved]

BACKGROUND

Normalization Process Theory (NPT) identifies mechanisms that have been demonstrated to play an important role in implementation processes. It is now widely used to inform feasibility, process evaluation, and implementation studies in healthcare and other areas of work. This qualitative synthesis of NPT studies aims to better understand how NPT explains observed and reported implementation processes, and to explore the ways in which its constructs explain the implementability, enacting and sustainment of complex healthcare interventions.

METHODS

We will systematically search Scopus, PubMed and Web of Science databases and use the Google Scholar search engine for citations of key papers in which NPT was developed. This will identify English language peer-reviewed articles in scientific journals reporting (a) primary qualitative or mixed methods studies; or, (b) qualitative or mixed methods evidence syntheses in which NPT was the primary analytic framework. Studies may be conducted in any healthcare setting, published between June 2006 and 31 December 2021. We will perform a qualitative synthesis of included studies using two parallel methods: (i) directed content analysis based on an already developed coding manual; and (ii) unsupervised textual analysis using Leximancer® topic modelling software.

OTHER

We will disseminate results of the review using peer reviewed publications, conference and seminar presentations, and social media (Facebook and Twitter) channels. The primary source of funding is the National Institute for Health Research ARC North Thames. No human subjects or personal data are involved and no ethical issues are anticipated.

Social determinants of health and cancer screening implementation and outcomes in the USA: a systematic review protocol

BACKGROUND

Improving the delivery, uptake, and implementation of cancer screening to meet evidence-based recommendations is needed to reduce persistent cancer health disparities in the USA. Current national public health targets emphasize the role of social determinants of health (SDOH) on cancer screening. However, there remains a need to explicate these linkages, toward the goal of identifying and implementing effective interventions that target and address SDOH to reduce inequities in cancer screening.

METHODS

We will conduct a systematic review of English language peer-reviewed original research articles published between 2010 and 2021 that describe observational (qualitative and quantitative) and intervention studies conducted in the USA. In alignment with Healthy People 2030, we will include studies of breast, cervical, colorectal, and/or lung cancer screening. Guided by multiple SDOH frameworks, we will broadly define SDOH by five domain areas: economic stability, education access and quality, healthcare access and quality, neighborhood and built environment, and social and community context. Following systematic literature searches in five databases (Ovid MEDLINE, Embase, CINAHL, Web of Science, Cochrane Library) and piloting of screening procedures, reviewers will independently screen titles/abstracts for potential relevance. Reviewer pairs will then screen full text articles for eligibility criteria. We will extract data items from included articles, including study characteristics, cancer screening intervention information, and coding of SDOH constructs. We will assess study quality using the Mixed Methods Appraisal Tool and synthesize our findings using narrative, descriptive statistics, tables, and figures. Our approach will adhere to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) recommendations.

DISCUSSION

By completing this systematic review, we will summarize recent literature on SDOH and cancer screening, identify research gaps for inclusion of SDOH, and propose future opportunities for advancing equity in cancer screening by integrating SDOH as part of the implementation context to promote uptake, sustainability, and scale-up in the implementation of screening guidelines.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42021276582 .

Advancing the reporting of mechanisms in implementation science: A guideline for reporting mediation analyses (AGReMA)

Well-conducted mediation analyses have the potential to move implementation science forward by better understanding how or why implementation strategies cause their effects on outcomes. The AGReMA statement provides authors with recommendations for reporting primary and secondary mediation analyses of randomized trials and observational studies. Improved reporting of studies that use mediation analyses could help produce publications that are complete, accurate, transparent, and reproducible.

Grounding implementation science in health equity for cancer prevention and control

BACKGROUND

The past decade of research has seen theoretical and methodological advances in both implementation science and health equity research, opening a window of opportunity for facilitating and accelerating cross-disciplinary exchanges across these fields that have largely operated in siloes. In 2019 and 2020, the National Cancer Institute's Consortium for Cancer Implementation Science convened an action group focused on 'health equity and context' to identify opportunities to advance implementation science. In this paper, we present a narrative review and synthesis of the relevant literature at the intersection of health equity and implementation science, highlight identified opportunities (i.e., public goods) by the action group for advancing implementation science in cancer prevention and control, and integrate the two by providing key recommendations for future directions.

DISCUSSION

In the review and synthesis of the literature, we highlight recent advances in implementation science, relevant to promoting health equity (e.g., theories/models/frameworks, adaptations, implementation strategies, study designs, implementation determinants, and outcomes). We acknowledge the contributions from the broader field of health equity research and discuss opportunities for integration and synergy with implementation science, which include (1) articulating an explicit focus on health equity for conducting and reviewing implementation science; (2) promoting an explicit focus on health equity in the theories, models, and frameworks guiding implementation science; and (3) identifying methods for understanding and documenting influences on the context of implementation that incorporate a focus on equity. To advance the science of implementation with a focus on health equity, we reflect on the essential groundwork needed to promote bi-directional learning between the fields of implementation science and health equity research and recommend (1) building capacity among researchers and research institutions for health equity-focused and community-engaged implementation science; (2) incorporating health equity considerations across all key implementation focus areas (e.g., adaptations, implementation strategies, study design, determinants, and outcomes); and (3) continuing a focus on transdisciplinary opportunities in health equity research and implementation science. We believe that these recommendations can help advance implementation science by incorporating an explicit focus on health equity in the context of cancer prevention and control and beyond.

Leveraging Stakeholder Engagement and Virtual Environments to Develop a Strategy for Implementation of Adolescent Depression Services Integrated Within Primary Care Clinics of Mozambique

Psychiatric disorders are the number one cause of disability in adolescents worldwide. Yet, in low- and middle-income countries (LMIC), where 90% of adolescents reside, mental health services are extremely limited, and the majority do not have access to treatment. Integration of mental health services within primary care of LMICs has been proposed as an efficient and sustainable way to close the adolescent mental health treatment gap. However, there is limited research on how to effectively implement integrated mental health care in LMIC. In the present study, we employed Implementation Mapping to develop a multilevel strategy for integrating adolescent depression services within primary care clinics of Maputo, Mozambique. Both in-person and virtual approaches for Implementation Mapping activities were used to support an international implementation planning partnership and promote the engagement of multilevel stakeholders. We identified determinants to implementation of mental health services for adolescents in LMIC across all levels of the Consolidated Framework for Implementation Research, of which of 25% were unique to adolescent-specific services. Through a series of stakeholder workshops focused on implementation strategy selection, prioritization, and specification, we then developed an implementation plan comprising 33 unique strategies that target determinants at the intervention, patient, provider, policy, and community levels. The implementation plan developed in this study will be evaluated for delivering adolescent depression services in Mozambican primary care and may serve as a model for other low-resource settings.

Linking Process and Outcome Measures to Improve Employment Support Programs for Individuals With the Most Significant Disabilities

Employment agencies and funding systems commonly use distal outcome measures such as employed or not employed, full-time or part-time, and continuous measures such as wage, hours worked, and type of job to document the employment status of individuals with disabilities. These measures continue to demonstrate that individuals with disabilities fall behind individuals without disabilities in all employment outcomes. While there is utility in distal outcome measures, it is difficult to determine what intervention or program variables were responsible for a specific outcome. Moreover, outcome measures do not provide sufficient information about the quality of employment supports and services an individual with disabilities receives. One way to improve accountability in employment support programs is to link outcomes to specific processes for obtaining and maintaining employment. The purpose of this manuscript is to describe how employment programs can link short-term (proximal) and long term (distal) outcomes measures to specific processes for employment. A customized employment framework is used to illustrate how systematically linking outcomes and processes improves accountability in programs that support job seekers with most significant disabilities.

The question of the question: impactful implementation science to address the HIV epidemic

INTRODUCTION

Questions about the implementation of evidence-based intervention to treat and prevent HIV have risen to the top of the field's scientific priorities. Despite the availability of highly efficacious treatment and prevention interventions, impact has fallen short of targets because these interventions are used with insufficient reach, consistency, sustainability and equity in diverse real-world settings. At present, substantial excitement for implementation science - defined as research methods and strategies to improve use of evidence-based interventions - has focused on developing and disseminating methods to conduct rigorous research. Yet, impactful answers depend on a sometimes less visible, but even more important, step: asking good questions about implementation.

DISCUSSION

In this commentary, we offer several considerations for researchers formulating implementation research questions based on several distinctive features of the field. First, as findings are used not only by other researchers but by implementers, scientific questions must incorporate a range of stakeholder and community perspectives to be most relevant. Second, real-world settings are contextually diverse, and the most relevant scientific questions must position answers to make sense within these contexts (whether geographical, organizational and sociological), rather than apart from them. Third, implementation is complex and dynamic; consequently, research questions must make use of emerging standards in describing implementation strategies and their effects whenever possible. Finally, the field of implementation science continues to evolve, so framing problems with a diverse disciplinary lens will enable researchers to pose insightful and impactful questions.

CONCLUSIONS

We are now at a juncture marked by both rich evidence-based interventions and a persistent global pandemic. To achieve continued scientific progress against the HIV epidemic, asking the right questions might be part of the answer itself.

Framework for identification and measurement of spillover effects in policy implementation: intended non-intended targeted non-targeted spillovers (INTENTS)

BACKGROUND

There is increasing awareness among researchers and policymakers of the potential for healthcare interventions to have consequences beyond those initially intended. These unintended consequences or "spillover effects" result from the complex features of healthcare organisation and delivery and can either increase or decrease overall effectiveness. Their potential influence has important consequences for the design and evaluation of implementation strategies and for decision-making. However, consideration of spillovers remains partial and unsystematic. We develop a comprehensive framework for the identification and measurement of spillover effects resulting from changes to the way in which healthcare services are organised and delivered.

METHODS

We conducted a scoping review to map the existing literature on spillover effects in health and healthcare interventions and used the findings of this review to develop a comprehensive framework to identify and measure spillover effects.

RESULTS

The scoping review identified a wide range of different spillover effects, either experienced by agents not intentionally targeted by an intervention or representing unintended effects for targeted agents. Our scoping review revealed that spillover effects tend to be discussed in papers only when they are found to be statistically significant or might account for unexpected findings, rather than as a pre-specified feature of evaluation studies. This hinders the ability to assess all potential implications of a given policy or intervention. We propose a taxonomy of spillover effects, classified based on the outcome and the unit experiencing the effect: within-unit, between-unit, and diagonal spillover effects. We then present the INTENTS framework: Intended Non-intended TargEted Non-Targeted Spillovers. The INTENTS framework considers the units and outcomes which may be affected by an intervention and the mechanisms by which spillover effects are generated.

CONCLUSIONS

The INTENTS framework provides a structured guide for researchers and policymakers when considering the potential effects that implementation strategies may generate, and the steps to take when designing and evaluating such interventions. Application of the INTENTS framework will enable spillover effects to be addressed appropriately in future evaluations and decision-making, ensuring that the full range of costs and benefits of interventions are correctly identified.

Clinician adoption of Parent–Child Interaction Therapy: A systematic review of implementation interventions

Background

Parent–Child Interaction Therapy (PCIT) is a parent training intervention for childhood conduct problems, distinctive in its use of live clinician coaching of the parent–child dyad via a one-way mirror and discrete earpiece. However, despite a compelling evidence base, uptake of evidence-based parent training programmes such as PCIT by clinicians in routine care settings remains poor. This systematic review aimed to identify and synthesise implementation interventions that have sought to increase clinician adoption of PCIT in usual care settings.

Methods

We searched MEDLINE (Ovid), Embase (Ovid), PsycInfo (Ovid), CINAHL (EBSCO), Science Citation Index and Social Sciences Citation Index, and Web of Science Core Collection from inception to October 2020. Articles were included if they tested (by way of randomised controlled trials, controlled clinical trials, interrupted time series and controlled before and after trials) implementation interventions across any and all of the patient, clinician, clinic, system or policy domains. Two independent reviewers screened and selected studies, assessed risk of bias and extracted data – summarising implementation intervention components according to items from the Template for Intervention Description and Replication (TIDieR) checklist ( Hoffmann et al., 2014 ).

Results

Of the 769 articles identified once duplicates were removed, 13 papers relating to three studies met the inclusion criteria – all were quantitative or mixed-methods examinations of the effectiveness of different PCIT clinician training or training-related consultation methods. A narrative description of interventions was provided, as quantitative synthesis was not possible.

Conclusions

Research attention has to date been focussed on the establishment of an evidence-base for PCIT's effectiveness, with relatively little attention to the dissemination, implementation and sustainment of this treatment. Those studies that do exist have focused on training methods and training-related expert consultation. Research attention could usefully turn to both adoption and sustainment of this effective treatment in usual care settings.

Plain language summary

In this review, we aimed to summarise what is already known about how to implement PCIT in community settings after clinicians have received training in the approach. While research relating to the implementation of other parent training programmes is interesting and informative, implementation efforts are most effective when tailored to a specific programme in a specific context. As such, it was important to review published studies relating to PCIT specifically. We identified three relevant studies, one of which is yet to publish its main implementation findings. The three studies have focused on how best to train clinicians in PCIT, including how best to provide post-training support from expert trainers. We concluded that a fruitful line for future research would be to focus on the post-training period, particularly how best to support clinicians to adopt and sustain PCIT in their practice.

Systematic review registration

The study was prospectively registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 01/10/2020 (CRD42020207118).

Sustainment of Integrated Care in Addiction Treatment Settings: Primary Outcomes From a Cluster-Randomized Controlled Trial

OBJECTIVE

Integrated treatment services are the gold standard for addressing co-occurring mental and substance use disorders, yet they are not readily available. The Network for the Improvement of Addiction Treatment (NIATx) was hypothesized to be an effective strategy to implement and sustain integrated mental health and substance use care in addiction treatment programs. This study examined sustainment of integrated services for up to 2 years after the active implementation phase.

METHODS

The effectiveness of NIATx strategies to implement and sustain integrated services was evaluated by using a cluster-randomized, waitlist control group design. Forty-nine addiction treatment organizations were randomly assigned to either NIATx1 (active implementation strategy) or NIATx2 (waitlist control). The Dual Diagnosis Capability in Addiction Treatment Index was used to evaluate organizations' capability to provide integrated care. The NIATx Stages of Implementation Completion scale was used to assess participation in and adherence to the NIATx implementation process. Linear mixed-effects modeling was used to evaluate changes from baseline to end of the sustainment period.

RESULTS

Both cohorts sustained their capability to provide integrated treatment services. Both groups achieved successful implementation and sustained integrated services to a similar degree, regardless of sustainment year. Sustainment did not vary as a function of NIATx adherence.

CONCLUSIONS

The delivery of integrated treatment services was sustained for 2 years after receipt of active implementation support. Future research should consider how contextual factors may predict, mediate, and moderate sustainment outcomes.

The case for prioritizing implementation strategy fidelity measurement: benefits and challenges

Implementation strategies are systematic approaches to improve the uptake and sustainability of evidence-based interventions. They frequently focus on changing provider behavior through the provision of interventions such as training, coaching, and audit-and-feedback. Implementation strategies often impact intermediate behavioral outcomes like provider guideline adherence, in turn improving patient outcomes. Fidelity of implementation strategy delivery is defined as the extent to which an implementation strategy is carried out as it was designed. Implementation strategy fidelity measurement is under-developed and under-reported, with the quality of reporting decreasing over time. Benefits of fidelity measurement include the exploration of the extent to which observed effects are moderated by fidelity, and critical information about Type-III research errors, or the likelihood that null findings result from implementation strategy fidelity failure. Reviews of implementation strategy efficacy often report wide variation across studies, commonly calling for increased implementation strategy fidelity measurement to help explain variations. Despite the methodological benefits of rigorous fidelity measurement, implementation researchers face multi-level challenges and complexities. Challenges include the measurement of a complex variable, multiple data collection modalities with varying precision and costs, and the need for fidelity measurement to change in-step with adaptations. In this position paper, we weigh these costs and benefits and ultimately contend that implementation strategy fidelity measurement and reporting should be improved in trials of implementation strategies. We offer pragmatic solutions for researchers to make immediate improvements like the use of mixed methods or innovative data collection and analysis techniques, the inclusion of implementation strategy fidelity assessment in reporting guidelines, and the staged development of fidelity tools across the evolution of an implementation strategy. We also call for additional research into the barriers and facilitators of implementation strategy fidelity measurement to further clarify the best path forward.