Integrating implementation science in clinical research to maximize public health impact: a call for the reporting and alignment of implementation strategy use with implementation outcomes in clinical research

Synthetic composites versus calcium phosphate cements in bone regeneration: A narrative review

BACKGROUND

When the natural process of bone remodeling is disturbed, the need arises for a stimulant material in order to enhance the formation of a new healthy and strong osseous tissue to replace the damaged one. Recent studies have reported synthetic biomaterials to be a very good option for supporting bone regeneration.

STUDY DESIGN

Narrative review.

OBJECTIVE

This review aims to provide a brief presentation of two of the most recently developed synthetic biomaterials, i.e. calcium phosphate cements and synthetic composites, that are currently being used in bone regeneration with promising results.

METHODS

Literature searches using broad terms such as "bone regeneration," "biomaterials," "synthetic composites" and "calcium phosphate cements" were performed using PubMed. The osteal cells state of the art was explored by searching topic-specific full text keywords using Google Scholar.

CONCLUSIONS

Synthetic polymers such as PCL (poly-ε-caprolactone) and PLGA (poly lactic-co-glycolic acid) can improve the effectiveness of biomaterials like HA (hydroxyapatite) and BG (bioglass). Calcium phosphate, although being a suitable material for stimulating bone regeneration, needs an adjuvant in order to be effective in larger bone defects.

From theory to practice in implementation science: qualitative insights from the implementation model developed by a commercial eMental Health provider

BACKGROUND

Although eMental health interventions are a viable solution to address disparities in access to mental healthcare and increase its efficiency, they still face challenges of implementation. Literature highlights numerous barriers such as diffusion of responsibility and unclear expectations of what implementation entails might hinder this process. While research mostly focuses on analyzing these barriers, there is an urgent need to increase uptake in practice. In turn, commercial companies focus mostly on increasing uptake, while overlooking research outputs. To bridge the gap between research and practice, attention to how implementation occurs in practice is required. This study investigates "Make it Happen" (MiH), the implementation model developed by the eMental Health company Minddistrict, aiming to gain more insight into operationalizing implementation frameworks by 1) describing MiH and its conceptual underpinnings, and 2) gaining lessons learned from the development of MiH. Ultimately, this work aims at improving existing scientific frameworks by extending them with knowledge from practice.

METHODS

First, individual interviews and focus groups with Minddistrict implementation managers were performed. Second, individual interviews with project leads in mental healthcare organizations that were involved in the implementation of Minddistrict were conducted. Within Minddistrict, 7 implementation managers and account managers were involved, in addition to 11 project leads from mental healthcare organizations. Data were elaborated with thematic analysis.

RESULTS

A comprehensive description of MiH and its 5 main phases was achieved. During the 1) Onboarding phase, implementing organizations are guided by Minddistrict to build a team responsible for implementation, which then 2) designs patient and client journeys, 3) builds, tailors and configures their offer, 4) trains key-users and, 5) evaluates the success of implementation. All participants had extensive and aligned definitions and articulated expectations on implementation. Points of improvement for the model such as role ambiguity and excessive workload were identified. As strengths, internal motivation and good relationships with the provider were valued.

CONCLUSION

The present study highlights the importance of clear role division and stakeholder engagement in implementation processes, and suggest that a strong collaboration between companies and academia could optimize implementation efforts and ensure a better fit between humans, context, and technologies.

Design and implementation of electronic health record-based tools to support a weight management program in primary care

Objectives

This paper reports on a mixed methods formative evaluation to support the design and implementation of information technology (IT) tools for a primary care weight management intervention delivered through the patient portal using primary care staff as coaches.

Methods

We performed a qualitative needs assessment, designed the IT tools to support the weight management program, and developed implementation tracking metrics. Implementation tracking metrics were designed to use real world electronic health record (EHR) data.

Results

The needs assessment revealed IT requirements as well as barriers and facilitators to implementation of EHR-based weight management interventions in primary care. We developed implementation metrics for the IT tools. These metrics were used in weekly project team calls to make sure that project resources were allocated to areas of need.

Conclusion

This study identifies the important role of IT in supporting weight management through patient identification, weight and activity tracking in the patient portal, and the use of the EHR as a population management tool. An intensive multi-level implementation approach is required for successful primary care-based weight management interventions including well-designed IT tools, comprehensive involvement of clinic leadership, and implementation tracking metrics to guide the process of workflow integration. This study helps to bridge the gap between informatics and implementation by using socio-technical formative evaluation methods early in order to support the implementation of IT tools.

Trial registration

clinicaltrials.gov, NCT04420936. Registered June 9, 2020.

Reframing Fall Prevention and Risk Management as a Chronic Condition Through the Lens of the Expanded Chronic Care Model: Will Integrating Clinical Care and Public Health Improve Outcomes?

Falls are a leading cause of morbidity and mortality among adults aged 65 years and older (older adults) and are increasingly recognized as a chronic condition. Yet, fall-related care is infrequently provided in a chronic care context despite fall-related death rates increasing by 41% between 2012 and 2021. One of the many challenges to addressing falls is the absence of fall-focused chronic disease management programs, which improve outcomes of other chronic conditions, like diabetes. Policies, information systems, and clinical-community connections help form the backbone of chronic disease management programs, yet these elements are often missing in fall prevention. Reframing fall prevention through the Expanded Chronic Care Model (ECCM) guided by implementation science to simultaneously support the uptake of evidence-based practices could help improve the care of older adults at risk for falling. The ECCM includes seven components: (1) self-management/develop personal skills, (2) decision support, (3) delivery system design/re-orient health services, (4) information systems, (5) build healthy public policy, (6) create supportive environments, and (7) strengthen community action. Applying the ECCM to falls-related care by integrating health care delivery system changes, community resources, and public policies to support patient-centered engagement for self-management offers the potential to prevent falls more effectively among older adults.

Feasibility, acceptability, and perceived usefulness of a community-evidence-based harm reduction intervention for sexualized stimulant use among Mexican gay, bisexual, and other men who have sex with men

BACKGROUND

The use of stimulants and other substances with the purpose of enhancing, maintaining, and prolonging sexual activity is known as sexualized substance use. Also known as chemsex, this pattern of use has been mainly explored in high-income countries. The aim of this article was to assess the feasibility, acceptability, and usefulness of a community- evidence-based harm reduction intervention among Mexican gay, bisexual, and other men who have sex with men (gbMSM) adults who reported sexualized stimulant use in the past 6 months and who were not enrolled in any psychosocial treatment.

METHODS

The in-person intervention was designed in partnership with gbMSM who used substances. It consisted of 39 harm reduction strategies before, during, and after episodes of use. The components of the intervention were health and self-care, safety, and psychopharmacology. The intervention was delivered at a university campus, a public recreational space, and an HIV public clinic. Feasibility to deliver the intervention was assessed based on enrolment and completion rates; acceptability through a 28-item, 5-point Likert scale (140 max.) constructed and validated for the Mexican population with good reliability coefficients; usefulness through a 5-point Likert scale ("not useful"-"very useful") for each of the 39 strategies; and potential behavioral change by subtracting the likelihood of implementing each strategy minus the frequency of use of the technique before the intervention.

RESULTS

Participants (n = 19; recruitment rate = 35.2%; completion rate = 84.2%) rated the intervention as acceptable with a mean score of 121.6 (SD = 7.5). The highest potential for behavioral change was regarding the use of information about the half-life of stimulants, polysubstance use, and overdose prevention.

CONCLUSIONS

This intervention is feasible when provided within public health services where potential participants are already in contact. Harm reduction strategies need to surpass sexually transmitted infections prevention and HIV care and focus on substance use and mental health strategies.

Adolescent, Parent, and Provider Perceptions of a Predictive Algorithm to Identify Adolescent Suicide Risk in Primary Care

OBJECTIVE

To understand adolescent, parent, and provider perceptions of a machine learning algorithm for detecting adolescent suicide risk prior to its implementation primary care.

METHODS

We conducted semi-structured, qualitative interviews with adolescents (n = 9), parents (n = 12), and providers (n = 10; mixture of behavioral health and primary care providers) across two major health systems. Interviews were audio recorded and transcribed with analyses supported by use of NVivo. A codebook was developed combining codes derived inductively from interview transcripts and deductively from implementation science frameworks for content analysis.

RESULTS

Reactions to the algorithm were mixed. While many participants expressed privacy concerns, they believed the algorithm could be clinically useful for identifying adolescents at risk for suicide and facilitating follow-up. Parents' past experiences with their adolescents' suicidal thoughts and behaviors contributed to their openness to the algorithm. Results also aligned with several key Consolidated Framework for Implementation Research domains. For example, providers mentioned barriers inherent to the primary care setting such as time and resource constraints likely to impact algorithm implementation. Participants also cited a climate of mistrust of science and health care as potential barriers.

CONCLUSIONS

Findings shed light on factors that warrant consideration to promote successful implementation of suicide predictive algorithms in pediatric primary care. By attending to perspectives of potential end users prior to the development and testing of the algorithm, we can ensure that the risk prediction methods will be well-suited to the providers who would be interacting with them and the families who could benefit.

Underreporting of implementation strategies and barriers in physical activity interventions for young people at risk of problematic substance use: a brief report

BACKGROUND

Several studies have assessed whether physical activity interventions can reduce substance use in young people at risk of problematic substance use. This report identifies and describes the reporting of implementation characteristics within published studies of physical activity interventions for young people at risk of problematic substance use and provides recommendations for future reporting.

METHODS

Reported implementation strategies (including intervention manualization), barriers, implementation fidelity, and personnel acceptance were extracted from studies of physical activity interventions for young people aged 12-25 years at risk of problematic substance use that were included in a previous systematic review of intervention efficacy.

RESULTS

Implementation strategies were reported in less than half of the included studies (42.9%), implementation barriers in only 10.7% of studies, intervention fidelity in 21.4%, and personnel acceptance in a single study (3.6%).

CONCLUSIONS

Results indicate insufficient reporting of implementation strategies, barriers, fidelity, and personnel acceptance. Consideration of implementation characteristics is essential for implementing physical activity interventions in practice. Inadequate or limited reporting of these characteristics may contribute to delayed uptake and adoption of evidence-based interventions in clinical practice. Recommendations to improve the reporting of implementation information include integrating standards for reporting implementation characteristics into existing reporting guidelines, developing an international taxonomy of implementation strategies, and upskilling intervention researchers in the fundamentals of implementation science.

Advancing Translation of Clinical Research Into Practice and Population Health Impact Through Implementation Science

Translational and implementation sciences aim to prioritize and guide efforts to create greater efficiency and speed of scientific innovation across the translational science continuum to improve patient and population health. Key principles and practices rooted in translational and implementation science may be incorporated into clinical trials research, particularly pragmatic trials, to improve the relevance and impact of scientific innovation. This thematic review intends to raise awareness on the value of translational and implementation science in clinical research and to encourage its use in designing and implementing clinical trials across the translational research continuum. Herein, we describe the gap in translating research findings into clinical practice, introduce translational and implementation science, and describe the principles and practices from implementation science that can be used in clinical trial research across the translational continuum to inform clinical practice, to improve population health impact, and to address health care inequities.

Drug development for major chronic health conditions-aligning with growing public health needs: Proceedings from a multistakeholder think tank

The global pharmaceutical industry portfolio is skewed towards cancer and rare diseases due to more predictable development pathways and financial incentives. In contrast, drug development for major chronic health conditions that are responsible for a large part of mortality and disability worldwide is stalled. To examine the processes of novel drug development for common chronic health conditions, a multistakeholder Think Tank meeting, including thought leaders from academia, clinical practice, non-profit healthcare organizations, the pharmaceutical industry, the Food and Drug Administration (FDA), payors as well as investors, was convened in July 2022. Herein, we summarize the proceedings of this meeting, including an overview of the current state of drug development for chronic health conditions and key barriers that were identified. Six major action items were formulated to accelerate drug development for chronic diseases, with a focus on improving the efficiency of clinical trials and rapid implementation of evidence into clinical practice.

Dosage of joint mobilization for the management of patients with rotator cuff-related shoulder pain: A scoping review

BACKGROUND

Evidence supporting type and dosage of joint mobilizations and rationale for selecting joint mobilization dosage for patients with rotator cuff-related shoulder pain are limited.

OBJECTIVES

This scoping review aimed to systematically map the type and dosage of joint mobilizations used in previous trials for managing patients with rotator cuff-related shoulder pain; and summarize the rationale for adopting a specific joint mobilization dosage.

METHODS

We searched six databases. We included randomised controlled trials using joint mobilization for patients with rotator cuff-related shoulder pain. We extracted data regarding technique, treatment joint mobilization dosages and rationale for a specific dosage.

RESULTS

We included 32 studies. Most studies did not or partially report technique (67%) and within-session dosage (64%) of passive joint mobilization. Overall treatment was fully reported in 95% of studies. The dosage used for passive joint mobilization was heterogeneous (ranging from grade I to grade V). Most studies (85%) did not or partially report technique of mobilization with movement (MWM), whereas within-session and overall treatment dosages were fully reported in more than 85% of studies. Three sets of 10 repetitions were commonly used within-session dosage for MWM. We found very limited information on the rationale for selecting dosage of joint mobilization.

CONCLUSION

We found limited information about the dosage or the rationale for selecting joint mobilization, with a heterogeneous dosage being tested across trials. Our findings highlight the importance of detailed reporting for dosage and rationale for selecting a specific dosage of joint mobilization.

Developing and testing a produce prescription implementation blueprint to improve food security in a clinical setting: a pilot study protocol

BACKGROUND

Food insecurity is common in the United States, especially in Rhode Island, where it affects up to 33% of residents. Food insecurity is associated with adverse health outcomes and disproportionally affects people from minoritized backgrounds. Produce prescription programs, in which healthcare providers write "prescriptions" for free or reduced cost vegetables, have been used to address food insecurity and diet-related chronic disease. Although there is growing evidence for the effectiveness of produce prescription programs in improving food security and diet quality, there have been few efforts to use implementation science methods to improve the adoption of these programs.

METHODS

This two-phase pilot study will examine determinants and preliminary implementation and effectiveness outcomes for an existing produce prescription program. The existing program is funded by an Accountable Care Organization in Rhode Island and delivered in primary care practices. For the first phase, we conducted a formative evaluation, guided by the Consolidated Framework for Implementation Research 2.0, to assess barriers, facilitators, and existing implementation strategies for the produce prescription program. Responses from the formative evaluation were analyzed using a rapid qualitative analytic approach to yield a summary of existing barriers and facilitators. In the second phase, we presented our formative evaluation findings to a community advisory board consisting of primary care staff, Accountable Care Organization staff, and staff who source and deliver the vegetables. The community advisory board used this information to identify and refine a set of implementation strategies to support the adoption of the program via an implementation blueprint. Guided by the implementation blueprint, we will conduct a single-arm pilot study to assess implementation antecedents (i.e., feasibility, acceptability, appropriateness, implementation climate, implementation readiness), implementation outcomes (i.e., adoption), and preliminary program effectiveness (i.e., food and nutrition security). The first phase is complete, and the second phase is ongoing.

DISCUSSION

This study will advance the existing literature on produce prescription programs by formally assessing implementation determinants and developing a tailored set of implementation strategies to address identified barriers. Results from this study will inform a future fully powered hybrid type 3 study that will use the tailored implementation strategies and assess implementation and effectiveness outcomes for a produce prescription program.

TRIAL REGISTRATION

Clinical trials: NCT05941403 , Registered June 9, 2023.

Economic evaluations performed alongside randomized implementation trials in clinical settings: a systematic review

BACKGROUND

Economic evaluations alongside implementation trials compare the outcomes and costs of competing implementation strategies to identify the most efficient strategies. The aims of this systematic review were to investigate how economic evaluations are performed in randomized implementation trials in clinical settings and to assess the quality of these evaluations.

METHODS

A systematic literature review was conducted on 23 March 2023 to identify studies that reported on economic evaluations embedded in randomized implementation trials in clinical settings. A systematic search was applied across seven databases, and references of relevant reviews were screened for additional studies. The Drummond Checklist was used to assess the quality and risk of bias of included economic evaluations. Study characteristics and quality assessments were tabulated and described.

RESULTS

Of the 6,550 studies screened for eligibility, 10 met the inclusion criteria. Included studies were published between 1990 and 2022 and from North America, the United Kingdom, Europe, and Africa. Most studies were conducted in the primary and out-patient care setting. Implementation costs included materials, staffing, and training, and the most common approach to collecting implementation costs was obtaining expense and budget reports. Included studies scored medium to high in terms of economic methodological quality.

CONCLUSIONS

Economic evidence is particularly useful for healthcare funders and service providers to inform the prioritization of implementation efforts in the context of limited resources and competing demands. The relatively small number of studies identified may be due to lack of guidance on how to conduct economic evaluations alongside implementation trials and the lack of standardized terminology used to describe implementation strategies in clinical research. We discuss these methodological gaps and present recommendations for embedding economic evaluations in implementation trials. First, reporting implementation strategies used in clinical trials and aligning these strategies with implementation outcomes and costs are an important advancement in clinical research. Second, economic evaluations of implementation trials should follow guidelines for standard clinical trial economic evaluations and adopt an appropriate costing and data collection approach. Third, hybrid trial designs are recommended to generate evidence for effective and cost-effective implementation strategies alongside clinical effectiveness and cost-effectiveness.

TRIAL REGISTRATION

The review was prospectively registered with PROSPERO (CRD42023410186).

Implementation of Parenting Programs in Real-World Community Settings: A Scoping Review

Implementing parenting programs in real-world community settings is fundamental to making effective programs widely available and consequently improving the lives of children and their families. Despite the literature acknowledging that the high-quality implementation of parenting programs is particularly challenging in real-world community settings, little is known about how the programs are implemented in these settings. This scoping review followed the methodological framework described by the Joanna Briggs Institute to map evidence on how evidence-based parenting programs have been implemented under real-world conditions. A systematic search of 12 scientific databases, gray literature, and the reference lists of the included studies identified 1918 records, of which 145 were included in the review. Fifty-three parenting programs were identified in studies documenting implementation in real-world community settings worldwide. Most studies included families in psychosocial risk engaged with family-support agencies. The qualitative synthesis identified several implementation outcomes, adaptations, barriers, and facilitators. Most studies reported a maximum of two implementation outcomes, mainly fidelity and acceptability. Providers frequently made adaptations, mainly to bring down barriers and to tailor the program to improve its fit. Findings highlight the need for a more detailed description of the implementation of programs, with greater consistency in terminology, operationalization, and measurement of implementation outcomes across studies. This will promote a more transparent, consistent, and accurate evaluation and reporting of implementation and increase the public health impact of parenting programs. Future studies should also assess the impact of adaptations and the cost-effectiveness and sustainability of programs in real-world community settings.

Core Components and Implementation Determinants of Multilevel Service Delivery Frameworks Across Child Mental Health Service Settings

Multilevel service delivery frameworks are approaches to structuring and organizing a spectrum of evidence-based services and supports, focused on assessment, prevention, and intervention designed for the local context. Exemplar frameworks in child mental health include positive behavioral interventions and supports in education, collaborative care in primary care, and systems of care in community mental health settings. Yet, their high-quality implementation has lagged. This work proposes a conceptual foundation for multilevel service delivery frameworks spanning diverse mental health service settings that can inform development of strategic implementation supports. We draw upon the existing literature for three exemplar multilevel service delivery frameworks in different child mental health service settings to (1) identify core components common to each framework, and (2) to highlight prominent implementation determinants that interface with each core component. Six interrelated components of multilevel service delivery frameworks were identified, including, (1) a systems-level approach, (2) data-driven problem solving and decision-making, (3) multiple levels of service intensity using evidence-based practices, (4) cross-linking service sectors, (5) multiple providers working together, including in teams, and (6) built-in implementation strategies that facilitate delivery of the overall model. Implementation determinants that interface with core components were identified at each contextual level. The conceptual foundation provided in this paper has the potential to facilitate cross-sector knowledge sharing, promote generalization across service settings, and provide direction for researchers, system leaders, and implementation intermediaries/practitioners working to strategically support the high-quality implementation of these frameworks.

Building Capacity for Pragmatic Trials of Digital Technology in Primary Care

Frontline primary care teams face important challenges in seeking to transform the quality of care delivered to patients and to reduce clerical burden for clinicians. Digital technologies using artificial intelligence hold substantial promise to aid in this transformation. Both pragmatic clinical trials and implementation science are key tools to successfully introduce, evaluate, and sustain innovations in real-world primary care practices. Previous articles in this thematic series have provided an in-depth overview of pragmatic trials and implementation science. This paper demonstrates and provides a framework for how these concepts, together with digital transformation, can be used to solve many of the challenges facing primary care. This framework is conceived as the collaboration of frontline primary care teams with innovators in academic institutions and industry through pragmatic trials and implementation science.

Describing the acceptability and use of an opioid stewardship self-assessment tool in real-world settings

BACKGROUND

The Stewardship Framework (Framework) was developed by an expert clinician group and was designed to provide a mechanism for continuous monitoring of improvement in opioid prescribing in acute hospitals. The aim of this study was to modify the Framework into an Opioid Stewardship Self-Assessment Tool (Self-Assessment Tool), and pilot test the acceptability and its use in a variety of acute hospital settings.

METHODS

The Framework was converted into the Self-Assessment Tool to allow hospitals to undertake a gap analysis of their current opioid stewardship activities. To participate hospitals were required to establish a small team and complete the Self-Assessment Tool. Participating sites were recruited using purposive sampling. Responses were tabulated and coded to enable assessment. 'Acceptability' was defined as the completion of the Self-Assessment Tool (response rate, proportion of questions answered) and responder feedback relating to its content. The use of the Tool was categorised based on the level of detail of responses.

RESULTS

Nineteen of the 20 facilities approached, agreed to participate. The 16 sites which established a small team to facilitate survey completion are included in the final analysis. The overall response rate was 96 % (413/432) for the (27 survey questions across 16 participating sites), 4 % (19/432) of questions were left unanswered or were not interpretable by the study team. Opportunities were identified to enhance the use of the Self-Assessment Tool, particularly to support its potential to assist reflection and planning of local strategies.

CONCLUSION

This study demonstrated that the Self-Assessment Tool was an acceptable method of assessing a facility's opioid stewardship capabilities in a real-world setting. The next iteration will be modified using the insights on how the Tool was used by study participants.

Process and Implementation Elements of Measurement Feedback Systems: A Systematic Review

Measurement feedback systems (MFS) can help guide treatment and improve clinical outcomes. Studies of MFS are heterogeneous both in execution and results, and the effects of MFS seem restricted by limited attention to process and implementation elements and by limited adoption by health professionals. The current systematic review mapped the use of process and implementation elements in MFS studies. An overview of therapists' use of and attitudes toward MFS is provided. Three-level meta-analyses were used to test theoretically informed process and implementation elements as moderators of the effects of MFS. Hypotheses and general propositions from Clinical Performance Feedback Intervention Theory (CP-FIT) were used to organize the elements of the studies and were used as moderator variables. Previous studies on MFS interventions have had a limited focus on implementation efforts and process elements that may increase the effects of MFS and their use among therapists. Efforts have sparsely been made to reduce barriers to MFS use, and several studies have reported limited engagement with MFS among therapists. Therapists' attitudes toward MFS, feedback, or standardized measures were heterogeneously reported, making data synthesis challenging. Identified process and implementation elements were not significantly associated with effect sizes in the studies and the results did not support the propositions of CP-FIT. The lack of statistically significant associations may be due to limited reporting of details about process and implementation aspects. More research designed to test hypotheses regarding process and implementation elements is needed to improve the use and effects of MFS. Future studies should aspire to report findings in a manner that allows for an understanding of the implementation process and therapists' adoption of these systems.

Optimising scale-up for public health impact: a multimethod implementation science research protocol to improve infant health outcomes in Ethiopia

INTRODUCTION

Child mortality rates remain high in sub-Saharan Africa, including Ethiopia. We are conducting a cluster randomised control trial in the Gondar zone of the Amhara region to determine the impact of pairing Orthodox priests with community health workers, known locally as the Health Development Army (HDA), on newborns' nutritional status, early illness identification and treatment, and vaccination completeness.Ensuring intervention efficacy with scientific rigour is essential, but there are often delays in adopting evidence into policy and programmes. Here, we present a protocol for conducting parallel implementation research alongside an efficacy study to understand intervention implementability and scalability. This will help develop a scale-up strategy for effective elements of the intervention to ensure rapid implementation at scale.

METHODS AND ANALYSIS

We will conduct a stakeholder analysis of key implementation stakeholders and readiness surveys to assess their readiness to scale up the intervention. We will conduct semistructured interviews and focus group discussions with stakeholders, including HDA members, health workers, Orthodox priests, and caregivers, to determine the core intervention elements that need to be scaled, barriers and facilitators to scaling up the intervention in diverse sociocultural settings, as well as the human and technical requirements for national and regional implementation. Finally, to determine the financial resources necessary for sustaining and scaling the intervention, we will conduct activity-based costing to estimate implementation costs from the provider's perspective.

ETHICS AND DISSEMINATION

The study received approval from the University of Gondar Institutional Review Board (approval no: VP/RTT/05/1030/2022) and the University of Washington Human Subjects Division (approval no: STUDY00015369). Participants will consent to participate. Results will be disseminated through workshops with stakeholders, local community meetings, presentations at local and international conferences, and journal publications. The study will provide evidence for factors to consider in developing a scale-up strategy to integrate the intervention into routine health system practices.

The application of implementation science methods in correctional health intervention research: a systematic review

BACKGROUND

Improving access to high-quality healthcare for individuals in correctional settings is critical to advancing health equity in the United States. Compared to the general population, criminal-legal involved individuals experience higher rates of chronic health conditions and poorer health outcomes. Implementation science frameworks and strategies offer useful tools to integrate health interventions into criminal-legal settings and to improve care. A review of implementation science in criminal-legal settings to date is necessary to advance future applications. This systematic review summarizes research that has harnessed implementation science to promote the uptake of effective health interventions in adult criminal-legal settings.

METHODS

A systematic review of seven databases (Academic Search Premier, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Social Work Abstracts, ProQuest Criminal Justice Database, ProQuest Sociological Abstracts, MEDLINE/PubMed) was conducted. Eligible studies used an implementation science framework to assess implementation outcomes, determinants, and/or implementation strategies in adult criminal-legal settings. Qualitative synthesis was used to extract and summarize settings, study designs, sample characteristics, methods, and application of implementation science methods. Implementation strategies were further analyzed using the Pragmatic Implementation Reporting Tool.

RESULTS

Twenty-four studies met inclusion criteria. Studies implemented interventions to address infectious diseases (n=9), substance use (n=6), mental health (n=5), co-occurring substance use and mental health (n=2), or other health conditions (n=2). Studies varied in their operationalization and description of guiding implementation frameworks/taxonomies. Sixteen studies reported implementation determinants and 12 studies measured implementation outcomes, with acceptability (n=5), feasibility (n=3), and reach (n=2) commonly assessed. Six studies tested implementation strategies. Systematic review results were used to generate recommendations for improving implementation success in criminal-legal contexts.

CONCLUSIONS

The focus on implementation determinants in correctional health studies reflects the need to tailor implementation efforts to complex organizational and inter-agency contexts. Future studies should investigate policy factors that influence implementation success, design, and test implementation strategies tailored to determinants, and investigate a wider array of implementation outcomes relevant to criminal-legal settings, health interventions relevant to adult and juvenile populations, and health equity outcomes.

TRIAL REGISTRATION

A study protocol (CRD42020114111) was registered with Prospero.

Strengthening integrated depression services within routine primary health care using the RE-AIM framework in South Africa

Integration of mental health into routine primary health care (PHC) services in low-and middle-income countries is globally accepted to improve health outcomes of other conditions and narrow the mental health treatment gap. Yet implementation remains a challenge. The aim of this study was to identify implementation strategies that improve implementation outcomes of an evidence-based depression care collaborative implementation model integrated with routine PHC clinic services in South Africa. An iterative, quasi-experimental, observational implementation research design, incorporating the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework, was applied to evaluate implementation outcomes of a strengthened package of implementation strategies (stage two) compared with an initial evaluation of the model (stage one). The first stage package was implemented and evaluated in 10 PHC clinics and the second stage strengthened package in 19 PHC clinics (inclusive of the initial 10 clinics) in one resource-scarce district in the province of KwaZulu-Natal, South Africa. Diagnosed service users were more likely to be referred for counselling treatment in the second stage compared with stage one (OR 23.15, SE = 18.03, z = 4.04, 95%CI [5.03-106.49], p < .001). Training in and use of a validated, mandated mental health screening tool, including on-site educational outreach and technical support visits, was an important promoter of nurse-level diagnosis rates (OR 3.75, 95% CI [1.19, 11.80], p = 0.02). Nurses who perceived the integrated care model as acceptable were also more likely to successfully diagnose patients (OR 2.57, 95% CI [1.03-6.40], p = 0.043). Consistent availability of a clinic counsellor was associated with a greater probability of referral (OR 5.9, 95%CI [1.29-27.75], p = 0.022). Treatment uptake among referred service users remained a concern across both stages, with inconsistent co-located counselling services associated with poor uptake. The importance of implementation research for strengthening implementation strategies along the cascade of care for integrating depression care within routine PHC services is highlighted.

Guidelines for Data and Safety Monitoring in Pragmatic Randomized Clinical Trials Using Case Studies

Pragmatic randomized clinical trials (pRCTs) have a unique set of considerations for data and safety monitoring. Because of their unconventional trial designs coupled with collection of multilevel data and implementation outcomes in real-world settings, thoughtful consideration is needed on the presentation of the trial design and accruing data to facilitate review and decision-making by the trial's data and safety monitoring board (DSMB). To our knowledge, there is limited information available in practical guidelines for generalists and medical general practitioners on what to monitor and to report to the DSMB during the conduct of pRCTs and what the DSMB should focus on in its review of reports. This article discusses these matters in the context of 3 case studies focusing on a set of critical data and safety monitoring questions that would be of interest to the generalist conducting pRCTs. In considering these questions, we provide tabular and graphical illustrations of how data can be presented to the DSMB while drawing attention to those areas that the DSMB should focus on in its review of the trial. The strategies and viewpoints discussed herein provide practical guidelines and can serve as a resource for the generalist conducting pRCTs.

Mapping implementation strategies of evidence-based interventions for three preselected phenomena in people with dementia-a scoping review

BACKGROUND

Caring for people with dementia is complex, and there are various evidence-based interventions. However, a gap exists between the available interventions and how to implement them. The objectives of our review are to identify implementation strategies, implementation outcomes, and influencing factors for the implementation of evidence-based interventions that focus on three preselected phenomena in people with dementia: (A) behavior that challenges supporting a person with dementia in long-term care, (B) delirium in acute care, and (C) postacute care needs.

METHODS

We conducted a scoping review according to the description of the Joanna Briggs Institute. We searched MEDLINE, CINAHL, and PsycINFO. For the data analysis, we conducted deductive content analysis. For this analysis, we used the Expert Recommendations for Implementation Change (ERIC), implementation outcomes according to Proctor and colleagues, and the Consolidated Framework for Implementation Research (CFIR).

RESULTS

We identified 362 (A), 544 (B), and 714 records (C) on the three phenomena and included 7 (A), 3 (B), and 3 (C) studies. Among the studies, nine reported on the implementation strategies they used. Clusters with the most reported strategies were adapt and tailor to context and train and educate stakeholders. We identified one study that tested the effectiveness of the applied implementation strategy, while ten studies reported implementation outcomes (mostly fidelity). Regarding factors that influence implementation, all identified studies reported between 1 and 19 factors. The most reported factors were available resources and the adaptability of the intervention. To address dementia-specific influencing factors, we enhanced the CFIR construct of patient needs and resources to include family needs and resources.

CONCLUSIONS

We found a high degree of homogeneity across the different dementia phenomena, the evidence-based interventions, and the care settings in terms of the implementation strategies used, implementation outcomes measured, and influencing factors identified. However, it remains unclear to what extent implementation strategies themselves are evidence-based and which intervention strategy can be used by practitioners when either the implementation outcomes are not adjusted to the implementation strategy and/or the effects of implementation strategies are mostly unknown. Future research needs to focus on investigating the effectiveness of implementation strategies for evidence-based interventions for dementia care.

TRIAL REGISTRATION

The review protocol was prospectively published (Manietta et al., BMJ Open 11:e051611, 2021).

Ten years of implementation outcomes research: a scoping review

BACKGROUND

Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes.

METHODS

Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome).

RESULTS

Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health.

CONCLUSIONS

Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.

"Now is the time for institutions to be investing in growing exercise programs as part of standard of care": a multiple case study examining the implementation of exercise oncology interventions

BACKGROUND

Implementation science seeks to systematically identify determinants, strategies, and outcomes within a causal pathway to help explain successful implementation. This process is applied to evidence-based interventions (EBIs) to improve their adoption, implementation, and sustainment. However, this method has not been applied to exercise oncology services, meaning we lack knowledge about implementing exercise EBIs in routine practice. This study aimed to develop causal pathways from the determinants, strategies (including mechanism of change), and implementation outcomes to explain exercise EBIs implementation in routine cancer care.

METHODS

A multiple-case study was conducted across three healthcare sites in Australia. Sites selected had implemented exercise within routine care for people diagnosed with cancer and sustained the delivery of services for at least 12 months. Four data sources informed the study: semi-structured interviews with staff, document reviews, observations, and the Program Sustainability Assessment Tool (survey). Framework analysis was applied to understand the findings. The Implementation Research Logic Model was used to identify commonalities in implementation across sites and develop causal pathways.

RESULTS

Two hundred and eighteen data points informed our findings. Across sites, 18 determinants and 22 implementation strategies were consistent. Sixteen determinants and 24 implementation strategies differed across sites and results of implementation outcomes varied. We identified 11 common pathways that when combined, help explain implementation processes. The mechanisms of implementation strategies operating within the pathways included (1) knowledge, (2) skills, (3) secure resources, (4) optimism, and (5) simplified decision-making processes associated with exercise; (6) relationships (social and professional) and support for the workforce; (7) reinforcing positive outcomes; (8) capability to action plan through evaluations and (9) interactive learning; (10) aligned goals between the organisation and the EBI; and (11) consumer-responsiveness.

CONCLUSION

This study developed causal pathways that explain the how and why of successful implementation of exercise EBIs in cancer care. These findings can support future planning and optimisation activities by creating more opportunities for people with cancer to access evidence-based exercise oncology services.

IMPLICATIONS FOR CANCER SURVIVORS

Understanding how to implement exercise within routine cancer care successfully is important so cancer survivors can experience the benefits of exercise.

Developing and Testing Implementation Strategies to support the Centers for Disease Control and Prevention's Initiative for Falls Risk Management in Outpatient Physical Therapy: A Protocol

Objectives

To develop and test implementation strategies to support implementing the Centers for Disease Control and Preventions' Stopping Elderly Accidents, Deaths, and Injuries (STEADI) initiative for falls prevention and falls risk management in a novel setting, outpatient physical therapy.

Design

A feasibility implementation study engaging key partners involved in or affected by the implementation throughout the study.

Setting

Five outpatient physical therapy clinics embedded in a health system.

Participants

Key partners (physical therapists, physical therapist assistants, referring physicians, administrative clinic staff, older adults, and caregivers) involved in or affected by the implementation (N=48) will participate in surveys and interviews to identify barriers and facilitators prior to implementation and post implementation. Twelve key partners representing at least 1 of each group will participate in evidence-based quality improvement panels to identify which barriers and facilitators are most important and feasible to address and to assist in choosing and designing implementation strategies to support the uptake of STEADI in outpatient rehabilitation. STEADI will be implemented in 5 outpatient physical therapy clinics as a standard of care for the ∼1200 older adults attending those clinics annually.

Outcomes

Primary outcomes include clinic- and provider-level (physical therapists and physical therapist assistant) adoption and fidelity to STEADI screening, multifactorial assessment, and falls risk interventions for older adults (65 years or older) attending outpatient physical therapy. Key partners' perceived feasibility, acceptability, and appropriateness of STEADI in outpatient physical therapy will also be measured using validated implementation science questionnaires. Exploratory clinical outcomes of older adults' falls risk pre- and post rehabilitation will be investigated.

Integrating Adolescent Mental Health into HIV Prevention and Treatment Programs: Can Implementation Science Pave the Path Forward?

Adolescent mental health (AMH) is a critical driver of HIV outcomes, but is often overlooked in HIV research and programming. The implementation science Exploration, Preparation, Implementation, Sustainment (EPIS) framework informed development of a questionnaire that was sent to a global alliance of adolescent HIV researchers, providers, and implementors working in sub-Saharan Africa with the aim to (1) describe current AMH outcomes incorporated into HIV research within the alliance; (2) identify determinants (barriers/gaps) of integrating AMH into HIV research and care; and (3) describe current AMH screening and referral systems in adolescent HIV programs in sub-Saharan Africa. Respondents reported on fourteen named studies that included AMH outcomes in HIV research. Barriers to AMH integration in HIV research and care programs were explored with suggested implementation science strategies to achieve the goal of integrated and sustained mental health services within adolescent HIV programs.

Refining Expert Recommendations for Implementing Change (ERIC) strategy surveys using cognitive interviews with frontline providers

BACKGROUND

The Expert Recommendations for Implementing Change (ERIC) compilation includes 73 defined implementation strategies clustered into nine content areas. This taxonomy has been used to track implementation strategies over time using surveys. This study aimed to improve the ERIC survey using cognitive interviews with non-implementation scientist clinicians.

METHODS

Starting in 2015, we developed and fielded annual ERIC surveys to evaluate liver care in the Veterans Health Administration (VA). We invited providers who had completed at least three surveys to participate in cognitive interviews (October 2020 to October 2021). Before the interviews, participants reviewed the complete 73-item ERIC survey and marked which strategies were unclear due to wording, conceptual confusion, or overlap with other strategies. They then engaged in semi-structured cognitive interviews to describe the experience of completing the survey and elaborate on which strategies required further clarification.

RESULTS

Twelve VA providers completed surveys followed by cognitive interviews. The "Engage Consumer" and "Support Clinicians" clusters were rated most highly in terms of conceptual and wording clarity. In contrast, the "Financial" cluster had the most wording and conceptual confusion. The "Adapt and Tailor to Context" cluster strategies were considered to have the most redundancy. Providers outlined ways in which the strategies could be clearer in terms of wording (32%), conceptual clarity (51%), and clarifying the distinction between strategies (51%).

CONCLUSIONS

Cognitive interviews with ERIC survey participants allowed us to identify and address issues with strategy wording, combine conceptually indistinct strategies, and disaggregate multi-barreled strategies. Improvements made to the ERIC survey based on these findings will ultimately assist VA and other institutions in designing, evaluating, and replicating quality improvement efforts.

Psychometric evaluation of a pragmatic measure of clinical supervision as an implementation strategy

BACKGROUND

Valid and reliable measurement of implementation strategies is essential to advancing implementation science; however, this area lags behind the measurement of implementation outcomes and determinants. Clinical supervision is a promising and highly feasible implementation strategy in behavioral healthcare for which pragmatic measures are lacking. This research aimed to develop and psychometrically evaluate a pragmatic measure of clinical supervision conceptualized in terms of two broadly applicable, discrete clinical supervision techniques shown to improve providers' implementation of evidence-based psychosocial interventions-(1) audit and feedback and (2) active learning.

METHODS

Items were generated based on a systematic review of the literature and administered to a sample of 154 outpatient mental health clinicians serving youth and 181 community-based mental health providers serving adults. Scores were evaluated for evidence of reliability, structural validity, construct-related validity, and measurement invariance across the two samples.

RESULTS

In sample 1, confirmatory factor analysis (CFA) supported the hypothesized two-factor structure of scores on the Evidence-Based Clinical Supervision Strategies (EBCSS) scale (χ2=5.89, df=4, p=0.208; RMSEA=0.055, CFI=0.988, SRMR=0.033). In sample 2, CFA replicated the EBCSS factor structure and provided discriminant validity evidence relative to an established supervisory alliance measure (χ2=36.12, df=30, p=0.204; RMSEA=0.034; CFI=0.990; SRMR=0.031). Construct-related validity evidence was provided by theoretically concordant associations between EBCSS subscale scores and agency climate for evidence-based practice implementation in sample 1 (d= .47 and .55) as well as measures of the supervision process in sample 2. Multiple group CFA supported the configural, metric, and partial scalar invariance of scores on the EBCSS across the two samples.

CONCLUSIONS

Scores on the EBCSS provide a valid basis for inferences regarding the extent to which behavioral health providers experience audit and feedback and active learning as part of their clinical supervision in both clinic- and community-based behavioral health settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04096274 . Registered on 19 September 2019.

A systematic review of dissemination and implementation science capacity building programs around the globe

BACKGROUND

Research centers and programs focused on dissemination and implementation science (DIS) training, mentorship, and capacity building have proliferated in recent years. There has yet to be a comprehensive inventory of DIS capacity building program (CBP) cataloging information about activities, infrastructure, and priorities as well as opportunities for shared resources, collaboration, and growth. The purpose of this systematic review is to provide the first inventory of DIS CBPs and describe their key features and offerings.

METHODS

We defined DIS CBPs as organizations or groups with an explicit focus on building practical knowledge and skills to conduct DIS for health promotion. CBPs were included if they had at least one capacity building activity other than educational coursework or training alone. A multi-method strategy was used to identify DIS CBPs. Data about the characteristics of DIS CBPs were abstracted from each program's website. In addition, a survey instrument was developed and fielded to gather in-depth information about the structure, activities, and resources of each CBP.

RESULTS

In total, 165 DIS CBPs met our inclusion criteria and were included in the final CBP inventory. Of these, 68% are affiliated with a United States (US) institution and 32% are internationally based. There was one CBP identified in a low- and middle-income country (LMIC). Of the US-affiliated CBPs, 55% are embedded within a Clinical and Translational Science Award program. Eighty-seven CBPs (53%) responded to a follow-up survey. Of those who completed a survey, the majority used multiple DIS capacity building activities with the most popular being Training and Education (n=69, 79%) followed by Mentorship (n=58, 67%), provision of DIS Resources and Tools (n=57, 66%), Consultation (n=58, 67%), Professional Networking (n=54, 62%), Technical Assistance (n=46, 52%), and Grant Development Support (n=45, 52%).

CONCLUSIONS

To our knowledge, this is the first study to catalog DIS programs and synthesize learnings into a set of priorities and sustainment strategies to support DIS capacity building efforts. There is a need for formal certification, accessible options for learners in LMICs, opportunities for practitioners, and opportunities for mid/later stage researchers. Similarly, harmonized measures of reporting and evaluation would facilitate targeted cross-program comparison and collaboration.

Common Elements Approaches to Implementation Research and Practice: Methods and Integration with Intervention Science

We propose that common elements approaches can advance implementation research and practice and facilitate pragmatic use of intervention and implementation evidence. Common elements are practices or processes frequently shared by interventions or implementations. Traditional common elements methodologies use synthesis, distillation, and statistics to describe and evaluate the merit of common ingredients in effective interventions. Recent developments include identifying and testing common configurations of elements, processes, and context variables across the literature of effective interventions and implementations. While common elements thinking has grown popular in intervention science, it has rarely been utilized in implementation science, and specifically, combined with the intervention literature. The goals of this conceptual methodology paper are to (1) provide an overview of the common elements concept and how it may advance implementation research and usability for practice, (2) give a step-by-step guide to systematic common elements reviews that synthesizes and distills the intervention and implementation literature together, and (3) offer recommendations for advancing element-level evidence in implementation science. A narrative review of the common elements literature was conducted with attention to applications to implementation research. A six-step guide to using an advanced common elements methodology was provided. Examples of potential results are presented, along with a review of the implications for implementation research and practice. Finally, we reviewed methodological limitations in current common elements approaches, and identified steps towards realizing their potential. Common elements methodologies can (a) synthesize and distill the implementation science literature into practical applications, (b) generate evidence-informed hypotheses about key elements and determinants in implementation and intervention processes and mechanisms, and (c) promote evidence-informed precision tailoring of intervention and implementation to context. To realize this potential, common elements approaches need improved reporting of details from both successful and unsuccessful intervention and implementation research, more data availability, and more testing and investigation of causal processes and mechanisms of change from diverse theories.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00077-4.

Decentralised clinical trials in multiple sclerosis research

Randomised controlled trials (RCTs) play an important role in multiple sclerosis (MS) research, ensuring that new interventions are safe and efficacious before their introduction into clinical practice. Trials have been evolving to improve the robustness of their designs and the efficiency of their conduct. Advances in digital and mobile technologies in recent years have facilitated this process and the first RCTs with decentralised elements became possible. Decentralised clinical trials (DCTs) are conducted remotely, enabling participation of a more heterogeneous population who can participate in research activities from different locations and at their convenience. DCTs also rely on digital and mobile technologies which allows for more flexible and frequent assessments. While hospitals quickly adapted to e-health and telehealth assessments during the COVID-19 pandemic, the conduct of conventional RCTs was profoundly disrupted. In this paper, we review the existing evidence and gaps in knowledge in the design and conduct of DCTs in MS.

Implementation of effective blended periconception lifestyle care in a tertiary hospital in the Netherlands: a cross-sectional study on determinants and patient satisfaction

OBJECTIVE

To identify implementation determinants of blended periconception lifestyle care, and to evaluate patient satisfaction.

DESIGN

Cross-sectional study.

SETTING

The outpatient clinic of the department of Obstetrics and Gynaecology of the Erasmus MC.

PARTICIPANTS

Implementation part: counsellors providing blended periconception lifestyle care. Patient satisfaction part: women who received blended periconception lifestyle care.

METHODS

Blended periconception lifestyle care, including face-to-face counselling and 26 weeks of lifestyle coaching via the online platform 'Smarter Pregnancy', was implemented between June-December 2018. The Measurement Instrument for Determinants of Innovations questionnaire was used as input for the consolidated framework for implementation research to assess determinants of implementation. To evaluate patient satisfaction, patients receiving lifestyle care filled out an evaluation questionnaire, including questions on the needs for lifestyle counselling, information provision during counselling, and motivation and lifestyle change after counselling.

PRIMARY AND SECONDARY OUTCOME MEASURES

Identification of implementation determinants and the level of patient satisfaction.

RESULTS

Facilitators were reported in the implementation domains 'characteristics of the intervention' and 'characteristics of the individuals'. Barriers were in the implementation domains 'inner setting' and 'implementation process'. Regarding patient satisfaction on nutrition counselling, 31% of the respondents wanted information prior to the counselling session, 22% received new information after consultation, 51% got motivated to change and 40% changed their nutritional behaviour.

CONCLUSIONS

A considerable number of patients improved lifestyle after counselling, although, a relatively small number wanted lifestyle counselling prior to consultation.This study underlines the importance of implementation science and the information it provides for improving the implementation process.

A collaborative care package for depression comorbid with chronic physical conditions in South Africa

INTRODUCTION

A task-sharing collaborative care model for integrated depression care for South Africa's burgeoning primary health care population with chronic conditions was developed and tested through two pragmatic cluster randomized controlled trials. One trial focused on patients with hypertension and was located in one district where a collaborative care model was co-designed with district stakeholders. The other trial, focused on patients on antiretroviral treatment, was located in the same district site, with the addition of a second neighbouring district, without adaptation of the original model. This paper describes the package used to implement this model, and implementation outcomes across the two sites, and summarises lessons and challenges.

METHODS

The Template for Intervention Description and Replication (TIDieR) framework, adapted for complex health systems interventions, was used to describe components of the package. Additional elements of 'modifications made' and 'actual implementation' introduced in the 'Getting messier with TIDieR' framework, were used to describe implementation outcomes in terms of reach, adoption and implementation across the two trial districts.

RESULTS

In the absence of a co-design process to adapt the model to the context of the second site, there was less system level support for the model. Consequently, more project employed human resources were deployed to support training of primary care nurses in identification and referral of patients with depression; and supervise co-located lay counsellors. Referrals to co-located lay counselling services were more than double in the second site. However, uptake of counselling sessions was greater in the first site. This was attributed to greater in-vivo supervision and support from existing mental health specialists in the system. There was greater reliance on online supervision and support in the second site where geographical distances between clinics were larger.

CONCLUSION

The need for in-country co-designed collaborative care models, and 'implementation heavy' implementation research to understand adaptations required to accommodate varying in-country health system contexts is highlighted.

Influence of implementation strategies on implementation outcomes in a statewide dissemination of Faith, Activity, and Nutrition (FAN)

Faith-based organizations are promising settings for implementation science because they can reach populations bearing a disproportionate burden of chronic disease. This study examined how implementation strategies influenced implementation outcomes in Faith, Activity, and Nutrition (FAN) statewide dissemination. Ninety-three (9%) of 985 invited churches enrolled; 91 (98%) and 83 (89%) completed baseline and 12-month assessments. Community Health Advisors trained and provided phone technical assistance to church committees, led by a FAN coordinator. Church committees were charged with developing plans and installing healthy eating (HE) and physical activity (PA) policies, opportunities, messages and pastor support (implementation outcomes). Structural equation modeling examined how implementation strategies influenced implementation outcomes. Nearly all (99%) FAN coordinators and 60% of pastors attended training, 57% of committees submitted program plans and 51%/54% (HE/PA) of committees met 'every few months'. Statistically significant (P < 0.05) model paths showed positive influences of strategies on implementation outcomes: pastor training on HE and PA pastor support; plan completion on HE and PA messages, PA policies and opportunities as well as FAN committee meetings and committee meetings on HE pastor support, HE policies, PA opportunities and HE and PA messages. This study advances implementation science and provides a model applicable to organizations such as worksites and schools.

Precision Implementation: An Approach to Mechanism Testing in Implementation Research

Advancing mechanism-focused research in implementation science is a priority given its potential to improve tailoring and efficiency of implementation strategies. Experimental therapeutics, or experimental medicine, offers an approach for mechanism testing that has been promoted by the NIH Science of Behavior Change and endorsed by the National Institute for Mental Health. This approach has been applied across the translational spectrum - with initial applications to biological research and more recent applications to psychosocial treatment development research. We describe further advancement of experimental therapeutics along the translational spectrum and describe how it is ideally suited to inform precision experimental tests of implementation strategy mechanisms, which we term precision implementation. Such an approach to mechanism testing will allow for identification of causal dose-response relationships between implementation strategies, presumed mechanisms, and implementation outcomes. We discuss the tension between the scientific rigor required to conduct mechanism-focused research using experimental therapeutics and the "real world" conditions in which implementation research takes place. We provide a series of example studies that show "beginning to end" application of this framework in research focused on provider implementation of an evidence-based intervention in routine clinical care settings.

Increasing Uptake of Depression Screening and Treatment Guidelines in Cardiac Patients: A Behavioral and Implementation Science Approach to Developing a Theory-Informed, Multilevel Implementation Strategy

BACKGROUND

Depression leads to poor health outcomes in patients with coronary heart disease (CHD). Despite guidelines recommending screening and treatment of depressed patients with CHD, few patients receive optimal care. We applied behavioral and implementation science methods to (1) identify generalizable, multilevel barriers to depression screening and treatment in patients with CHD and (2) develop a theory-informed, multilevel implementation strategy for promoting guideline adoption.

METHODS

We conducted a narrative review of barriers to depression screening and treatment in patients with CHD (ie, medications, exercise, cardiac rehabilitation, or therapy) comprising data from 748 study participants. Informed by the behavior change wheel framework and Expert Recommendations for Implementing Change, we defined multilevel target behaviors, characterized determinants (capability, opportunity, motivation), and mapped barriers to feasible, acceptable, and equitable intervention functions and behavior change techniques to develop a multilevel implementation strategy, targeting health care systems/providers and patients.

RESULTS

We identified implementation barriers at the system/provider level (eg, Capability: knowledge; Opportunity: workflow integration; Motivation: ownership) and patient level (eg, Capability: knowledge; Opportunity: mobility; Motivation: symptom denial). Acceptable, feasible, and equitable intervention functions included education, persuasion, environmental restructuring, and enablement. Expert Recommendations for Implementing Change strategies included learning collaborative, audit, feedback, and educational materials. The final multicomponent strategy (iHeart DepCare) for promoting depression screening/treatment included problem-solving meetings with clinic staff (system); educational/motivational videos, electronic health record reminders/decisional support (provider); and a shared decision-making (electronic shared decision-making) tool with several functions for patients, for example, patient activation, patient treatment selection support.

CONCLUSIONS

We applied implementation and behavioral science methods to identify implementation barriers and to develop a multilevel implementation strategy for increasing uptake of depression screening and treatment in patients with CHD as a use case. The multilevel implementation strategy will be evaluated in a future hybrid II effectiveness-implementation trial.

Adolescent Substance Use Behavior Change Through School Intervention Is Improved by Teacher and School Implementation Support Together, Especially for Girls

An earlier trial of a school-based, preventative intervention, HealthWise South Africa, demonstrated some efficacy in preventing adolescent drinking and smoking in the Western Cape, South Africa. This was followed by the current implementation trial, which examined how implementation support conditions influenced adolescent drinking and smoking behavior change in the HealthWise intervention. The hybridized implementation-effectiveness trial included 34 schools (n = 2175 students) that provided student data at four waves through Grades 8 to 10. Implementation support conditions included a combination of two components (enhanced school environment and teacher consultation), resulting in four conditions: enhanced school environment, teacher consultation, both components, and standard delivery. Using configural frequency analysis, we examined how drinking and smoking behavior change differed across four configurations of intervention support longitudinally and by gender. For baseline non-smokers, results indicated sustained differences in abstention from smoking and smoking initiation between schools that received both support components and schools in the standard delivery condition. These results were primarily driven by girls. For baseline drinkers and smokers in the both components condition, changes in drinking were delayed until Grade 9 and smoking decayed by Grade 10. Results suggest that providing both school and teacher implementation support synergistically facilitates improved intervention outcomes both immediately following intervention and 2 years later across schools with diverse resource levels. Future iterations of HealthWise, and other interventions, may benefit from a multilevel implementation support strategy to improve student outcomes. More research is needed to understand how to improve HealthWise effectiveness among boys.

A Framework for the Implementation of Digital Mental Health Interventions: The Importance of Feasibility and Acceptability Research

Digital mental health interventions (DMHIs) have the potential to serve a significantly wider portion of the population in need of mental health services. The coronavirus disease 2019 (COVID-19) pandemic has especially highlighted the exacerbation of mental health disparities among minoritized populations. Innovations and research on DMHIs continue to expand, reinforcing the need for a more systemic process of DMHI implementation. In practice, DMHI implementation often skips the fundamental steps of conducting acceptability and feasibility studies. We propose a DMHI implementation framework that identifies an acceptability and feasibility study as an essential first step, simultaneously centering equitable processes that address populations disproportionately affected by mental illness.

Acceptability of an interstage home monitoring mobile application for caregivers of children with single ventricle physiology: Toward technology-integrated family management

PURPOSE

Infants with single ventricle physiology experience numerous vulnerable transitions, and the interstage period for shunt-dependent children represents the time of highest risk for morbidity and mortality. Data exchange, physiological monitoring, and communication between clinicians and caregivers through interstage home monitoring are critical. The purpose of this study is to report on the acceptability of a technology-enhanced home monitoring mobile application for interstage family management of children with single ventricle physiology.

DESIGN AND METHODS

This study employed a qualitative descriptive study design and recruited caregivers that were part of a broader quality improvement project where they were beta users of a mobile health application specifically developed for the interstage home monitoring time period.

RESULTS

Eleven caregivers were enrolled in this study that was a part of the early phases of beta testing the mobile application from a human-centered design perspective. In general, the participants had a favorable sentiment toward the technology-integrated family management aspects that the mobile application allowed for during the interstage process. The acceptability findings can be organized through the following themes: time needed for mobile application, family as integrated members of care team, connectedness and confidence, and resolving technical issues.

CONCLUSIONS

Evaluation of the feasibility and acceptability of this technology from the perspective of family/caregivers is a critical component of human-centered design. The integration of technology-facilitated communication shows immense promise for patient populations undergoing vulnerable transitions in care. Future study is needed to determine the role mobile applications have in improved clinical outcomes, enhanced provider clinical-decision support, and family engagement in care.

Fatigue self-management education in persons with disease-related fatigue: A comprehensive review of the effectiveness on fatigue and quality of life

OBJECTIVES

To systematically synthesize the effectiveness of fatigue self-management education (SME) on fatigue and quality of life (QoL) in persons with disease-related fatigue, and to describe the intervention characteristics.

METHODS

We systematically reviewed the literature on SMEs in people with disease-related fatigue. We included randomized controlled trials (RCT), which aimed to improve self-management skills for fatigue in daily life. We synthesized the effectiveness and mapped the intervention characteristics.

RESULTS

We included 26 RCTs studying samples from eight disease groups. At follow-up, 46% studies reported statistically significant improvements on fatigue and 46% on QoL. For persons with cancer 6/8 and multiple sclerosis 8/10 RCTs showed positive evidence in favor of SME. The range of effect sizes was wide (d: 0.0 ->0.8). Delivery modalities (inpatient, outpatient, home), interactions (individual, group, remote), and duration [range (h): 1-17.5] varied.

CONCLUSIONS

The overall evidence on the effectiveness of SMEs on fatigue and QoL is limited and inconsistent. For persons with cancer and multiple sclerosis, the evidence provides a positive effect. The RCTs with medium to large effect on QoL indicate the potential benefit of SMEs.

PRACTICAL IMPLICATION

Duration and peer interaction should be considered when tailoring SMEs to populations and contexts.

Optimizing the implementation of a multisite feasibility trial of a mind-body program in acute orthopedic trauma

The Toolkit for Optimal Recovery (TOR) is a mind-body program for patients with acute orthopedic injuries who are at risk for persistent pain/disability. In preparation for a multisite feasibility trial of TOR at three orthopedic trauma centers, we aim to qualitatively identify barriers and facilitators to study implementation and strategies to mitigate the implementation barriers and leverage facilitators.We conducted 18 live video focus groups among providers and three one-on-one interviews with department chiefs at Level 1 trauma centers in three geographically diverse sites (N = 79 participants). Using a content analysis approach, we detected the site-specific barriers and facilitators of implementation of TOR clinical trial. We organized the data according to 26 constructs of the Consolidated Framework for Implementation Research (CFIR), mapped to three Proctor implementation outcomes relevant to the desired study outcomes (acceptability, appropriateness, and feasibility). Across the three sites, we mapped six of the CFIR constructs to acceptability, eight to appropriateness, and three to feasibility. Prominent perceived barriers across all three sites were related to providers' lack of knowledge/comfort addressing psychosocial factors, and organizational cultures of prioritizing workflow efficiency over patients' psychosocial needs (acceptability), poor fit between TOR clinical trial and the fast-paced clinic structure as well as basic needs of some patients (appropriateness), and limited resources (feasibility). Suggestions to maximize the implementation of the TOR trial included provision of knowledge/tools to improve providers' confidence, streamlining study recruitment procedures, creating a learning collaborative, tailoring the study protocol based on local needs assessments, exercising flexibility in conducting research, dedicating research staff, and identifying/promoting champions and using novel incentive structures with regular check-ins, while keeping study procedures as nonobtrusive and language as de-stigmatizing as possible. These data could serve as a blueprint for implementation of clinical research and innovations in orthopedic and other medical settings.

Funders' Perspectives on Supporting Implementation Research in Low- and Middle-Income Countries

We identify and discuss 7 approaches for funders to contemplate when considering support for implementation research in low- and middle-income countries.

An mHealth Intervention to Reduce the Packing of Discretionary Foods in Children's Lunch Boxes in Early Childhood Education and Care Services: Cluster Randomized Controlled Trial

Background

Interventions in early childhood education and care (ECEC) services have the potential to improve children’s diet at the population level.

Objective

This study aims to test the efficacy of a mobile health intervention in ECEC services to reduce parent packing of foods high in saturated fat, sugar, and sodium (discretionary foods) in children’s (aged 3-6 years) lunch boxes.

Methods

A cluster randomized controlled trial was undertaken with 355 parent and child dyads recruited by phone and in person from 17 ECEC services (8 [47%] intervention and 9 [53%] control services). Parents in the intervention group received a 10-week fully automated program targeting barriers to packing healthy lunch boxes delivered via an existing service communication app. The program included weekly push notifications, within-app messages, and links to further resources, including websites and videos. The control group did not receive any intervention. The primary outcomes were kilojoules from discretionary foods and associated nutrients (saturated fat, free sugars, and sodium) packed in children’s lunch boxes. Secondary outcomes included consumption of kilojoules from discretionary foods and related nutrients and the packing and consumption of serves of discretionary foods and core food groups. Photography and weights of foods in children’s lunch boxes were recorded by trained researchers before and after the trial to assess primary and secondary outcomes. Outcome assessors were blinded to service allocation. Feasibility, appropriateness, and acceptability were assessed via an ECEC service manager survey and a parent web-based survey. Use of the app was assessed via app analytics.

Results

Data on packed lunch box contents were collected for 88.8% (355/400) of consenting children at baseline and 84.3% (337/400) of children after the intervention. There was no significant difference between groups in kilojoule from discretionary foods packed (77.84 kJ, 95% CI −163.49 to 319.18; P=.53) or the other primary or secondary outcomes. The per-protocol analysis, including only data from children of parents who downloaded the app, also did not find any statistically significant change in primary (−1.98 kJ, 95% CI −343.87 to 339.90; P=.86) or secondary outcomes. Approximately 61.8% (102/165) of parents in the intervention group downloaded the app, and the mean service viewing rate of weekly within-app messages was 26% (SD 14.9). Parents who responded to the survey and participating services agreed that it was appropriate to receive lunch box information via the app (40/50, 80% and 6/8, 75%, respectively).

Conclusions

The intervention was unable to demonstrate an impact on kilojoules or associated nutrients from discretionary foods packed in children’s lunch boxes. Low app downloads and program message views indicate a need to explore how to improve factors related to implementation before further testing similar mobile health interventions in this setting.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12618000133235; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=374379

Clinician adoption of Parent–Child Interaction Therapy: A systematic review of implementation interventions

Background

Parent–Child Interaction Therapy (PCIT) is a parent training intervention for childhood conduct problems, distinctive in its use of live clinician coaching of the parent–child dyad via a one-way mirror and discrete earpiece. However, despite a compelling evidence base, uptake of evidence-based parent training programmes such as PCIT by clinicians in routine care settings remains poor. This systematic review aimed to identify and synthesise implementation interventions that have sought to increase clinician adoption of PCIT in usual care settings.

Methods

We searched MEDLINE (Ovid), Embase (Ovid), PsycInfo (Ovid), CINAHL (EBSCO), Science Citation Index and Social Sciences Citation Index, and Web of Science Core Collection from inception to October 2020. Articles were included if they tested (by way of randomised controlled trials, controlled clinical trials, interrupted time series and controlled before and after trials) implementation interventions across any and all of the patient, clinician, clinic, system or policy domains. Two independent reviewers screened and selected studies, assessed risk of bias and extracted data – summarising implementation intervention components according to items from the Template for Intervention Description and Replication (TIDieR) checklist ( Hoffmann et al., 2014 ).

Results

Of the 769 articles identified once duplicates were removed, 13 papers relating to three studies met the inclusion criteria – all were quantitative or mixed-methods examinations of the effectiveness of different PCIT clinician training or training-related consultation methods. A narrative description of interventions was provided, as quantitative synthesis was not possible.

Conclusions

Research attention has to date been focussed on the establishment of an evidence-base for PCIT's effectiveness, with relatively little attention to the dissemination, implementation and sustainment of this treatment. Those studies that do exist have focused on training methods and training-related expert consultation. Research attention could usefully turn to both adoption and sustainment of this effective treatment in usual care settings.

Plain language summary

In this review, we aimed to summarise what is already known about how to implement PCIT in community settings after clinicians have received training in the approach. While research relating to the implementation of other parent training programmes is interesting and informative, implementation efforts are most effective when tailored to a specific programme in a specific context. As such, it was important to review published studies relating to PCIT specifically. We identified three relevant studies, one of which is yet to publish its main implementation findings. The three studies have focused on how best to train clinicians in PCIT, including how best to provide post-training support from expert trainers. We concluded that a fruitful line for future research would be to focus on the post-training period, particularly how best to support clinicians to adopt and sustain PCIT in their practice.

Systematic review registration

The study was prospectively registered with the International Prospective Register of Systematic Reviews (PROSPERO) on 01/10/2020 (CRD42020207118).

The case for prioritizing implementation strategy fidelity measurement: benefits and challenges

Implementation strategies are systematic approaches to improve the uptake and sustainability of evidence-based interventions. They frequently focus on changing provider behavior through the provision of interventions such as training, coaching, and audit-and-feedback. Implementation strategies often impact intermediate behavioral outcomes like provider guideline adherence, in turn improving patient outcomes. Fidelity of implementation strategy delivery is defined as the extent to which an implementation strategy is carried out as it was designed. Implementation strategy fidelity measurement is under-developed and under-reported, with the quality of reporting decreasing over time. Benefits of fidelity measurement include the exploration of the extent to which observed effects are moderated by fidelity, and critical information about Type-III research errors, or the likelihood that null findings result from implementation strategy fidelity failure. Reviews of implementation strategy efficacy often report wide variation across studies, commonly calling for increased implementation strategy fidelity measurement to help explain variations. Despite the methodological benefits of rigorous fidelity measurement, implementation researchers face multi-level challenges and complexities. Challenges include the measurement of a complex variable, multiple data collection modalities with varying precision and costs, and the need for fidelity measurement to change in-step with adaptations. In this position paper, we weigh these costs and benefits and ultimately contend that implementation strategy fidelity measurement and reporting should be improved in trials of implementation strategies. We offer pragmatic solutions for researchers to make immediate improvements like the use of mixed methods or innovative data collection and analysis techniques, the inclusion of implementation strategy fidelity assessment in reporting guidelines, and the staged development of fidelity tools across the evolution of an implementation strategy. We also call for additional research into the barriers and facilitators of implementation strategy fidelity measurement to further clarify the best path forward.

Six practical recommendations for improved implementation outcomes reporting

Background

Implementation outcomes research spans an exciting mix of fields, disciplines, and geographical space. Although the number of studies that cite the 2011 taxonomy has expanded considerably, the problem of harmony in describing outcomes persists. This paper revisits that problem by focusing on the clarity of reporting outcomes in studies that examine them. Published recommendations for improved reporting and specification have proven to be an important step in enhancing the rigor of implementation research. We articulate reporting problems in the current implementation outcomes literature and describe six practical recommendations that address them.

Recommendations

Our first recommendation is to clearly state each implementation outcome and provide a definition that the study will consistently use. This includes providing an explanation if using the taxonomy in a new way or merging terms. Our second recommendation is to specify how each implementation outcome will be analyzed relative to other constructs. Our third recommendation is to specify “the thing” that each implementation outcome will be measured in relation to. This is especially important if you are concurrently studying interventions and strategies, or if you are studying interventions and strategies that have multiple components. Our fourth recommendation is to report who will provide data and the level at which data will be collected for each implementation outcome, and to report what kind of data will be collected and used to assess each implementation outcome. Our fifth recommendation is to state the number of time points and frequency at which each outcome will be measured. Our sixth recommendation is to state the unit of observation and the level of analysis for each implementation outcome.

Conclusion

This paper advances implementation outcomes research in two ways. First, we illustrate elements of the 2011 research agenda with concrete examples drawn from a wide swath of current literature. Second, we provide six pragmatic recommendations for improved reporting. These recommendations are accompanied by an audit worksheet and a list of exemplar articles that researchers can use when designing, conducting, and assessing implementation outcomes studies.