Characterizing Shared and Unique Implementation Influences in Two Community Services Systems for Autism: Applying the EPIS Framework to Two Large-Scale Autism Intervention Community Effectiveness Trials

"He Just Wants Someone to Hear Him and Listen to Him": Barriers and Facilitators to Autistic Youth with Anxiety Receiving Quality Mental Healthcare

About half of autistic youth present with clinically interfering anxiety. Psychotherapies with exposure-focused elements are effective in academic clinical settings and controlled trials. However, there is relatively less research examining the implementation of modified interventions for autistic youth with anxiety in community mental health settings. The current study explores community members' perceptions of barriers and facilitators that impact autistic youth with anxiety's receipt of quality mental health services in their community. Semi-structured interviews were conducted with 15 autistic youth, 15 caregivers of autistic youth, 11 community mental health clinicians, and 8 community mental health clinic leaders. Interviews were analyzed thematically. Participants shared their experiences with facilitators and barriers to autistic youth with anxiety receiving quality mental healthcare. Themes that emerged include (1) characteristics of the autistic youth, (2) engagement of autistic youth and caregivers, (3) building rapport between providers, autistic youth, and caregivers, (4) access to mental health services, (5) intervention fit, and (6) provider characteristics. Based on participants' perspectives and suggestions, future directions for anxiety treatment programs tailored for autistic youth include building more time into the intervention sessions to build rapport, incorporating autistic youth's preferences into provider matches, and providing families with more psychoeducation.

Randomized trial of the leadership and organizational change for implementation (LOCI) strategy in substance use treatment clinics

INTRODUCTION

Evidence-based practice (EBP) implementation represents a strategic change that requires alignment of leadership and support throughout organizations. Leadership and Organizational Change for Implementation (LOCI) is a multifaceted implementation strategy that aims to improve implementation leadership and climate within organizations through iterative cycles of leadership and climate assessment and feedback, leadership training and coaching, and strategic planning with upper-level leaders. This study tested the effects of LOCI on transformational and implementation leadership, implementation climate, implementation citizenship behavior, and EBP reach.

METHODS

A multiple cohort, cluster randomized trial tests the effect of LOCI in 60 clinics across nine behavioral health organizations in California and Arizona, USA. The study randomized clinics within organizations to either LOCI or a leadership training webinar control condition in three consecutive cohorts. Repeated web-based surveys of direct service providers (nLOCI = 201, nControl = 179) assessed leadership, implementation climate, and implementation citizenship over time. Multilevel autoregressive modeling was the primary statistical analysis such that providers (level-1) were nested within clinics (level-2). The study predicted between-condition differences at 4-, 8-, and 12-month follow-up assessments. Provider engagement in a fidelity monitoring process assessed reach of motivational interviewing (i.e., number of sessions recorded/submitted for fidelity coding). An independent sample t-test explored between condition differences in motivational interviewing reach.

RESULTS

Results indicated between condition differences at 4 months for implementation leadership, implementation climate, and implementation citizenship behavior such that greater improvements were evidenced in the LOCI condition compared to the control condition. Reach of MI was significantly greater in the LOCI vs control condition such that LOCI providers were significantly more likely to engage in the fidelity monitoring process (chi-square (1, n = 370) = 5.59, p = .018).

CONCLUSIONS

LOCI was developed based on organizational theories of strategic leadership and climate to affect organizational change processes that communicate that innovation implementation is expected, supported, and recognized as a value of the organization. The LOCI implementation strategy resulted in more positive hypothesized outcomes compared to the control condition. Organizational change strategies have utility for implementing health innovations in complex, multilevel contexts and for greater sustainment of facilitative leader behaviors, strategic implementation climate, and improved implementation outcomes.

TRIAL REGISTRATION

This study is registered with Clinicaltrials.gov gov (NCT03042832, 2 February 2017; retrospectively registered).

A research agenda to advance the study of implementation mechanisms

BACKGROUND

Implementation science scholars have made significant progress identifying factors that enable or obstruct the implementation of evidence-based interventions, and testing strategies that may modify those factors. However, little research sheds light on how or why strategies work, in what contexts, and for whom. Studying implementation mechanisms-the processes responsible for change-is crucial for advancing the field of implementation science and enhancing its value in facilitating equitable policy and practice change. The Agency for Healthcare Research and Quality funded a conference series to achieve two aims: (1) develop a research agenda on implementation mechanisms, and (2) actively disseminate the research agenda to research, policy, and practice audiences. This article presents the resulting research agenda, including priorities and actions to encourage its execution.

METHOD

Building on prior concept mapping work, in a semi-structured, 3-day, in-person working meeting, 23 US-based researchers used a modified nominal group process to generate priorities and actions for addressing challenges to studying implementation mechanisms. During each of the three 120-min sessions, small groups responded to the prompt: "What actions need to be taken to move this research forward?" The groups brainstormed actions, which were then shared with the full group and discussed with the support of facilitators trained in structured group processes. Facilitators grouped critical and novel ideas into themes. Attendees voted on six themes they prioritized to discuss in a fourth, 120-min session, during which small groups operationalized prioritized actions. Subsequently, all ideas were collated, combined, and revised for clarity by a subset of the authorship team.

RESULTS

From this multistep process, 150 actions emerged across 10 priority areas, which together constitute the research agenda. Actions included discrete activities, projects, or products, and ways to shift how research is conducted to strengthen the study of implementation mechanisms.

CONCLUSIONS

This research agenda elevates actions to guide the selection, design, and evaluation of implementation mechanisms. By delineating recommended actions to address the challenges of studying implementation mechanisms, this research agenda facilitates expanding the field of implementation science, beyond studying what works to how and why strategies work, in what contexts, for whom, and with which interventions.

Providing Clinical Psychology Training and Trauma-Focused Treatment via Telehealth During COVID-19

To slow the spread of COVID-19 many mental health providers transitioned to telehealth delivery of trauma-focused treatment for maltreated children. However, these providers faced myriad challenges, including equitable access to equipment and technical demands of telehealth software. Training clinics overseeing pre-doctoral clinical psychology interns experienced the added challenge of providing quality supervision and training via telehealth. This study involves a retrospective application of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework to describe the innovative adaptation to a telehealth service delivery model in a training clinic providing evidence-based trauma-focused treatment to children and their families. Mixed methods data from clinic records and intern evaluations indicate that compared to pre-COVID (February 2019 - February 2020), during early COVID (April 2020 - April 2021) more patients accessed clinic services, interns reported fewer hours of individual supervision, and interns reported greater satisfaction with their training experiences. Implications for ongoing provision of telehealth services are discussed.

Partnering with Schools to Adapt a Team Science Intervention: Processes and Challenges

Public schools are a major provider of mental health services for children in the US. Mental and behavioral health services range from universal programming to individualized clinical supports to address student needs. These services in schools are delivered by various professionals including non-teaching and teaching school personnel, school-employed clinicians, and/or contracted community mental health partners. Provision of mental health services requires complex coordination of providers across disciplines, although few professionals have training in multidisciplinary collaboration strategies. Attention to team processes, such as delineating team members' roles, improving communication, and identifying collaboration strategies, may impact the effectiveness of evidence-based mental health service provision in real world settings. One intervention, Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS), has been used in healthcare with positive outcomes and has been adapted to educational settings. The current paper describes the community-partnered subsequent adaptation of TeamSTEPPS for schools. Needs assessment interviews identified challenges, successes, and goals for student mental health. Overarching themes extracted from interviews include limited resources at multiple levels (e.g., financial support, time, and personnel), communication challenges, and poor role clarity. A community advisory board provided guidance during the adaptation and implementation planning process. Adaptations to the intervention included tailoring the intervention to the school context and the development of flexible training plans. In addition, individualized implementation plans were developed with each school partner to mitigate foreseeable barriers to rolling-out TeamSTEPPS. Our team is currently piloting the adapted TeamSTEPPS intervention and implementation strategies in partnership with three school districts.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12310-024-09665-7.

Feasibility and acceptability of a low-resource-intensive, transdiagnostic intervention for children with social-communication challenges in early childhood education settings

ABSTRACT

Preschool classrooms provide a unique context for supporting the development of children with social-communication challenges. This study is an uncontrolled clinical trial of an adapted professional development intervention for preschool teachers (Social Emotional Engagement-Knowledge & Skills-Early Childhood). Social Emotional Engagement-Knowledge & Skills-Early Childhood is a low-resource-intensive, transdiagnostic intervention to address the learning needs of children with social-communication challenges and consists of four asynchronous online modules and three synchronous coaching sessions. The current research evaluated the feasibility and acceptability of intervention and research procedures, implemented in authentic early childhood education settings. Participants included one teacher and one target child with social-communication challenges from 25 preschool classrooms, sampled to maximize variability. Overall, the current research revealed high levels of feasibility, with 9 out of 10 benchmarks met: (a) procedures for participant recruitment reliably identified a neurodiverse sample of children with teacher-reported social-communication challenges; (b) teachers showed high levels of program engagement and Social Emotional Engagement-Knowledge & Skills-Early Childhood completion (76%); and (c) results revealed a robust pattern of gains in Social Emotional Engagement-Knowledge & Skills-Early Childhood classrooms and associations among key outcome measures (including active engagement, student teacher relationship, social-communication competencies). Implications for the design of a subsequent, larger effectiveness-implementation hybrid trial (Type 1) are discussed.

Community implementation of a brief parent mediated intervention for toddlers with probable or confirmed autism spectrum disorder: feasibility, acceptability, and drivers of success (IE Drmic et al.)

Background

Social ABCs is a caregiver-mediated Naturalistic Developmental Behavioral Intervention for toddlers with confirmed/suspected Autism Spectrum Disorder (ASD), with evidence in controlled research settings. Information is lacking on implementation in community settings. We reported on the treatment effectiveness of this program within a community setting, and the current paper describes the implementation phase of this work. Distinguishing between treatment and implementation effectiveness is critical for transporting interventions from laboratory to community.

Objectives

Describe the implementation of Social ABCs through a large public autism service, supported by a research-community partnership.

Methods

We describe this project through the Exploration, Preparation, Implementation, Sustainment (EPIS) framework as it focuses on implementation of evidence-based practices in publicly funded services. We apply this framework to the reporting stage. This project took place in the context of a 3-year government-funded pilot at a hospital-based publicly funded autism service. Participants: Program developers; Autism Service team; toddlers with suspected/confirmed ASD aged 14-34 months (M = 25.18 months) and their caregivers. Training/supervision: Provided by program developers at tapering intensity. Evaluation: Caregivers completed the Caregiver Diary and satisfaction surveys. We explored training processes, intervention uptake, acceptability, adaptations to fit community context, appropriateness, perceived impact, and facilitators/barriers.

Results

Six coaches were trained to fidelity, and three of these were further trained as Site Trainers. 183 clinically referred families enrolled and 89.4% completed the 12-week program. Caregivers reported increases in adherence and competence, high satisfaction and perceived benefits for their children. Coaches reported high satisfaction. Toddlers were appropriately identified to receive the intervention. Referral processes improved, including decreased referral age, and increased family readiness for diagnostic assessment and subsequent services.

Conclusions

Social ABCs was successfully implemented in a community service through a research-community partnership. The program was feasible, acceptable, and appropriate within a community context. Drivers of success included funding, institutional support, shared decision-making, adaptations to fit context, leadership support, perceived positive impact, and commitment to evaluation.

Helping Educational Leaders Mobilize Evidence (HELM): The iterative redesign of the Leadership and Organizational Change for Implementation (LOCI) intervention for use in schools

Background

Few "intervention agnostic" strategies have been developed that can be applied to the broad array of evidence-based practices (EBPs) in schools. This paper describes two studies that reflect the initial iterative redesign phases of an effective leadership-focused implementation strategy-Leadership and Organizational Change for Implementation (LOCI)-to ensure its acceptability, feasibility, contextual appropriateness, and usability when used in elementary schools. Our redesigned strategy-Helping Educational Leaders Mobilize Evidence (HELM)-is designed to improve principals' use of strategic implementation leadership to support the adoption and high-fidelity delivery of a universal EBP to improve student outcomes.

Method

In Study 1, focus groups were conducted (n = 6) with 54 district administrators, principals, and teachers. Stakeholders provided input on the appropriateness of original LOCI components to maximize relevance and utility in schools. Transcripts were coded using conventional content analysis. Key themes referencing low appropriateness were summarized to inform LOCI adaptations. We then held a National Expert Summit (Study 2) with 15 research and practice experts. Participants provided feedback via a nominal group process (NGP; n = 6 groups) and hackathon (n = 4 groups). The research team rated each NGP suggestion for how actionable, impactful/effective, and feasible it was. We also coded hackathon notes for novel ideas or alignment with LOCI components.

Results

Study 1 suggestions included modifications to LOCI content and delivery. Study 2's NGP results revealed most recommendations to be actionable, impactful/effective, and feasible. Hackathon results surfaced two novel ideas (distributed leadership teams and leaders' knowledge to support educators EBP use) and several areas of alignment with LOCI components.

Conclusion

Use of these iterative methods informed the redesign of LOCI and the development of HELM. Because it was collaboratively constructed, HELM has the potential to be an effective implementation strategy to support the use of universal EBP in schools.

Implementation of a Stepped Care Program to Address Emotional Recovery among Traumatic Injury Patients

BACKGROUND

Annually, over 600,000 adults served in US trauma centers (≥20%) develop posttraumatic stress disorder (PTSD) and/or depression in the first year after injury. American College of Surgeons guidelines include screening and addressing mental health recovery in trauma centers. Yet, many trauma centers do not monitor and address mental health recovery, and it is a priority to learn how to implement evidence-informed mental health programs in trauma centers.

STUDY DESIGN

This report describes our application of the Exploration, Preparation, Implementation, Sustainment model to implement the Trauma Resilience and Recovery Program (TRRP) in 3 Level I and II trauma centers to address patients' mental health needs. TRRP is a scalable and sustainable stepped model of care-one of the few in the US-that provides early intervention and direct services after traumatic injury.

RESULTS

Trauma centers are well positioned to accelerate patients' mental health recovery via early identification, education, screening, and referrals to mental health agencies that provide best-practice care. We found that TRRP was acceptable to the 3 partnering trauma centers we studied. Early engagement of patient, provider, and hospital administration stakeholders enhanced buy-in during the early stages of the implementation process and promoted sustainability. Active processes to support monitoring, evaluation, and adaptation were critical.

CONCLUSIONS

Our work demonstrates the feasibility of implementing and adapting TRRP, a cost-efficient and sustainable stepped care intervention, in Level I and II trauma centers. Several factors should be carefully considered by trauma centers seeking to integrate behavioral health interventions into their trauma program.

Examining adaptations necessary to support the implementation of a parent-mediated intervention for children with autism spectrum disorder and moderate feeding problems

LAY ABSTRACT

Moderate feeding problems and disruptive mealtime behaviors are common in children with autism spectrum disorder. Although parent-mediated interventions are able to support feeding problems in autistic children, most research has occurred within specialty clinics when delivered by highly trained clinicians. Thus, the fit of these interventions within community settings is not clear. To address this limitation, this study explored adaptations to a parent-mediated intervention, Managing Eating Aversions and Limited Variety (i.e. MEAL Plan), to improve its fit and use within community settings. Participants were 14 multidisciplinary providers who attended one of the three intensive workgroups that included focus groups about the fit of MEAL Plan in their practice setting. Qualitative analysis was used to determine the main themes that came up within the focus groups. Specific themes included the appropriateness MEAL Plan for autistic and non-autistic children, how providers might adapt their delivery of MEAL Plan, billing and insurance considerations, administrator support for MEAL Plan, and the content and format of ongoing training and consultation. By proactively considering and responding to these factors, it may be possible to enhance MEAL Plan so that it is better able to be delivered and sustained within community practices that support autistic children.

Abbreviating the Early Start Denver Model for community-based family-centered care

Introduction

Parent-mediated approaches for young children with or with a higher likelihood of autism have gained traction, with mounting evidence of efficacy, but a research-to-gap practice exists, and community effectiveness remains to be firmly established.

Methods

Using a community-participatory framework, a total of 10 parent-child dyads received a five-day workshop and six follow-up sessions of ESDM parent coaching. Intervention was implemented across two phases with in-person and telehealth delivery.

Results

From pre to post intervention across both phases, parents improved in their fidelity of intervention implementation and children maid gains on proximal measures of social communication.

Discussion

Community delivery of an evidence-based parent-mediated interventions for toddlers on the autism spectrum is feasible and promising. Giving resource efficiencies associated with parent-mediated approaches, particularly when delivered through government-funded programs, findings bolster current efforts to promote earlier and more widespread community access to necessary interventions. Facilitators and barriers to supporting parent learning and behavior change via interactive strategies are discussed.

Advancing research on teams and team effectiveness in implementation science: An application of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework

Background

Effective teams are essential to high-quality healthcare. However, teams, team-level constructs, and team effectiveness strategies are poorly delineated in implementation science theories, models, and frameworks (TMFs), hindering our understanding of how teams may influence implementation. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework is a flexible and accommodating framework that can facilitate the application of team effectiveness approaches in implementation science.

Main Text

We define teams and provide an overview of key constructs in team effectiveness research. We describe ways to conceptualize different types of teams and team constructs relevant to implementation within the EPIS framework. Three case examples illustrate the application of EPIS to implementation studies involving teams. Within each study, we describe the structure of the team and how team constructs influenced implementation processes and outcomes.

Conclusions

Integrating teams and team constructs into the EPIS framework demonstrates how TMFs can be applied to advance our understanding of teams and implementation. Implementation strategies that target team effectiveness may improve implementation outcomes in team-based settings. Incorporation of teams into implementation TMFs is necessary to facilitate application of team effectiveness research in implementation science.

Perspectives from parents of autistic children on participating in early intervention and associated research

LAY ABSTRACT

Support for autistic children early in life should help them to lead flourishing lives. However, many of the early intervention programmes for young autistic children are time-consuming and costly for families. These programmes are also often conducted in settings that are not closely matched to real life. We spoke to 23 parents (of 22 autistic children) to understand their experiences of their children's involvement in early intervention. Parents told us they were grateful for the opportunity, that they had 'hit the jackpot', and their children had 'gained so much' from the programme. They seemed to value the service because it made them feel safe and secure during an uncertain time in their children's lives. Parents told us they trusted staff, felt that they weren't 'doing it alone', and this 'took that pressure off' and helped them feel empowered. They also spoke of feelings of safety from being linked to the university research programme which offered 'accountability' and 'integrity'. Parents' comments showed a strong commitment to the early intervention model and staff - but also common feelings of abandonment and disempowerment as their child's time with the programme came to an end and they went 'back to the real world' and needed to find new supports for their children. These parents' insights should help to inform the design and delivery of community supports for preschool-aged autistic children and their families, which match the reality of their lived experiences.

The perspectives of Australian speech pathologists in providing evidence-based practices to children with autism

BACKGROUND

Bridging the research-practice gap in autism communication services is an identified priority for improving services. Limited research has investigated the views of practitioners regarding this research-practice gap. Investigation of the barriers experienced and facilitators used in clinical practice may assist to identify scalable and sustainable strategies to increase use of evidence-based practices (EBPs) in the delivery of communication services to children with autism.

AIMS

To elucidate how Australian speech pathologists engage with external evidence and how communication outcomes are measured to demonstrate the effectiveness of service provision to children with autism.

METHODS & PROCEDURES

A total of 15 Australian speech pathologists, with experience ranging from less than 1 to more than 16 years, participated in three focus groups. Data from focus groups were analysed using reflexive thematic analysis within an interpretive phenomenological paradigm.

OUTCOMES & RESULTS

Seven themes were identified. Participants reported on the diversity of individuals with autism, their experiences of resource constraints, seeking collegial advice and accessing a diverse range of evidence sources, the role of clinical expertise in translating evidence to practice, the barriers experienced in outcome measurement and use of stakeholders to facilitate data collection to demonstrate outcomes.

CONCLUSIONS & IMPLICATIONS

Individual practitioner skill and beliefs are facilitators to translating research to practice. Interventions to improve clinician use of EBP should address the skill and belief barriers, aiming to increase a clinician's EBP self-efficacy and increasing their expectation that investing in EBP activities will result in improved services for children with autism. Modelling and reflective practice are two strategies that may have an application as interventions to improve EBP use in clinical practice.

WHAT THIS PAPER ADDS

What is already known on the subject Constrained resources, especially lack of time, is a barrier to routine uptake of best available evidence in clinical services for children with autism. What this paper adds to existing knowledge In this study, the perception that speech pathologists lacked time to engage in EBP activities was linked with the speech pathologist's research skill and their beliefs about the benefits of engaging in EBP. Speech Pathologists reported using a range of information sources, as "evidence" but also reported feeling uneasy when using evidence of disputable, or unknown quality. Accessibility and relevance to their individual client were highly prioritised in selecting evidence. Clinical expertise was an essential skill for research translation. What are the potential or actual clinical implications of this work? Interventions which target professional beliefs and research translation capability are requisite for motivating speech pathologists to improve their use of EBP. Modelling of EBP use, individual reflective practice and collegial active listening to facilitate reflective practice, might be useful strategies which target beliefs and capability of individual speech pathologists; thereby changing their EBP use.

Using implementation science frameworks to explore barriers and facilitators for parents' use of therapeutic strategies following a parent-mediated autism intervention

LAY ABSTRACT

Many early autism interventions teach parents therapeutic strategies to help them adjust their communication style with their children. Research has shown that this behaviour change in parents leads to improvements in child communication. It is, therefore, important to learn what factors support or hinder parents in their use of therapeutic strategies learned in such interventions. This study set out to interview parents who had participated in a research trial of the Paediatric Autism Communication Therapy-Generalised intervention. We interviewed 27 caregivers and explored their use of the strategies up to 2 years after the end of the research trial. Qualitative frameworks were used to inform interview questions and data analysis. These frameworks focused on a range of contextual factors, including parents' characteristics, their context and features of the intervention. Parents reported barriers and facilitators to using Paediatric Autism Communication Therapy-Generalised strategies across three themes: Motivating Factors; Opportunity and Support; Parent Characteristics. One of these themes, Motivating Factors, was further divided into the subthemes Compatibility and Buy-In and Alignment of Goals and Outcomes. Almost all parents reported continued use of the Paediatric Autism Communication Therapy-Generalised strategies. Facilitators included parental confidence in using the strategies and barriers included child's behaviour. Consideration of these factors can inform ways to better support parents in future autism interventions.

Leading the charge in the education sector: development and validation of the School Implementation Leadership Scale (SILS)

Background

Strategic implementation leadership is a critical determinant of successful implementation, hypothesized to create a more supportive implementation climate conducive to the adoption and use of evidence-based practices. Implementation leadership behaviors may vary significantly across contexts, necessitating studies that examine the validity of established measurement tools in novel health service delivery sectors. The education sector is the most common site for delivering mental health services to children and adolescents in the USA, but research focused on implementation leadership in schools is in the early phases, and there is a need for adaptation and expansion of instruments in order to tailor to the school context. The current study adapted and validated the School Implementation Leadership Scale (SILS) (based on the Implementation Leadership Scale) in a sample of elementary school personnel from six school districts who were implementing one of two well-established prevention programs for supporting children’s mental health.

Methods

Participants were 441 public school teachers from 52 elementary schools in the Midwest and West Coast of the USA. Participants completed a survey that contained: (1) an adapted and expanded version of the SILS with additional items generated for four existing subscales as well as three new subscales (communication, vision/mission, and availability), and (2) additional tools to evaluate convergent and divergent validity (i.e., measures of general/molar leadership and teaching attitudes). Data underwent (1) examination of item characteristic curves to reduce items and ensure a pragmatic instrument, (2) confirmatory factor analyses to establish structural validity, and (3) evaluation of convergent and divergent validity.

Results

Item reduction analyses resulted in seven subscales of three items each. Results indicated acceptable fit for a seven-factor structural model (CFI = .995, TLI = .99, RMSEA = .07, SRMR = 0.02). Second-order factor loadings were high (λ = .89 to .96), suggesting that the SILS subscales comprise a higher-order implementation leadership factor. All subscales demonstrated good inter-item reliability (α = .91–.96). Convergent and divergent validity results were generally as hypothesized, with moderate to high correlations between SILS subscales and general leadership, moderate correlations with teaching attitudes, and low correlations with school demographics.

Conclusions

Overall, results provided strong structural, convergent, and divergent validity evidence for the 21-item, 7-factor SILS instrument. Implications for the measurement of implementation leadership in schools are discussed, as well as strategies to support leaders to enhance their strategic behaviors related to the implementation of mental health prevention programs (e.g., adaptation of existing leadership-focused implementation strategies).

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01222-7.

Using Novel Implementation Tools for Evidence-based Intervention Delivery (UNITED) across public service systems for three evidence-based autism interventions in under-resourced communities: study protocol

BACKGROUND

There are a growing number of evidence-based interventions (EBIs) for autistic individuals, but few are successfully implemented with fidelity in under-resourced communities and with families from traditionally disenfranchised groups. Implementation science offers tools to increase EBI use in communities, but most implementation strategies are designed specific to a single EBI. It is not feasible to develop a new implementation strategy each time a new EBI is introduced in the community. Therefore, to test the effectiveness and generalizability of implementation strategies we are developing and testing a multifaceted implementation strategy with three EBIs concurrently. The goal of this protocol paper is to describe the randomized field trial of an implementation strategy for use across autism EBIs, diverse settings and participants, with the goal of increasing rapid uptake of effective practices to reach our most vulnerable children.

METHODS

We developed a multifaceted implementation strategy called Using Novel Implementation Tools for Evidence-based intervention Delivery (UNITED) to facilitate the implementation and sustainment of three EBIs in under-resourced settings. We will compare fidelity to, and effectiveness of, each intervention [Mind the Gap (MTG), Remaking Recess (RR), Self-Determined Learning Model of Instruction (SDLMI)] with and without UNITED in a randomized field trial. Randomization will be stratified using a minimization allocation method. We will train community practitioners using remote delivery of modules specific to the intervention, and active coaching via Zoom for at least 6 sessions and up to 12 as dictated by each EBI. Our primary outcome is fidelity to each EBI, and our secondary outcome is at the child or family level (family empowerment for MTG, child peer social engagement for RR, and adolescent self-determination for SDLMI, respectively). We will measure progress through the implementation phases using the Stages of Implementation Completion and cost-effectiveness of UNITED.

DISCUSSION

The results of this study will provide rigorous data on the effectiveness and generalizability of one relatively light-touch implementation strategy in increasing use of autism EBIs and associated outcomes in diverse under resourced public service settings for underrepresented autistic youth.

TRIAL REGISTRATION

Mind the Gap: Clinicaltrials.gov Identifier:  NCT04972825 (Date registered July 22, 2021); Remaking Recess: Clinicaltrials.gov Identifier:  NCT04972838 (Date registered July 22, 2021); Self-Determined Learning Model of Instruction: Clinicaltrials.gov Identifier:  NCT04972851 (Date registered July 22, 2021).

Factors associated with implementation of a school-based comprehensive program for students with autism

LAY ABSTRACT

The purpose of this study was to identify influences on the implementation of a school-based, comprehensive program for autistic students. Influences from the community context, from within the school organization, and from features of the intervention itself were examined. The study took place in 39 elementary schools in a southeastern state in the United States. Transformational leadership style of the building principal, percentage of white students at the school (which was proposed as a broader community socioeconomic variable), and adequacy of coaching were all associated with implementation.

Project MIMIC (Maximizing Implementation of Motivational Incentives in Clinics): A cluster-randomized type 3 hybrid effectiveness-implementation trial

BACKGROUND

Opioid-related overdoses and harms have been declared a public health emergency in the United States, highlighting an urgent need to implement evidence-based treatments. Contingency management (CM) is one of the most effective behavioral interventions when delivered in combination with medication for opioid use disorder, but its implementation in opioid treatment programs is woefully limited. Project MIMIC (Maximizing Implementation of Motivational Incentives in Clinics) was funded by the National Institute on Drug Abuse to identify effective strategies for helping opioid treatment programs improve CM implementation as an adjunct to medication. Specific aims will test the impact of two different strategies on implementation outcomes (primary aim) and patient outcomes (secondary aims), as well as test putative mediators of implementation effectiveness (exploratory aim).

METHODS

A 3-cohort, cluster-randomized, type 3 hybrid design is used with the opioid treatment programs as the unit of randomization. Thirty programs are randomized to one of two conditions. The control condition is the Addiction Technology Transfer Center (ATTC) Network implementation strategy, which consists of three core approaches: didactic training, performance feedback, and on-going consultation. The experimental condition is an enhanced ATTC strategy, with the same core ATTC elements plus two additional theory-driven elements. The two additional elements are Pay-for-Performance, which aims to increase implementing staff's extrinsic motivations, and Implementation & Sustainment Facilitation, which targets staff's intrinsic motivations. Data will be collected using a novel, CM Tracker tool to document CM session delivery, session audio recordings, provider surveys, and patient surveys. Implementation outcomes include CM Exposure (number of CM sessions delivered per patient), CM Skill (ratings of CM fidelity), and CM Sustainment (number of patients receiving CM after removal of support). Patient outcomes include self-reported opioid abstinence and opioid-related problems (both assessed at 3- and 6-months post-baseline).

DISCUSSION

There is urgent public health need to improve the implementation of CM as an adjunct to medication for opioid use disorder. Consistent with its hybrid type 3 design, Project MIMIC is advancing implementation science by comparing impacts of these two multifaceted strategies on both implementation and patient outcomes, and by examining the extent to which the impacts of those strategies can be explained by putative mediators.

TRIAL REGISTRATION

This clinical trial has been registered with clinicaltrials.gov (NCT03931174). Registered April 30, 2019. https://clinicaltrials.gov/ct2/show/NCT03931174?term=project+mimic&draw=2&rank=1.

A Systematic Review of Mental Health Interventions for ASD: Characterizing Interventions, Intervention Adaptations, and Implementation Outcomes

Youth with autism spectrum disorder (ASD) have high rates of co-occurring mental health needs that necessitate mental health interventions. Given the unique clinical characteristics of youth with ASD, there have been significant efforts to adapt and test mental health interventions for this population. Yet, characterization of the nature and types of interventions adaptations is limited, especially across the wide range of interventions tested for youth with ASD with a focus on implementation factors. Additionally, understanding how these interventions may be implemented in community services is limited. The aims of this systematic review are to characterize the (1) types of interventions tested for co-occurring mental health conditions for youth with ASD; (2) adaptations to mental health interventions for use with youth with ASD; and (3) implementation strategies, outcomes, and determinants of mental health interventions to inform their translation to community service settings. Eighty-three articles testing interventions targeting mental health symptoms in youth with ASD that included implementation factors in analyses were reviewed. The Stirman et al. (2013; 2019) FRAME adaptation, Powell et al. (2012;2015) implementation strategies, and Proctor et al. (2011) implementation outcomes taxonomies were applied to characterize the nature and types of adaptations for use with youth with ASD and types of implementation strategies, outcomes, and determinants used, when available, respectively. Of the interventions examined, the majority (64.1%) were originally designed to target youth mental health concerns and were then adapted to be used with ASD. The most common adaptations included those to the intervention content, particularly adding elements with tailoring or refining aspects of the intervention while maintaining core functions. Half of the articles described at least one implementation strategy used during intervention testing. Fidelity and acceptability were the most frequently examined implementation outcomes, with some examination of appropriateness and feasibility. Nineteen percent of articles described implementation determinants (i.e. barriers/facilitators) of these implementation outcomes. The common adaptations for ASD provide direction for future intervention development and for training community therapists. Further examination, specification, and reporting of implementation strategies and outcomes within ongoing efforts to adapt and interventions to meet the co-occurring mental health needs of youth ASD are needed to facilitate their translation to community settings. Areas for future research as well as clinical implications are discussed.

Mental Health Services for Autistic Individuals Across the Lifespan: Recent Advances and Current Gaps

PURPOSE OF REVIEW

This synthesis of recent mental health services research with autistic individuals presents significant advances, current gaps, and recommendations for improving mental healthcare for this population.

RECENT FINDINGS

Recent advances include improved understanding of co-occurring mental health conditions among autistic individuals, a growing evidence base for interventions to address them, the development and implementation of new service models to support mental health for this population, and a substantial increase in mental health services and implementation research focused on autism. Ongoing challenges include a lack of mental health interventions designed for community implementation with autistic individuals, limited workforce capacity, complex and disconnected service systems, and racial, ethnic, and socioeconomic disparities in accessibility and quality of mental health services. Despite the advances in our understanding of mental health needs and mental health services for autistic individuals, several critical gaps remain. We encourage future efforts to develop and test interventions that can be used in community settings, train and incentivize the workforce to provide them, realign policies and funding with best practice, and embrace an equity-focused approach to autism research and care.

Festschrift for Leonard Bickman: Introduction to The Future of Children's Mental Health Services Special Issue

This introductory article describes the genesis of the Festschrift for Leonard Bickman and of this Festschrift special issue entitled, The Future of Children’s Mental Health Services. The special issue includes a collection of 11 original children’s mental health services research articles, broadly organized in accordance with three themes (i.e., Improving Precision and Use of Service Data to Guide Policy and Practice, Implementation and Dissemination, and Preparing for Innovation), followed by an interview-style article with Bickman. Then follows a featured manuscript by Bickman himself, three invited commentaries, and a compilation of letters and notes in which colleagues reflect on his career and on their experiences of him. The introduction concludes with a few thoughts about the future of children’s mental health services portended by the extraordinary scholarly contributions of Bickman and those who have been inspired by him.

Correction to: A Systematic Review of Mental Health Interventions for ASD: Characterizing Interventions, Intervention Adaptations, and Implementation Outcomes

Due to the errors occurred in the originally published version, this article is being reprinted in its entirety as Correction. All errors have been corrected. It is the correct version.

Implementation of school-based services for students with autism: Barriers and facilitators across urban and rural districts and phases of implementation

LAY ABSTRACT

The law requires that schools use evidence-based practices to educate students with autism spectrum disorder. However, these practices are often not used, or are not used correctly in school programs. Understanding barriers and facilitators of use of evidence-based practices in schools will help improve the implementation process. This study uses focus groups to characterize how school-based providers representing urban or rural school districts perceive barriers and facilitators for implementing new practices for students with autism spectrum disorder. Guiding questions include the following: (1) Are contextual factors perceived as barriers or facilitators and how do these vary by district location? and (2) What are the key factors impacting implementation across the Exploration, Preparation, Implementation, and Sustainment phases? Focus group participants (n = 33) were service providers to children with autism spectrum disorder from urban- and rural-located school districts. Several personnel-related themes (attitudes and buy-in, knowledge and skills, staffing, and burnout) were shared by participants representing both urban and rural districts. However, some personnel-related themes and organizational factors were unique to rural or urban districts. For example, themes related to system and organizational factors (leadership approval, support and expectations, district structure, competing priorities, time for effective professional development, litigation and due process, and materials and resources) differed between the district locations. This project serves as an initial step in identifying implementation strategies that may improve the use of evidence-based practices in schools.

The STS case study: an analysis method for longitudinal qualitative research for implementation science

BACKGROUND

Ethnographic approaches offer a method and a way of thinking about implementation. This manuscript applies a specific case study method to describe the impact of the longitudinal interplay between implementation stakeholders. Growing out of science and technology studies (STS) and drawing on the latent archaeological sensibilities implied by ethnographic methods, the STS case-study is a tool for implementors to use when a piece of material culture is an essential component of an innovation.

METHODS

We conducted an ethnographic process evaluation of the clinical implementation of tele-critical care (Tele-CC) services in the Department of Veterans Affairs. We collected fieldnotes and conducted participant observation at virtual and in-person education and planning events (n = 101 h). At Go-Live and 6-months post-implementation, we conducted site visits to the Tele-CC hub and 3 partnered ICUs. We led semi-structured interviews with ICU staff at Go-Live (43 interviews with 65 participants) and with ICU and Tele-CC staff 6-months post-implementation (44 interviews with 67 participants). We used verification strategies, including methodological coherence, appropriate sampling, collecting and analyzing data concurrently, and thinking theoretically, to ensure the reliability and validity of our data collection and analysis process.

RESULTS

The STS case-study helped us realize that we must think differently about how a Tele-CC clinician could be noticed moving from communal to intimate space. To understand how perceptions of surveillance impacted staff acceptance, we mapped the materials through which surveillance came to matter in the stories staff told about cameras, buttons, chimes, motors, curtains, and doorbells.

CONCLUSIONS

STS case-studies contribute to the literature on longitudinal qualitive research (LQR) in implementation science, including pen portraits and periodic reflections. Anchored by the material, the heterogeneity of an STS case-study generates questions and encourages exploring differences. Begun early enough, the STS case-study method, like periodic reflections, can serve to iteratively inform data collection for researchers and implementors. The next step is to determine systematically how material culture can reveal implementation barriers and direct attention to potential solutions that address tacit, deeply rooted challenges to innovations in practice and technology.

From Research Training to Scientific Advancement-Contributions from the Implementation Research Institute: An Introduction to the Special Issue

The special series is designed to provide examples of funded implementation research conducted by alumni of the first four cohorts of the Implementation Research Institute (IRI). The introduction links the six substantive papers to the conceptual and methodological challenges laid out in a 2009 publication in this journal which led to the IRI training program in the emerging science of implementation with a special focus on behavior health settings. The 7th paper in the series illustrates an innovative evaluative approach to design and measurement of IRI fellow publications and grants informed by the training program such as bibliometrics. The introduction also notes some elements identified in the 2009 foundational paper not represented in these papers such as costs as well as important developments and foci in the decade since 2009 such as de-implementation, sustainability, dynamic adaptation processes, and hybrid designs that need to be an integral part of training programs in implementation research.

Training Teachers to Implement Classroom Pivotal Response Teaching during Small-group Instruction: A Pilot Study

Background: Providing effective education to students with autism spectrum disorder (ASD) poses a significant challenge to educators. Although several evidence-based practices (EBPs) have been developed, few have been systematically implemented in educational settings. Pivotal response treatment (PRT) is a naturalistic behavioral intervention that has been adapted for implementation in the school context. Methods: This pilot study used a concurrent multiple baseline design across seven teachers and students with ASD to examine the effectiveness of teacher training in classroom pivotal response teaching (CPRT) on teacher fidelity of implementation during small-group instruction and students' communication skills and maladaptive behaviors in schools for special education in the Netherlands. Results: Results indicated no replicated effect of CPRT training on teachers' fidelity of implementation or children's communications skills and maladaptive behavior, although teachers reported high satisfaction with the CPRT training. Discussion: Implications for clinical practice and directions for future research are discussed.

Strengthening capacity for implementation of evidence-based practices for autism in schools: The roles of implementation climate, school leadership, and fidelity

Understanding the factors that influence the use of evidence-based practices (EBPs) for autism spectrum disorder (ASD) in schools is critical to the selection of effective implementation strategies to support their sustained use. The current study has 2 aims: (a) evaluate the association between school leadership profiles (undifferentiated and optimal) and fidelity of EBP implementation and (b) examine the role of implementation climate as a mediator in this association. Participants included 56 principals, 90 special education teachers, and 133 classroom staff from 66 elementary schools. Participants completed the Multifactor Leadership Questionnaire and Implementation Climate Scale. Teachers and staff reported on intensity (frequency) of EBP delivery, and the research team rated the accuracy (adherence) to the components of the EBP. Schools were required to implement at least 1 of 3 EBPs for ASD (discrete trial training, pivotal response training, or visual supports). Using structural equation modeling, we found that schools with optimal leadership had higher observed ratings of teacher and staff fidelity for pivotal response training accuracy (p < .05), but not for discrete trial training or visual supports. However, this association became nonsignificant with the introduction of implementation climate into the models. Optimal leadership profiles were linked to more positive teacher/staff-reported implementation climate, compared with undifferentiated profiles (p < .01), but found no association between implementation climate and fidelity. Overall, the results of this study indicate that the role of principal leadership in EBP implementation is complex, which has implications for fostering a conducive organizational implementation context in schools. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Statewide Interagency Collaboration to Support Evidence-based Practice Scale Up: The California Autism Professional Training and Information Network (CAPTAIN)

The California Autism Professional Training and Information Network (CAPTAIN) is a statewide interagency collaboration with the goal of scaling up use of evidence-based practices (EBPs) for individuals with autism spectrum disorder (ASD). CAPTAIN began as a clinical initiative then further developed under the influence of implementation science methodology. The Exploration, Preparation, Implementation and Sustainment framework (EPIS) has impacted targeted strategy use for this statewide scale up of EBPs by informing the development of key partnerships, implementation goals, and collaborative processes within CAPTAIN. Currently, CAPTAIN has over 407 members representing 140 school and community agencies who provide training and coaching in EBP and meet regularly with regional teams. Outcome data indicate 51.9% of members provide training and coaching to more than three direct service providers/programs per year. Primary barriers to implementation of EBP were time for training (25.6%), lack of substitute teachers (16.5%), and staff lacking foundational skills (11.5%). Facilitators of implementation and sustainment of the CAPTAIN model include active participation in effective dissemination practices, creative funding and leveraging of local resources, development of the regional collaboratives with active membership, member commitment to EBP for ASD, and use of implementation science to identify and overcome barriers. The purpose of this paper is to highlight CAPTAIN as a model for statewide scale up of EBP in schools as well as other community agencies. Although these efforts have focused on EBP for ASD, the concepts, partnerships and procedures will likely be transferable to other focal issues and may be generalized across service sectors.

Implementation Science, Behavior Analysis, and Supporting Evidence-based Practices for Individuals with Autism

Although applied behavior analysis researchers have created efficacious treatment and intervention practices for children and youth with autism spectrum disorder (ASD), there is a gap between research and practice. Implementation Science (IS) and Organizational Behavior Management (OBM), based with Applied Behavior Analysis, are two parallel fields that could close this gap. This paper provides descriptions of both IS and OBM, highlighting their commonalities and unique featuers. The paper concludes with examples of how researchers have used IS and OBM to promote practitioners' use of evidence-based practices and services for children and youth with ASD.

Ten recommendations for using implementation frameworks in research and practice

Background

Recent reviews of the use and application of implementation frameworks in implementation efforts highlight the limited use of frameworks, despite the value in doing so. As such, this article aims to provide recommendations to enhance the application of implementation frameworks, for implementation researchers, intermediaries, and practitioners.

Discussion

Ideally, an implementation framework, or multiple frameworks should be used prior to and throughout an implementation effort. This includes both in implementation science research studies and in real-world implementation projects. To guide this application, outlined are ten recommendations for using implementation frameworks across the implementation process. The recommendations have been written in the rough chronological order of an implementation effort; however, we understand these may vary depending on the project or context: (1) select a suitable framework(s), (2) establish and maintain community stakeholder engagement and partnerships, (3) define issue and develop research or evaluation questions and hypotheses, (4) develop an implementation mechanistic process model or logic model, (5) select research and evaluation methods (6) determine implementation factors/determinants, (7) select and tailor, or develop, implementation strategy(s), (8) specify implementation outcomes and evaluate implementation, (9) use a framework(s) at micro level to conduct and tailor implementation, and (10) write the proposal and report. Ideally, a framework(s) would be applied to each of the recommendations. For this article, we begin by discussing each recommendation within the context of frameworks broadly, followed by specific examples using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

Summary

The use of conceptual and theoretical frameworks provides a foundation from which generalizable implementation knowledge can be advanced. On the contrary, superficial use of frameworks hinders being able to use, learn from, and work sequentially to progress the field. Following the provided ten recommendations, we hope to assist researchers, intermediaries, and practitioners to improve the use of implementation science frameworks.

Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: a prospective study across multiple U.S. public sector service systems

BACKGROUND

Bridging factors are relational ties (e.g. partnerships), formal arrangements (e.g. contracts or polices) and processes (e.g. data sharing agreements) linking outer and inner contexts and are a recent evolution of the Exploration-Preparation-Implementation-Sustainment (EPIS) framework. Bridging factor research can elucidate ways that service systems may influence and/or be influenced by organizations providing health services. This study used the EPIS framework and open systems and resource dependence theoretical approaches to examine contracting arrangements in U.S. public sector systems. Contracting arrangements function as bridging factors through which systems communicate, interact, and exchange resources with the organizations operating within them.

METHODS

The sample included 17 community-based organizations in eight service systems. Longitudinal data is derived from 113 contract documents and 88 qualitative interviews and focus groups involving system and organizational stakeholders. Analyses consisted of a document review using content analysis and focused coding of transcripts from the interviews and focus groups. A multiple case study analysis was conducted to identify patterns across service systems and organizations. The dataset represented service systems that had sustained the same EBP for between 2 and 10 years, which allowed for observation of bridging factors and outer-inner context interactions over time.

RESULTS

Service systems and organizations influenced each other in a number of ways through contracting arrangements. Service systems influenced organizations when contracting arrangements resulted in changes to organizational functioning, required organizational responses to insufficient funding, and altered interorganizational network relationships. Organizations influenced service systems when contract arrangements prompted organization-driven contract negotiation/tailoring, changes to system-level processes, and interorganizational collaboration. Service systems and organizations were dependent on each other as implementation progressed. Resources beyond funding emerged, including adequate numbers of eligible clients, expertise in the evidence-based practice, and training and coaching capacity.

CONCLUSION

This study advances implementation science by expanding the range and definition of bridging factors and illustrating specific bi-directional influences between outer context service systems and inner context organizations. This study also identifies bi-directional dependencies over the course of implementation and sustainment. An analysis of influence, dependencies, and resources exchanged through bridging factors has direct implications for selecting and tailoring implementation strategies, especially those that require system-level coordination and change.

Ten recommendations for using implementation frameworks in research and practice

BACKGROUND

Recent reviews of the use and application of implementation frameworks in implementation efforts highlight the limited use of frameworks, despite the value in doing so. As such, this article aims to provide recommendations to enhance the application of implementation frameworks, for implementation researchers, intermediaries, and practitioners.

DISCUSSION

Ideally, an implementation framework, or multiple frameworks should be used prior to and throughout an implementation effort. This includes both in implementation science research studies and in real-world implementation projects. To guide this application, outlined are ten recommendations for using implementation frameworks across the implementation process. The recommendations have been written in the rough chronological order of an implementation effort; however, we understand these may vary depending on the project or context: (1) select a suitable framework(s), (2) establish and maintain community stakeholder engagement and partnerships, (3) define issue and develop research or evaluation questions and hypotheses, (4) develop an implementation mechanistic process model or logic model, (5) select research and evaluation methods (6) determine implementation factors/determinants, (7) select and tailor, or develop, implementation strategy(s), (8) specify implementation outcomes and evaluate implementation, (9) use a framework(s) at micro level to conduct and tailor implementation, and (10) write the proposal and report. Ideally, a framework(s) would be applied to each of the recommendations. For this article, we begin by discussing each recommendation within the context of frameworks broadly, followed by specific examples using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

SUMMARY

The use of conceptual and theoretical frameworks provides a foundation from which generalizable implementation knowledge can be advanced. On the contrary, superficial use of frameworks hinders being able to use, learn from, and work sequentially to progress the field. Following the provided ten recommendations, we hope to assist researchers, intermediaries, and practitioners to improve the use of implementation science frameworks.

Adaption and pilot implementation of an autism executive functioning intervention in children's mental health services: a mixed-methods study protocol

BACKGROUND

Youth with autism spectrum disorder (ASD) represent a growing population with significant service needs. Prominent among these needs are high rates of co-occurring psychiatric conditions that contribute to increased functional impairments and often necessitate mental health services. Executive functioning deficits are associated with ASD as well as common co-occurring conditions (e.g., attention-deficit/hyperactivity disorder) and an evidence-based intervention has been developed and tested to address executive functioning within the school context. There is an urgent need to implement indicated evidence-based interventions for youth with ASD receiving care in community mental health settings. Interventions that optimally "fit" the mental health services context as well as the complex and co-occurring mental health needs of these youth have the potential to improve key clinical outcomes for this high priority population.

METHODS

This mixed-methods developmental study will apply the Exploration, Preparation, Implementation, Sustainment implementation framework and a community-academic partnership approach to systematically adapt and test an evidence-based executive functioning intervention for youth with ASD for delivery in community mental health settings. Specific aims are to (1) conduct a need and context assessment to inform the systematic adaptation an executive functioning evidence-based intervention; (2) systematically adapt the clinical intervention and develop a corresponding implementation plan, together entitled "Executive Functioning for Enhancing Community-based Treatment for ASD," (EFFECT for ASD); and (3) conduct a feasibility pilot test of EFFECT for ASD in community mental health settings.

DISCUSSION

Tailoring evidence-based interventions for delivery in community-based mental health services for youth with ASD has the potential to increase quality of care and improve child outcomes. Results from the current study will serve as the foundation for large-scale hybrid implementation and effectiveness trials and a generalizable approach for different service systems of care and clinical populations.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT04295512.

Commentary: Establishing Scientific Rigor and Excellence in Implementation Science Training to Improve the Deployment of Evidence-Based Mental Health Services

Real-world challenges continue to impede the dissemination, implementation and sustainment of high-quality, evidence-based practices, resulting in too many individuals not receiving the effective mental health care that they urgently need. The field of implementation science is poised to generate new solutions to address this important public health problem. Training a new generation of researchers in implementation science is one solution. The Implementation Research Institute (IRI) offers one approach to such training. The papers in this series, authored by some of the IRI graduates, illustrate the depth and breadth of the intellectual scope of IRI graduates' contributions to the implementation science field, chronicles important lessons learned, and underscores the IRI's training capacity. This commentary reflects upon the series in terms of a framework and themes that relate to core implementation science principles and to future research that corresponds to the National Institute of Mental Health research priorities and strategic plan.