A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System

A multi-constituent qualitative examination of facilitators and barriers to caregiver coaching for autistic children in publicly funded early intervention

LAY ABSTRACT

Caregiver coaching is an evidence-based practice for young autistic children, but it is not widely used in community-based early intervention services. Previous research has explored why caregiver coaching is not widespread in early intervention, but only from the perspective of early intervention providers. Caregivers, providers, and administrators are all involved in the decision of whether to use caregiver coaching in early intervention. Therefore, it is important to include all perspectives in research regarding this practice. In this study we interviewed 20 caregivers of autistic children, 36 early intervention providers, and 6 administrators from early intervention agencies and asked questions about their perspectives regarding the use of caregiver coaching in early intervention. We did this to figure out what factors help and hinder the use of caregiver coaching in this setting and to see how caregivers, providers, and administrators agreed or disagreed on these factors. All participants agreed that caregivers' attitudes and expectations can influence whether caregiver coaching is used. In addition, all participants agreed that when caregivers and providers collaborate and have a strong working relationship, it can facilitate the use of caregiver coaching in early intervention. Other factors, such as caregiver stress and provider flexibility were also discussed. Based on these findings, we suggest strategies that can be used to possibly increase the use of caregiver coaching in early intervention for autistic children and their families.

A pragmatic, stepped-wedge, hybrid type II trial of interoperable clinical decision support to improve venous thromboembolism prophylaxis for patients with traumatic brain injury

BACKGROUND

Venous thromboembolism (VTE) is a preventable medical condition which has substantial impact on patient morbidity, mortality, and disability. Unfortunately, adherence to the published best practices for VTE prevention, based on patient centered outcomes research (PCOR), is highly variable across U.S. hospitals, which represents a gap between current evidence and clinical practice leading to adverse patient outcomes. This gap is especially large in the case of traumatic brain injury (TBI), where reluctance to initiate VTE prevention due to concerns for potentially increasing the rates of intracranial bleeding drives poor rates of VTE prophylaxis. This is despite research which has shown early initiation of VTE prophylaxis to be safe in TBI without increased risk of delayed neurosurgical intervention or death. Clinical decision support (CDS) is an indispensable solution to close this practice gap; however, design and implementation barriers hinder CDS adoption and successful scaling across health systems. Clinical practice guidelines (CPGs) informed by PCOR evidence can be deployed using CDS systems to improve the evidence to practice gap. In the Scaling AcceptabLE cDs (SCALED) study, we will implement a VTE prevention CPG within an interoperable CDS system and evaluate both CPG effectiveness (improved clinical outcomes) and CDS implementation.

METHODS

The SCALED trial is a hybrid type 2 randomized stepped wedge effectiveness-implementation trial to scale the CDS across 4 heterogeneous healthcare systems. Trial outcomes will be assessed using the RE2-AIM planning and evaluation framework. Efforts will be made to ensure implementation consistency. Nonetheless, it is expected that CDS adoption will vary across each site. To assess these differences, we will evaluate implementation processes across trial sites using the Exploration, Preparation, Implementation, and Sustainment (EPIS) implementation framework (a determinant framework) using mixed-methods. Finally, it is critical that PCOR CPGs are maintained as evidence evolves. To date, an accepted process for evidence maintenance does not exist. We will pilot a "Living Guideline" process model for the VTE prevention CDS system.

DISCUSSION

The stepped wedge hybrid type 2 trial will provide evidence regarding the effectiveness of CDS based on the Berne-Norwood criteria for VTE prevention in patients with TBI. Additionally, it will provide evidence regarding a successful strategy to scale interoperable CDS systems across U.S. healthcare systems, advancing both the fields of implementation science and health informatics.

TRIAL REGISTRATION

Clinicaltrials.gov - NCT05628207. Prospectively registered 11/28/2022, https://classic.

CLINICALTRIALS

gov/ct2/show/NCT05628207 .

Effect of Providing Evidence-Based Mental Health Treatment on Retention in Care Among Medicaid-Enrolled Youths

OBJECTIVE

Youths who start behavioral health treatment often stop before completing a therapeutic course of care. To increase treatment engagement and quality of care, the Evidence-Based Practice and Innovation Center in Philadelphia has incentivized use of evidence-based practices (EBPs) for mental health care of youths. The authors aimed to compare treatment outcomes between youths who received EBP care and those who did not.

METHODS

Using EBP-specific billing codes and propensity score matching, the authors compared treatment retention among youths who received trauma-focused cognitive-behavioral therapy (TF-CBT; N=413) or parent-child interaction therapy (PCIT; N=90) relative to matched samples of youths in standard outpatient therapy (N=503).

RESULTS

Youths with a minimum of one session of TF-CBT or PCIT attended a second session at higher rates than did youths in the matched control group (TF-CBT: 96% vs. 68%, p<0.01; PCIT: 94% vs. 69%, respectively, p<0.01). On average, these returning youths attended more sessions in the EBP groups than in the control group (TF-CBT: 15.9 vs. 11.5 sessions, p<0.01; PCIT: 11.2 vs. 6.9 sessions, p<0.01).

CONCLUSIONS

These findings indicate that, in addition to improving quality of care, EBP implementation helps address the major challenge that most youths who engage with treatment are not retained long enough for care to have therapeutic effects. Future research should examine the mechanisms through which EBPs can improve treatment retention.

Mental Health Provider Reach and Engagement in a Countywide Training Initiative

Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.

What Really Matters in the Implementation of Evidence-based Practices in Community Mental Health? Insight and Recommendations from Experts, Providers, and Clients

Perceptions of evidence-based practices (EBPs) and implementation are inherent drivers of implementation outcomes. Most studies on implementation perceptions have focused on direct service providers, but clients and EBP experts may offer additional meaningful information about implementing EBPs in community settings. EBP providers (n = 21), EBP experts (n = 12), and clients who received EBPs (n = 6) participated in focus groups to ascertain their perceptions of and experiences with EBP implementation, as part of a program evaluation. Thematic analysis indicated that provider and expert perceptions of EBP implementation in community settings converged around themes of implementation supports and training and client outcomes, along with several subthemes. Client perceptions centered on themes regarding the importance of their personal experiences, their impressions of EBPs, as well as their recommendation for increasing public awareness and use of EBPs. Findings suggest that the perspectives of EBP providers and experts are closely aligned, focusing on system-level, individual-level, and training issues that impact EBP implementation within a public mental health system. The themes that were important to clients were primarily related to their experiences as recipients of an EBP which produced insightful recommendations for promoting EBPs in the community.

Bridging the transition from homelessness: Developing an occupational therapy framework

BACKGROUND

Occupational therapists support individuals experiencing homelessness in traditional roles, and occupational therapy positions focussed specifically on homelessness appear to be growing.

OBJECTIVES

To develop and refine a framework to guide occupational therapy practice and research in homelessness.

METHOD

We developed a framework and refined it through a stakeholder consultation process conducted with 17 international occupational therapy experts using an online survey. In this survey, we presented an initial framework and requested qualitative feedback. We analyzed this qualitative data using content analysis.

RESULTS

Stakeholder feedback was categorized into eight recommendations: (1) Revision to the 'four processes'; (2) Emphasizing social justice and systems-level advocacy; (3) Reflecting intersectionality; (4) Emphasizing meaningful activity; (5) Emphasizing peer support; (6) Incorporating a focus on independent living skills; (7) Increasing a focus on an activity for addressing substance misuse; and (8) Acknowledging cognitive and physical health. Each of these recommendations was incorporated into a refined version of this framework. These recommendations and a refined version of the framework are presented in this paper.

CONCLUSIONS

We have developed and refined a framework aimed at guiding practice and research in occupational therapy in homelessness that will be evaluated in future research.

SIGNIFICANCE

Though a range of frameworks exists for guiding the practice of occupational therapists more generally, this framework represents the first that is focussed specifically on guiding occupational therapy practice and research with individuals who experience homelessness. Research and practice implications are discussed.

Therapist perceptions of experiential training for exposure therapy

BACKGROUND

Despite evidence for its efficacy, exposure therapy for anxiety is rarely used in routine care settings. Efforts to address one major barrier to its use - therapists' negative beliefs about exposure - have included therapist-level implementation strategies, such as training and consultation. Experiential training, in which therapists themselves undergo exposures, has recently demonstrated feasibility, acceptability and preliminary effectiveness for increasing exposure use.

AIMS

This study aimed to assess: (1) therapists' perceptions of experiential training and (2) barriers and facilitators to implementing exposure following training.

METHOD

Therapists who underwent experiential training (n=12) completed qualitative interviews and quantitative questionnaires. Interviews were coded using an integrated approach, combining both inductive and deductive approaches. Mixed methods analyses examined how themes varied by practice setting (community mental health versus private practice) and exposure use.

RESULTS

Results highlight how therapist-level factors, such as clinician self-efficacy, interact with inner- and outer-setting factors. Participants reported positive perceptions of exposure after training; they noted that directly addressing myths about exposure and experiencing exposures themselves improved their attitudes toward exposure. Consistent with prior literature, issues such as insufficient supervisory support, organizational constraints, and client characteristics made it challenging to implement exposures.

DISCUSSION

Results highlight the benefits of experiential training, while also highlighting the need to consider contextual determinants. Differences in responses across practice settings highlight areas for intervention and the importance of tailoring implementation strategies. Barriers that were specific to therapists who did not use exposure (e.g. hesitancy about its appropriateness for most clients) point to directions for future implementation efforts.

Perceptions of professionals about factors affecting the implementation of early childhood support systems: A case study evaluation from an ecological perspective

This evaluation research looked at factors affecting collaboration across the various levels of implementation of early childhood support systems. An ecological conceptual framework was used to examine barriers and facilitators to implementing social and health care services from the perspective of the professionals involved at the national, state, and local level of government. A single case study following a qualitative research strategy was conducted with a total of 29 professionals from social development and health ministries, one municipality and a family health center responsible for implementing the Chile Grows with You system. The results show that at the national level, the main factors include socio-political aspects, funding, and the empathy that professional employees hold for peers who are at lower rungs in the hierarchy. At the state level workplace conditions play a key role. For the local level those factors include information system management and the political support of the local government. The discussion section emphasizes the relevance of considering the interdependence of such factors that influence implementation outcomes and the need to move away from a single program evaluation to a multilevel implementation analysis of public policy.

CBT for Youth Anxiety: How Does It Fit Within Community Mental Health?

PURPOSE OF REVIEW

We review (1) the empirical literature for cognitive behavioral therapy (CBT) for youth anxiety delivered in community settings, (2) the use of online delivery methods in this process, and (3) identified barriers and facilitators to implementation of CBT for youth anxiety in community mental health clinics (CMHCs). We provide suggestions for future work.

RECENT FINDINGS

Meta-analytic reviews of effectiveness studies suggest that outcomes comparable to those of efficacy studies can be achieved in community settings, particularly when in-session exposures occur. Several online programs support delivery of these services, with an evidence base that is promising. The notable barrier to the implementation of services is the cost of implementation and sustainability. Organizational factors such as leadership, culture, and climate are consistently identified as barriers and facilitators depending on their valence and appear to be related to implementation outcomes (e.g., on provider attitudes). The current findings need to be integrated into future studies, with a focus on further identifying facilitators (e.g., champions and online programs) of implementation. There is also the need for efforts to address organizational and individual barriers and to compare ways to reduce costs.

Implementing trauma-focused cognitive behavioral therapy in Philadelphia: A 10-year evaluation

Background: In 2012, Philadelphia's Department of Behavioral Health and Intellectual disAbility Services (DBHIDS) developed an initiative to implement an evidence-based treatment for posttraumatic stress disorder (PTSD), trauma-focused cognitive behavioral therapy (TF-CBT), across the city's behavioral health system. This report evaluates the initiative's 10-year implementation and effectiveness outcomes. Method: The Exploration, Preparation, Implementation, and Sustainment framework guided our implementation evaluation. The implementation outcomes include adoption, reach, and sustainment; these were obtained during regular evaluation data collection from publicly funded behavioral health agencies participating in the TF-CBT initiative. We analyze effectiveness outcomes (i.e., changes in PTSD symptoms) from a subset of patients receiving TF-CBT, which were collected in 6-month intervals by our research team between 2013 and 2021. Results: From 2012 to 2021, DBHIDS trained 478 clinicians in TF-CBT across 20 behavioral health agencies. During this time, 23,401 youths were screened for potentially traumatic events and PTSD symptoms, and 7,550 youths received TF-CBT. Through the TF-CBT initiative, the city expanded the network of TF-CBT providers from 3 to 20 agencies. DBHIDS sustained this network by maintaining the participation of 16 behavioral health agencies over the course of a decade. The subset of 202 youths who were evaluated to assess TF-CBT effectiveness was drawn from 94 therapists and 20 agencies across Philadelphia. All participating youths completed a baseline assessment, and 151 (75%) completed at least one follow-up assessment. Linear mixed-effects models accounting for observations nested within participants and nested within clinicians found that treatment significantly reduced PTSD symptoms. Conclusion: Between 2012 and 2021, DBHIDS successfully implemented and sustained TF-CBT across the city's behavioral health system. Adoption, reach, and sustainment of TF-CBT were high. Despite the considerable adverse experiences faced by youths seeking treatment in Philadelphia's behavioral health system, TF-CBT was effective. Future directions to improve TF-CBT implementation in the next iteration of the initiative are described.

Stakeholder engagement to inform evidence-based treatment implementation for children’s mental health: a scoping review

Background

There is a pervasive mental health treatment gap for children across the globe. Engaging stakeholders in child mental health evidence-based treatment (EBT) implementation projects may increase the likelihood of successful EBT implementation, thereby better addressing the treatment gap. However, little is known about the extent of stakeholder engagement to inform the implementation of child mental health EBTs.

Methods

We conducted a scoping review to characterize stakeholder engagement in child mental health EBT implementation projects, including what stakeholders are engaged, how they are engaged, when they are engaged, where they are engaged (i.e., location of projects), why they are engaged, and the reported impacts of stakeholder engagement. We searched seven databases: MEDLINE, PsycInfo, Embase, ERIC, CINAHL Complete, Scopus, and Web of Science Core Collection. To be included, studies had to report on some form of stakeholder engagement that was undertaken to inform or explain the implementation of a child mental health EBT. We performed data extraction and synthesis to describe key study and stakeholder characteristics, stakeholder engagement methods and rationales, reported impacts of stakeholder engagement, and quality of reporting on stakeholder engagement.

Results

In total, 122 manuscripts met our inclusion criteria, from which we identified a total of 103 unique child mental health EBT implementation projects. Projects spanned 22 countries, which included low-, lower-middle, upper-middle, and high-income countries. The largest number of projects was in the USA and conducted in public mental health settings. Most projects engaged EBT providers during the active implementation phase and with limited depth, often gathering information from stakeholders without sharing decision-making power in implementation efforts. Across projects, impacts of stakeholder engagement spanned all of Proctor and colleague’s implementation outcomes.

Conclusions

Given that stakeholder engagement is often shallow and with limited shared decision-making, additional effort should be made to increase engagement to preempt challenges to EBT implementation and ensure implementation success. Such efforts may ensure the just distribution of power in EBT implementation efforts.

Trial registration

All procedures were pre-registered on the Open Science Framework prior to conducting the literature search (DOI 10.17605/OSF.IO/GR9AP).

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00327-w.

Implementing the Strengths Model of Case Management: Assessing Practice Three Years After Initial Implementation

While strengths approaches are important to recovery-oriented practice, implementation can be challenging. This study implemented the strengths model of case management (SMCM) in 11 CM teams and assessed the fidelity of delivery and staff perceptions of the model after 36 months using the SMCM fidelity scale and the Readiness Monitoring Tool. Paired sample t-tests assessed change in fidelity from baseline to 36 months. Adjusted regression analyses compared survey responses of direct and management staff. While fidelity ratings significantly improved across all domains, at 36 months they remained suboptimal in supervision practices and use of model tools. Staff perceptions were generally positive but consistently lower for front-line than management staff. Implementing SMCM into existing case management practice with good fidelity is feasible. However, clear support from management may strengthen staff motivation and delivery. A review of practice later in implementation can flag challenges for sustainability and guide implementation support.

Spreading a Strategy to Prevent Suicide After Psychiatric Hospitalization: Results of a Quality Improvement Spread Initiative

BACKGROUND

Suicide after psychiatric hospitalization is a major concern. Poor treatment engagement may contribute to risk. The World Health Organization Brief Intervention and Contact (BIC) Program is an evidence-based practice shown to prevent suicide after psychiatric discharge in international trials. There have been no efforts to implement BIC into routine practice in US populations.

METHODS

The authors conducted a 12-month quality improvement (QI) collaborative at six US Department of Veterans Affairs (VA) medical centers serving a large rural population. Sites had low to moderate performance on a VA quality measure of mental health postdischarge care; a measure assessing the proportion of discharged patients who achieve the required number of visits ≤ 30 days. Sites received programmatic support to implement BIC locally. Implementation was assessed using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework.

RESULTS

Overall, teams had high participation in programmatic activities and enrolled 85% of eligible patients that they approached. Among 70 enrolled patients, 81.4% achieved the VA quality measure of mental health postdischarge care, suggesting good treatment engagement. On average, patients rated BIC as excellent. Team members agreed that BIC was easy to use, implementable, possible, and doable. Factors facilitating implementation included standardized operating procedures to standardize processes. Barriers included insufficient staffing and loss to follow-up. Most sites plan to continue to enroll patients and to expand BIC to other areas.

CONCLUSION

A QI collaborative can facilitate implementation of BIC in six VA facilities that provide inpatient psychiatric treatment. BIC may appeal to patients and providers and may improve treatment engagement.

Consultation and professional development within the prolonged exposure initiative

Previous studies have identified that ongoing consultation and organizational support are key factors in sustaining evidence-based implementation initiatives in community mental health. Clinician-level factors likely influence implementation but are not well delineated. This study assessed clinician-reported professional development incentives for participating in consultation in prolonged exposure (PE) therapy to guide future evidence-based practice (EBP) initiatives. Providers in the PE initiative (N = 22) completed a survey asking about their motivations to participate, the impact of consultation on the implementation of PE and their professional development goals, and the impact of organizational-level support on their goals and on organizational-level clinician turnover. Of the respondents,   10 had decided to pursue additional training to become PE consultants at their agencies. Providers (response rate = 22/35) reported joining the PE Initiative to learn an evidence-based practice in general (not PE specifically) and increase their skill in treating posttraumatic stress disorder. Providers largely found ongoing consultation helpful and reported that consultation provided the feedback and support necessary to achieve their professional goals. Providers who decided to pursue PE consultant training reported that expanding upon supervision and clinical skills were strong motivators. Providers largely attributed clinician turnover within the PE Initiative to organizational-level factors. Ongoing consultation facilitated providers' professional development goals. The survey identified several areas for further exploration, including how consultation can reduce clinician turnover, and how taking on additional responsibility within implementation initiatives can facilitate provider engagement in the EBP.

A modified video-feedback intervention for carers of foster children aged 6 years and under with reactive attachment disorder: a feasibility study and pilot RCT

BACKGROUND

Looked-after children are at risk of suboptimal attachment patterns and reactive attachment disorder. However, access to interventions varies widely and there are no evidence-based interventions for this disorder.

OBJECTIVES

(1) To adapt an existing video-feedback intervention to meet the specific needs of foster children in the UK with reactive attachment symptoms, (2) to conduct a case series to road-test the treatment manual and study procedures, (3) to conduct a scoping study of the key hurdles in a pilot trial and (4) to conduct a pilot randomised controlled trial of the adapted intervention to determine the feasibility of a future full-scale trial.

DESIGN

This was a mixed-methods study. The adapted treatment manual was developed with expert input and tested on a small case series. Qualitative interviews with key stakeholders were used in the scoping study in preparation for the trial and later with foster carers who received the new intervention. The final stage was a feasibility and pilot randomised controlled trial of the new intervention, compared with usual care. Researchers assessing the outcomes were blinded to group assignment.

SETTING

The study was set in outpatient child and adolescent mental health services and partner social services departments. Sites included urban and rural/semirural areas.

PARTICIPANTS

Participants were foster carers with children aged ≤ 6 years presenting with difficulties in the domain of reactive attachment disorder. Key stakeholders included children's services managers and mental health service practitioners in the scoping study. Foster carers who received the modified intervention participated in qualitative interviews.

INTERVENTION

The video-feedback intervention to promote positive parenting and sensitive discipline is an extensively evaluated and effective treatment approach. This intervention was modified (based on the adapted version for foster care in the Netherlands) to suit the needs of young children with reactive attachment symptoms in foster care in the UK and was delivered to improve the sensitive responding of foster carers, foster carer-child relationships and child outcomes. The modified intervention was delivered in-home by trained mental health professionals over a period of 4-6 months.

MAIN OUTCOME MEASURE

The main outcome was reactive attachment symptom scores on the Disturbances of Attachment Interview.

RESULTS

A series of minor changes to the intervention programme were introduced, which focused on improving its suitability for the UK foster care context. Challenges in recruitment meant that, despite numerous modifications to the protocol and the inclusion of additional sites, only 30 families (target, n = 40) were recruited to the randomised controlled trial (15 allocated to each group). However, most other trial parameters were deemed feasible and acceptable, particularly the high levels of data and treatment completeness. All randomised families were available for baseline analyses, but two in the treatment arm were not available for post-treatment analyses. The revised intervention was positively received by practitioners and foster carers.

LIMITATIONS

Only three-quarters of the target sample size was recruited. Furthermore, the sites' own exclusion of potential participants and the low return rates of screening questionnaires raise the possibility of non-randomness of non-responses.

CONCLUSION

A larger-scale trial may be feasible, but only if recruitment barriers can be overcome. Dedicated resources to support recruitment within local authorities and wider inclusion criteria are recommended. Central resourcing of intervention capacity to supplement NHS staff is also recommended.

TRIAL REGISTRATION

This trial is registered as ISRCTN18374094.

FUNDING

This project was funded by the National Institute for Health and Care Research ( NIHR ) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 35. See the NIHR Journals Library website for further project information.

Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-Country Analysis

BACKGROUND

Context is recognized as important to successful knowledge translation (KT) in health settings. What is meant by context, however, is poorly understood. The purpose of the current study was to elicit tacit knowledge about what is perceived to constitute context by conducting interviews with a variety of health system stakeholders internationally so as to compile a comprehensive list of contextual attributes and their features relevant to KT in healthcare.

METHODS

A descriptive qualitative study design was used. Semi-structured interviews were conducted with health system stakeholders (change agents/KT specialists and KT researchers) in four countries: Australia, Canada, the United Kingdom, and the United States. Interview transcripts were analyzed using inductive thematic content analysis in four steps: (1) selection of utterances describing context, (2) coding of features of context, (3) categorizing of features into attributes of context, (4) comparison of attributes and features by: country, KT experience, and role.

RESULTS

A total of 39 interviews were conducted. We identified 66 unique features of context, categorized into 16 attributes. One attribute, Facility Characteristics, was not represented in previously published KT frameworks. We found instances of all 16 attributes in the interviews irrespective of country, level of experience with KT, and primary role (change agent/KT specialist vs. KT researcher), revealing robustness and transferability of the attributes identified. We also identified 30 new context features (across 13 of the 16 attributes).

CONCLUSION

The findings from this study represent an important advancement in the KT field; we provide much needed conceptual clarity in context, which is essential to the development of common assessment tools to measure context to determine which context attributes and features are more or less important in different contexts for improving KT success.

References to Evidence-based Program Registry (EBPR) websites for behavioral health in U.S. state government statutes and regulations

BACKGROUND AND AIM

U.S. state governments have the responsibility to regulate and license behavioral healthcare interventions, such as for addiction and mental illness, with increasing emphasis on implementing evidence-based programs (EBPs). A serious obstacle to this is lack of clarity or agreement about what constitutes "evidence-based." The study's purpose was to determine the extent to which and in what contexts web-based Evidence-based Program Registries (EBPRs) are referenced in state government statutes and regulations ("mandates") concerning behavioral healthcare. Examples are: What Works Clearinghouse; National Register of Evidence-based Programs and Practices; Cochrane Database of Systematic Reviews.

METHODS

The study employed the Westlaw Legal Research Database to search for 30 known EBPR websites relevant to behavioral healthcare within the statutes and regulations of all 50 states.

RESULTS

There was low prevalence of EBPR references in state statutes and regulations pertaining to behavioral healthcare; 20 states had a total of 33 mandates that referenced an EBPR. These mandates usually do not rely on an EBPR as the sole acceptable source for classifying a program or practice as "evidence-based." Instead, EBPRs were named in conjunction with internal state or external sources of information about putative program effectiveness, which may be less valid than EBPRs, to determine what is "evidence-based."

CONCLUSION

Greater awareness of scientifically - based EBPRs and greater understanding of their advantages need to be fostered among state legislators and regulators charged with making policy to increase or improve the use of evidence-based programs and practices in behavioral healthcare in the U.S.

Exploring perceptions of implementation practice capacity in community-based behavioral health organizations

Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.

Mental health clinician perspectives regarding factors impacting implementation of evidence-based psychotherapies in Veterans Health Administration community-based outpatient clinics

OBJECTIVE

Uptake of Evidence-Based Psychotherapies (EBPs) by mental health (MH) clinicians, especially in community settings, remains highly variable. This formative pilot study aimed to understand the attitudes and practices of Veterans Health Administration community-based MH clinicians regarding EBPs and to identify multi-level factors that enable and hinder EBP implementation in this unique context.

METHODS

Semi-structured interviews were conducted with MH clinicians (N = 40) working in community-based outpatient clinics (CBOCs) in metro/urban (n = 20) and non-metro/rural (n = 20) locations. Interviews were guided by the Consolidated Framework for Implementation Research and were analyzed using rapid content analysis. Results were organized by system-, clinician-, patient-, and innovation-levels.

RESULTS

EBPs were consistently perceived as important to delivering quality MH care, with most clinicians having received training in at least one VHA EBP. However, limited EBP training and consultation opportunities, inadequate autonomy to schedule EBP sessions, high and complex caseloads, and feelings of isolation at CBOCs decreased EPB use. Social workers perceived disparities in EBP training access relative to psychologists. Some barriers were more salient in non-metro/rural settings (e.g., patient-level privacy concerns).

CONCLUSIONS

Increased EBP training opportunities- particularly for social workers-, greater flexibility over schedules and caseloads, and more mechanisms for consultation and professional development may increase EBP uptake in community-based clinics.

Effectiveness of Child-Focused Interventions for Externalizing Behavior: a Rapid Evidence Review

Parent behavior management training (BMT) is well established as an effective, evidence-based treatment for children with externalizing behavior. Despite the wealth of data supporting BMT, many community providers use a variety of child-focused and non-directive interventions to target behavior problems. There is lack of clarity as to whether the evidence supporting child-focused externalizing treatments is sufficiently compelling to support offering these treatments rather than or in addition to BMT. This rapid evidence review compares the effectiveness of BMT with several common child-focused interventions for externalizing behavior including cognitive behavioral (CBT), social skill (SS), and play/dynamic (PT) approaches. PubMed, PsychINFO, and Web of Science were searched for English-language articles from year 2000 onwards for each intervention type. Inclusion criteria were child age (12 and under), presence of a child-focused behavioral treatment condition, and externalizing behavior as an outcome variable. A total of 30 studies met inclusion criteria and were coded (13 CBT, 10 SS, 7 PT). Results supported social skills interventions with accompanying BMT as effective in improving externalizing problems, with generally moderate effect sizes. Individual social skills interventions were promising but needing further evaluation compared to treatment as usual. CBT treatments with and without accompanying BMT showed moderate effects over waitlist but produced less consistently significant effects compared to more robust controls. Play therapy approaches showed inconsistent effects and require further evaluation. This review supports social skills plus BMT treatments as a child-focused intervention with probable efficacy for child externalizing problems. Implications for policy and community practice are discussed.

Utilization of Evidence-based Intervention Criteria in U.S. Federal Grant Funding Announcements for Behavioral Healthcare

Recent U.S. federal government policy has required or recommended the use of evidence-based interventions (EBIs), so that it is important to determine the extent to which this priority is reflected in actual federal solicitations for intervention funding, particularly for behavioral healthcare interventions. Understanding how well such policies are incorporated in federal opportunity announcements (FOAs) for grant funding could improve compliance with policy and increase the societal use of evidence-based interventions for behavioral healthcare. FOAs for discretionary grants (n = 243) in fiscal year 2021 were obtained from the Grants.gov website for 44 federal departments, agencies and sub-agencies that were likely to fund interventions in behavioral health-related areas. FOAs for block/formula grants to states that included behavioral healthcare (n = 17) were obtained from the SAM.gov website. Across both discretionary and block grants, EBIs were required in 60% and recommended in 21% of these FOAs for funding. Numerous different terms were used to signify EBIs by the FOAs, with the greatest variation occurring among the block grants. Lack of adequate elaboration or definition of alternative EBI terms prominently characterized FOAs issued by the Department of Health and Human Services, although less so for those issued by the Departments of Justice and Education. Overall, 43% of FOAs referenced evidence-based program registers on the web, which are scientifically credible sources of EBIs. Otherwise, most of the remaining elaborations of EBI terms in these FOAs were quite brief, often idiosyncratic, and not scientifically vetted. The FOAs generally adhered to federal policy requiring or encouraging the use of EBIs for funding requests. However, an overall pattern showing lack or inadequate elaboration of terms signifying EBIs makes it difficult for applicants to comply with federal policies regarding use of EBIs for behavioral healthcare.

Stakeholder intention to engage in fidelity measurement methods in community mental health settings: A mixed methods study

Background

The current gold standard for measuring fidelity (specifically, adherence) to cognitive behavioral therapy (CBT) is direct observation, a costly, resource-intensive practice that is not feasible for many community organizations to implement regularly. Recent research indicates that behavioral rehearsal (i.e., role-play between clinician and individual with regard to session delivery) and chart-stimulated recall (i.e., brief structured interview between clinician and individual about what they did in session; clinicians use the client chart to prompt memory) may provide accurate and affordable alternatives for measuring adherence to CBT in such settings, with behavioral rehearsal yielding greater correspondence with direct observation.

Methods

Drawing on established causal theories from social psychology and leading implementation science frameworks, this study evaluates stakeholders’ intention to use behavioral rehearsal and chart-stimulated recall. Specifically, we measured attitudes, self-efficacy, and subjective norms toward using each, and compared these factors across the two methods. We also examined the relationship between attitudes, self-efficacy, subjective norms, and intention to use each method. Finally, using an integrated approach we asked stakeholders to discuss their perception of contextual factors that may influence beliefs about using each method. These data were collected from community-based supervisors ( n = 17) and clinicians ( n = 66).

Results

Quantitative analyses suggest moderately strong intention to use both methods across stakeholders. There were no differences in supervisors’ or clinicians’ attitudes, self-efficacy, subjective norms, or intention across methods. More positive attitudes and greater reported subjective norms were associated with greater reported intention to use either measure. Qualitative analyses identified participants’ specific beliefs about using each fidelity measure in their organization, and results were organized using the Consolidated Framework for Implementation Research.

Conclusions

Strategies are warranted to overcome or minimize potential barriers to using fidelity measurement methods and to further increase the strength of intention to use them. Plain Language Summary: The best way to measure fidelity, or how closely a clinician follows the protocol, to Cognitive Behavioral Therapy (CBT) is watching the session. This is an expensive practice that is not feasible for many community organizations to do regularly. Recent research indicates that behavioral rehearsal, or a role-play between the clinician and individual with regard to session delivery, and chart-stimulated recall, or a brief discussion between an individual and the clinician about what they did in session with the clinician having access to the chart to help them remember, may provide accurate and affordable alternatives for measuring fidelity to CBT. We just completed a study demonstrating that both methods are promising, with behavioral rehearsal offering scores that are the most similar to watching the session. Drawing on established theories from social psychology and leading implementation science frameworks, this study evaluates future supervisor and clinician motivation to use these fidelity measurement methods. Specifically, we measured supervisor (n = 17) and clinician (n = 66) attitudes, norms, self-efficacy, intentions, and anticipated barriers and facilitators to using each of these fidelity measurement tools. Quantitative and qualitative analyses suggest similar intention to use both methods, and concerns about barriers to using each method. Further research is warranted to minimize the burden associated with implementing fidelity measurement methods and deploying strategies to increase use.

Lessons From Maslow: Prioritizing Funding to Improve the Quality of Community Mental Health and Substance Use Services

Evidence-based practices (EBPs) are frequently proposed as an approach to close the quality chasm in behavioral health treatment, and many U.S. municipalities are investing in EBPs as a primary way to improve the quality of care delivered to individuals most in need. In this Open Forum, the authors argue that EBPs often cannot be successfully implemented because basic organizational needs are not met in the current fiscal environment. The authors summarize research that supports why EBPs, along with other approaches to improve quality, are likely to fail until there is adequate financing. They also propose a policy and research agenda to ameliorate and address the fiscal challenges inherent in community mental health and substance use services.

The Organizational Financial Context of Publicly-Funded Mental Health Clinics: Development and Preliminary Psychometric Evaluation of the Agency Financial Status Scales

Funding is a major barrier to implementation of evidence-based practices (EBPs) in publicly-funded community mental health clinics (CMHCs). Understanding how best to deploy implementation strategies that address this barrier requires greater clarity on the financial context within agencies. We developed the Agency Financial Status Scales (AFSS) to assess employee perceptions of the level of three hypothesized and theoretical funding related constructs in organizations: (a) perceptions of financial health, (b) financial attitudes toward EBPs, and (c) strategic financial climate. This investigation serves as a preliminary evaluation of this measure. Participants were 239 therapists and 40 supervisors from 25 publicly-funded CMHCs providing outpatient mental health services for young people. Confirmatory factor analysis was used to investigate the latent trait structure of the items. Internal consistency, interrater agreement, concordance between therapists and supervisors, and convergent validity were also examined. A two-factor model measuring perceptions of financial health and strategic financial climate best fit the data. For both of these scales, alpha reliability was acceptable and agreement statistics provided moderate support for aggregation at the organizational level. Analyses supported the convergent validity of the scales. The development and preliminary evaluation of the AFSS is an important first step in understanding the financial context of publicly-funded CMHCs. Though findings from this investigation are promising, additional development and testing are needed to develop a more thorough understanding of the constructs and to improve the validity and reliability of this measure.

Justice community opioid innovation network (JCOIN): The TCU research hub

Recognizing the current opioid crisis among justice-involved individuals and the need to intervene at the intersection of justice and community health, the JCOIN TCU hub study explores outcomes associated with a multi-level hybrid implementation approach. The study capitalizes on facilitated collaboration, training, and cross-system data sharing to leverage improvements in criminal justice (CJ) and community behavioral health (CBH) interagency collaboration. The goal is to improve local community public health and safety outcomes for reentering justice-involved individuals who have a history of (or are at risk for) using opioids. The study compares two implementation strategies: one (vertical) in which all units in a community are trained and begin the program simultaneously and another (horizontal) in which one lead-off unit in the community is trained as a prototype of the program, the prototype is tested and refined, and then the lead-off unit helps to train other units within the community. Specific aims are to 1) increase access to and retention in CBH and medications for opioid use disorder services; 2) improve outcomes associated with public health and safety; 3) compare two implementation strategies on systems-level outcomes designed to increase service initiation and receipt of implementation and services; and 4) examine the impact of these strategies on justice-involved individuals' outcomes. The study examines both implementation and implementation-effectiveness, seeking to answer the questions of which implementation strategy is most effective for rapid and sustainable uptake of evidence-based practices and for increasing service linkage and initiation, services retention, and improved opioid-related public health safety outcomes. The study uses a hybrid type 3 study design. The study's primary aim is to compare two implementation strategies and two interventions at two levels (client and system), with a secondary aim to assess client-level outcomes associated with the trial. The study design integrates 2 robust methodologies (stepped wedge and cluster randomized trial), and plans to include 18 research performance sites (communities) located in Texas, New Mexico, and Illinois. The study will contribute to the JCOIN network's effort to establish a national consortium of investigators examining promising strategies to enhance the capabilities and capacity of the justice system to more effectively address the opioid epidemic.

Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children's mental health services

BACKGROUND

Although there is increasing investment to implement evidence-based practices (EBPs) in public systems across the USA, continued or sustained use of EBPs after initial implementation remains a challenge. The low integration of EBPs in routine practice severely limits their public health impact, highlighting the need to understand factors that affect the return on costly investments in EBP implementation. This study aims to (1) characterize trajectories of EBP delivery volume through a reimbursement-driven implementation and (2) examine impacts of system-level policy regulatory activity and state-level mental health services funding on the implementation reimbursement strategy.

METHODS

This study involved secondary data analyses. Psychotherapy administrative claims and regulatory site visit data from the Los Angeles County Department of Mental Health and California state mental health expenditures were extracted from 2010 to 2017. Multilevel regression examined EBP claims volume over time with state expenditures and regulatory compliance as predictors.

RESULTS

EBP claims volume trajectories demonstrated a rapid initial increase, followed by a period of decrease, and a small increase in the final year. State mental health expenditures increased across time reflecting increased funding availability. State mental health expenditures and system regulatory compliance were inversely related to EBP claims volume.

CONCLUSIONS

The impact of reimbursement-driven EBP implementation strategy is sensitive to multiple outer-context determinants. At the system level, commitment to fidelity of implementation regulations resulted in reduced use of the reimbursement strategy. Alternative reimbursement streams not tied to EBPs coupled with an expanded array of reimbursable services also impacted the use of the reimbursement strategy to implement EBPs.

Applying the Exploration, Preparation, Implementation, Sustainment (EPIS) Framework to Safe Surgery 2020 Implementation in Tanzania's Lake Zone

BACKGROUND

Access to safe, high-quality surgical care in sub-Saharan Africa is a critical gap. Interventions to improve surgical quality have been developed, but research on their implementation is still at a nascent stage. We retrospectively applied the Exploration, Preparation, Implementation, Sustainment framework to characterize the implementation of Safe Surgery 2020, a multicomponent intervention to improve surgical quality.

METHODS

We used a longitudinal, qualitative research design to examine Safe Surgery 2020 in 10 health facilities in Tanzania's Lake Zone. We used documentation analysis with confirmatory key informant interviews (n = 6) to describe the exploration and preparation phases. We conducted interviews with health facility leaders and surgical team members at 1, 6, and 12 months (n = 101) post initiation to characterize the implementation phase. Data were analyzed using the constant comparison method.

RESULTS

In the exploration phase, research, expert consultation, and scoping activities revealed the need for a multicomponent intervention to improve surgical quality. In the preparation phase, onsite visits identified priorities and barriers to implementation to adapt the intervention components and curriculum. In the active implementation phase, 4 themes related to the inner organizational context-vision for safe surgery, existing surgical practices, leadership support, and resilience-and 3 themes related to the intervention-innovation-value fit, holistic approach, and buy-in-facilitated or hindered implementation. Interviewees perceived improvements in teamwork and communication and intra- and inter-facility learning, and their need to deliver safe surgery evolved during the implementation period.

CONCLUSIONS

Examining implementation through the exploration, preparation, implementation, and sustainment phases offers insights into the implementation of interventions to improve surgical quality and promote sustainability.

State behavioral health agency website references to evidence-based program registers

PURPOSE

Evidence-based program registers (EBPRs) are important tools for facilitating the use of evidence-based practices or programs (EBPs) by state statutory agencies responsible for behavioral healthcare, broadly defined as substance misuse, mental health, HIV/AIDS prevention, child welfare, and offender rehabilitation. There are currently no data on the purposes for which such state agencies reference EBPRs on their official websites.

METHOD

A webscraping method was used to identify and classify relevant "hits", defined as a state behavioral health webpage with single or multiple references to a study EBPR. A total of 778 hits (unique combinations of webpage and register) were coded. Up to three codes were applied to each hit for the "reasons for the EBPR reference" (EBPR use) dimension, one code was applied to each hit for the "purpose of the EBPR reference" and "intended audience of the webpage containing the hit" dimensions, and up to two codes were applied to each hit for the "funding mentions" dimension.

RESULTS

Three EBPRs out of 28 accounted for 73.6% of the hits. The most frequent reason for referencing EBPRs were as a resource for selecting EBPs or validating existing programs and practices. The references tended to appear in reports from the state, in training materials, or guidelines. The references tended to address broad groups of behavioral healthcare professionals. EBPRs were frequently referenced in the context of federal block grants or other federal funding.

CONCLUSIONS

Increasing state agencies' awareness and use of the entire range of existing EBPRs may improve implementation of EBPs nationally.

Application of Evidence-Based Treatment in Community Mental Health Settings: Examining EBT Delivery Duration and Client Discharge

Characterizing community mental health (CMH) treatment duration and discharge is an important step toward understanding how to better meet client needs. This report describes patterns of treatment duration and discharge among clinicians participating in a state-funded evidence-based treatment (EBT) training initiative. After training and consultation, clinicians (N = 376) reported on treatment duration and discharge for their "most complete case." On average, clinicians delivered 12.4 sessions (SD = 5.1) of the treatment. After completing treatment, half of clinicians (58.7%) continued with regularly scheduled therapy, either using EBT elements or switching to supportive therapy. Clinicians who continued with regularly scheduled therapy delivered treatment in approximately the same number of sessions. Results revealed that CMH clinicians often do not discontinue therapy after completing a treatment protocol. These findings suggest it may be essential to better understand clinician decision-making around applying EBTs to their caseloads.

Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis

BACKGROUND

The fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts.

METHODS

We developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature.

RESULTS

A total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components.

CONCLUSIONS

This framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.

Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis

BACKGROUND

The fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts.

METHODS

We developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature.

RESULTS

A total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components.

CONCLUSIONS

This framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.

Improving Management of Infantile Spasms by Adopting Implementation Science

Over the last several decades, significant progress has been made in the discovery of appropriate therapy in the management of infantile spasms (IS). Based on several well-controlled studies, the American Academy of Neurology and the Child Neurology Society have published the current best practice parameters for the treatment of IS. However, dissemination and implementation of evidence-based guidelines remain a significant challenge. Though the number of well-performed controlled trials and systematic reviews is increasing exponentially, the proportion of valuable new information subsequently embedding into the routine clinical care is significantly lower. Planned and systematic implementation of evidence-based interventions in a given health care structure may outstrip the benefits of discovering a new insight, procedure, or drug in another controlled setting. Implementation problems can be broad-ranging to hinder effective, efficient, safe, timely, and patient-centered care without significant variation. The first part of this review article provides a detailed summary of some crucial comparative treatment studies of IS available in the literature. In the second part, practical challenges to mitigate the gap between knowledge and practice to improve outcomes in the management of IS has been explored, and a consolidated framework approach for systematic implementation research methodology has been discussed to implement evidence-based guidelines for the management of IS. Although large multicenter controlled studies will help gather quality evidence in the treatment of IS, a more comprehensive range of scientific methodologies, including qualitative research and mixed research methodologies, will hold the more considerable promise for implementing evidence-based practices in the health care system.

Implementing a transdiagnostic sleep and circadian intervention in a community mental health setting: A qualitative process evaluation with community stakeholders

The implementation of evidence-based psychological treatments (EBPTs) may be particularly challenging to accomplish in community mental health settings for individuals with severe mental illness (SMI). Transdiagnostic treatments, or treatments that target a mechanism that underpins multiple mental health problems, may be particularly well-suited to community mental health settings. This study examines community stakeholder perspectives (N = 22) of the Transdiagnostic Sleep and Circadian Intervention (TranS-C) implemented in a community mental health setting in the context of a randomized controlled trial of TranS-C for SMI. The present study aimed to identify barriers and facilitators to the implementation of TranS-C for SMI in a community mental health setting using (1) a deductive theory-based process based on the Framework for Dissemination in Health Services Intervention Research and (2) an inductive thematic analysis process. All deductive themes were identified as both barriers and facilitators to the implementation of EBPTs and TranS-C in this community mental health setting. Seven additional themes were identified through the inductive thematic analysis. A discussion of how the findings are related to prior research, other EBPT implementation, and future TranS-C implementation are included.

Importance of congruence between communicating and executing implementation programmes: a qualitative study of focus group interviews

Background

The Ostrobothnia Depression Programme (ODP) in Finland was intended to implement two evidence-based brief psychotherapy interventions, namely motivational interview and behavioural activation, in several regional psychiatric teams. A simultaneous effectiveness study was conducted. Considerable tension was encountered between these two arms, causing resistance to change. We conducted a qualitative case study to better understand this tension and to discuss how managerial and executive practices may ensure the successful running of a hybrid design programme.

Methods

We conducted focus group interviews to evaluate the phases of preparation and practical execution of the ODP from the perspectives of management and the programme executives. To gather the data, we applied the revised Socratic approach for health technology assessment and focus group interviews. We analysed the data deductively according to the Normalization Process Theory.

Results

We identified two main critical issues: (1) The ODP programme plan ignored the team leaders’ crucial role in influencing the implementation climate and mobilizing organizational strategies. The ODP had a simplistic top-down design with minimal and delayed collaboration with its target groups in the preparation phase. (2) Incongruence occurred between what the project group had explicitly communicated about being the spearhead of the ODP and what they then actually enacted. These two issues caused tension between the implementation efforts and the effectiveness study as well as resistance to change among the staff.

Conclusion

Early, open collaboration with all prospective stakeholders towards a shared understanding about the programme is the first action the programme administrators should take. Agreement on goals and the means to achieve them would lower tension between the two arms of a hybrid design programme, thereby reducing resistance to change. Congruence between the goals communicated and the actual managerial and executive actions is of paramount importance in getting the programme recipients on board.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-020-00090-w.

Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review

A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.

Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes

A lack of effective therapist training is a major barrier to evidence-based intervention (EBI) delivery in the community. Systematic reviews published nearly a decade ago suggested that traditional EBI training leads to higher knowledge but not more EBI use, indicating that more work is needed to optimize EBI training and implementation. This systematic review synthesizes the training literature published since 2010 to evaluate how different training models (workshop, workshop with consultation, online training, train-the-trainer, and intensive training) affect therapists' knowledge, beliefs, and behaviors. Results and limitations for each approach are discussed. Findings show that training has advanced beyond provision of manuals and brief workshops; more intensive training models show promise for changing therapist behavior. However, methodological issues persist, limiting conclusions and pointing to important areas for future research.

Implementing Evidence-Based Treatments for Youth in Acute and Intensive Treatment Settings

Evidence-based treatments (EBTs) have been well studied in outpatient and research settings to address a myriad of mental health concerns. Research studies have found benefits and challenges when implementing these interventions. However, less is known about the implementation of EBTs in acute and intensive treatment settings such as inpatient psychiatric hospitalization (IPH) units, partial hospitalization programs (PHPs), or intensive outpatient programs (IOPs). As a result, the specific benefits and challenges of providing EBTs in these settings are less clear. For example, challenges of implementing EBTs in IPHs, PHPs, and IOPs can include working within a multi-disciplinary team setting and sustaining trained staff. The current article provides an overview of implementing EBTs in IPHs PHPs, and IOPs. Current PHP, IOP, and IPH models of implementing evidence-based interventions along with strategies for engaging stakeholders, program development and implementation, and measurement are reviewed. Further considerations for sustainability and practice consideration are also provided.

The Potential of Pay-for-Success as a Financing Strategy for Evidence-Based Practices: An Illustration with Multisystemic Therapy

There is a critical need to identify strategies for financing the implementation of evidence-based practices. We illustrate the potential of pay-for-success financing (PFS)-a strategy in which private investors fund implementation and receive a return on investment from a government payer-using multisystemic therapy as an example. We argue that standard multisystemic therapy (for serious juvenile offenders) and several of its adaptations (for other complex behavioral problems in youth) would be good candidates for PFS in the right contexts. Despite some challenges for policymakers and administrators, PFS has significant potential as a financing strategy for evidence-based practices.

A Mixed-Method Analysis on the Impacts of a System-Driven Implementation of Multiple Child Evidence-Based Practices on Community Mental Health Providers

Initiatives to scale up evidence-based practices (EBPs) in routine care are likely to have myriad impacts on community providers, but these impacts have not yet been examined in depth. This is especially true within the context of simultaneous implementation of multiple evidence-based practices. The aim of this study was to characterize the multifaceted impacts on community mental health therapists within a system-driven implementation of multiple EBPs for youth and families. Semistructured interview and survey data were gathered from 60 therapists at 11 agencies contracted with the Los Angeles County Department of Mental Health to deliver EBPs within the Prevention and Early Intervention initiative. Therapists' accounts of impacts varied, and were either predominately negative, predominantly positive, or mixed-valence. Mixed-methods analyses using Kruskal-Wallis tests showed therapist valence groups varied on mean levels of self-reported burnout on surveys. Themes from qualitative data revealed several favorable (e.g., increased EBP knowledge, structure) and unfavorable (e.g., distress, feeling constrained by EBPs) impacts of county-contracted EBP implementation. These findings inform the development and implementation of future system-driven EBP initiatives that consider therapist perspective to optimize positive impacts and minimize negative impacts on therapists.

Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: a prospective study across multiple U.S. public sector service systems

BACKGROUND

Bridging factors are relational ties (e.g. partnerships), formal arrangements (e.g. contracts or polices) and processes (e.g. data sharing agreements) linking outer and inner contexts and are a recent evolution of the Exploration-Preparation-Implementation-Sustainment (EPIS) framework. Bridging factor research can elucidate ways that service systems may influence and/or be influenced by organizations providing health services. This study used the EPIS framework and open systems and resource dependence theoretical approaches to examine contracting arrangements in U.S. public sector systems. Contracting arrangements function as bridging factors through which systems communicate, interact, and exchange resources with the organizations operating within them.

METHODS

The sample included 17 community-based organizations in eight service systems. Longitudinal data is derived from 113 contract documents and 88 qualitative interviews and focus groups involving system and organizational stakeholders. Analyses consisted of a document review using content analysis and focused coding of transcripts from the interviews and focus groups. A multiple case study analysis was conducted to identify patterns across service systems and organizations. The dataset represented service systems that had sustained the same EBP for between 2 and 10 years, which allowed for observation of bridging factors and outer-inner context interactions over time.

RESULTS

Service systems and organizations influenced each other in a number of ways through contracting arrangements. Service systems influenced organizations when contracting arrangements resulted in changes to organizational functioning, required organizational responses to insufficient funding, and altered interorganizational network relationships. Organizations influenced service systems when contract arrangements prompted organization-driven contract negotiation/tailoring, changes to system-level processes, and interorganizational collaboration. Service systems and organizations were dependent on each other as implementation progressed. Resources beyond funding emerged, including adequate numbers of eligible clients, expertise in the evidence-based practice, and training and coaching capacity.

CONCLUSION

This study advances implementation science by expanding the range and definition of bridging factors and illustrating specific bi-directional influences between outer context service systems and inner context organizations. This study also identifies bi-directional dependencies over the course of implementation and sustainment. An analysis of influence, dependencies, and resources exchanged through bridging factors has direct implications for selecting and tailoring implementation strategies, especially those that require system-level coordination and change.

Applying NUDGE to Inform Design of EBP Implementation Strategies in Community Mental Health Settings

We demonstrate the application of NUDGE (Narrow, Understand, Discover, Generate, Evaluate), a behavioral economics approach to systematically identifying behavioral barriers that impede behavior enactment, to the challenge of evidence-based practice (EBP) use in community behavioral health. Drawing on 65 clinician responses to a system-wide crowdsourcing challenge about EBP underutilization, we applied NUDGE to discover, synthesize and validate specific behavioral barriers to EBP utilization that directly inform the design of tailored implementation strategies. To our knowledge, this is the first study to apply behavioral economic insights to clinician-proposed solutions to implementation challenges in order to design implementation strategies. The study demonstrates the successful application of NUDGE to implementation strategy design and provides novel targets for intervention.

Evaluating the national multisite implementation of dialectical behaviour therapy in a community setting: a mixed methods approach

BACKGROUND

The implementation of evidence-based interventions for borderline personality disorder in community settings is important given that individuals with this diagnosis are often extensive users of both inpatient and outpatient mental health services. Although work in this area is limited, previous studies have identified facilitators and barriers to successful DBT implementation. This study seeks to expand on previous work by evaluating a coordinated implementation of DBT in community settings at a national level. The Consolidated Framework for Implementation Research (CFIR) (Damschroder et al., Implementation Sci. 4:50, 2009) provided structural guidance for this national level coordinated implementation.

METHODS

A mixed methods approach was utilised to explore the national multisite implementation of DBT from the perspective of team leaders and therapists who participated in the coordinated training and subsequent implementation of DBT. Qualitative interviews with DBT team leaders (n = 8) explored their experiences of implementing DBT in their local service and was analysed using content analysis. Quantitative surveys from DBT therapists (n = 74) examined their experience of multiple aspects of the implementation process including orienting the system, and preparations and support for implementation. Frequencies of responses were calculated. Written qualitative feedback was analysed using content analysis.

RESULTS

Five themes were identified from the interview data: team formation, implementation preparation, client selection, service level challenges and team leader role. Participants identified team size and support for the team leader as key points for consideration in DBT implementation. Key challenges encountered were the lack of system support to facilitate phone coaching and a lack of allocated time to focus on DBT. Implementation facilitators included having dedicated team members and support from management.

CONCLUSIONS

The barriers and facilitators identified in this study are broadly similar to those reported in previous research. Barriers and facilitators were identified across several domains of the CFIR and are consistent with a recently published DBT implementation Framework (Toms et al., Borderline Personal Disord Emot Dysregul. 6: 2, 2019). Future research should pay particular attention to the domain of characteristics of individuals involved in DBT implementation. The results highlight the importance of a mandated service plan for the coordinated implementation of an evidence-based treatment in a public health service.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT03180541; Registered June 7th 2017 'retrospectively registered'.

Implementing Evidence Based Practices for Children's Mental Health: A Case Study in Implementing Modular Treatments in Community Mental Health

There is strong enthusiasm for utilizing implementation science in the implementation of evidence-based programs in children's community mental health, but there remains work to be done to improve the process. Despite the proliferation of implementation frameworks, there is limited literature providing case examples of overcoming implementation barriers. This article examines whether the use of three implementations strategies, a structured training and coaching program, the use of professional development portfolios for coaching, and a progress monitoring data system, help to overcome barriers to implementation by facilitating four implementation drivers at a community mental health agency. Results suggest that implementation is a process of recognizing and adapting to both predictable and unpredictable barriers. Furthermore, the use of these implementation strategies is important in improving implementation outcomes.

What Motivates Mental Health Clinicians-in-Training to Implement Evidence-Based Assessment? A Survey of Social Work Trainees

Mental health clinicians do not consistently use evidence-based assessment (EBA), a critical component of accurate case conceptualization and treatment planning. The present study used the Unified Theory of Behavior to examine determinants of intentions to use EBA in clinical practice among a sample of Masters' level social work trainees (N = 241). Social norms had the largest effect on intentions to use EBA. Injunctive norms in reference to respected colleagues accounted for the most variance in EBA intentions. Findings differed for respondents over 29 years of age versus younger respondents. Implications for implementation strategies and further research are discussed.

Adaption and pilot implementation of an autism executive functioning intervention in children's mental health services: a mixed-methods study protocol

BACKGROUND

Youth with autism spectrum disorder (ASD) represent a growing population with significant service needs. Prominent among these needs are high rates of co-occurring psychiatric conditions that contribute to increased functional impairments and often necessitate mental health services. Executive functioning deficits are associated with ASD as well as common co-occurring conditions (e.g., attention-deficit/hyperactivity disorder) and an evidence-based intervention has been developed and tested to address executive functioning within the school context. There is an urgent need to implement indicated evidence-based interventions for youth with ASD receiving care in community mental health settings. Interventions that optimally "fit" the mental health services context as well as the complex and co-occurring mental health needs of these youth have the potential to improve key clinical outcomes for this high priority population.

METHODS

This mixed-methods developmental study will apply the Exploration, Preparation, Implementation, Sustainment implementation framework and a community-academic partnership approach to systematically adapt and test an evidence-based executive functioning intervention for youth with ASD for delivery in community mental health settings. Specific aims are to (1) conduct a need and context assessment to inform the systematic adaptation an executive functioning evidence-based intervention; (2) systematically adapt the clinical intervention and develop a corresponding implementation plan, together entitled "Executive Functioning for Enhancing Community-based Treatment for ASD," (EFFECT for ASD); and (3) conduct a feasibility pilot test of EFFECT for ASD in community mental health settings.

DISCUSSION

Tailoring evidence-based interventions for delivery in community-based mental health services for youth with ASD has the potential to increase quality of care and improve child outcomes. Results from the current study will serve as the foundation for large-scale hybrid implementation and effectiveness trials and a generalizable approach for different service systems of care and clinical populations.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT04295512.

Pragmatic adaptation of implementation research measures for a novel context and multiple professional roles: a factor analysis study

BACKGROUND

Although some advances have been made in recent years, the lack of measures remains a major challenge in the field of implementation research. This results in frequent adaptation of implementation measures for different contexts-including different types of respondents or professional roles-than those for which they were originally developed and validated. The psychometric properties of these adapted measures are often not rigorously evaluated or reported. In this study, we examined the internal consistency, factor structure, and structural invariance of four well-validated measures of inner setting factors across four groups of respondents. The items in these measures were adapted as part of an evaluation of a large-scale organizational change in a rehabilitation hospital, which involved transitioning to a new building and a new model of patient care, facilitated by a significant redesign of patient care and research spaces.

METHODS

Items were tailored for the context and perspective of different respondent groups and shortened for pragmatism. Confirmatory factor analysis was then used to test study hypotheses related to fit, internal consistency, and invariance across groups.

RESULTS

The survey was administered to approximately 1208 employees; 785 responded (65% response rate) across the roles of clinician, researcher, leader, support staff, or dual clinician and researcher. For each of the four scales, confirmatory factor analysis demonstrated adequate fit that largely replicated the original measure. However, a few items loaded poorly and were removed from the final models. Internal consistencies of the final scales were acceptable. For scales that were administered to multiple professional roles, factor structures were not statistically different across groups, indicating structural invariance.

CONCLUSIONS

The four inner setting measures were robust for use in this new context and across the multiple stakeholder groups surveyed. Shortening these measures did not significantly impair their measurement properties; however, as this study was cross sectional, future studies are required to evaluate the predictive validity and test-retest reliability of these measures. The successful use of adapted measures across contexts, across and between respondent groups, and with fewer items is encouraging, given the current emphasis on designing pragmatic implementation measures.

Factors Associated with Community-Partnered School Behavioral Health Clinicians' Adoption and Implementation of Evidence-Based Practices

Community-partnered school behavioral health (CP-SBH) is a model whereby schools partner with local community agencies to deliver services. This mixed-methods study examined 80 CP-SBH clinicians' adoption and implementation of evidence-based practice (EBP) approaches following mandated training. Forty-four clinicians were randomly assigned to one of two training conditions for a modular common elements approach to EBPs; 36 clinicians were preselected for training in a non-modular EBP. EBP knowledge improved for all training conditions at 8-month follow-up and practice element familiarity improved for modular approach training conditions, but the modular condition including ongoing consultation did not yield better results. Qualitative interviews (N = 17) highlighted multi-level influences of the CP-SBH service system and individual clinician characteristics on adoption and implementation.