The ARC organizational and community intervention strategy for implementing evidence-based children's mental health treatments

Managers' Micro-Communities Matter: The Impact of Clinical Supervision Team on Therapist Perception of the Organization

Positive organizational climate - employee perceptions of their work environment and the impact of this environment on well-being and functioning - is associated with desirable organizational and client-level outcomes in mental health organizations. Clinical supervisors are well-positioned to impact organizational climate, as they serve as intermediaries between higher-level administrators who drive the policies and procedures and the therapists impacted by such decisions. This cross-sectional study examined the role of clinical supervisors as drivers of therapist perceptions of organizational climate within supervisory teams. Specifically, the present study investigated: (1) shared perceptions of organizational climate among therapists on the same supervisory team; (2) predictors of therapist climate perceptions. Eighty-six therapists were supervised by 22 supervisors. Indices of interrater agreement and interrater reliability of therapists on the same supervisory team were examined to determine shared or distinct perceptions of organizational climate. Multi-level models were used to examine whether supervisor attitudes towards evidence-based practices and therapist perceptions of supervisor communication predicted perceived organizational climate. Results showed perceptions of organizational cohesion and autonomy were shared among therapists on the same supervisory team and distinct from therapists on different supervisory teams. Therapist perceptions of their supervisor's communication was positively associated with perceptions of organizational cohesion and autonomy. These findings align with emerging evidence that middle managers shape their employees' experience of their work environment through communication strategies. These findings also point to the potential for intervening at lower organizational levels to improve overall organizational climate.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

A scoping review of implementation science theories, models, and frameworks - an appraisal of purpose, characteristics, usability, applicability, and testability

BACKGROUND

A proliferation of theories, models, and frameworks (TMFs) have been developed in the implementation science field to facilitate the implementation process. The basic features of these TMFs have been identified by several reviews. However, systematic appraisals on the quality of these TMFs are inadequate. To fill this gap, this study aimed to assess the usability, applicability, and testability of the current TMFs in a structured way.

METHODS

A scoping review method was employed. Electronic databases were searched to locate English and Chinese articles published between January 2000 and April 2022. Search terms were specific to implementation science. Additionally, hand searches were administered to identify articles from related reviews. Purpose and characteristics such as the type of TMF, analytical level, and observation unit were extracted. Structured appraisal criteria were adapted from Birken et al.'s Theory Comparison and Selection Tool (T-CaST) to conduct an in-depth analysis of the TMFs' usability, applicability, and testability.

RESULTS

A total of 143 TMFs were included in this analysis. Among them, the most common purpose was to identify barriers and facilitators. Most TMFs applied the descriptive method to summarize the included constructs or the prescriptive method to propose courses of implementation actions. TMFs were mainly mid-range theories built on existing conceptual frameworks or demonstrated grand theories. The usability of the TMFs needs to be improved in terms of the provision of conceptually matched strategies to barriers and facilitators and instructions on the TMFs usage. Regarding the applicability, little attention was paid to the constructs of macro-level context, stages of scale-up and sustainability, and implementation outcomes like feasibility, cost, and penetration. Also, fewer TMFs could propose recommended research and measurement methods to apply the TMFs. Lastly, explicit hypotheses or propositions were lacking in most of the TMFs, and empirical evidence was lacking to support the claimed mechanisms between framework elements in testability.

CONCLUSIONS

Common limitations were found in the usability, application, and testability of the current TMFs. The findings of this review could provide insights for developers of TMFs for future theoretical advancements.

Toward Meaningful Cultural Adaptation Across Implementation Stages: Lessons Learned From a Culturally Based HIV Stigma Intervention in Gaborone, Botswana

A culturally based stigma intervention for pregnant women living with HIV in Gaborone, Botswana highlights the importance of conceptualizing and formalizing cultural adaptation across all stages of implementation.

Evaluation of a Trauma-Informed Parenting Program for Resource Parents

Child maltreatment impacts many young people involved in the child welfare system, and it is important that the resource parents supporting these youth have knowledge and skills in trauma-informed care. The current study is a preliminary evaluation of the Resource Parent Curriculum (RPC), an in-service, 8-module, group-based parenting program developed by the National Child Traumatic Stress Network. Youth and caregiver outcomes were examined by way of a quasi-experimental design that included 22 resource parents in the experimental group and 21 in the waitlist control group and involved baseline, post-program, and 2-month follow-up assessments. For learning outcomes, RPC resulted in improvements in resource parents' knowledge and beliefs about trauma-informed parenting. While not statistically significant, potential effects included improvements in resource parents' tolerance of challenging youth behaviors and parenting self-efficacy. For behavioral outcomes, several non-significant potential effects were noted, including improvements in resource parents' attachment relationships with their youth and increased social supports. This study was the first to evaluate RPC using a quasi-experimental design within a Canadian context and through a virtual delivery. Findings highlighted several benefits of the program and resource parents' ongoing training needs.

Attitudes Towards Evidence-Based Practice of Professionals Working with Children and Adolescents with Autism Spectrum Disorder in Bangladesh

Like in many lower-middle-income countries (LMIC), progress in implementing evidence-based practices (EBPs) for children with autism spectrum disorder (ASD) has been slow in Bangladesh. This cross-sectional study examined professionals' attitudes towards evidence-based practice (EBP) for children and adolescents with ASD and explored how providers' demographic factors are related to attitudes to and adoption of EBPs in Bangladesh. The sample consisted of 150 mental health professionals and special teachers from the urban area of Dhaka. Attitudes were assessed by the Evidence-based Practice Attitude Scale-36. Findings indicated that professionals have favorable attitudes towards EBP. Their attitudes varied depending on service settings (public clinical, private clinical, and special school) and caseload per year. Professionals who work in private and special school settings claimed to be more willing to adopt an EBP when required and perceived a higher fit of EBPs and their work than those in public clinical settings. The number of different EBPs used also differed by service setting. Every type of intervention (except medication) was used by more professionals in special schools than in private and public clinical settings. Many professionals reported few barriers to the implementation of EBPs. These findings indicate conditions that are often conducive to the implementation of EBPs. However, these results do not reflect the situation in rural areas, in which poverty is more widespread and the number of specialized professionals is low.

Relationship between clinician-level attributes and implementation outcomes from the Pathways to Comorbidity Care training program

BACKGROUND

The process of determining the best strategy for increasing the uptake of evidence-based practice might be improved through an understanding of relevant clinician-level factors. The Pathways to Comorbidity Care (PCC) training program (Louie E, et al., J Dual Diagnosis 17:304-12, 2021) aimed to facilitate integrated management of comorbid drug and alcohol and mental disorders amongst drug and alcohol clinicians. We hypothesised that uptake of integrated management of comorbidity following the implementation of the PCC program would be associated with clinician-level: (i) demographics (gender, education, experience), (ii) attitudes (evidence-based practice, therapist manuals, counselling self-efficacy), and (iii) organisational readiness to change.

METHODS

Twenty clinicians participated in the 9-month PCC training program. Attitudes towards evidence-based practices and psychotherapist manuals, self-efficacy, and organisational readiness to change, along with demographics, were measured at baseline. At follow-up, change in Comorbidity Practice (CoP) scores related to integrated comorbidity management were obtained using a file audit checklist and categorised into high (at least 60% increase in CoP), medium or low (a decrease of - 20% or less in CoP). Clinician-level characteristics were examined across the implementation categories.

RESULTS

There were no significant differences found between implementation groups on sociodemographic variables (p's > 0.30), attitudes to evidence-based practices, attitudes to therapist manuals, and self-efficacy (p's > 0.52). The high implementation group demonstrated significantly higher scores on leadership practices aspect of organisational readiness to change relative to the low and medium implementation group ((F(2, 16) = 3.63, p = 0.05; Cohen's d = .31) but not on the other subscales (p's > 0.07).

CONCLUSIONS

Confidence that leadership will play a positive role in the implementation process may improve effectiveness of comorbidity training programs for drug and alcohol clinicians. On the other hand, contrary to our hypothesis, counselling self-efficacy, evidence-based practice attitudes, attitudes towards therapist manuals, gender, education and experience were not distinguishing factors.

Corrigendum: Implementation of Therapeutic Virtual Reality Into Psychiatric Care: Clinicians' and Service Managers' Perspectives

[This corrects the article DOI: 10.3389/fpsyt.2021.791123.].

Exploring perceptions of implementation practice capacity in community-based behavioral health organizations

Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.

Implementation of Therapeutic Virtual Reality Into Psychiatric Care: Clinicians' and Service Managers' Perspectives

Objectives: Virtual reality (VR) has emerged as a highly promising tool for assessing and treating a range of mental illnesses. However, little is known about the perspectives of key stakeholders in mental healthcare, whose support will be critical for its successful implementation into routine clinical practise. This study aimed to explore the perspectives of staff working in the private mental health sector around the use of therapeutic VR, including potential implementation barriers and facilitators. Methods: Semi-structured qualitative interviews were conducted with cross-disciplinary clinicians (n = 14) and service managers (n = 5), aged 28-70 years working in a major private mental health hospital in Victoria, Australia. Transcripts were analysed using general inductive coding to allow themes to naturally emerge. Results: Three major themes were identified: clinical factors (four subthemes), organisational factors (five subthemes), and professional factors (three subthemes). The themes encompassed enabling factors and potential barriers that need to be addressed for successful implementation of VR. Clinical factors highlighted the influence of knowledge or perceptions about appropriate clinical applications, therapeutic efficacy, safety and ethical concerns, and patient engagement. Organisational factors emphasised the importance of service contexts, including having a strong business case, stakeholder planning, recruitment of local opinion leaders to champion change, and an understanding of resourcing challenges. Professional factors highlighted the need for education and training for staff, and the influence of staff attitudes towards technology and perceived usability of VR. Conclusions: In addition to enabling factors, potential implementation barriers of therapeutic VR were identified, including resourcing constraints, safety and ethical concerns, negative staff attitudes towards technology and VR system limitations. Future dissemination should focus on addressing knowledge and skills gaps and attitudinal barriers through development of clinical guidelines, training programs, and implementation resources (e.g., adoption decision tools, consultation opportunities).

Moving from Implementation Science to Implementation Practice: The Need to Solve Practical Problems to Improve Behavioral Health Services

It is well recognized that the use of evidence-based practices (EBPs) is critical to improving service outcomes for those receiving behavioral health services. However, EBPs are not easily implemented in behavioral health settings, and there are many challenges to supporting these services over time. Recently, research efforts in implementation science (IS) have greatly expanded our understanding of issues that influence the successful implementation of EBPs. Unfortunately, less effort has been devoted to translating this research theory on a practical level to help individual service entities solve the specific problems of putting programs into place. A process is needed where service organizations and practitioners can build their capacity, informed by IS research, to improve service outcomes. The purpose of this commentary is to describe the IS research base, provide an introduction to implementation practice, describe challenges confronting practitioners, and propose necessary steps in building organizational capacity that enables practitioners to implement the most effective services available.

An Exploration of Practitioners' Perceptions and Beliefs About Trauma-Informed Youth Drug Prevention Programs: a Qualitative Study

Adverse childhood experiences (ACEs), such as childhood maltreatment and household dysfunction, have been linked to adolescent substance use. As a result, there exists a pressing need for trauma-informed, substance use preventive intervention for adolescents with a history of ACEs. The primary aim of this qualitative study is to increase our understanding of practitioners' perceptions of substance use among ACE-exposed youth and their views on trauma-informed adolescent substance use prevention programs. The present study conducted six focus groups (N = 32) among current child and adolescent health and human service providers in a mid-Atlantic urban area. The focus groups explored the practitioners' views on the main reasons that youth with a history of ACEs use illicit substances and suggestions on components, constructs, or techniques of trauma-informed substance use prevention programs and perceived barriers in implementing such programs. Transcripts of the focus groups were analyzed using open coding and subsequent axial coding, which was followed by thematic analysis. Thematic analysis identified ten themes within three categories, including the etiology of substance use among ACE-exposed youth, barriers to preventing substance use among ACEs-exposed youth, and suggested program components for trauma-informed prevention programs. These findings provide support for developing a preventive intervention that addresses trauma symptoms and overall skill buildings to prevent substance use among ACE-exposed youth. Teaching skills to cope with trauma symptoms, enhancing knowledge about the signs and symptoms of trauma, and improving key social and emotional learning competencies might be important and effective strategies to curb substance use among ACE-exposed youth.

Therapist Strategies for Managing Midtreatment Problems in Evidence-based Interventions in Community Settings

The National Institute of Health has made it a priority to identify, develop, and refine strategies to disseminate and implement effective interventions (National Institute of Health, 2015). This study examined qualitative reports of the strategies therapists used to manage common implementation problems they encountered during midtreatment in Multisystemic Therapy^® (MST) and Functional Family Therapy (FFT), two widely disseminated evidence- and family-based treatments for substance abusing and delinquent adolescents. Experienced therapists from dissemination sites across the U.S. described cases in which they encountered midtreatment problems they perceived as serious threats to treatment success. They indicated why each case terminated and rated the outcome of the case. Qualitative analyses examined 16 treatment failures and then 16 treatment successes to identify contextual obstacles that accompanied the problems therapists identified, along with strategies they reported using with families that ultimately succeeded or failed. Therapists reported that midtreatment problems were often embedded in additional related difficulties and that they employed multiple relationship techniques and process-focused strategies to try to resolve these problems. For the most part, therapists described obstacles and strategies for successful and unsuccessful families in similar ways. Patterns of themes and subthemes suggested, however, that therapists in successful cases may be more likely to report "on-script" strategies and therapists in unsuccessful cases may describe more "off-script" strategies as well as more generic relationship building and advice-giving strategies.

Examining Organizational Factors Supporting the Adoption and Use of Evidence-Based Interventions

The purpose of this study was to develop a greater understanding of the factors influencing the adoption of evidence-based interventions in outpatient mental health clinics serving youth. An improved understanding of these factors can potentially improve efforts to ensure effective adoption, implementation, and sustainment of evidence-based interventions, and thus improve treatment for youth in mental health settings. This explanatory cross-sectional study involves secondary data analysis of a longitudinal randomized control intervention trial. The SEM- based model that was tested supported the primary hypothesis that a more supportive organizational climate with greater readiness for change is more likely to improve the chances for the adoption of evidence-based interventions in outpatient mental health clinics serving youths.

The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability

BACKGROUND

Implementation strategies have flourished in an effort to increase integration of research evidence into clinical practice. Most strategies are complex, socially mediated processes. Many are complicated, expensive, and ultimately impractical to deliver in real-world settings. The field lacks methods to assess the extent to which strategies are usable and aligned with the needs and constraints of the individuals and contexts who will deliver or receive them. Drawn from the field of human-centered design, cognitive walkthroughs are an efficient assessment method with potential to identify aspects of strategies that may inhibit their usability and, ultimately, effectiveness. This article presents a novel walkthrough methodology for evaluating strategy usability as well as an example application to a post-training consultation strategy to support school mental health clinicians to adopt measurement-based care.

METHOD

The Cognitive Walkthrough for Implementation Strategies (CWIS) is a pragmatic, mixed-methods approach for evaluating complex, socially mediated implementation strategies. CWIS includes six steps: (1) determine preconditions; (2) hierarchical task analysis; (3) task prioritization; (4) convert tasks to scenarios; (5) pragmatic group testing; and (6) usability issue identification, classification, and prioritization. A facilitator conducted two group testing sessions with clinician users (N = 10), guiding participants through 6 scenarios and 11 associated subtasks. Clinicians reported their anticipated likelihood of completing each subtask and provided qualitative justifications during group discussion. Following the walkthrough sessions, users completed an adapted quantitative assessment of strategy usability.

RESULTS

Average anticipated success ratings indicated substantial variability across participants and subtasks. Usability ratings (scale 0-100) of the consultation protocol averaged 71.3 (SD = 10.6). Twenty-one usability problems were identified via qualitative content analysis with consensus coding, and classified by severity and problem type. High-severity problems included potential misalignment between consultation and clinical service timelines as well as digressions during consultation processes.

CONCLUSIONS

CWIS quantitative usability ratings indicated that the consultation protocol was at the low end of the "acceptable" range (based on norms from the unadapted scale). Collectively, the 21 resulting usability issues explained the quantitative usability data and provided specific direction for usability enhancements. The current study provides preliminary evidence for the utility of CWIS to assess strategy usability and generate a blueprint for redesign.

Critical Factors Influencing Interorganizational Relationships Between Juvenile Probation and Behavioral Health Agencies

Although interorganizational relationships (IORs) are essential to the effective delivery of human services, very little research has examined relationships between juvenile justice agencies and behavioral health providers, and few studies have identified the most critical organizational and individual-level characteristics influencing IORs. Across 36 sites, juvenile probation officials (n = 458) and community behavioral health providers (n = 91) were surveyed about characteristics of their agencies, themselves, and IORs with each other. Generalized Linear Mixed Models were used to analyze the data. The strongest predictors included Perceived Organizational Support and individual Adaptability. Implications for research, theory and practice are discussed.

When Do Therapists Stop Using Evidence-Based Practices? Findings from a Mixed Method Study on System-Driven Implementation of Multiple EBPs for Children

Therapist discontinuation of delivering an evidence-based practice (EBP) is a critical outcome in the community implementation of EBPs. This mixed methods study examined factors associated with therapist discontinuation within a large reimbursement-driven implementation of multiple EBPs in public children's mental health services. The study integrated quantitative survey data from 748 therapists across 65 agencies, and qualitative interviews from a subset of 79 therapists across 14 agencies. Therapists adopted, on average, 2.41 EBPs (SD = 1.05, range = 1-5), and nearly half (n = 355, 47.5%) reported discontinuing at least one EBP. Multi-level models were used to predict the binary outcome of discontinuation, and qualitative analyses were used to expand upon quantitative findings. Quantitative models revealed that therapist factors, including fewer direct service hours per week, a greater number of EBPs adopted, higher emotional exhaustion, and more negative attitudes toward EBPs in general were associated with discontinuation. In addition, EBP-specific factors including more negative perceptions of the particular EBP and lower self-efficacy for delivering the specific EBP predicted discontinuation. Themes from interview responses highlighted the importance of fit of the EBP with the agency's client base, as well as therapist perceptions of adequate EBP training supports, and the alignment of an EBP with therapists' professional goals. Together, the findings suggest the need for strategic sustainment planning interventions that target EBP fit (i.e., fit between adopted EBPs and agency target population, fit between EBP and therapist preferences and career goals) and support therapist self-efficacy in delivering EBPs.

Protocol for a hybrid type 2 cluster randomized trial of trauma-focused cognitive behavioral therapy and a pragmatic individual-level implementation strategy

BACKGROUND

More than two-thirds of youth experience trauma during childhood, and up to 1 in 5 of these youth develops posttraumatic stress symptoms that significantly impair their functioning. Although trauma-focused cognitive behavior therapy (TF-CBT) has a strong evidence base, it is rarely adopted, delivered with adequate fidelity, or evaluated in the most common setting where youth access mental health services-schools. Given that individual behavior change is ultimately required for successful implementation, even when organizational factors are firmly in place, focusing on individual-level processes represents a potentially parsimonious approach. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a pragmatic, motivationally focused multifaceted strategy that augments training and consultation and is designed to target precise mechanisms of behavior change to produce enhanced implementation and youth clinical outcomes. This study protocol describes a hybrid type 2 effectiveness-implementation trial designed to concurrently evaluate the main effects, mediators, and moderators of both the BASIS implementation strategy on implementation outcomes and TF-CBT on youth mental health outcomes.

METHODS

Using a cluster randomized controlled design, this trial will assign school-based mental health (SMH) clinicians and schools to one of three study arms: (a) enhanced treatment-as-usual (TAU), (b) attention control plus TF-CBT, or (c) BASIS+TF-CBT. With a proposed sample of 120 SMH clinicians who will each recruit 4-6 youth with a history of trauma (480 children), this project will gather data across 12 different time points to address two project aims. Aim 1 will evaluate, relative to an enhanced TAU condition, the effects of TF-CBT on identified mechanisms of change, youth mental health outcomes, and intervention costs and cost-effectiveness. Aim 2 will compare the effects of BASIS against an attention control plus TF-CBT condition on theoretical mechanisms of clinician behavior change and implementation outcomes, as well as examine costs and cost-effectiveness.

DISCUSSION

This study will generate critical knowledge about the effectiveness and cost-effectiveness of BASIS-a pragmatic, theory-driven, and generalizable implementation strategy designed to enhance motivation-to increase the yield of evidence-based practice training and consultation, as well as the effectiveness of TF-CBT in a novel service setting.

TRIAL REGISTRATION

ClinicalTrials.gov registration number NCT04451161 . Registered on June 30, 2020.

Prospective predictors of sustainment of multiple EBPs in a system-driven implementation context: Examining sustained delivery based on administrative claims

Background

System-driven scale-up of multiple evidence-based practices (EBPs) is an increasingly common method used in public mental health to improve care. However, there are little data on the long-term sustained delivery of EBPs within these efforts, and previous studies have relied on retrospective self-report within cross-sectional studies. This study identified prospective predictors of sustained EBP delivery at the EBP-, therapist-, and organizational-levels using survey and administrative claims data within a large-scale system-driven implementation effort.

Methods

777 therapists and 162 program leaders delivering at least one of six EBPs of interest completed surveys assessing perceptions of EBPs and organizational context. These surveys were linked to administrative data to examine prospective predictors of therapists' EBP delivery over 33 months.

Results

Five of the six EBPs implemented showed sustained delivery in the system, with volume varying by EBP. Although total EBP claim volume per therapist decreased over time, the volume ratio (ratio of EBP-specific claims to total EBP and non-EBP claims) stayed relatively stable. Multilevel models revealed that EBPs that required consultation, had unstructured content, higher therapist self-efficacy with the EBP, and more positive program leader perceptions of the EBP were associated with greater sustained volume and volume ratio of the EBP. Therapists who were trained in fewer EBPs, who were unlicensed, and who worked in agencies rated by program leaders as lower on organizational staff autonomy and stress showed greater sustained EBP volume and volume ratio. Finally, more direct service hours per week provided by therapist predicted greater sustained EBP volume, but lower volume ratio.

Conclusions

The results point to the importance of EBP, therapist, and organizational factors that may be targeted in implementation strategies to promote the sustainment of EBPs.

CORE: Compassion Oriented Reflection and Engagement to Guide Academic-Community Partnership

Estimates in dissemination, implementation, and services (DIS) research continue to present a 17-year lag for implementation of only 14% of evidence-based clinical services and technologies in practice (Chambers, 2018) - especially troubling for communities characterized by disproportionately high rates of poverty, crime and mental health need (Yoshikawa, Aber, & Beardslee, 2012). Academic-community partnerships offer pathways by which to speed the transport of evidence-based innovations; however, a range of challenges can disrupt implementation and adoption (Damschroder et al., 2009). This manuscript presents Compassion-Oriented Reflection and Engagement (CORE), a framework to inform academic collaborators’ perspectives and practices towards building flexible, responsive partnerships with youth-serving community-based organizations.

The prospects for sustaining evidence-based responses to the US opioid epidemic: state leadership perspectives

BACKGROUND

The US 21st Century Cures Act provided $7.5 billion in grant funding to states and territories for evidence-based responses to the opioid epidemic. Currently, little is known about optimal strategies for sustaining these programs beyond this start-up funding.

METHODS

Using an inductive, conventional content analysis, we conducted key informant interviews with former and current state leaders (n = 16) about barriers/facilitators to sustainment and strategies for sustaining time-limited grants.

RESULTS

Financing and reimbursement, service integration, and workforce capacity were the most cited barriers to sustainment. Status in state government structure, public support, and spending flexibility were noted as key facilitators. Effective levers to increase chances for sustainment included strong partnerships with other state agencies, workforce and credentialing changes, and marshalling advocacy through public awareness campaigns.

CONCLUSIONS

Understanding the strategies that leaders have successfully used to sustain programs in the past can inform how to continue future time-limited, grant-funded initiatives.

Ten recommendations for using implementation frameworks in research and practice

Background

Recent reviews of the use and application of implementation frameworks in implementation efforts highlight the limited use of frameworks, despite the value in doing so. As such, this article aims to provide recommendations to enhance the application of implementation frameworks, for implementation researchers, intermediaries, and practitioners.

Discussion

Ideally, an implementation framework, or multiple frameworks should be used prior to and throughout an implementation effort. This includes both in implementation science research studies and in real-world implementation projects. To guide this application, outlined are ten recommendations for using implementation frameworks across the implementation process. The recommendations have been written in the rough chronological order of an implementation effort; however, we understand these may vary depending on the project or context: (1) select a suitable framework(s), (2) establish and maintain community stakeholder engagement and partnerships, (3) define issue and develop research or evaluation questions and hypotheses, (4) develop an implementation mechanistic process model or logic model, (5) select research and evaluation methods (6) determine implementation factors/determinants, (7) select and tailor, or develop, implementation strategy(s), (8) specify implementation outcomes and evaluate implementation, (9) use a framework(s) at micro level to conduct and tailor implementation, and (10) write the proposal and report. Ideally, a framework(s) would be applied to each of the recommendations. For this article, we begin by discussing each recommendation within the context of frameworks broadly, followed by specific examples using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

Summary

The use of conceptual and theoretical frameworks provides a foundation from which generalizable implementation knowledge can be advanced. On the contrary, superficial use of frameworks hinders being able to use, learn from, and work sequentially to progress the field. Following the provided ten recommendations, we hope to assist researchers, intermediaries, and practitioners to improve the use of implementation science frameworks.

Acquisition of Information About Innovative Practices in Outpatient Mental Health Clinics

This study uses qualitative interviews with leaders of 34 mental health clinics in the context of a statewide rollout of clinical and business innovations to explore how clinics first learn about innovations and which external sources of information they access. Clinic leaders reported accessing information about innovations mainly from government agencies, professional associations, peer organizations, and research literature. Leaders mentioned an average of two external sources of information. There was evidence of variation in how leaders accessed information and how information about innovations was communicated within clinics. Findings have implications for improving dissemination of information about innovations in mental health systems.

Designing the Future of Children's Mental Health Services

Advancements in evidence-based psychosocial interventions, digital technologies, and implementation strategies (i.e., health services research products) for youth mental health services have yet to yield significant improvement in public health outcomes. Achieving such impact will require that these research products are easy to use, useful, and contextually appropriate. This paper describes how human-centered design (HCD), an approach that aligns product development with the needs of the people and settings that use those products, can be leveraged to improve youth mental health services. We articulate how HCD can advance accessibility, effectiveness, and equity, with specific consideration of unique aspects of youth mental health services.

Development of Customizable Implementation Guides to Support Clinical Adoption of Pharmacogenomics: Experiences of the Implementing GeNomics In pracTicE (IGNITE) Network

Introduction

Clinical adoption of genomic medicine has lagged behind the pace of scientific discovery. Practice-based resources can help overcome implementation challenges.

Methods

In 2015, the IGNITE (Implementing GeNomics In pracTicE) Network created an online genomic medicine implementation resource toolbox that was expanded in 2017 to incorporate the ability for users to create targeted implementation guides. This expansion was led by a multidisciplinary team that developed an evidence-based, structured framework for the guides, oversaw the technical process/build, and pilot tested the first guide, CYP2C19-Clopidogrel Testing Implementation.

Results

Sixty-five resources were collected from 12 institutions and categorized according to a seven-step implementation framework for the pilot CYP2C19-Clopidogrel Testing Implementation Guide. Five months after its launch, 96 CYP2C19-Clopidogrel Testing Implementation Guides had been created. Eighty percent of the resources most frequently selected by users were created by IGNITE to fill an identified resource gap. Resources most often included in guides were from the test reimbursement (22%), Implementation support gathering (22%), EHR integration (17%), and genetic testing workflow steps (17%).

Conclusion

Lessons learned from this implementation guide development process provide insight for prioritizing development of future resources and support the value of collaborative efforts to create resources for genomic medicine implementation.

Therapist and Youth Predictors of Specific Practices Derived from the Evidence-Base in Community Mental Health

Over the past several years, youth treatment research has moved toward understanding the dissemination and implementation of evidence-based practices (EBPs). As a result, studies have focused on identifying predictors that aid in successful adoption and sustainment of EBPs. Theories of behavior change posit that therapist knowledge and attitudes play a fundamental role in EBP adoption; however, studies have produced mixed findings, which may be an artifact of broad definitions of both EBP knowledge and EBP itself. The current study was an examination of 46 youth community therapists and the extent to which varying types of knowledge and attitudes as well as youth characteristics predicted specific practices derived from the evidence-base. Results suggested that specific EBP knowledge predicted specific practices, highlighting the need for more specificity when examining predictors of EBP use. Therapists' attitudes, demographic characteristics, and youth characteristics were also significant predictors of EBP use. Future research should consider examining discrete and specific practices to better understand and predict therapists' future behavior.

User testing to drive the iterative development of a strategy to improve implementation of evidence-based practices in school mental health

Research has produced a steady stream of evidence-based practices (EBP) that can promote youth behavioral health, but widespread implementation is often poor. To narrow the "science to practice gap," an implementation strategy was developed to enhance school-based mental health providers' intentions to implement EBP. The current study adopted a user-testing approach to inform the iterative development of this implementation strategy, which consisted of strategic education, social influence techniques, and motivational interviewing. Segments of the implementation strategy were demonstrated live for a representative sample of the intended audience. Participants rated each segment on acceptability, appropriateness, and likely impact on intentions to use EBP. Ratings were tallied in real time and presented to participants to spur discussion. Qualitative input was coded via conventional content analyses. Results indicated that that implementation strategies may need to be tailored to the specific EBP. In addition, implementation goal setting was well-received by some participants but not others, suggesting a difficulty of conducting motivational interviewing in group settings. Participants also perceived themselves as familiar with EBP and strong advocates of school mental health services. The paper concludes with a discussion of how this research has influenced the ongoing development of the strategy and implications for EBP implementation efforts.

Implementation support practitioners - a proposal for consolidating a diverse evidence base

BACKGROUND

Workforce development for implementation practice has been identified as a grand challenge in health services. This is due to the embryonic nature of the existing research in this area, few available training programs and a general shortage of frontline service staff trained and prepared for practicing implementation in the field. The interest in the role of "implementation support" as a way to effectively build the implementation capacities of the human service sector has therefore increased. However, while frequently used, little is known about the skills and competencies required to effectively provide such support.

MAIN BODY

To progress the debate and the research agenda on implementation support competencies, we propose the role of the "implementation support practitioner" as a concept unifying the multiple streams of research focused on e.g. consultation, facilitation, or knowledge brokering. Implementation support practitioners are professionals supporting others in implementing evidence-informed practices, policies and programs, and in sustaining and scaling evidence for population impact. They are not involved in direct service delivery or management and work closely with the leadership and staff needed to effectively deliver direct clinical, therapeutic or educational services to individuals, families and communities. They may be specialists or generalists and be located within and/or outside the delivery system they serve. To effectively support the implementation practice of others, implementation support practitioners require an ability to activate implementation-relevant knowledge, skills and attitudes, and to operationalize and apply these in the context of their support activities. In doing so, they aim to trigger both relational and behavioral outcomes. This thinking is reflected in an overarching logic outlined in this article.

CONCLUSION

The development of implementation support practitioners as a profession necessitates improved conceptual thinking about their role and work and how they enable the uptake and integration of evidence in real world settings. This article introduces a preliminary logic conceptualizing the role of implementation support practitioners informing research in progress aimed at increasing our knowledge about implementation support and the competencies needed to provide this support.

Ten recommendations for using implementation frameworks in research and practice

BACKGROUND

Recent reviews of the use and application of implementation frameworks in implementation efforts highlight the limited use of frameworks, despite the value in doing so. As such, this article aims to provide recommendations to enhance the application of implementation frameworks, for implementation researchers, intermediaries, and practitioners.

DISCUSSION

Ideally, an implementation framework, or multiple frameworks should be used prior to and throughout an implementation effort. This includes both in implementation science research studies and in real-world implementation projects. To guide this application, outlined are ten recommendations for using implementation frameworks across the implementation process. The recommendations have been written in the rough chronological order of an implementation effort; however, we understand these may vary depending on the project or context: (1) select a suitable framework(s), (2) establish and maintain community stakeholder engagement and partnerships, (3) define issue and develop research or evaluation questions and hypotheses, (4) develop an implementation mechanistic process model or logic model, (5) select research and evaluation methods (6) determine implementation factors/determinants, (7) select and tailor, or develop, implementation strategy(s), (8) specify implementation outcomes and evaluate implementation, (9) use a framework(s) at micro level to conduct and tailor implementation, and (10) write the proposal and report. Ideally, a framework(s) would be applied to each of the recommendations. For this article, we begin by discussing each recommendation within the context of frameworks broadly, followed by specific examples using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

SUMMARY

The use of conceptual and theoretical frameworks provides a foundation from which generalizable implementation knowledge can be advanced. On the contrary, superficial use of frameworks hinders being able to use, learn from, and work sequentially to progress the field. Following the provided ten recommendations, we hope to assist researchers, intermediaries, and practitioners to improve the use of implementation science frameworks.

Barriers and facilitators to implementation of menu labelling interventions from a food service industry perspective: a mixed methods systematic review

Background

Eating outside the home contributes to poor dietary habits worldwide and is associated with increased body fat and weight gain. Evidence shows menu labelling is effective in promoting healthier food choices; however, implementation issues have arisen. The purpose of this systematic review was to synthesise the evidence on the perceived barriers and facilitators to implementation of menu labelling interventions from the perspective of the food service industry.

Methods

Peer-reviewed and grey literature were searched using databases, specialised search engines and public health organisation websites. Screening reference lists, citation chaining and contacting authors of all included studies were undertaken. Primary research studies relevant to direct supply-side stakeholders were eligible for inclusion. There were no restrictions on menu labelling scheme or format, study methods, publication year or language. At least two independent reviewers performed study selection, data extraction and quality appraisal. The results were synthesised using the ‘best fit’ framework synthesis approach, with reference to the Consolidated Framework for Implementation Research (CFIR).

Results

Seventeen studies met the eligibility criteria, with the majority rated as average quality (n = 10). The most frequently cited barriers were coded to the CFIR constructs ‘Consumer Needs & Resources’ (e.g. lack of customer demand for/interest in menu labelling, risk of overwhelmed/confused customers) and ‘Compatibility’ with organisation work processes (e.g. lack of standardised recipes, limited space on menus). Frequently cited facilitators were coded to the CFIR constructs ‘Relative Advantage’ of menu labelling (e.g. improved business image/reputation) and ‘Consumer Needs & Resources’ (e.g. customer demand for/interest in menu labelling, providing nutrition information to customers). An adapted framework consisting of a priori and new constructs was developed, which illustrates the relationships between domains.

Conclusion

This review generates an adapted CFIR framework for understanding implementation of menu labelling interventions. It highlights that implementation is influenced by multiple interdependent factors, particularly related to the external and internal context of food businesses, and features of the menu labelling intervention. The findings can be used by researchers and practitioners to develop or select strategies to address barriers that impede implementation and to leverage facilitators that assist with implementation effort.

Trial registration

Systematic review registration: PROSPERO CRD42017083306.

After-School Programs and Children's Mental Health: Organizational Social Context, Program Quality, and Children's Social Behavior

OBJECTIVE

The current study examined associations among organizational social context, after-school program (ASP) quality, and children's social behavior in a large urban park district.

METHOD

Thirty-two park-based ASPs are included in the final sample, including 141 staff and 593 children. Staff reported on organizational culture (rigidity, proficiency, resistance) and climate (engagement, functionality, stress), and children's social skills and problem behaviors. Children and their parents reported on program quality indicators (e.g., activities, routines, relationships). Parents also completed a children's mental health screener.

RESULTS

A series of Hierarchical Linear Models revealed that proficiency and stress were the only organizational predictors of program quality; associations between stress and program quality were moderated by program enrollment and aggregated children's mental health need. Higher child- and parent-perceived program quality related to fewer staff-reported problem behaviors, while overall higher enrollment and higher aggregated mental health need were associated with fewer staff-reported social skills.

CONCLUSIONS

Data are informing ongoing efforts to improve organizational capacity of urban after-school programs to support children's positive social and behavior trajectories.

Implementation of evidence-based practice for alcohol and substance use disorders: protocol for systematic review

BACKGROUND

Whilst effective treatments exist for substance use and alcohol use disorders, they are not commonly practised. Studies have shown that only a small percentage of services provide evidence-based treatments such as addiction medications or psychosocial therapies. Although there is a growing body of literature on evidence-based treatment, no synthesis of research on the implementation of evidence-based addiction treatment exists. This proposed systematic review will synthesise and evaluate the effectiveness of implementation programmes in the treatment of patients with drug and alcohol problems using the Consolidated Framework for Implementation Research (CFIR) framework.

METHODS

We will search (from inception onwards) PubMed/MEDLINE, Cochrane Library, PsycINFO, Web of Science and CINAHL. Eligible studies will be clinical trials (e.g. randomised controlled trials, non-randomised controlled trials) and observational studies (e.g. before-and-after studies, interrupted time series) evaluating strategies used to implement evidence-based psychosocial treatments for alcohol and substance use disorders. The primary outcomes will be related to the implementation, service system, or clinical practice (e.g. acceptability, implementation costs, feasibility). Two researchers will independently screen all citations, full-text articles and abstract data. Risk of bias of individual studies will be appraised using appropriate tools. A narrative synthesis will be provided.

DISCUSSION

This project aims to provide evidence to help guide the design of translational research programmes to improve implementation of evidence-based care in drug and alcohol settings. Findings from the study will specify effective strategies for domains of influence including (1) intervention characteristics (e.g. evidence strength and quality, adaptability), (2) outer setting (e.g. patient needs and resources, external policies and incentives), (3) inner setting (e.g. implementation climate, readiness for implementation), (4) individuals involved (e.g. self-efficacy, knowledge and beliefs about the intervention) and (5) the implementation process (e.g. engaging members of the organisation, executing the innovation). Identified gaps in knowledge will guide further study.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42019123812.

Fostering international collaboration in implementation science and research: a concept mapping exploratory study

OBJECTIVE

International collaboration in science has received increasing attention given emphases on relevance, generalizability, and impact of research. Implementation science (IS) is a growing discipline that aims to translate clinical research findings into health services. Research is needed to identify efficient and effective ways to foster international collaboration in IS. Concept-mapping (CM) was utilized with a targeted sample for preliminary exploration of fostering international collaboration. Concept-mapping is a mixed-method approach (qualitative/quantitative) particularly suited for identifying essential themes and action items to facilitate planning among diverse stakeholders. We sought to identify key factors likely to facilitate productive and rewarding international collaborations in implementation research.

RESULTS

We identified eleven dimensions: Strategic Planning; Practicality; Define Common Principles; Technological Tools for Collaboration; Funding; Disseminate Importance of Fostering International Collaboration in IS; Knowledge Sharing; Innovative & Adaptive Research; Training IS Researchers; Networking & Shared Identity; Facilitate Meetings. Strategic Planning and Funding were highest rated for importance and Strategic Planning and Networking and Shared Identity were rated most feasible to institute. Fostering international collaboration in IS can accelerate the efficiency, relevance, and generalizability of implementation research. Strategies should be developed and tested to improve international collaborations and engage junior and experienced investigators in collaborations advancing implementation science and practice.

Increasing implementation science literacy to address the research-to-practice gap in school psychology

Many evidence-based practices have not achieved their potential to broadly impact student outcomes as schools struggle with their adoption and implementation. This costly and consequential implementation gap must be addressed within school psychology through the focused study of implementation processes and outcomes. Implementation science is a multidisciplinary, translational field focused on increasing the usage and implementation of evidence-based practices into typical practice to improve outcomes. Despite the rapid development of the field of implementation science over the past decade it has been underexamined in school psychology research. As a step toward decreasing the implementation gap, the purpose of this introductory article is to increase school psychology researchers' implementation literacy. Specifically, this article provides an overview of implementation science, including (a) key terminology; (b) theories, models, and frameworks designed to explain, describe, or illustrate implementation processes or constructs; (c) strategies to support implementation across levels (e.g., provider, organization); (d) measures to capture implementation and related context; and (e) utilized research designs. By increasing school psychology researchers' implementation literacy, it is hoped that future research will attend to and evaluate implementation process and outcomes and thus facilitate the adoption and implementation of evidence-based practices to improve student outcomes.

What Types of Brokerage Bridge the Research-Practice Gap? The Case of Public School Educators

The presence of a research-practice gap is recognized across multiple fields including education, psychology, and public health. In this paper, we examine which of five structural types of brokerage are most and least effective in bridging this research-practice gap in the context of education. Using a small world survey design, we tracked how a statewide random sample of 247 K-12 principals and superintendents in Michigan seek information about social skills programs from brokering individuals and organizations. We find that some triadic brokerage structures are more effective than others in closing the communication gap between practitioners and researchers. Specifically, educators relying on itinerant brokerage, which circulates information between members of the same community, were five times less likely to obtain information from a researcher. In contrast, educators relying on representative or liaison brokerage, which facilitate information transfer between members of different communities, were more than twice as likely to obtain information from a researcher. We conclude by discussing implications for the development of interventions designed to facilitate information sharing between practitioners and researchers.

A synthesis of implementation science frameworks and application to global health gaps

Background

Implementation science has been growing as discipline in the past decades, producing an increasing number of models in the area. On the other hand, most frameworks are intended to guide the implementation of programs, focusing on identifying elements and stages that increase their success. This article aims to structure this discussion, proposing a simplified tool that synthesizes common elements of other frameworks, and highlight the usefulness to use implementation science not only in identifying successful implementation strategies but as a tool to assess gaps in global health initiatives.

Methods

The study was carried out through a combined methodology that included an initial search of implementation science frameworks, experts’ opinions, and the use of references in frameworks to elaborate a list of articles to be reviewed. A total of 52 articles were analyzed, identifying their definitions of implementation science and the elements of different frameworks.

Results

The analysis of articles allowed identifying the main goals and definitions of implementation science. In a second stage, frameworks were classified into “time-based”, “component-based” and “mixed”, and common elements of each type of model were used to propose a synthetic framework with six elements: Diagnosis, Intervention provider/ system, Intervention, Recipient, Environment, and Evaluation. Finally, this simplified framework was used to identify gaps in global health was using The Lancet Global Health Series. Potential areas of intervention arise for five different global health issues: malaria, non-communicable diseases, maternal and child health, HIV/AIDS, and tuberculosis. Prioritization strategies differ for the different health issues, and the proposed framework can help identify and classify all these different proposals.

Conclusions

There is a huge variety of definitions and models in implementation science. The analysis showed the usefulness of applying an implementation science approach to identify and prioritize gaps in implementation strategies in global health.

Electronic supplementary material

The online version of this article (10.1186/s41256-019-0115-1) contains supplementary material, which is available to authorized users.

Workforce Support for Urban After-School Programs: Turning Obstacles into Opportunities

Organized after-school programs can mitigate risk and build resilience for youth in urban communities. Benefits rely on high-quality developmental experiences characterized by a supportive environment, structured youth-adult interactions, and opportunities for reflective engagement. Programs in historically disenfranchised communities are underfunded; staff are transient, underpaid, and undertrained; and youth exhibit significant mental health problems which staff are variably equipped to address. Historically, after-school research has focused on behavior management and social-emotional learning, relying on traditional evidence-based interventions designed for and tested in schools. However, after-school workforce and resource limitations interfere with adoption of empirically supported strategies and youth health promotion. We have engaged in practice-based research with urban after-school programs in economically vulnerable communities for nearly two decades, toward building a resource-efficient, empirically informed multitiered model of workforce support. In this paper, we offer first-person accounts of four academic-community partnerships to illustrate common challenges, variability across programs, and recommendations that prioritize core skills underlying risk and resilience, align with individual program goals, and leverage without overextending natural routines and resources. Reframing obstacles as opportunities has revealed the application of mental health kernels to the after-school program workforce support and inspired lessons regarding sustainability of partnerships and practice.

The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention

BACKGROUND

Individual-level implementation determinants, such as clinician attitudes, commonly influence the successful adoption of evidence-based practices, but few explicit strategies have been tested with regard to their ability to impact these key mechanisms of change. This paper reports on an initial test of a blended, theoretically informed pre-implementation strategy designed to target malleable individual-level determinants of behavior change. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a brief and pragmatic pre-implementation strategy that uses strategic education, social influence techniques, and group-based motivational interviewing to target implementation attitudes, perceived social norms, perceived behavioral control, and behavioral intentions to implement among mental health clinicians working in the education sector.

METHODS

As part of a pilot trial, 25 school mental health clinicians were randomized to BASIS (n = 12) or an attention control placebo (n = 13), with both conditions receiving training and consultation in an evidence-based intervention for youth experiencing trauma (the Cognitive Behavioral Intervention for Trauma in Schools). Theorized mechanisms of change (attitudes, perceived social norms, perceived behavioral control, and behavioral intentions) were assessed at baseline, post-training, and 4-month follow-up. Clinician participation in post-training consultation and intervention adoption were also tracked.

RESULTS

A series of regression models and independent sample t tests indicated that BASIS had significant, medium to large effects on the majority of its proximal mechanisms from baseline to post-training. BASIS was also associated with a greater latency between initial training in the intervention and discontinuation of participation in post-training consultation, with clinicians in the BASIS condition persisting in consultation for an average of 134 days versus 32 days for controls, but this difference was not statistically significant. At 4-month follow-up, most differences in the theorized mechanisms had attenuated, and approximately the same small number of BASIS clinicians adopted the trauma intervention as controls.

CONCLUSION

Findings suggest that the brief BASIS pre-implementation strategy had a significant influence on its proximal mechanisms of change, but that these changes did not persist over time or translate into adoption of the trauma intervention. Implications for theory refinement, revisions to the BASIS protocol, and next steps for research surrounding individual-level implementation strategies are discussed.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03791281 . Registered 31 December 2018-Retrospectively registered.

Training transfer: a systematic review of the impact of inner setting factors

Consistent with Baldwin and Ford's model (Pers Psychol 41(1):63-105, 1988), training transfer is defined as the generalization of learning from a training to everyday practice in the workplace. The purpose of this review was to examine the influence of work-environment factors, one component of the model hypothesized to influence training transfer within behavioral health. An electronic literature search guided by the Consolidated Framework for Implementation Research's inner setting domain was conducted was conducted on Medline OVID, Medline EMBASE, and PsycINFO databases. Of 9184 unique articles, 169 full-text versions of articles were screened for eligibility, yielding 26 articles meeting inclusion criteria. Results from the 26 studies revealed that overall, having more positive networks and communication, culture, implementation climate, and readiness for implementation can facilitate training transfer. Although few studies have examined the impact of inner setting factors on training transfer, these results suggest organizational context is important to consider with training efforts. These findings have important implications for individuals in the broader health professions educational field.

The effect of implementation climate on program fidelity and student outcomes in autism support classrooms

OBJECTIVE

An organization's implementation climate, or the extent to which use of an intervention is expected, supported, and rewarded by colleagues and supervisors, has been identified as critical to successful intervention implementation and outcomes. The effect of implementation climate has not been well studied in special education settings. The present study examines the association between teachers' perceptions of implementation climate, teacher fidelity to a school-based program for students with autism, and student outcomes (measured as changes in IQ) over time.

METHOD

Participants included 158 students from 45 classrooms and their teachers. Teachers provided a measure of implementation climate at the beginning of the academic year; program fidelity was measured monthly throughout the year. The main and interaction effects of perceived implementation climate and fidelity on student outcomes were examined using longitudinal nested linear models with random effects for classroom and student, controlling for important covariates.

RESULTS

On average, IQ scores improved 2.2 points (SD = 8.7). There were no main effects of perceived implementation climate or fidelity on student outcomes; however, the interaction between perceived implementation climate and fidelity was associated with student outcomes (p < .05, d = 0.54). Among classrooms with a strong perceived implementation climate, higher fidelity was associated with better student outcomes.

CONCLUSIONS

While preliminary and requiring replication, these findings suggest that perceived implementation climate and program fidelity each may be important but not sufficient for optimizing outcomes for students with autism. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The survivability of dialectical behaviour therapy programmes: a mixed methods analysis of barriers and facilitators to implementation within UK healthcare settings

BACKGROUND

Dialectical Behaviour Therapy (DBT) is an evidence-based intervention that has been included in the National Institute of Health and Care Excellence guidelines as a recommended treatment for Borderline Personality Disorder in the UK. However, implementing and sustaining evidence-based treatments in routine practice can be difficult to achieve. This study compared the survival of early and late adopters of DBT as well as teams trained via different training modes (on-site versus off-site), and explored factors that aided or hindered implementation of DBT into routine healthcare settings.

METHODS

A mixed-method approach was used. Kaplan-Meier survival analyses were conducted to quantify and compare survivability as a measure of sustainability between early and late implementers and those trained on- and off-site. An online questionnaire based on the Consolidated Framework for Implementation Research was used to explore barriers and facilitators in implementation. A quantitative content analysis of survey responses was carried out.

RESULTS

Early implementers were significantly less likely to survive than late implementers, although, the effect size was small. DBT teams trained off-site were significantly more likely to survive. The effect size for this difference was large.  An unequal amount of censored data between groups in both analyses means that findings should be considered tentative. Practitioner turnover and financing were the most frequently cited barriers to implementation. Individual characteristics of practitioners and quality of the evidence base were the most commonly reported facilitators to implementation.

CONCLUSIONS

A number of common barriers and facilitators to successful implementation of DBT were found among DBT programmes. Location of DBT training may mediate programme survival.

A Cross-Site Partnership to Examine Implementation and Sustainability of a School-Based Trauma Program

Objectives

Schools have been identified as an ideal setting for increasing access to mental health services particularly for underserved minority youth. The emerging field of implementation science has begun to systematically investigate strategies for more efficiently integrating evidence-based practices into community settings. Significantly less translational research has focused specifically on the school setting. To address this need, we examined the implementation of a school-based trauma intervention across three distinct regions.

Design

We conducted key informant interviews guided by Mendel's Framework of Dissemination in Health Services Intervention Research with multiple school stakeholders to examine what school organizational characteristics influence the adoption and implementation process and sustainability of Cognitive Behavioral Intervention for Trauma in Schools (CBITS). Participants were selected from schools in three geographic regions in the United States: Western, Midwestern, and Southern.

Results

Our findings reveal that while sites had some common organizational factors that appeared to facilitate implementation, regions differed in how they compensated for less robust implementation domains. Across all regions, school stakeholders recognized the need for services to support students impacted by trauma. In the Western region, there was no centralized district policy for implementation; therefore, implementation was facilitated by school-level change agents and supervision support from the district mental health unit. In the Midwestern region, centralized district policies drove implementation. In both the Midwestern and Southern regions, implementation was facilitated by collaboration with a local mental health agency.

Conclusions

This study contributes to the paucity of empirical information on the organizational factors that influence the implementation of evidence-based mental health interventions in schools. Our findings reveal that different implementation strategies across policies, structures, and resources can result in implementation of a school-based intervention. Frameworks such as Mendel's can be helpful in identifying areas of strength and improvement of implementation within a school organization.

Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants

BACKGROUND

The Evidence-Based Practice Attitude Scale (EBPAS) is a widely used tool, but it has not been adapted and validated for use in schools, the most common setting where youth access behavioral health services. This study examined the factor structure, psychometric properties, and criterion-related validity of the school-adapted EBPAS in a sample of school-based behavioral health consultants.

METHOD

A research team comprised of experts in implementation of evidence-based practices in schools along with the original developer adapted the EBPAS for the school setting. The adapted instrument was administered to a representative sample (n = 196) of school-based behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses.

RESULTS

The original EBPAS factor structure was confirmed, with the final model supporting four first-order factors that load onto a second-order factor capturing general attitudes toward evidence-based practice. Correlations among the subscales indicated both unique and shared variance. Correlations between EBPAS scores and consultant variables demonstrated differential criterion-related validity, with the total score and the Requirements and Openness subscales demonstrating the strongest correlations.

CONCLUSIONS

The adapted EBPAS performed well when administered to behavioral health consultants operating in the educator sector, supporting the relevance of assessing attitudes in school settings. Potential directions for future research and applications of the EBPAS in schools and other service sectors are discussed.

Mixed-method analysis of program leader perspectives on the sustainment of multiple child evidence-based practices in a system-driven implementation

BACKGROUND

Understanding program leader perspectives on the sustainment of evidence-based practice (EBP) in community mental health settings is essential to improving implementation. To date, however, much of the literature has focused on direct service provider perspectives on EBP implementation. The aim of this mixed-method study was to identify factors associated with the sustainment of multiple EBPs within a system-driven implementation effort in children's mental health services.

METHODS

Data were gathered from 186 leaders at 59 agencies within the Los Angeles County Department of Mental Health who were contracted to deliver one of six EBPs within the Prevention and Early Intervention initiative.

RESULTS

Multi-level analyses of quantitative survey data (N = 186) revealed a greater probability of leader-reported EBP sustainment in large agencies and when leaders held more positive perceptions toward the EBP. Themes from semi-structured qualitative interviews conducted with a subset of survey participants (n = 47) expanded quantitative findings by providing detail on facilitating conditions in larger agencies and aspects of EBP fit that were perceived to lead to greater sustainment, including perceived fit with client needs, implementation requirements, aspects of the organizational workforce, availability of trainings, and overall therapist attitudes about EBPs.

CONCLUSIONS

Findings inform EBP implementation efforts regarding decisions around organizational-level supports and promotion of EBP fit.

Organisational capacity and its relationship to research use in six Australian health policy agencies

There are calls for policymakers to make greater use of research when formulating policies. Therefore, it is important that policy organisations have a range of tools and systems to support their staff in using research in their work. The aim of the present study was to measure the extent to which a range of tools and systems to support research use were available within six Australian agencies with a role in health policy, and examine whether this was related to the extent of engagement with, and use of research in policymaking by their staff. The presence of relevant systems and tools was assessed via a structured interview called ORACLe which is conducted with a senior executive from the agency. To measure research use, four policymakers from each agency undertook a structured interview called SAGE, which assesses and scores the extent to which policymakers engaged with (i.e., searched for, appraised, and generated) research, and used research in the development of a specific policy document. The results showed that all agencies had at least a moderate range of tools and systems in place, in particular policy development processes; resources to access and use research (such as journals, databases, libraries, and access to research experts); processes to generate new research; and mechanisms to establish relationships with researchers. Agencies were less likely, however, to provide research training for staff and leaders, or to have evidence-based processes for evaluating existing policies. For the majority of agencies, the availability of tools and systems was related to the extent to which policymakers engaged with, and used research when developing policy documents. However, some agencies did not display this relationship, suggesting that other factors, namely the organisation's culture towards research use, must also be considered.

Barriers, facilitators, and benefits of implementation of dialectical behavior therapy in routine care: results from a national program evaluation survey in the Veterans Health Administration

National implementation of evidence-based psychotherapies (EBPs) in the Veterans Health Administration (VHA) provides important lessons on the barriers and facilitators to implementation in a large healthcare system. Little is known about barriers and facilitators to the implementation of a complex EBP for emotional and behavioral dysregulation-dialectical behavioral therapy (DBT). The purpose of this study was to understand VHA clinicians' experiences with barriers, facilitators, and benefits from implementing DBT into routine care. This national program evaluation survey measured site characteristics of VHA sites (N = 59) that had implemented DBT. DBT was most often implemented in general mental health outpatient clinics. While 42% of sites offered all four modes of DBT, skills group was the most frequently implemented mode. Fifty-nine percent of sites offered phone coaching in any form, yet only 11% of those offered it all the time. Providers were often provided little to no time to support implementation of DBT. Barriers that were difficult to overcome were related to phone coaching outside of business hours. Facilitators to implementation included staff interest and expertise. Perceived benefits included increased hope and functioning for clients, greater self-efficacy and compassion for providers, and ability to treat unique symptoms for clinics. There was considerable variability in the capacity to address implementation barriers among sites implementing DBT in VHA routine care. Mental health policy makers should note the barriers and facilitators reported here, with specific attention to phone coaching barriers.