Therapists perspectives on the effective elements of consultation following training

The Secret Sauce? Taking the Mystery Out of Scaling-Up School-Based Physical Activity Interventions

Over the last 4 decades, physical activity researchers have invested heavily in determining "what works" to promote healthy behaviors in schools. Single and multicomponent school-based interventions that target physical education, active transportation, and/or classroom activity breaks effectively increased physical activity among children and youth. Yet, few of these interventions are ever scaled-up and implemented under real-world conditions and in diverse populations. To achieve population-level health benefits, there is a need to design school-based health-promoting interventions for scalability and to consider key aspects of the scale-up process. In this opinion piece, we aim to identify challenges and advance knowledge and action toward scaling-up school-based physical activity interventions. We highlight the key roles of planning for scale-up at the outset, scale-up pathways, trust among partners and program support, program adaptation, evaluation of scale-up, and barriers and facilitators to scaling-up. We draw upon our experience scaling-up effective school-based interventions and provide a solid foundation from which others can work toward bridging the implementation-to-scale-up gap.

Supervisory Alliance as a Moderator of the Effects of Behavioral Rehearsal on TF-CBT Fidelity: Results from a Randomized Trial of Supervision Strategies

Exposure is an important element of treatment for many evidence-based treatments but can be challenging to implement. Supervision strategies to support exposure delivery may be an important tool to facilitate the use of exposure techniques; however, they must be considered and used in the context of the supervisory alliance. The present study examined relations between supervisory alliance and fidelity to the trauma narrative (TN; i.e., imaginal exposure) component of Trauma-Focused Cognitive Behavioral Therapy. We also examined how supervisory alliance moderated the effect of behavioral rehearsal use in supervision on TN fidelity. We analyzed data from a randomized controlled trial, in which forty-two supervisors and their clinicians (N = 124) from 28 Washington State community-based mental health offices participated. Clinicians were randomized to receive one of two supervision conditions-symptom and fidelity monitoring (SFM) or SFM with behavioral rehearsal (SFM + BR). Supervisory alliance alone did not predict delivery (i.e., occurrence) or extensiveness of delivery of the trauma narrative. Client-focused supervisory alliance moderated the effectiveness of behavioral rehearsal-as client-focused alliance increased, the odds of delivering the TN also increased significantly. Future research should further investigate how to appropriately match supervision techniques with supervisory dyads and explore the interplay of alliance with supervision techniques a supervisor might employ.

Applying the Project ECHO Model to Support Implementation and Sustainment of Cognitive Behavioral Therapy for Psychosis

INTRODUCTION

Project Extension for Community Healthcare Outcomes (ECHO) is a teleconsultation model that leverages technology to sustain specialized interventions in underresourced settings. We present the application of the ECHO model to longitudinal training and consultation for community behavioral health providers learning to deliver cognitive behavioral therapy for psychosis, an evidence-based psychotherapy for individuals with psychotic disorders that has poorly penetrated the US mental health system.

METHODS

We analyzed within-group change over practitioners' 6-month ECHO participation cycle using the Expanded Outcomes Framework. We evaluated outcomes associated with participation, satisfaction, knowledge acquisition, performance, patient symptom severity, and functional impairment.

RESULTS

In the first 3 years, the cognitive behavioral therapy for psychosis ECHO Clinics supported 150 providers from 12 community agencies. Forty percent did not complete the 6-month ECHO calendar, most commonly due to separation from their agency. Participants reported high degrees of satisfaction. Declarative and procedural knowledge increased over the 6-month period. Of the 24 providers who received a fidelity review, 87.5% met or exceeded the competency benchmark within the 6-month period. Clinical outcomes reflected reductions in hallucinations, negative symptoms, depression, mania, and functional impairment, but no reductions were detected in delusions, disorganized speech, or abnormal psychomotor behavior.

DISCUSSION

ECHO Clinics offer a mode of providing continuous access to expert instruction, peer-to-peer consultation, and case-based learning that other workforce training models lack. Our evaluation suggests that the ECHO model supports continuous professional development for practitioners, most of whom had indicated inadequate preparation for their role. We observed improved learner and select patient outcomes.

A thematic analysis of broker consultation in a TF-CBT community based learning collaborative

Background

Consultation is an important implementation strategy to increase competence, knowledge, and fidelity to evidence-based practice in community settings. However, the literature has primarily focused on consultation for clinical providers, and less is known about consultation for "broker" professionals, or those who identify and refer children to mental health services. Given their critical role in connecting youth to evidence-based treatment, investigating broker knowledge and use of evidence-based screening and referral are needed.

Objective

To address this gap, the current study examines the content of consultation provided to broker professionals.

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

PURPOSE

Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address.

METHODS

The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session.

RESULTS

Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care.

CONCLUSION

Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

Satisfaction with Telepsychiatry during the COVID-19 pandemic: Patients' and psychiatrists' report from a University Hospital

BACKGROUND

The COVID-19 pandemic has led to important changes in the approach to patients worldwide. Different agencies have proposed and implemented telemedicine-based care services in order to ensure access to health care for all people.

AIM

The aim of this study was to determine the satisfaction of patients using the Telepsychiatry service offered by the Department of Psychiatry of the Hospital de Clínicas (National University of Asunción, Paraguay).

METHODS

A cross sectional and descriptive study has been conducted. Participants were recruited through a phone-based survey. Satisfaction with Telepsychiatry has been measured with an adapted version of a satisfaction survey in Teleneurology. As a complement, psychiatrists from the Hospital de Clínicas were also interviewed about their rate of satisfaction with Telepsychiatry.

RESULTS

A total of 530 patients were included, 51.3% of whom were women. The consultation satisfaction scale ranged between 2.15 and 4.30 with a mean score of 3.02 ± 0.32. Cronbach's alpha for the scale was .897, indicating a good internal consistency. Patients' satisfaction was higher for the perception of Telepsychiatry and lower for the doctor-patient relationship. Of the physicians, 87.5% were satisfied with the Telepsychiatry service.

CONCLUSION

The satisfaction overall score indicates patients' general satisfaction with the quality of care in Telepsychiatry, mainly regarding the perception of health care. and lower satisfaction with the doctor-patient relationship. Nine out of 10 psychiatrists felt satisfied with the Telepsychiatry service and considered that the degree of patient's satisfaction was acceptable during the Telepsychiatry consultation.

Building trusting relationships to support implementation: A proposed theoretical model

This paper presents a theory of change that articulates (a) proposed strategies for building trust among implementation stakeholders and (b) the theoretical linkages between trusting relationships and implementation outcomes. The theory of change describes how trusting relationships cultivate increases in motivation, capability, and opportunity for supporting implementation among implementation stakeholders, with implications for commitment and resilience for sustained implementation, and ultimately, positive implementation outcomes. Recommendations related to the measurement of key constructs in the theory of change are provided. The paper highlights how the development of a testable causal model on trusting relationships and implementation outcomes can provide a bridge between implementation research and implementation practice.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Testing a community developed training protocol for an evidence-based treatment

The implementation of evidence-based treatments (EBTs) in community behavioral health settings is a recommended practice, yet training experienced by community-based clinicians may require novel and creative training methods. The current study focused on creating a training protocol for Alternative for Families: a Cognitive-Behavioral Therapy from both evidence-based foundations and community-based agency feedback to promote better EBT integration into agencies. Twenty-four clinicians from three agencies were trained using a community-informed training protocol. Outcomes for clinician-reports of organizational functioning, self-reports of skill and knowledge, and observational single-subject data of clinician skills were assessed. Minimal improvements were found for clinician skills across self-report and observations. More research on tailoring trainings to meet needs of community agencies and clinicians should be explored to determine best practice in wide-scale implementation efforts.

Knowledge and attitudes of Implementation Support Practitioners-Findings from a systematic integrative review

BACKGROUND

It requires thoughtful planning and work to successfully apply and sustain research-supported interventions like healthcare treatments, social support, or preventive programs in practice. Implementation support practitioners (ISPs) such as facilitators, technical assistance providers, knowledge brokers, coaches or consultants may be involved to actively support the implementation process. This article presents knowledge and attitudes ISPs bring to their work.

METHODS

Building on a previously developed program logic, a systematic integrative review was conducted. Literature was sourced by searching nine electronic data bases, organizational websites, and by launching a call for publications among selected experts and social media. Article screening was performed independently by two researchers, and data from included studies were extracted by members of the research team and quality-assured by the lead researcher. The quality of included RCTs was assessed based on a framework by Hodder and colleagues. Thematic Analysis was used to capture information on knowledge and attitudes of ISPs across the included studies. Euler diagrams and heatmaps were used to present the results.

RESULTS

Results are based on 79 included studies. ISPs reportedly displayed knowledge about the clinical practice they work with, implementation / improvement practice, the local context, supporting change processes, and facilitating evidence-based practice in general. In particular, knowledge about the intervention to be implemented and its target population, specific improvement / implementation methods and approaches, organizational structures and sensitivities, training, and characteristics of (good) research was described in the literature. Seven themes describing ISPs' attitudes were identified: 1) professional, 2) motivated / motivating / encouraging / empowering, 3) empathetic / respectful / sensitive, 4) collaborative / inclusive, 5) authentic, 6) creative / flexible / innovative / adaptive, and 7) frank / direct / honest. Pertaining to a professional attitude, being responsive and focused were the most prevalent indicators across included publications.

CONCLUSION

The wide range and complexity of knowledge and attitudes found in the literature calls for a comprehensive and systematic approach to collaboratively develop a professional role for ISPs across disciplines. Embedding the ISP role in different health and social welfare settings will enhance implementation capacities considerably.

A stepped-wedge randomized trial investigating the effect of the Leadership and Organizational Change for Implementation (LOCI) intervention on implementation and transformational leadership, and implementation climate

BACKGROUND

This study evaluates the Leadership and Organizational Change for Implementation (LOCI) strategy and its effect on implementation leadership, transformational leadership, and implementation climate.

METHODS

A stepped wedge cluster randomized study design enrolling 47 first-level leaders from child- and adult-specialized mental health clinics within Norwegian health trusts across three cohorts. All therapists (n = 790) received training in screening of trauma exposure and posttraumatic stress, and a subgroup of therapists (n = 248) received training in evidence-based treatment methods for posttraumatic stress disorder (PTSD). First-level leaders and therapists completed surveys at baseline, 4, 8-, 12-, 16-, and 20-months assessing leadership and implementation climate. General linear mixed-effects models were used to investigate whether the LOCI strategy would lead to greater therapist-rated scores on implementation leadership, transformational leadership, and implementation climate.

RESULTS

After introducing the LOCI strategy, there was a significant increase in therapist-rated implementation and transformational leadership and implementation climate. The increase was sustained at all measurement time points compared to non-LOCI conditions, which demonstrated a steady decrease in scores before LOCI.

CONCLUSIONS

The LOCI strategy can develop better transformational and implementation leadership skills and contribute to a more positive implementation climate, which may enhance successful EBP implementation. Thus, LOCI can help leaders create an organizational context conducive for effective EBP implementation.

TRIAL REGISTRATION

Retrospectively registered: ClinicalTrials NCT03719651 , 25th of October 2018. The trial protocol can be accessed from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6417075/ .

Intervening for sustainable change: Tailoring strategies to align with values and principles of communities

This paper presents a rationale for tailoring implementation strategies within a values-driven implementation approach. Values-driven implementation seeks to organize implementers around clarifying statements of their shared values in ways that harmonize implementation dynamics related to individual and group mental models, relationships among implementers, and the implementation climate. The proposed approach to tailoring strategies is informed by systems theory and emphasizes the need to focus on both tangible events and behaviors, as well deeper patterns, structures, relationships, and mental models, in order to increase the likelihood of sustaining implementation efforts and improving outcomes for people and communities. We offer for consideration three specific sets of context determinants that are under-represented in the implementation literature and that emerge as especially relevant within a systems approach to identifying and successfully tailoring implementation strategies in the implementation setting including relationships, mental models, and implementation climate.

Strategies that Promote Therapist Engagement in Active and Experiential Learning: Micro-Level Sequential Analysis

Therapists' active learning increases treatment fidelity, but research is needed on supervisory strategies to engage therapists in active learning. This study used sequential analysis to examine consultant behaviors associated with increased and decreased probability of eliciting therapists' active learning. The study included 162 consultation sessions from 27 community therapists implementing Attachment and Biobehavioral Catch-up. Consultants' client discussion, information provision, and modeling were associated with reduced likelihood of active learning. Consultants' questions, engagement in active learning strategies, use of video, and silence were associated with greater likelihood of therapist active learning. These findings inform supervisors' attempts to encourage active learning.

Cognitive Behavioral Intervention for Youth at Risk for Conduct Problems: Future Directions

This article briefly overviews the history of cognitive behavioral intervention (CBI) for children displaying early signs, or actual diagnoses, of conduct disorders. A series of randomized control trials have identified evidence-based CBI programs for children with these behavior problems at various developmental stages from preschool through adolescence. Although it is critically important for the field to disseminate these existing programs as developed, we argue that it is important to also move beyond the existing evidence-based programs. Research should continue to test new comprehensive, multicomponent interventions, fueled by our evolving understanding of active mechanisms that contribute to children's externalizing behavior problems. The future of research in this area can also benefit from a focus on four central issues. First, research can address how single interventions can have meaningful impact on a range of transdiagnostic outcomes because the intervention mechanisms may affect those various outcomes. Second, rooted in implementation science, we are beginning to understand better how evidence-based programs can be disseminated in the real world, examining key issues such as the adequacy of training approaches and the role of therapist and organizational characteristics. Third, a major focus of research can be on how to optimize intervention outcomes, including a focus on microtrials, on tailoring of interventions, on examining rigorously how interventions are delivered, and on the integration of technology and of other approaches such as mindfulness training into CBI. Fourth, research can explore how the therapeutic relationship and the therapists' characteristics can play substantial roles in effective CBI with conduct problem children.

Statewide implementation of child trauma-focused practices using the community-based learning collaborative model

A significant number of youth in the United States experience traumatic events that substantially increase the risk of physical and behavioral health problems across the life span. This public health concern warrants concerted efforts to promote trauma-informed, evidence-based practices that facilitate recovery. Although youth-focused trauma-specific treatments exist, determining effective ways to disseminate and implement these services-so that they are available, accessible, and sustainable-poses an ongoing challenge. This paper describes a comprehensive model for such implementation, the community-based learning collaborative (CBLC), developed as part of Project BEST, a four-phase statewide initiative to promote trauma-focused practices. The CBLC augments the learning collaborative model by including clinical and nonclinical (i.e., broker) professionals from multiple service organizations within a targeted community. CBLCs aim to build capacity for sustained implementation of trauma-focused practices by promoting interprofessional collaboration among those involved in the coordination and provision of these services. This paper describes the iterative development of the CBLC by examining participant completion data across the three completed phases of Project BEST (N = 13 CBLCs; 1,190 participants). Additionally, data from Project BEST's third phase (N = 6 CBLCs; 639 participants) were used to evaluate changes in the frequency of specific practices, pre- to post-CBLC, and post-CBLC perceived utility of CBLC components. High participant completion rates, significant increases in reported trauma-focused practices, and positive ratings of the CBLC's utility provisionally support the feasibility and efficacy of the model's final iteration. Implications for implementation and CBLC improvements are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The Availability of Supervision in Routine Mental Health Care

Clinical supervision is an embedded resource for practice quality in community mental health organizations. Supervision has been found to increase provider competence and decrease stress. In addition, supervision has been associated with service user outcomes including decreased depressive symptoms. However, little is known about the availability and nature of supervision in real world settings. The primary aims of this study were to identify available supervision and the extent to which contextual factors are related to that availability. The data source for this study was a multi-state and multi-site (N=14) NIMH-funded trial survey of providers (N=273). Supervision was measured by hours per week (quantity) and by utilization of best practice activities (content). Univariate, chi-square, independent samples t-tests, and ANOVA analyses were used to assess supervision content and quantity and to examine subgroup differences. Participants reported an average of 2.17 hours of supervision per week and 28.6% of participants endorsed best practice content. Supervision quantity varied significantly across sites (p<.05) and program type (p<.05) while content did not. Individual role within the organization had a significant relationship with reported supervision content (p<.001). In these settings, organizations are exercising discretion in how to utilize supervision within the available time. Supervision time also varied by program type, increasing with the intensity of services. Findings demonstrate that reports of availability vary according to position within the organization and the intensity of services within a given program type. Implications for workforce development, access to quality services, and implementation of evidence-based practices are discussed.

Supervision in Community Mental Health: Understanding Intensity of EBT Focus

The goal of the present study was to examine clinician, supervisor, and organizational factors that are associated with the intensity of evidence-based treatment (EBT) focus in workplace-based clinical supervision of a specific EBT, Trauma-Focused Cognitive Behavioral Therapy (TF-CBT). Supervisors (n = 56) and clinicians (n = 207) from mental health organizations across Washington State completed online self-report questionnaires. Multilevel modeling (MLM) analyses were used to examine the relative influence of nested clinician and supervisor factors on the intensity of EBT focus in supervision. We found that 33% of the variance in clinician report of EBT supervision intensity clustered at the supervisor level and implementation climate was the only significant factor associated with EBT supervision intensity. While individual clinician and supervisor factors may play a role in EBT coverage in supervision, our results suggest that an implementation climate that supports EBT may be the most critical factor for improving intensity of EBT coverage. Thus, implementation efforts that address the extent to which EBTs are expected, rewarded, and supported within an organization may be needed to support greater coverage of EBT during workplace-based supervision.

How Intervention and Implementation Characteristics Relate to Community Therapists' Attitudes Toward Evidence-Based Practices: A Mixed Methods Study

Therapists' perceptions toward evidence-based practices (EBPs) are important in implementation efforts, however little is known about characteristics of EBPs associated with more positive attitudes. This mixed-methods study examined how intervention and implementation characteristics of six EBPs related to therapist attitudes. Quantitative analysis of 793 cross-sectional surveys revealed that therapists endorsed more positive attitudes toward EBPs with (1) prescribed session content and order and (2) required consultation. Associations between these intervention and implementation characteristics and attitudes were not moderated by therapist experience or emotional exhaustion. Qualitative analyses complemented quantitative findings, indicating that "structure" was appealing for interventions and that therapists felt supported by consultation.

The effectiveness of consultation for clinicians learning to deliver motivational interviewing with fidelity

Despite the emerging literature documenting gains in clinician competence following consultation, little empirical work has examined consultation as an implementation strategy. To this end, the present study examined consultation in the context of implementing motivational interviewing in four community child and youth mental health organizations. We used qualitative methods with a dual goal: to describe the consultation process and to explore trainees' perspectives on consultation. Participants included 22 clinicians and 9 supervisors who received monthly, group, phone-based consultation for seven months following training in motivational interviewing. Analyses showed that consultation was perceived as effective because it helped to "keep motivational interviewing alive," fulfilled a profound learning function through collaboration and connection with others, and served as protected time for reflection on practice change. Our findings contribute to a body of knowledge about consultation elements that appear to be effective when implementing research-supported interventions in child and youth mental health.

Clinical Case Consultation and Experiential Learning in Cognitive Behavioral Therapy Implementation: Brief Qualitative Investigation

There has been an increased emphasis on the implementation of cognitive behavioral therapy (CBT) to community mental health (CMH) systems due to its broad efficacy. Previous research has highlighted the importance of ongoing consultation in this process. The current study clarifies the role and process of clinical case consultation in the implementation of CBT to CMH from the consultants' perspective. Trainers from two large-scale implementation initiatives (n = 27) were surveyed regarding their strategies used in the consultation process. Historically, researchers have focused on trainees who view relational variables as the most effective elements of consultation; however, in the current study, trainers perceived experiential learning as being the most effective consultation strategy for helping CMH clinicians learn CBT. Other aspects of consultation such as case conceptualization and practice sample review are discussed in terms of their relative perceived utility in raising CMH clinician's competency to treat comorbid patients.

Best practices in supervising cognitive behavioral therapy with youth

Clinical supervision of cognitive behavioral therapy (CBT) with youth ensures better patient care and fosters trainees' professional development. However, often insufficient attention is directed toward disseminating best practices in supervision of CBT with youth. This Therapeutic Advances contribution aims to communicate the core content of supervision. Additionally, the key supervisory practices associated with CBT with youth are described. Supervisory outcomes are summarized and recommendations for supervisory practices are made.

The good coach: implementation and sustainment factors that affect coaching as evidence-based intervention fidelity support

PURPOSE

Evidence-based interventions (EBIs) for human services unfold within complicated social and organizational circumstances and are influenced by the attitudes and behaviors of diverse stakeholders situated within these environments. Coaching is commonly regarded as an effective strategy to support service providers in delivering EBIs and attaining high levels of fidelity over time. The purpose of this paper is to address a lacuna in research examining the factors influencing coaching, an important EBI support component.

METHODOLOGY

The authors use the Exploration, Preparation, Implementation, and Sustainment framework to consider inner- and outer-context factors that affect coaching over time. This case study of coaching draws from a larger qualitative data set from three iterative investigations of implementation and sustainment of a home visitation program, SafeCare®. SafeCare is an EBI designed to reduce child neglect.

FINDINGS

The authors elaborate on six major categories of findings derived from an iterative data coding and analysis process: perceptions of "good" and "bad" coaches by system sustainment status; coach as peer; in-house coaching capacity; intervention developer requirements vs other outer-context needs; outer- context support; and inner-context support.

PRACTICAL IMPLICATIONS

Coaching is considered a key component for effective implementation of EBIs in public-sector systems, yet is under-studied. Understanding inner- and outer-context factors illuminates the ways they affect the capacity of coaches to support service delivery.

ORIGINALITY

This paper demonstrates that coaching can accomplish more than provision of EBI fidelity support. Stakeholders characterized coaches as operating as boundary spanners who link inner and outer contexts to enable EBI implementation and sustainment.

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess "analogue fidelity" in a children's mental health quality improvement initiative. Results indicated low-but representative-clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

Themes arising in clinical consultation for therapists implementing family-based treatment for adolescents with anorexia nervosa: a qualitative study

BACKGROUND

Our study aims to explore and describe themes arising in sessions of clinical consultation with therapists implementing Family-Based Treatment (FBT) for adolescents with Anorexia Nervosa (AN). There is currently no literature describing the content of clinical consultation for FBT. Thus, this knowledge will add to the evidence-base on what therapists need from consultants in ongoing clinical consultation.

METHODS

Eight therapists at four sites participated in this study, which spanned a two-year period. Following a two-day training workshop, each therapist treated at least one adolescent patient presenting with a restrictive eating disorder with FBT, focusing on adherence to the treatment manual. Clinical consultation sessions occurred monthly and were led by an external FBT expert. Thirty-five (average per site = 9) audio recorded group clinical consultation sessions were transcribed verbatim and coded for themes. Twenty percent of the transcripts were double-coded to ensure consistency. Fundamental qualitative description guided the sampling and data collection.

RESULTS

Thematic content analysis revealed ten common themes relating to the provision of clinical consultation to therapists implementing FBT in clinical practice: encouraging parental meal time supervision,discussing the role of mothers, how to align parents, ensuring parental buy-in, when to transition to Phase 2, weighing the patient and the patients' knowledge of their weight, the role of siblings in FBT sessions, how best to manage patient co-morbidities, the role of the father in FBT and how best to manage the family meal.

CONCLUSIONS

In conclusion, clinical consultation themes aligned with many of the central tenets of FBT, including how to help parents align their supportive approach during the refeeding process, and how to help parents assume control of eating disordered behaviours. This knowledge helps to guide consultants to anticipate common issues brought forward by therapists attempting to implement FBT.

A Non-randomized Comparison of Strategies for Consultation in a Community-Academic Training Program to Implement an Evidence-Based Psychotherapy

Despite the central role of training and consultation in the implementation of evidence-based psychological interventions (EBPIs), comprehensive reviews of research on training have highlighted serious gaps in knowledge regarding best practices. Consultation after initial didactic training appears to be of critical importance, but there has been very little research to determine optimal consultation format or interventions. This observational study compared two consultation formats that included review of session audio and feedback in the context of a program to train clinicians (n = 85) in community mental health clinics to deliver cognitive therapy (CT). A "gold standard" condition in which clinicians received individual feedback after expert consultants reviewed full sessions was compared to a group consultation format in which short segments of session audio were reviewed by a group of clinicians and an expert consultant. After adjusting for potential baseline differences between individuals in the two consultation conditions, few differences were found in terms of successful completion of the consultation phase or in terms of competence in CT at the end of consultation or after a 2 year follow-up. However, analyses did not support hypotheses regarding non-inferiority of the group consultation condition. While both groups largely maintained competence, clinicians in the group consultation condition demonstrated increases in competence over the follow-up period, while a sub-group of those in the individual condition experienced decreases. These findings, if replicated, have important implications for EBP implementation programs, as they suggest that observation and feedback is feasible in community mental health setting, and that employing this method in a group format is an effective and efficient consultation strategy that may enhance the implementation and sustainability of evidence-based psychotherapies.

Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research

Twenty years after Sobell's (1996) influential call to integrate advances in behavior therapy into clinical settings, significant progress has been made in implementation science. In this narrative review, we provide an overview of implementation research findings and highlight recent findings that can inform efforts to bridge the gap between research and practice in mental health service settings. Key findings are summarized, organized according to levels of influence described in two implementation frameworks: The Exploration, Planning, Implementation, and Sustainment Framework (EPIS; Aarons et al., 2011) and the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009). Important levels of influence to consider when implementing new treatments include the outer context, inner context, characteristics of the individual, and characteristics of the innovation. Research on strategies to prepare clinicians to deliver evidence-based psychosocial treatments (EBPTs) and to address contextual barriers to implementation at each level is described, with discussion of implications for the implementation of EBPTs and next steps for research.

The Effect of a Change Agent on Use of Evidence-Based Mental Health Practices

Children's service systems are faced with a critical need to disseminate evidence-based mental health interventions. Despite the proliferation of comprehensive implementation models, little is known about the key active processes in effective implementation strategies. This proof of concept study focused on the effect of change agent interactions as conceptualized by Rogers' diffusion of innovation theory on providers' (N = 57) use of a behavioral intervention in a child welfare agency. An experimental design compared use for providers randomized to training as usual or training as usual supplemented by change agent interactions after the training. Results indicate that the enhanced condition increased use of the intervention, supporting the positive effect of change agent interactions on use of new practices. Change agent types of interaction may be a key active process in implementation strategies following training.

Independent Contractors in Public Mental Health Clinics: Implications for Use of Evidence-Based Practices

OBJECTIVES

Community mental health clinics are increasingly utilizing independent contractors to provide clinical services. At the same time, many organizations are participating in initiatives intended to increase implementation of evidence-based practices (EBPs). The primary aim of this study was to understand the associations of utilizing independent contractors with clinician knowledge and attitudes toward EBPs and organizational culture and climate. The study also sought to understand the potential impact of using independent contractors on mental health services delivery from the perspective of organizational leadership.

METHODS

Quantitative data were collected from 130 therapists in 23 organizations; qualitative data were collected from executive administrators in nine of the 16 organizations participating in EBP initiatives sponsored by the City of Philadelphia. Regression with random effects was used to estimate the associations between worker status (contractor or employee) and clinician attitudes toward EBPs, knowledge of EBPs, and organizational culture and climate. Qualitative inquiry was used to understand the impact of reliance on independent contractors on organizational participation in EBP initiatives.

RESULTS

Independent contractors endorsed less positive attitudes toward EBPs and scored lower on knowledge of EBPs. Interviews revealed four main themes: reasons for using independent contractors, general consequences of using independent contractors, specific impact of independent contractors on participation in EBP initiatives, and suggestions for alternatives.

CONCLUSIONS

A growing number of community mental health clinics rely on independent contractors. There may be consequences of this shift that deserve exploration.

Development and Implementation of a Child Welfare Workforce Strategy to Build a Trauma-Informed System of Support for Foster Care

Effective strategies that increase the extent to which child welfare professionals engage in trauma-informed case planning are needed. This study evaluated two approaches to increase trauma symptom identification and use of screening results to inform case planning. The first study evaluated the impact of training on trauma-informed screening tools for 44 child welfare professionals who screen all children upon placement into foster care. The second study evaluated a two-stage approach to training child welfare workers on case planning for children's mental health. Participants included (a) 71 newly hired child welfare professionals who received a 3-hr training and (b) 55 child welfare professionals who participated in a full-day training. Results from the first study indicate that training effectively increased knowledge and skills in administering screening tools, though there was variability in comfort with screening. In the second study, participants self-reported significant gains in their competency in identifying mental health needs (including traumatic stress) and linking children with evidence-based services. These findings provide preliminary evidence for the viability of this approach to increase the extent to which child welfare professionals are trauma informed, aware of symptoms, and able to link children and youth with effective services designed to meet their specific needs.

Barriers to and Facilitators in the Implementation of Cognitive-Behavioral Therapy for Youth Anxiety in the Community

OBJECTIVE

The study examined, from the perspective of therapists, the barriers to and facilitators in implementing cognitive-behavioral therapy (CBT) for anxious youths in community settings.

METHODS

Fifty therapists (43% of the original training sample of 115 providers) participated in a follow-up interview two years after training and consultation. They reported on barriers to and facilitators in implementation of CBT for youths with anxiety.

RESULTS

Qualitative analyses identified numerous barriers and facilitators, including client factors (for example, motivated clients facilitated the use of CBT, whereas clients with complex issues and numerous psychosocial stressors hindered its use), intervention factors (the structure of CBT helped facilitate its use for some providers, whereas others reported feeling constrained by such structure), and organizational factors (for example, the absence of support within one's institution served as a barrier, whereas supervision supporting the use of CBT facilitated implementation).

CONCLUSIONS

Findings of this implementation trial align with conceptual implementation frameworks and may guide the tailoring of future implementation efforts in order to overcome barriers and maximize facilitators.

Sustaining clinician penetration, attitudes and knowledge in cognitive-behavioral therapy for youth anxiety

Background

Questions remain regarding the sustainment of evidence-based practices following implementation. The present study examined the sustainment of community clinicians’ implementation (i.e., penetration) of cognitive-behavioral therapy, attitudes toward evidence-based practices, and knowledge of cognitive-behavioral therapy for youth anxiety two years following training and consultation in cognitive-behavioral therapy for youth anxiety.

Methods

Of the original 115 participants, 50 individuals (43%) participated in the two-year follow-up. A t- test examined sustainment in penetration over time. Hierarchical linear modeling examined sustainment in knowledge and attitudes over time. Time spent in consultation sessions was examined as a potential moderator of the change in knowledge and attitudes.

Results

Findings indicated sustained self-reported penetration of cognitive-behavioral therapy for anxious youth, with low fidelity to some key CBT components (i.e., exposure tasks). Follow-up knowledge was higher than at baseline but lower than it had been immediately following the consultation phase of the study. Belief in the utility of evidence-based practices was sustained. Willingness to implement an evidence-based practice if required to do so, appeal of evidence-based practices, and openness toward evidence-based practices were not sustained. Participation in consultation positively moderated changes in knowledge and some attitudes.

Conclusions

Sustainment varied depending on the outcome examined. Generally, greater participation in consultation predicted greater sustainment. Implications for future training include higher dosages of consultation.

Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box

There is great interest in the dissemination and implementation of evidence-based treatments and practices for children across schools and community mental health settings. A growing body of literature suggests that the use of one-time workshops as a training tool is ineffective in influencing therapist behavior and patient outcomes and that ongoing expert consultation and coaching is critical to actual uptake and quality implementation. Yet, we have very limited understanding of how expert consultation fits into the larger implementation support system, or the most effective consultation strategies. This commentary reviews the literature on consultation in child mental health, and proposes a set of core consultation functions, processes, and outcomes that should be further studied in the implementation of evidence-based practices for children.

An examination of behavioral rehearsal during consultation as a predictor of training outcomes

The training literature suggests that ongoing support following initial therapist training enhances training outcomes, yet little is known about what occurs during ongoing support and what accounts for its effectiveness. The present study examined consultation sessions provided to 99 clinicians following training in cognitive-behavioral therapy for youth anxiety. Recorded consultation sessions (N = 104) were coded for content and consultative methods. It was hypothesized that behavioral rehearsal (an active learning technique) would predict therapist adherence, skill, self-efficacy, and satisfaction at post-consultation. Regression analyses found no significant relation, however, clinician involvement during consultation sessions positively moderated the relationship between behavioral rehearsals and skill. Implications, limitations, and future directions are discussed.

Show Me, Don't Tell Me: Behavioral Rehearsal as a Training and Analogue Fidelity Tool

Behavioral rehearsal, when a trainee engages in a simulated interaction with another individual, is an underutilized but potentially cost-effective and feasible solution for two difficult questions in implementation science: how to improve training, a commonly used implementation strategy, and how to feasibly measure fidelity using analogue methods in community settings. This paper provides practical information on how to develop and use behavioral rehearsal for both of these purposes to implementation researchers. Therefore, we focus on development and use of behavioral rehearsal as a training and analogue fidelity tool in the context of three illustrative studies.