An examination of behavioral rehearsal during consultation as a predictor of training outcomes

Clinical Consultation During a Trauma-Focused Cognitive Behavioral Therapy Community-Based Learning Collaborative: Examination of Consultation Content, Consultative Strategies, and Provider Engagement

Consultation following evidence-based practice (EBP) training enhances the uptake of EBPs. Yet, little is known about what occurs during consultation, and it is often difficult for providers to engage in consultation. This study examined provider engagement in consultation and the content and strategies used during consultation following training in Trauma-focused Cognitive Behavioral Therapy (TF-CBT) as part of a community-based learning collaborative (CBLC). Minute-to-minute live coding of consultation calls revealed most content was clinically-oriented and the most common strategies used by consultants were didactic in nature. Providers with more years of professional experience and those with greater TF-CBT knowledge attended significantly more consultation calls. Providers with a greater average weekly caseload and providers who were supervisors presented significantly more cases on calls. Providers with greater TF-CBT knowledge spoke significantly more minutes on calls. Consistent with previous work, findings highlight difficulties with provider engagement in consultation and that providers with more baseline expertise are most likely to be engaged. Findings suggest tailoring EBP training efforts to better engage providers at greatest risk for low engagement.

Consultation Content and Techniques for measurement-Based Care Implementation in Youth Community Mental Health Settings

Measurement-based care (MBC) is an evidence-based practice (EBP) focused on regularly administering outcome measures to clients to inform clinical decision making. While MBC shows promise for improving youth treatment outcomes, therapist adoption remains low. Clinical consultation is one strategy that improves MBC implementation, but our limited understanding of consultation hinders the ability to optimize its impact. This research explored the content of, and techniques used during MBC consultation calls. Therapists (N = 55) in a randomized controlled trial treating adolescents with anxiety and/or depression were trained to utilize MBC with usual treatment using the Youth Outcome Questionnaire (YOQ) through an online measurement feedback system (MFS). Weekly ongoing consultation followed an initial workshop training in MBC. Case discussions (N = 294) during consultation calls were coded using a developed codebook, including 12 content and 10 consultant techniques. Results indicated that content focused predominantly on interpretation of client symptom and alliance report, planning for YOQ administration, and discussion of data with clients in session. Common consultant techniques included modeling and eliciting report viewing and interpretation, making clinical suggestions, and didactics about clinical and technical issues. Notably, role-play/behavioral rehearsal was not used. The prevalence of passive consultation techniques (suggestions, didactics) suggests a focus on teaching rather than active techniques (behavioral rehearsal, modeling), potentially influenced by the novelty of MBC and MFS. Technical aspects of MBC, such as measure administration and system usage, emerged as key consultation content, highlighting an unanticipated emphasis on logistics over clinical implementation. These findings underscore the evolving role of consultation in supporting MBC implementation and suggest that addressing technical challenges early in training might enhance adoption.

Training home visitors in mentalization-based practice: A qualitative case study of clinical supervision in mothering from the inside out

Attachment-based interventions are important for improving parent-child outcomes. These interventions must be scaled and made available to under-resourced communities. An important part of scaling these interventions is delineating and reproducing high-quality training, including clinical training which often requires the completion of a supervised case. However, descriptions and guidelines for clinical training are frequently broad or not available in the literature. A detailed description of clinical training could lead to further research to improve the effectiveness and dissemination of evidence-based interventions. Mothering from the Inside Out (MIO) is an attachment-based parenting intervention effective at reducing substance use and depression, improving caregiving, and enhancing child attachment. It is now being brought from research to community settings. This paper outlines the didactic and clinical training components of MIO. We then present a qualitative case study of one community-based counselor participating in the clinical training of MIO and employ qualitative methods to describe the main themes that arose during the training. We aim to illustrate how the trainer assisted the counselor in implementing the core components of MIO, which included (a) refining the language used in MIO sessions, (b) making space to explore mental states, and (c) addressing trauma. We conclude by presenting the implications of these findings.

Self-Coding of Fidelity as a Potential Active Ingredient of Consultation to Improve Clinicians' Fidelity

A key goal for implementation science is the identification of evidence-based consultation protocols and the active ingredients within these protocols that drive clinician behavior change. The current study examined clinicians' self-coding of fidelity as a potential active ingredient of consultation for the Attachment and Biobehavioral Catch-up (ABC) intervention. It also examined two other potential predictors of clinician fidelity in response to consultation: dosage of consultation and working alliance. Twenty-nine clinicians (97% female, 62% White, M age = 34 years) participated in a year of weekly fidelity-focused ABC consultation sessions, for which clinicians self-coded fidelity and received consultant feedback on both their coding and their fidelity. Data from the ABC fidelity measure were available for 1067 sessions coded by consultants, and clinicians' self-coding accuracy was calculated from 1044 sessions coded by both clinicians and consultants. Alliance was measured with the Working Alliance Inventory-Trainee and Supervisor Versions. The study was observational, and fidelity and self-coding accuracy were modeled across time using hierarchical linear modeling. Clinicians' ABC fidelity, as well as their self-coding accuracy, increased over the course of consultation. Clinicians' self-coding accuracy predicted their initial fidelity and growth in fidelity. Working alliance was also linked to fidelity and self-coding accuracy. These results suggest that clinician self-coding should be further examined as an active ingredient of consultation. The study has important implications for the design of consultation procedures and fidelity assessments.

Clinical supervision approach predicts evidence-based trauma treatment delivery in children's mental health

OBJECTIVE

Observational studies of practices used in clinical supervision-as-usual can be leveraged to advance the limited research on workplace-based supervision as an evidence-based treatment (EBT) implementation strategy. This exploratory observational study examined the presence of supervision approaches (comprised of supervision techniques) and whether these predicted clinicians' EBT technique delivery.

METHODS

Participants included 28 supervisors, 70 clinician supervisees, and 60 youth clients and guardians from 17 public mental health organizations. Data included audio recorded supervision-as-usual sessions over 1 year, audio recorded Trauma-focused Cognitive Behavioral Therapy (TF-CBT) treatment sessions with youth for 6 months, and youth-reported post-traumatic stress severity scores. Audio recordings of 438 supervision sessions were coded for session duration and the presence of 13 supervision techniques and intensity of their coverage. Audio recordings of 465 treatment sessions were coded for presence and intensity of coverage of TF-CBT practice elements. Agglomerative hierarchical cluster analysis examined the presence of clusters of supervision technique use, termed supervision approaches. Generalized estimating equations estimated the relation between supervision approaches and delivery of TF-CBT elements.

RESULTS

Two supervision approaches were identified- Supportive-Directive and Supportive- that discriminated between use of five supervision techniques. Clinicians who received a higher proportion of supportive-directive supervision sessions had greater odds of delivering the trauma narrative with a client.

CONCLUSION

Findings suggest that patterns of supervision techniques can be identified and may shape EBT delivery. Supervision approaches show some evidence of being tailored to individual clinicians. Implications for the development of supervision implementation strategies and future directions are discussed.

Stakeholder intention to engage in fidelity measurement methods in community mental health settings: A mixed methods study

Background

The current gold standard for measuring fidelity (specifically, adherence) to cognitive behavioral therapy (CBT) is direct observation, a costly, resource-intensive practice that is not feasible for many community organizations to implement regularly. Recent research indicates that behavioral rehearsal (i.e., role-play between clinician and individual with regard to session delivery) and chart-stimulated recall (i.e., brief structured interview between clinician and individual about what they did in session; clinicians use the client chart to prompt memory) may provide accurate and affordable alternatives for measuring adherence to CBT in such settings, with behavioral rehearsal yielding greater correspondence with direct observation.

Methods

Drawing on established causal theories from social psychology and leading implementation science frameworks, this study evaluates stakeholders’ intention to use behavioral rehearsal and chart-stimulated recall. Specifically, we measured attitudes, self-efficacy, and subjective norms toward using each, and compared these factors across the two methods. We also examined the relationship between attitudes, self-efficacy, subjective norms, and intention to use each method. Finally, using an integrated approach we asked stakeholders to discuss their perception of contextual factors that may influence beliefs about using each method. These data were collected from community-based supervisors ( n = 17) and clinicians ( n = 66).

Results

Quantitative analyses suggest moderately strong intention to use both methods across stakeholders. There were no differences in supervisors’ or clinicians’ attitudes, self-efficacy, subjective norms, or intention across methods. More positive attitudes and greater reported subjective norms were associated with greater reported intention to use either measure. Qualitative analyses identified participants’ specific beliefs about using each fidelity measure in their organization, and results were organized using the Consolidated Framework for Implementation Research.

Conclusions

Strategies are warranted to overcome or minimize potential barriers to using fidelity measurement methods and to further increase the strength of intention to use them. Plain Language Summary: The best way to measure fidelity, or how closely a clinician follows the protocol, to Cognitive Behavioral Therapy (CBT) is watching the session. This is an expensive practice that is not feasible for many community organizations to do regularly. Recent research indicates that behavioral rehearsal, or a role-play between the clinician and individual with regard to session delivery, and chart-stimulated recall, or a brief discussion between an individual and the clinician about what they did in session with the clinician having access to the chart to help them remember, may provide accurate and affordable alternatives for measuring fidelity to CBT. We just completed a study demonstrating that both methods are promising, with behavioral rehearsal offering scores that are the most similar to watching the session. Drawing on established theories from social psychology and leading implementation science frameworks, this study evaluates future supervisor and clinician motivation to use these fidelity measurement methods. Specifically, we measured supervisor (n = 17) and clinician (n = 66) attitudes, norms, self-efficacy, intentions, and anticipated barriers and facilitators to using each of these fidelity measurement tools. Quantitative and qualitative analyses suggest similar intention to use both methods, and concerns about barriers to using each method. Further research is warranted to minimize the burden associated with implementing fidelity measurement methods and deploying strategies to increase use.

Strategies that Promote Therapist Engagement in Active and Experiential Learning: Micro-Level Sequential Analysis

Therapists' active learning increases treatment fidelity, but research is needed on supervisory strategies to engage therapists in active learning. This study used sequential analysis to examine consultant behaviors associated with increased and decreased probability of eliciting therapists' active learning. The study included 162 consultation sessions from 27 community therapists implementing Attachment and Biobehavioral Catch-up. Consultants' client discussion, information provision, and modeling were associated with reduced likelihood of active learning. Consultants' questions, engagement in active learning strategies, use of video, and silence were associated with greater likelihood of therapist active learning. These findings inform supervisors' attempts to encourage active learning.

Provider self-efficacy in delivering evidence-based psychosocial interventions: A scoping review

Background

Among the many variables that affect implementation of evidence-based interventions in real-world settings, self-efficacy is one of the most important factors at the provider level of the social ecology. Yet, research on the construct of provider self-efficacy remains limited.

Objectives

This scoping review was conducted to enhance understanding of the construct of provider self-efficacy and to examine how the construct is defined and measured in the context of implementation of evidence-based mental health interventions.

Design

Online databases were used to identify 190 papers published from 1999 to June of 2018 that included search terms for providers, evidence-based, and self-efficacy. To be eligible for the scoping review, papers needed to focus on the self-efficacy of mental health providers to deliver evidence-based psychosocial interventions. A total of 15 publications were included in the review.

Results

The construct of provider self-efficacy is not clearly defined but is typically described as confidence to deliver a specific intervention or practice. A range of measures are used to assess provider self-efficacy across both provider and intervention types.

Conclusions

Standardized definition and measurement of provider self-efficacy is needed to advance practice and implementation research.

Plain language abstract

Provider self-efficacy is known to influence implementation of evidence-based mental health interventions. However, the ways in which provider self-efficacy is defined and measured in implementation research literature is not well understood; furthermore, it is not clear what types of providers and interventions are represented in this literature. This scoping review adds to current research by revealing that there is no agreed upon definition or measure of provider self-efficacy in the context of implementation of evidence-based interventions, and that the research includes multiple types of providers (e.g., social workers, counselors, psychologists) and interventions. Self-efficacy appears to change as a function of training and support. To further research in this area, a common definition and agreed upon measures of this construct are needed.

Training with tarantulas: A randomized feasibility and acceptability study using experiential learning to enhance exposure therapy training

BACKGROUND

Although exposure is a key evidence-based intervention for anxiety, it is infrequently used in clinical settings. This study employed a novel training strategy, experiential learning, to improve exposure implementation. This study aimed to assess the feasibility and acceptability of experiential training and preliminary training effectiveness.

METHODS

Participants were 28 therapists who were randomized to (a) training-as-usual or (b) experiential training (training-as-usual plus a one-session treatment for fear of spiders). Workshops lasted one day and were followed by three months of weekly consultation.

RESULTS

Experiential training was viewed as feasible and acceptable. Participants, including those who were fearful of spiders, had a positive response to the training and reported it to be useful. There was a significant increase in the number of exposures used by therapists receiving experiential training compared to training-as-usual at 1-month follow-up.

CONCLUSIONS

A one-day training resulted in significant improvements in knowledge, attitudes toward exposure, and self-efficacy in using exposure. Preliminary findings suggest that experiential training resulted in greater use of exposure post-training compared to training-as-usual. Results provide evidence for the feasibility and acceptability of experiential training as a strategy to increase the use of evidence-based interventions.

Are you sitting (un)comfortably? Action-based supervision and supervisory drift

Action-based methods such as behavioural experiments, role-play and (by extension) ‘chairwork’ are powerful techniques recommended in core supervisory texts for cognitive behavioural therapy (CBT). Despite this, experiential methods are seldom used by supervisors, suggesting that supervision often drifts from a ‘doing process’ to a ‘talking process’. A number of factors contribute to this divergence from best practice, including limited confidence and a lack of familiarity with experiential procedures amongst supervisors. To address this, the current paper presents a variety of action-based techniques for enhancing supervisees’ technical, perceptual, interpersonal, reflective and personal competencies. Behavioural experiments, empty-chair, multi-chair and role-playing exercises for maintaining treatment fidelity, enhancing empathic attunement, repairing therapeutic ruptures, resolving impasses and working through negative countertransference are described, amongst others. Further research is needed to establish the nature and extent of supervisory drift, as well as the efficacy of action-based methods.

Key learning aims

As a result of reading this paper, readers should:(1)

Consultation for EMDRIA Certification in EMDR: Best Practices and Challenges

Post-graduate credentials in specific therapeutic models have become more common in recent decades and offer assurance of certain levels of expertise amid increased globalization. Since 1999, the Eye Movement Desensitization and Reprocessing International Association (EMDRIA) and the international EMDR community have worked to establish guidelines and standards for advanced designations in the provision of EMDR therapy. This article focuses on the consultation processes that are outlined in the requirements for clinicians seeking to apply for advanced designations in EMDR therapy. Within the individual and group consultation hours required, consultants operate in several roles, including educator and evaluator, toward addressing the needs of consultees and the requirements put forth by credentialing bodies. The needs of consultees pursuing advanced designations in EMDR therapy include education, documentation of consultation hours and skills attained, and recommendation for the advanced designation. This article provides recommendations and best practices for EMDRIA Approved Consultants who are challenged by the current EMDRIA Certification credentialing process. Challenges with implementation of EMDR Europe's Accredited Practitioner program are also addressed. Strategies are offered to reduce identified ethical concerns surrounding consultation for advanced designations, and to support the integrity of EMDR therapy as an evidence-based treatment model. Building upon the history of the advanced designations within EMDRIA and EMDR Europe, current requirements and the need for research to inform requirements, explicit guidelines, and objective standards are discussed.

Enhancing primary care services for diverse sexual and gender minority populations: a developmental study protocol

INTRODUCTION

Compared with heterosexual, cisgender populations, sexual and gender minority (SGM) people are more likely to suffer from serious health conditions and insufficient access to health services. Primary care is at the frontlines of healthcare delivery; yet, few clinics have resources or mechanisms in place to meet SGM patient needs. This developmental study protocol focuses on reducing health disparities among SGM patients by identifying, adapting and developing SGM practice guidelines/recommendations and implementation strategies for primary care clinics in urban and rural New Mexico. Using input from patients, healthcare advocates and providers, and researchers, the study will pilot a practice parameter and implementation toolkit to promote SGM-specific cultural competence at multiple service delivery levels.

METHODS AND ANALYSIS

We will recruit providers/staff from four Federally Qualified Health Centers (FQHCs) serving ethnically and geographically diverse communities. Incorporating the Implementation of Change Model and an intersectionality perspective, data collection includes a systematic review of SGM-specific practice guidelines/recommendations, focus groups and semistructured interviews, quantitative surveys and the Nominal Group Technique (NGT) with providers/staff. We will categorise guidelines/recommendations identified through the review by shared elements, use iterative processes of open and focused coding to analyse qualitative data from focus groups, interviews and the NGT, and apply descriptive statistics to assess survey data. Findings will provide the foundation for the toolkit. Focus groups with SGM patients will yield supplemental information for toolkit refinement. To investigate changes in primary care contexts following the toolkit's pilot, we will undertake systematic walkthroughs and document review at the FQHCs, analysing these data qualitatively to examine SGM inclusiveness. The structured data-informed Plan-Do-Study-Act method will enable further revision of the toolkit. Finally, focus groups, interviews and quantitative surveys with providers/staff will highlight changes made in the FQHCs to address SGM patient needs, barriers to sustainment of changes, satisfaction, acceptability, usability and feasibility of the toolkit.

ETHICS AND DISSEMINATION

The study has been reviewed and approved by the Pacific Institute for Research and Evaluation Institutional Review Board. Informed consent will be obtained from all participants before their involvement in research activities begins. Study results will be actively disseminated through peer-reviewed journals, conference presentations, social media and the internet, and community/stakeholder engagement activities.

Suicide prevention in community mental health: changing systems

Purpose

This paper aims to describe a performance improvement process related to suicide assessment in a community mental health center. As suicide rates rise in the USA, it is crucial that community mental health providers are capable and comfortable to assess for suicide risk among individuals with mental illness. Support for healthcare providers is emphasized in the quadruple aim model of enhancing healthcare delivery and patient experience. The quadruple aim model is applied in the present performance improvement project in a community mental health center.

Design/methodology/approach

An interprofessional team used provider survey responses, critical incident data and other stakeholder input to implement a new assessment mechanism and education plan to support direct care staff to address suicide risk.

Findings

Although the rate of patient death by suicide at the community mental health center is low, managing risk is a frequent provider concern. Providers’ comfort assessing and managing suicide risk varied widely based on survey responses. A structured suicide assessment process was implemented to offer clarity and direction for providers. Education to address assessment and management was designed and implemented.

Research limitations/implications

Suicide data were retrospective and limited to known deaths, thus there may have been higher numbers of deaths by suicide historically. Providers’ comfort with suicide risk management was based on self-report and future work should also integrate skills-based assessment.

Originality/value

Improving the provider experience in mental health care must be explored. Focusing on provider input and voice in suicide-related efforts in community settings is a step toward integrating the quadruple aim ideals into mental health care.

Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field

BACKGROUND

Scientists have developed evidence-based interventions that improve the symptoms and functioning of youth with psychiatric disorders; however, these interventions are rarely used in community settings. Eliminating this research-to-practice gap is the purview of implementation science, the discipline devoted to the study of methods to promote the use of evidence-based practices in routine care.

METHODS

We review studies that have tested factors associated with implementation in child psychology and psychiatry, explore applications of social science theories to implementation, and conclude with recommendations to advance implementation science through the development and testing of novel, multilevel, causal theories.

RESULTS

During its brief history, implementation science in child psychology and psychiatry has documented the implementation gap in routine care, tested training approaches and found them to be insufficient for behavior change, explored the relationships between variables and implementation outcomes, and initiated randomized controlled trials to test implementation strategies. This research has identified targets related to implementation (e.g., clinician motivation, organizational culture) and demonstrated the feasibility of activating these targets through implementation strategies. However, the dominant methodological approach has been atheoretical and predictive, relying heavily on a set of variables from heuristic frameworks.

CONCLUSIONS

Optimizing the implementation of effective treatments in community care for youth with psychiatric disorders is a defining challenge of our time. This review proposes a new direction focused on developing and testing integrated causal theories. We recommend implementation scientists: (a) move from observational studies of implementation barriers and facilitators to trials that include causal theory; (b) identify a core set of implementation determinants; (c) conduct trials of implementation strategies with clear targets, mechanisms, and outcomes; (d) ensure that behaviors that are core to EBPs are clearly defined; and (e) agree upon standard measures. This agenda will help fulfill the promise of evidence-based practice for improving youth behavioral health.

Implementing evidence-based treatment protocols: Flexibility within fidelity

Efficacious psychological treatments exist for a variety of mental health conditions, but many who could benefit from these treatments do not receive them. Increasing efforts have been made to disseminate effective protocols, and several approaches for implementing such treatments have been proposed, including the use of protocols, principles, practices, and policies. We discuss the relative merits of disseminating protocols, and highlight the importance of employing flexibility within fidelity. We describe the benefits of using protocols, including their empirical support, guidance for decision making, and structure to facilitate training and enhance treatment integrity. We also address several criticisms that have been offered against protocols, citing data that indicates that many of the criticisms are not warranted.

The effectiveness of consultation for clinicians learning to deliver motivational interviewing with fidelity

Despite the emerging literature documenting gains in clinician competence following consultation, little empirical work has examined consultation as an implementation strategy. To this end, the present study examined consultation in the context of implementing motivational interviewing in four community child and youth mental health organizations. We used qualitative methods with a dual goal: to describe the consultation process and to explore trainees' perspectives on consultation. Participants included 22 clinicians and 9 supervisors who received monthly, group, phone-based consultation for seven months following training in motivational interviewing. Analyses showed that consultation was perceived as effective because it helped to "keep motivational interviewing alive," fulfilled a profound learning function through collaboration and connection with others, and served as protected time for reflection on practice change. Our findings contribute to a body of knowledge about consultation elements that appear to be effective when implementing research-supported interventions in child and youth mental health.

Clinical Case Consultation and Experiential Learning in Cognitive Behavioral Therapy Implementation: Brief Qualitative Investigation

There has been an increased emphasis on the implementation of cognitive behavioral therapy (CBT) to community mental health (CMH) systems due to its broad efficacy. Previous research has highlighted the importance of ongoing consultation in this process. The current study clarifies the role and process of clinical case consultation in the implementation of CBT to CMH from the consultants' perspective. Trainers from two large-scale implementation initiatives (n = 27) were surveyed regarding their strategies used in the consultation process. Historically, researchers have focused on trainees who view relational variables as the most effective elements of consultation; however, in the current study, trainers perceived experiential learning as being the most effective consultation strategy for helping CMH clinicians learn CBT. Other aspects of consultation such as case conceptualization and practice sample review are discussed in terms of their relative perceived utility in raising CMH clinician's competency to treat comorbid patients.

Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

BACKGROUND

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

METHODS

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

RESULTS

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

CONCLUSIONS

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

TRIAL REGISTRATION

NCT01800266 , Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results]).

The good coach: implementation and sustainment factors that affect coaching as evidence-based intervention fidelity support

PURPOSE

Evidence-based interventions (EBIs) for human services unfold within complicated social and organizational circumstances and are influenced by the attitudes and behaviors of diverse stakeholders situated within these environments. Coaching is commonly regarded as an effective strategy to support service providers in delivering EBIs and attaining high levels of fidelity over time. The purpose of this paper is to address a lacuna in research examining the factors influencing coaching, an important EBI support component.

METHODOLOGY

The authors use the Exploration, Preparation, Implementation, and Sustainment framework to consider inner- and outer-context factors that affect coaching over time. This case study of coaching draws from a larger qualitative data set from three iterative investigations of implementation and sustainment of a home visitation program, SafeCare®. SafeCare is an EBI designed to reduce child neglect.

FINDINGS

The authors elaborate on six major categories of findings derived from an iterative data coding and analysis process: perceptions of "good" and "bad" coaches by system sustainment status; coach as peer; in-house coaching capacity; intervention developer requirements vs other outer-context needs; outer- context support; and inner-context support.

PRACTICAL IMPLICATIONS

Coaching is considered a key component for effective implementation of EBIs in public-sector systems, yet is under-studied. Understanding inner- and outer-context factors illuminates the ways they affect the capacity of coaches to support service delivery.

ORIGINALITY

This paper demonstrates that coaching can accomplish more than provision of EBI fidelity support. Stakeholders characterized coaches as operating as boundary spanners who link inner and outer contexts to enable EBI implementation and sustainment.

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess "analogue fidelity" in a children's mental health quality improvement initiative. Results indicated low-but representative-clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

Building an Evidence Base for Effective Supervision Practices: An Analogue Experiment of Supervision to Increase EBT Fidelity

Treatments that are efficacious in research trials perform less well under routine conditions; differences in supervision may be one contributing factor. This study compared the effect of supervision using active learning techniques (e.g. role play, corrective feedback) versus "supervision as usual" on therapist cognitive restructuring fidelity, overall CBT competence, and CBT expertise. Forty therapist trainees attended a training workshop and were randomized to supervision condition. Outcomes were assessed using behavioral rehearsals pre- and immediately post-training, and after three supervision meetings. EBT knowledge, attitudes, and fidelity improved for all participants post-training, but only the SUP+ group demonstrated improvement following supervision.

Examining adherence to components of cognitive-behavioral therapy for youth anxiety after training and consultation

The present study examined 115 service providers' adherence to components of cognitive-behavioral therapy (CBT) for youth anxiety prior to training, post workshop training, and after three months of weekly consultation. Adherence was measured using a role-play with a trained actor. We examined differences in individual adherence to CBT components across time and the relationship between number of consultation sessions attended and adherence ratings following consultation. Findings indicated that somatic arousal identification and relaxation were the most used treatment components prior to training. Adherence to all components of CBT increased following workshop training, except the usage of problem-solving. Adherence to problem-solving, positive reinforcement, the identification of anxious self-talk, and the creation of coping thoughts increased following consultation but usage of problem-solving remained low compared to other treatment components. Overall adherence remained less than optimal at the final measurement point. Number of consultation sessions attended predicted post-consultation adherence to identification of somatic arousal, identification of anxious self-talk, and positive reinforcement. Implications include tailoring future training based on baseline levels of adherence and spending more time during training and consultation on underutilized CBT components, such as problem-solving. Limitations of the present study, including how adherence was measured, are discussed. This study adds to the implementation science literature by providing more nuanced information on changes in adherence over the course of training and consultation of service providers.

Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research

Twenty years after Sobell's (1996) influential call to integrate advances in behavior therapy into clinical settings, significant progress has been made in implementation science. In this narrative review, we provide an overview of implementation research findings and highlight recent findings that can inform efforts to bridge the gap between research and practice in mental health service settings. Key findings are summarized, organized according to levels of influence described in two implementation frameworks: The Exploration, Planning, Implementation, and Sustainment Framework (EPIS; Aarons et al., 2011) and the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009). Important levels of influence to consider when implementing new treatments include the outer context, inner context, characteristics of the individual, and characteristics of the innovation. Research on strategies to prepare clinicians to deliver evidence-based psychosocial treatments (EBPTs) and to address contextual barriers to implementation at each level is described, with discussion of implications for the implementation of EBPTs and next steps for research.

Model-Consistent Cognitive Behavioral Therapy Supervision: A Case Study of a Psychotherapy-Based Approach

There is a great need for training in cognitive behavioral therapy (CBT) for community clinicians who work in public mental health systems where resources are low and demands are high. Researchers have found that simply attending intensive CBT workshops will not result in adherent or competent CBT being delivered, rather ongoing CBT supervision/consultation has been found to be associated with the best training outcomes. Psychotherapy-based approaches to supervision have recently received some attention for their value in providing experiential learning. What follows is a case example of a community clinician who had little previous training in CBT and following an intensive training and 16 weeks of CBT supervision had substantial gains in her CBT adherence and competency ratings. Recommendations such as the value of experiential learning are discussed.

Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety?

Among the challenges facing the mental health field are the dissemination and implementation of evidence-based practices. The present study investigated the relationships between inner context variables (i.e., adopter characteristics and individual perceptions of intra-organizational factors) and two implementation outcomes-independently rated therapist fidelity on a performance-based role-play (i.e., adherence and skill) and self-reported penetration of cognitive behavioral therapy for youth anxiety following training. A significant relationship was found between inner context variables and fidelity. Specifically, adopter characteristics were associated with adherence and skill; individual perceptions of intra-organizational factors were associated with adherence. Inner context variables were not associated with penetration. Future directions are discussed.

Sustaining clinician penetration, attitudes and knowledge in cognitive-behavioral therapy for youth anxiety

Background

Questions remain regarding the sustainment of evidence-based practices following implementation. The present study examined the sustainment of community clinicians’ implementation (i.e., penetration) of cognitive-behavioral therapy, attitudes toward evidence-based practices, and knowledge of cognitive-behavioral therapy for youth anxiety two years following training and consultation in cognitive-behavioral therapy for youth anxiety.

Methods

Of the original 115 participants, 50 individuals (43%) participated in the two-year follow-up. A t- test examined sustainment in penetration over time. Hierarchical linear modeling examined sustainment in knowledge and attitudes over time. Time spent in consultation sessions was examined as a potential moderator of the change in knowledge and attitudes.

Results

Findings indicated sustained self-reported penetration of cognitive-behavioral therapy for anxious youth, with low fidelity to some key CBT components (i.e., exposure tasks). Follow-up knowledge was higher than at baseline but lower than it had been immediately following the consultation phase of the study. Belief in the utility of evidence-based practices was sustained. Willingness to implement an evidence-based practice if required to do so, appeal of evidence-based practices, and openness toward evidence-based practices were not sustained. Participation in consultation positively moderated changes in knowledge and some attitudes.

Conclusions

Sustainment varied depending on the outcome examined. Generally, greater participation in consultation predicted greater sustainment. Implications for future training include higher dosages of consultation.

Consultation as an implementation strategy for evidence-based practices across multiple contexts: unpacking the black box

There is great interest in the dissemination and implementation of evidence-based treatments and practices for children across schools and community mental health settings. A growing body of literature suggests that the use of one-time workshops as a training tool is ineffective in influencing therapist behavior and patient outcomes and that ongoing expert consultation and coaching is critical to actual uptake and quality implementation. Yet, we have very limited understanding of how expert consultation fits into the larger implementation support system, or the most effective consultation strategies. This commentary reviews the literature on consultation in child mental health, and proposes a set of core consultation functions, processes, and outcomes that should be further studied in the implementation of evidence-based practices for children.

Therapists perspectives on the effective elements of consultation following training

Consultation is an effective implementation strategy to improve uptake of evidence-based practices for youth. However, little is known about what makes consultation effective. The present study used qualitative methods to explore therapists perspectives about consultation. We interviewed 50 therapists who had been trained 2 years prior in cognitive-behavioral therapy for child anxiety. Three themes emerged regarding effective elements of consultation: (1) connectedness with other therapists and the consultant, (2) authentic interactions around actual cases, and (3) the responsiveness of the consultant to the needs of individual therapists. Recommendations for the design of future consultation endeavors are offered.