Proposing a Mechanistic Model of Clinician Training and Consultation

Practitioner Adherence and Competence in MEYA, a Free Online Self-Instruction Program in Modular Psychotherapy and Counseling for Children's Autism-Related Clinical Needs

The quality of care in public schools and other community settings for school-aged youths on the autism spectrum is variable and often not evidence-based. Training practitioners in these settings to deliver evidence-based practices (EBPs) may improve the quality of care. We developed a free internet-based training and clinical guidance system synthesizing multiple EBPs for youth on the autism spectrum addressing a range of mental health needs and autism-related behaviors, entitled Modular EBPs for Youth on the Autism Spectrum (MEYA; meya.ucla.edu). A multiple baseline study was conducted with seven practitioners recruited from mental health practice settings across the United States who were providing services to children on the autism spectrum (aged 6 to 17 years). Practitioners were randomly assigned to undergo baseline conditions of 2 to 8 weeks. Once online training in MEYA commenced, practitioners engaged in algorithm-guided self-instruction in EBPs for autism. Participants video-recorded sessions. Independent coders used the MEYA Fidelity Scale (MEYA-FS) to rate adherence and competence in EBPs for autism. Practitioners also completed measures pertaining to implementation outcomes and parents rated youth outcomes on personalized target behaviors. Five of seven practitioners increased their adherence to MEYA practices (i.e., MEYA-FS scores) following MEYA training. Findings for competence were similar, though somewhat less robust. Practitioners generally viewed MEYA as feasible, understandable, and acceptable. Most youth outcomes improved during MEYA. A randomized, controlled trial of MEYA would be helpful in characterizing its effectiveness for supporting practitioner EBP implementation and youth outcomes in school and community service settings.

Consultation as an Implementation Strategy to Increase Fidelity of Measurement-Based Care Delivery in Community Mental Health Settings: An Observational Study

Regularly administering outcome measures to clients to inform clinical decision making, referred to as measurement-based care (MBC), has the potential to improve mental health treatment due to its applicability across disorders and treatment settings. Given the utility of MBC, understanding predictors of high-fidelity MBC implementation is important. Training and consultation are widely used implementation strategies to increase the fidelity of evidence-based practice delivery but have rarely been studied with MBC. The current study will examine the relationship between time clinicians spent discussing a case in consultation ("dosage") and MBC fidelity. Thirty clinicians and 56 youth were in the MBC condition of a randomized controlled trial and completed baseline questionnaires. Consultation dosage was extracted from call notes. MBC fidelity was measured using the implementation index, which combines rates of administering and viewing questionnaires, using objective data from the online MBC system. Multi-level modeling was used. Greater consultation dosage significantly predicted a higher implementation index (ß = 0.27, SE = 0.06, p < .001). For every 30 min spent discussing a case in consultation, the case's MBC fidelity increased by 8.1%. Greater consultation dosage significantly predicted higher rates of administration (ß = 0.07, SE = 0.03, p = 0.033) and feedback report viewing (ß = 0.24, SE = 0.06, p < .001). More consultation at the case level predicts greater MBC fidelity using objective measures. The greatest impact was increasing the clinician feedback report viewing rate. The results of this study can help inform future efforts to increase the fidelity with which MBC is delivered and to make consultation as efficient and effective as possible.

Pilot Trial of Online Measurement Training and Feedback in Family Therapy for Adolescent Behavior Problems

OBJECTIVE

Pragmatic procedures for sustaining high-fidelity delivery of evidence-based interventions are needed to support implementation in usual care. This study tested an online therapist training system, featuring observational coder training and self-report fidelity feedback, to promote self-report acumen and routine use of family therapy (FT) techniques for adolescent behavior problems.

METHOD

Therapists (N = 84) from nine substance use and mental health treatment sites reported on 185 adolescent clients. Therapists submitted baseline data on FT technique use with clients, completed a workshop introducing the 32-week training system, and were randomly assigned by site to Core Training versus Core Training + Consultation. Core Training included a therapist coder training course (didactic instruction and mock session coding exercises in 13 FT techniques) and fidelity feedback procedures depicting therapist-report data on FT use. Consultation convened therapists and supervisors for one-hour monthly sessions with an external FT expert. During the 32 weeks of training, therapists submitted self-report data on FT use along with companion session audiotapes subsequently coded by observational raters.

RESULTS

Therapist self-report reliability and accuracy both increased substantially during training. Observers reported no increase over time in FT use; therapists self-reported a decrease in FT use, likely an artifact of their improved self-report accuracy. Consultation did not enhance therapist self-report acumen or increase FT use.

CONCLUSIONS

Online training methods that improve therapist-report reliability and accuracy for FT use may confer important advantages for treatment planning and fidelity monitoring. More intensive and/or different training interventions appear needed to increase routine FT delivery.

Examining provider decisions around the delivery and adaptation of a parent-mediated intervention within an Early Intervention system

LAY ABSTRACT

Parent-mediated interventions are an evidence-based practice for autism in which providers support caregivers in learning and applying strategies that support their child's development. Research has begun to study whether parent-mediated interventions can be effectively delivered in Part C Early Intervention systems. This research has been promising; however, it has been difficult to determine how Early Intervention providers deliver and adapt parent-mediated interventions to meet the needs of the families they serve. Examining how parent-mediated interventions are delivered and adapted may help us understand whether parent-mediated interventions are a good fit in these systems. The current study examined the delivery of an evidence-based parent-mediated intervention, Project ImPACT, when delivered by providers within an Early Intervention system. Results from 24 Early Intervention providers demonstrated that, on average, providers delivered Project ImPACT with higher quality during their time in training and consultation. However, there was also variability in how providers delivered Project ImPACT, with some delivering the program inconsistently, some increasing their quality throughout consultation, and others having consistently high-quality delivery. In addition, qualitative data demonstrated that a variety of events arose within Project ImPACT sessions that drove providers to adapt the program. Results suggest the importance of carefully examining how and why providers deliver evidence-based interventions within Early Intervention systems.

Therapists' Perceived Competence in Delivering Trauma-Focused Cognitive Behavioral Therapy During Statewide Learning Collaboratives

The learning collaborative (LC), a multi-component training and implementation model, is one promising approach to address the need for increased availability of trauma-focused evidence-based practices. The current study used data from four cohorts of a statewide LC on Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) to 1) evaluate pre- to post-LC changes in therapists' perceived competence in delivering TF-CBT and 2) explore therapist and contextual factors related to therapists' perceived TF-CBT competence. Therapists (N = 237) completed pre- and post-LC measures of practice information, interprofessional collaboration, organizational climate, and TF-CBT knowledge, perceived competence, and use. Findings indicated therapists' perceived TF-CBT competence significantly increased, pre- to post-LC (d = 1.31), with greater use of trauma-focused practices at pre-training and more TF-CBT training cases completed predicting greater pre- to post-LC gains in perceived TF-CBT competence. These findings highlight the need to assist therapists in identifying and completing training cases to promote competence and implementation.

Practice Makes Proficient: Evaluation of Implementation Fidelity Following COMPASS Consultation Training

Objective

To test a training package for COMPASS, a multi-level consultation and coaching intervention for improved educational outcomes of students with ASD.

Method

Using a Hybrid Type 3 design with emphasis on implementation and a multidimensional approach to evaluating implementation outcomes, we tested a training package with community-based consultant trainees (CTs) unfamiliar with COMPASS and evaluated acceptance, appropriateness, feasibility, and fidelity from multiple sources (trainees, teachers, and parents).

Results

Results confirm that COMPASS-naïve CTs can be successfully trained. At least one feedback session was needed to achieve proficiency. Initial fidelity ratings between researchers and CTs were disparate suggesting self-report may not be adequate. Four feedback opportunities were required to achieve proficiency in writing intervention plans, an activity particularly challenging for CTs. Teachers and parents perceived COMPASS as acceptable, appropriate, and feasible. CTs knowledge of EBPs increased significantly following training; however, positive attitudes toward EBPs did not.

Conclusions

The implementation outcomes suggest that the training package was effective for training CTs; however, additional practice with writing intervention plans is warranted.

Implementing Trauma-Informed Care Through a Learning Collaborative: A Theory-Driven Analysis of Sustainability

This study investigated the sustainability of a multi-agency 15-month Learning Collaborative (LC) for implementing trauma-informed care in 23 rural Pennsylvania counties. Provider agencies (N = 22) were assessed three years following completion of the LC. Sustained trauma-informed practices were assessed through criteria indicating organizational achievement as a trauma-informed care center. A theoretical model of clinical training was applied to determine the extent to which training- and skill-related factors were associated with sustained trauma-informed care. Three years after the LC, trauma symptom screening rates and staff training improvements were sustained, while staff confidence in delivering trauma-informed care worsened across time. Sustained trauma-informed care was associated with implementation milestone completion and third-party ratings of quality improvement skills during the LC. Building capacity for organizational change through training and skill development during active phases of implementation is important for sustained trauma informed care in behavioral health service.

What is the Status of Multi-Informant Treatment Fidelity Research?

OBJECTIVE

The precise measurement of treatment fidelity (quantity and quality in the delivery of treatment strategies in an intervention) is essential for intervention development, evaluation, and implementation. Various informants are used in fidelity assessment (e.g., observers, practitioners [clinicians, teachers], clients), but these informants often do not agree on ratings. This scoping review aims to ascertain the state of science around multi-informant assessment of treatment fidelity.

METHOD

A literature search of articles published through December 2021 identified 673 articles. Screening reduced the number of articles to 44, and the final study set included 35 articles.

RESULTS

There was substantial variability across studies regarding study design, how fidelity was operationalized, and how reliability was defined and assessed. Most studies evaluated the agreement between independent observers and practitioner-report, though several other informant pairs were assessed. Overall, findings suggest that concordance across fidelity informants was low to moderate, with a few key exceptions.

CONCLUSIONS

It is difficult to draw clear conclusions about the degree to which single versus multiple informant assessment is needed to produce an accurate and complete picture of treatment fidelity. The field needs to take steps to determine how to leverage multi-informant assessment to accurately assess treatment fidelity.

Implementing Evidence-Based Mental-Health Treatments: Attending to Training, Fidelity, Adaptation, and Context

This article provides a very high-level overview of some key considerations in the field of implementation science as it relates to clinical psychology. The article reviews recent findings regarding treatment fidelity, adaptation of treatments, and clinical outcomes. It then details some recent findings on training therapists to provide evidence-based therapies as they were designed to be delivered, with sufficient skill and adaptations if needed to ensure better fit for clients who receive treatments in different treatment settings. Finally, the article considers implications for implementing and sustaining new treatments and supporting their fidelity and adaptation, as well as key directions for future research.

Developing the Workforce of the Digital Future: Leveraging Technology to Train Community-Based Mobile Mental Health Specialists

Challenges in training, dissemination, and implementation have impeded the ability of providers to integrate promising digital health tools in real-world services. There is a need for generalizable strategies to rapidly train real-world providers at scale to support the adoption of digital health. This study describes the development of principles guiding rapid training of community-based clinicians in the support of digital health. This training approach was developed in the context of an ongoing trial examining implementation strategies for FOCUS, a mobile mental health intervention designed for people with serious mental illness. The SAIL (Simple, Accessible, Inverted, Live) model introduces how digital tools can be leveraged to facilitate rapid training of community agency-based personnel to serve as digital mental health champions, promoters, and providers. This model emphasizes simple and flexible principles of intervention delivery, accessible materials in a virtual learning environment, inverted or "flipped" live training structure, and live consultation calls for ongoing support. These initial insights lay the groundwork for future work to test and replicate generalizable training strategies focused on real-world delivery of digital mental health services. These strategies have the potential to remove key obstacles to the implementation and dissemination of digital health interventions for mental health.

To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth

Mental health organizations that serve youth are under pressure to adopt measurement-based care (MBC), defined as the continuous collection of client-report data used to support clinical decision-making as part of standard care. However, few frameworks exist to help leadership ascertain how to select an MBC approach for a clinical setting. This paper seeks to define how an MBC approach can display clinical utility to provide such a framework. Broadly, we define clinical utility as evidence that an MBC approach assists stakeholders in fulfilling clinical goals related to care quality (i.e., improve client-clinician alliance and clinical outcomes) at the client (i.e., youth and caregiver), clinician, supervisor, and administrator levels. More specifically, our definition of clinical utility is divided into two categories relevant to the usability and usefulness of an MBC approach for a specific setting: (a) implementability (i.e., evidence indicating ease of use in a clinical setting) and (b) usefulness in aiding clinical activities (i.e., evidence indicating the potential to improve communication and make clinical activities related to care quality easier or more effective). These categories provide valuable information about how easy an MBC approach is to use and the potential benefits that the MBC data will confer. To detail how we arrived at this definition, we review prior definitions of clinical utility, discuss how previous definitions inform our definition of clinical utility for MBC, and provide examples of how the concept of clinical utility can be applied to MBC. We finish with a discussion of future research directions.

Self-Coding of Fidelity as a Potential Active Ingredient of Consultation to Improve Clinicians' Fidelity

A key goal for implementation science is the identification of evidence-based consultation protocols and the active ingredients within these protocols that drive clinician behavior change. The current study examined clinicians' self-coding of fidelity as a potential active ingredient of consultation for the Attachment and Biobehavioral Catch-up (ABC) intervention. It also examined two other potential predictors of clinician fidelity in response to consultation: dosage of consultation and working alliance. Twenty-nine clinicians (97% female, 62% White, M age = 34 years) participated in a year of weekly fidelity-focused ABC consultation sessions, for which clinicians self-coded fidelity and received consultant feedback on both their coding and their fidelity. Data from the ABC fidelity measure were available for 1067 sessions coded by consultants, and clinicians' self-coding accuracy was calculated from 1044 sessions coded by both clinicians and consultants. Alliance was measured with the Working Alliance Inventory-Trainee and Supervisor Versions. The study was observational, and fidelity and self-coding accuracy were modeled across time using hierarchical linear modeling. Clinicians' ABC fidelity, as well as their self-coding accuracy, increased over the course of consultation. Clinicians' self-coding accuracy predicted their initial fidelity and growth in fidelity. Working alliance was also linked to fidelity and self-coding accuracy. These results suggest that clinician self-coding should be further examined as an active ingredient of consultation. The study has important implications for the design of consultation procedures and fidelity assessments.

The impact of implementation climate on community mental health clinicians’ attitudes toward exposure: An evaluation of the effects of training and consultation

Background:

Most evidence-based treatments (EBTs) for posttraumatic stress disorder (PTSD) and anxiety disorders include exposure; however, in community settings, the implementation of exposure lags behind other EBT components. Clinician-level determinants have been consistently implicated as barriers to exposure implementation, but few organizational determinants have been studied. The current study examines an organization-level determinant, implementation climate, and clinician-level determinants, clinician demographic and background factors, as predictors of attitudes toward exposure and changes in attitudes following training.

Method:

Clinicians (n = 197) completed a 3-day training with 6 months of twice-monthly consultation. Clinicians were trained in cognitive behavioral therapy (CBT) for anxiety, depression, behavior problems, and trauma-focused CBT (TF-CBT). Demographic and background information, implementation climate, and attitudes toward exposure were assessed in a pre-training survey; attitudes were reassessed at post-consultation. Implementation climate was measured at the aggregated/group-level and clinician-level.

Results:

Attitudes toward exposure significantly improved from pre-training to post-consultation (t(193) = 9.9, p < .001; d = 0.71). Clinician-level implementation climate scores did not predict more positive attitudes at pre-training (p > .05) but did predict more positive attitudes at post-consultation (ß = −2.46; p < .05) and greater changes in those attitudes (ß = 2.28; p < .05). Group-level implementation climate scores did not predict attitudes at pre-training, post-consultation, or changes in attitudes (all ps > .05). Higher frequency of self-reported CBT use was associated with more positive attitudes at pre-training (ß = −0.81; p < .05), but no other clinician demographic or background determinants were associated with attitudes at post-consultation (all p > .05) or with changes in attitudes (all p > .05).

Conclusions:

Clinician perceptions of implementation climate predicted greater improvement of attitudes toward exposure following EBT training and consultation. Findings suggest that organizational determinants outside of training impact changes in clinicians’ attitudes. Training in four EBTs, only two of which include exposure as a component, resulted in positive changes in clinicians’ attitudes toward exposure, which suggests non-specialty trainings can be effective at changing attitudes, which may enable scale-up.

Exposure is highly effective for treating trauma symptoms and anxiety-based disorders, but it is not commonly used in community mental health settings. Clinicians who endorsed higher expectations, support, and rewards for using exposure in their agency had more positive attitudes toward exposure after training and consultation. Additionally, clinicians who endorsed that exposure is expected, supported, and rewarded in their agency showed a greater improvement in attitudes throughout the training process. Organizational culture can affect clinicians’ attitude changes in the training process, and therefore should become a focus of training efforts.

Online Training of Community Therapists in Observational Coding of Family Therapy Techniques: Reliability and Accuracy

A foundational strategy to promote implementation of evidence-based interventions (EBIs) is providing EBI training to therapists. This study tested an online training system in which therapists practiced observational coding of mock video vignettes demonstrating family therapy techniques for adolescent behavior problems. The study compared therapists ratings to gold-standard scores to measure therapist reliability (consistency across vignettes) and accuracy (approximation to gold scores); tested whether reliability and accuracy improved during training; and tested therapist-level predictors of overall accuracy and change in accuracy over time. Participants were 48 therapists working in nine community behavioral health clinics. The 32-exercise training course provided online instruction (about 15 min/week) in 13 core family therapy techniques representing three modules: Family Engagement, Relational Orientation, Interactional Change. Therapist reliability in rating technique presence (i.e., technique recognition) remained moderate across training; reliability in rating extensiveness of technique delivery (i.e., technique judgment) improved sharply over time, from poor to good. Whereas therapists on average overestimated extensiveness for almost every technique, their tendency to give low-accuracy scores decreased. Therapist accuracy improved significantly over time only for Interactional Change techniques. Baseline digital literacy and submission of self-report checklists on use of the techniques in their own sessions predicted coding accuracy. Training therapists to be more reliable and accurate coders of EBI techniques can potentially yield benefits in increased EBI self-report acumen and EBI use in daily practice. However, training effects may need to improve from those reported here to avail meaningful impact on EBI implementation.Trial Registration: The parent clinical trial is registered at www.ClinicalTrials.gov , ID: NCT03342872 (registration date: 11.10.17).

A Glimpse into the "Black Box": Which Elements of Consultation in an EBP are Associated with Client Symptom Change and Therapist Fidelity?

Background: Consultation is an implementation strategy that improves delivery and clinical outcomes for Cognitive Processing Therapy (CPT), an evidence-based practice (EBP) for posttraumatic stress disorder (PTSD). However, little is known about the specific components of consultation that influence the fidelity of treatment delivery or clinical outcomes. Methods: The current study examined whether specific activities performed during CPT consultation meetings were associated with better fidelity to the CPT protocol among 60 newly trained therapists or improved clinical outcomes among 135 clients treated by these therapists. Consultation activities that fall under three broad categories (discussion of the application of CPT to individual cases, review/feedback on fidelity, and technical difficulties) were measured by consultant checklists for each consultation session. Treatment fidelity (adherence to the protocol and competence of delivery) was rated by trained observers for a random sample of therapists' CPT sessions following consultation. The self-reported PTSD Checklist-IV assessed PTSD symptom change. Results: Multilevel regression analyses indicated that higher therapist consultation attendance predicted a greater decrease in their clients' PTSD symptoms and that attendance was not associated with observer-rated treatment fidelity. Discussion of the application of specific CPT strategies was the only consultation activity that was significantly associated with greater improvement in PTSD symptoms. Lastly, no consultation activities were significantly associated with treatment fidelity. Conclusions: Our findings suggest that specific consultation strategies such as emphasizing the discussion of the application of specific CPT strategies to individual cases during consultation meetings may be effective in improving the clinical outcomes of CPT.

Changes in Community Clinicians' Attitudes and Competence following a Transdiagnostic Cognitive Behavioral Therapy Training

Background

Although the literature suggest that attitudes toward evidence-based practices (EBPs) are associated with provider use of EBPs, less is known about the association between attitudes and how competently EBPs are delivered. This study examined how initial attitudes and competence relate to improvements in attitudes and competence following EBP training.

Methods

Program evaluation data was collected during implementation of an EBP in a large community mental health network. Clinicians (N=891) received intensive training in cognitive behavioral therapy followed by six months of consultation. Attitudes were assessed using the Evidence-Based Practice Attitude Scale, and competence was assessed using the Cognitive Therapy Rating Scale. Data were analyzed by fitting three latent change score models to examine the relationship between changes in attitudes and competence across the training and within its two phases (workshop phase, consultation phase).

Results

Latent change models identified significant improvement in attitudes (Ms _latent change≥1.03, SEs≤ 0.18, zs≥6.55, ps< .001) and competence (Ms _{latent change} ≥14.16, SEs≤3.10, zs≥2.82, ps<.001) across the full training and in each phase. Higher pre-workshop attitudes predicted significantly greater change in competence in the workshop and across training (bs≥1.62, SEs≤0.90, z≥1.09, p<.04, β≥0.10); however, contrary to our hypothesis, post-workshop attitudes did not significantly predict change in competence in consultation (b=1.62, SE=0.86, z=1.87, p=.06, β=0.09). Change in attitudes and change in competence in the training period and within the two phases were not significantly correlated.

Conclusions

Results indicate that pre-training attitudes about EBPs present a target for implementation interventions, given their relation to changes in both attitudes and competence throughout training. Following participation in in itial training workshops, other factors such as subjective norms, implementation culture, or system-level policy shifts may be more predictive of change in competence through consultation.

Core Elements of CBT for Adolescent Conduct and Substance Use Problems: Comorbidity, Clinical Techniques, and Case Examples

Adolescent externalizing problems (AEPs), including serious conduct problems, delinquency, and substance misuse, are the most common adolescent behavioral issues in specialty care. High rates of comorbidity between conduct and substance use problems necessitate multidomain treatment strategies that can effectively address the AEP spectrum. One strategy to increase delivery of evidence-based interventions for multiproblem youth in usual care is to focus on core elements of empirically supported treatments that can be judiciously applied to clients presenting with diverse clinical profiles. This article describes six core practice elements of the cognitive-behavioral treatment (CBT) approach for AEPs: (1) Functional Analysis of Behavior Problems; (2) Prosocial Activity Sampling; (3) Cognitive Monitoring and Restructuring; (4) Emotion Regulation Training; (5) Problem-solving Training; (6) Communication Training. Integrated delivery of these core CBT elements is illustrated in two case examples, and implications for treatment planning for youth with AEPs are discussed.

Implementation support practitioners - a proposal for consolidating a diverse evidence base

BACKGROUND

Workforce development for implementation practice has been identified as a grand challenge in health services. This is due to the embryonic nature of the existing research in this area, few available training programs and a general shortage of frontline service staff trained and prepared for practicing implementation in the field. The interest in the role of "implementation support" as a way to effectively build the implementation capacities of the human service sector has therefore increased. However, while frequently used, little is known about the skills and competencies required to effectively provide such support.

MAIN BODY

To progress the debate and the research agenda on implementation support competencies, we propose the role of the "implementation support practitioner" as a concept unifying the multiple streams of research focused on e.g. consultation, facilitation, or knowledge brokering. Implementation support practitioners are professionals supporting others in implementing evidence-informed practices, policies and programs, and in sustaining and scaling evidence for population impact. They are not involved in direct service delivery or management and work closely with the leadership and staff needed to effectively deliver direct clinical, therapeutic or educational services to individuals, families and communities. They may be specialists or generalists and be located within and/or outside the delivery system they serve. To effectively support the implementation practice of others, implementation support practitioners require an ability to activate implementation-relevant knowledge, skills and attitudes, and to operationalize and apply these in the context of their support activities. In doing so, they aim to trigger both relational and behavioral outcomes. This thinking is reflected in an overarching logic outlined in this article.

CONCLUSION

The development of implementation support practitioners as a profession necessitates improved conceptual thinking about their role and work and how they enable the uptake and integration of evidence in real world settings. This article introduces a preliminary logic conceptualizing the role of implementation support practitioners informing research in progress aimed at increasing our knowledge about implementation support and the competencies needed to provide this support.

Consultation for EMDRIA Certification in EMDR: Best Practices and Challenges

Post-graduate credentials in specific therapeutic models have become more common in recent decades and offer assurance of certain levels of expertise amid increased globalization. Since 1999, the Eye Movement Desensitization and Reprocessing International Association (EMDRIA) and the international EMDR community have worked to establish guidelines and standards for advanced designations in the provision of EMDR therapy. This article focuses on the consultation processes that are outlined in the requirements for clinicians seeking to apply for advanced designations in EMDR therapy. Within the individual and group consultation hours required, consultants operate in several roles, including educator and evaluator, toward addressing the needs of consultees and the requirements put forth by credentialing bodies. The needs of consultees pursuing advanced designations in EMDR therapy include education, documentation of consultation hours and skills attained, and recommendation for the advanced designation. This article provides recommendations and best practices for EMDRIA Approved Consultants who are challenged by the current EMDRIA Certification credentialing process. Challenges with implementation of EMDR Europe's Accredited Practitioner program are also addressed. Strategies are offered to reduce identified ethical concerns surrounding consultation for advanced designations, and to support the integrity of EMDR therapy as an evidence-based treatment model. Building upon the history of the advanced designations within EMDRIA and EMDR Europe, current requirements and the need for research to inform requirements, explicit guidelines, and objective standards are discussed.

Measurement training and feedback system for implementation of evidence-based treatment for adolescent externalizing problems: protocol for a randomized trial of pragmatic clinician training

BACKGROUND

Innovations in clinical training and support that enhance fidelity to evidence-based treatment (EBT) for adolescent behavior problems are sorely needed. This study will develop an online training system to address this gap: Measurement Training and Feedback System for Implementation (MTFS-I). Using procedures intended to be practical and sustainable, MTFS-I is designed to increase two aspects of therapist behavior that are fundamental to boosting EBT fidelity: therapist self-monitoring of EBT delivery, and therapist utilization of core techniques of EBTs in treatment sessions. This version of MTFS-I focuses on two empirically supported treatment approaches for adolescent conduct and substance use problems: family therapy and cognitive behavioral therapy (CBT).

METHODS/DESIGN

MTFS-I expands on conventional measurement feedback systems for client outcomes by adding training in observational coding to promote EBT self-monitoring and focusing on implementation of EBT treatment techniques. It has two primary components. (1) The training component, delivered weekly in two connected parts, involves self-monitored learning modules containing brief clinical descriptions of core EBT techniques and mock session coding exercises based on 5-8 min video segments that illustrate delivery of core techniques. (2) The feedback component summarizes aggregated therapist-reported data on EBT techniques used with their active caseloads. MTFS-I is hosted online and requires approximately 20 min per week to complete for each treatment approach. This randomized trial will first collect data on existing delivery of family therapy and CBT techniques for youth in outpatient behavioral health sites (Baseline phase). It will then randomize site clinicians to two study conditions (Implementation phase): Training Only versus Training + Feedback + Consultation. Therapists will choose whether to train in family therapy, CBT, or both. Study aims will compare clinician performance across study phase and between study conditions on MTFS-I uptake, reliability and accuracy in EBT self-monitoring, and utilization of EBT techniques in treatment sessions (based on observer coding of audiotapes).

DISCUSSION

Study contributions to implementation science and considerations of MTFS-I sustainability are discussed.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03722654. Registered on 29 October 2018.