Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes

Intrinsic Motivation and Institutional Limitations: Key Implementation Determinants of Psychological First Aid Training

Psychological first aid (PFA) trainings are conducted to train frontline care workers in practical and emotional support to people who have been recently affected by stressful events. The aim of this study was to describe the determinants of the implementation behavior of a PFA training strategy in Chile and to provide theoretical information on the factors that influence trainers' self-efficacy. For this purpose, the Determinants of Implementation Behavior Questionnaire, administered online to a sample of 117 PFA trainers throughout Chile, was used. The results indicate that the main facilitators for implementation originate in the intrinsic motivation of the trainers, while the barriers are mainly found in the limited institutional opportunities offered by the context. Evidence was also found on the effect of motivation and context on trainer self-efficacy. PFA trainers may need to invest a lot of psychological resources to overcome the barriers encountered during implementation.

Mental Health Provider Reach and Engagement in a Countywide Training Initiative

Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.

Therapist Anxious Distress and Avoidance of Implementing Time-Out

Therapist anxious distress when delivering child mental health treatment has been understudied as a factor that contributes to the underuse of some evidence-based interventions (EBIs), such as time-out for children with disruptive behaviors. This study investigated therapist anxious avoidance of time-out using a three-part, vignette-based survey design. Therapists (n = 198) read a vignette of an in-session time-out and reported on their personal anxious distress and likelihood of discontinuing the implementation of time-out. Therapists also provided open-ended descriptions of challenges to delivering time-out. Therapists reported moderate anxious distress at time points 1 and 2 and lower anxious distress at time 3 when the time-out had resolved. Most therapists endorsed some avoidance of time-out. Binomial logistic regression analyses indicated that increased anxious distress corresponded with an increased probability of avoiding time-out delivery in the future. Qualitative reports expanded on challenges to implementing time-out. Findings suggest the importance of addressing therapist anxious distress when implementing children's mental health treatments.

Effects of Training in Cognitive Behavioural Therapy and Motivational Interviewing on Mental Health Practitioner Behaviour: A Systematic Review and Meta-Analysis

Effective training of mental health professionals is crucial for bridging the gap between research and practice when delivering cognitive behavioural therapy (CBT) and motivational interviewing (MI) within community settings. However, previous research has provided inconclusive evidence regarding the impact of training efforts. The current study aimed to systematically search, review and synthesize the literature on CBT and MI training to assess its effect on practitioner behavioural outcomes. Following prospective registration, a literature search was conducted for studies where mental health practitioners were exposed to training in face-to-face CBT or MI, reporting on at least one quantitative practitioner behavioural outcome. A total of 116 studies were eligible for the systematic review, and 20 studies were included in four meta-analyses. The systematic review highlights the need to establish psychometrically valid outcome measures for practitioner behaviour. Results of the meta-analyses suggest that training has a greater effect on practitioner behaviour change compared to receiving no training or reading a treatment manual. Training combined with consultation/supervision was found to be more effective than training alone, and no differences were found between face-to-face and online training. Results should be interpreted with caution due to methodological limitations in the primary studies, large heterogeneity, and small samples in the meta-analyses. Future directions are discussed.

Randomized Feasibility Pilot of an Executive Functioning Intervention Adapted for Children's Mental Health Settings

The critical role of executive functioning in autism as well as the co-occurring mental health challenges common among autistic youth support to the immense value of interventions targeting executive functioning for enhancing mental health services for autistic children. The goal of the present study was to conduct a randomized feasibility trial of Unstuck and On Target, an executive functioning intervention, adapted for delivery in children's community mental health setting. Mental health therapists (n = 26) enrolled with participating autistic clients (n = 32) were randomized to receive training in and deliver the adapted Unstuck intervention or to deliver care as usual. We completed masked observational measures of Unstuck strategy use (fidelity) during recorded sessions of participating therapist-client dyads and collected measures of acceptability from participating clients and their caregivers. We also collected measures of pre-post changes in executive functioning and mental health symptoms. Therapists trained in Unstuck demonstrated significantly higher use of Unstuck strategies compared to usual care therapists. Caregivers and autistic clients perceive adapted Unstuck as highly acceptability and helpful. Autistic clients whose therapists were trained in adapted Unstuck demonstrated larger pre-post changes in executive functioning compared to usual care. Across all participating clients, changes in executive functioning were significantly related to changes in mental health symptoms. Finally, clients of therapists trained in adapted Unstuck demonstrated moderate improvements in overall mental health symptoms. The current study provides preliminary evidence of the feasibility and impact of Unstuck and On Target for children's community mental health settings.

Determinants of Exposure Therapy Implementation in Clinical Practice for the Treatment of Anxiety, OCD, and PTSD: A Systematic Review

Exposure therapy (ET) forms a vital part of effective psychotherapy for anxiety-related presentations including anxiety disorders, obsessive-compulsive disorder (OCD), and post-traumatic stress disorder (PTSD), and is often underutilised in clinical practice. Using the Theoretical Domains Framework (TDF), this systematic review synthesised existing literature on the determinants of ET implementation for anxiety-related presentations and examined differences across presentations and developmental subgroups. Fifty-two eligible studies were assessed using the Mixed Methods Appraisal Tool, with 389 results (99%) mapped onto the TDF. Results suggested that clinicians' negative beliefs about the consequences of ET were commonly associated with reduced implementation. It also appeared that whilst broad unspecified ET training may be related to improved implementation for anxiety disorders; greater implementation for complex presentations (i.e., PTSD) likely requires more specialised training involving practical components. A subset of domains (e.g., social/professional role and identity) accounted for most results, whilst some remain unexplored (i.e., optimism; reinforcement; memory, attention, and decision processes) or underexplored (i.e., behavioural regulation). Likewise, specific presentations and developmental subgroups (i.e., PTSD and adults) represented a greater proportion of results in the literature than others (i.e., OCD and youth). Future research exploring ET implementation, across specific presentations and developmental subgroups, would benefit from integrating implementation science frameworks to guide the development of targeted, comprehensive strategies to close the research-practice gap of ET for the treatment of anxiety-related presentations.

When Movement Therapy Meets Spirituality: A Quasi-Experiment

Depression is a public health issue in older adults. This study followed a participatory train-the-trainer approach to develop the Movement-based x 'Elderspirituality-Fu Le Man Xin' intervention. Additionally, a quasi-experimental design was followed to evaluate the effectiveness of the intervention. Data were collected from pre-and post-intervention assessments. A total of 135 older adults with depressive symptoms were recruited, 77 received the intervention and 58 received an active control intervention. Repeated measures ANCOVA showed that the 'Movement-based x 'Elderspirituality-Fu Le Man Xin' intervention significantly reduced depression in cognitively sound participants (F(1, 73) = 62.346, p < .001).

Where it all begins: Predicting initial therapeutic skills before clinical training in cognitive behavior therapy

To train novice students adequately, it is crucial to understand where they start and how they develop their skills. This study examined the impact of novice students' characteristics on their initial clinical micro-skills when treating simulated patients with cognitive behavior therapy. The sample consisted of 44 graduate psychology students treating seven simulated patients. Clinical micro-skills were measured both using video-based ratings in reaction to short video clips of simulated patients (via the Facilitative Interpersonal Skills (FIS) performance task) and by using video-based ratings within a session with a simulated patient (using the Inventory of Therapeutic Interventions and Skills; ITIS). Two separate LASSO regressions were performed using machine learning to select potential predictors for both skills assessments. Subsequently, a bootstrapping algorithm with 10,000 iterations was used to examine the variability of regression coefficients. Using LASSO regression, we identified two predictors for clinical micro-skills in standardized scenarios: extraversion (b = 0.10) and resilience (b = 0.09), both were not significantly associated with clinical micro-skills. Together, they explained 15% of the skill variation. Bootstrapping confirmed the stability of these predictors. For clinical micro-skills in sessions, only competitiveness was excluded by LASSO regression, and all predictors showed significant instability. The results provide initial evidence that trainees' resilience and extraversion should be promoted in the clinical training of cognitive behavior therapy. More studies on clinical micro-skills and training with larger sample sizes are needed to fully understand clinical development.

Action recommendations review in community-based therapy and depression and anxiety outcomes: a machine learning approach

BACKGROUND

While the positive impact of homework completion on symptom alleviation is well-established, the pivotal role of therapists in reviewing these assignments has been under-investigated. This study examined therapists' practice of assigning and reviewing action recommendations in therapy sessions, and how it correlates with patients' depression and anxiety outcomes.

METHODS

We analyzed 2,444 therapy sessions from community-based behavioral health programs. Machine learning models and natural language processing techniques were deployed to discern action recommendations and their subsequent reviews. The extent of the review was quantified by measuring the proportion of session dialogues reviewing action recommendations, a metric we refer to as "review percentage". Using Generalized Estimating Equations modeling, we evaluated the correlation between this metric and changes in clients' depression and anxiety scores.

RESULTS

Our models achieved 76% precision in capturing action recommendations and 71.1% in reviewing them. Using these models, we found that therapists typically provided clients with one to eight action recommendations per session to engage in outside therapy. However, only half of the sessions included a review of previously assigned action recommendations. We identified a significant interaction between the initial depression score and the review percentage (p = 0.045). When adjusting for this relationship, the review percentage was positively and significantly associated with a reduction in depression score (p = 0.032). This suggests that more frequent review of action recommendations in therapy relates to greater improvement in depression symptoms. Further analyses highlighted this association for mild depression (p = 0.024), but not for anxiety or moderate to severe depression.

CONCLUSIONS

An observed positive association exists between therapists' review of previous sessions' action recommendations and improved treatment outcomes among clients with mild depression, highlighting the possible advantages of consistently revisiting therapeutic homework in real-world therapy settings. Results underscore the importance of developing effective strategies to help therapists maintain continuity between therapy sessions, potentially enhancing the impact of therapy.

Computerized Suicide Prevention Clinical Training Simulations: A Pilot Study

Purpose

Mental health providers are well-positioned to engage in suicide prevention efforts, yet implementation depends on skill acquisition and providers often report feeling underprepared. This pilot study explored the acceptability, feasibility, and preliminary effectiveness of three suicide prevention-focused simulations with virtual clients.

Method

Students (n=22) were recruited from a MSW program, completed pre- and post-test surveys, and engaged with three simulated trainings: 1) suicide risk assessment, 2) safety planning, and 3) motivating a client to treatment.

Results

Simulations were reported to be acceptable and feasible, with strong student desire and need for greater suicide prevention training. We observed significant improvements over time in clinical skills via simulated training scores and perceptions of clinical preparedness.

Discussion

Preliminary findings indicate simulated training with virtual clients is promising and suggest the three suicide prevention simulations may be useful, scalable, and effective in social work training programs and beyond.

Implementation fidelity, student outcomes, and cost-effectiveness of train-the-trainer strategies for Masters-level therapists in urban schools: results from a cluster randomized trial

BACKGROUND

Little is known about the effectiveness and cost-effectiveness of train-the-trainer implementation strategies in supporting mental health evidence-based practices in schools, and about the optimal level of support needed for TT strategies.

METHODS

The current study is part of a larger type 2 hybrid cluster randomized controlled trial. It compares two train-the-trainer strategies, Train-the-Trainer (TT) and Train-the-Trainer plus ongoing consultation for trainers (TT +) on the delivery of a group cognitive behavioral treatment protocol for anxiety disorders. Participants were 33 therapists, 29 supervisors, and 125 students who were at risk for anxiety disorders from 22 urban schools. Implementation outcomes were implementation fidelity and treatment dosage. Student outcomes were child- and parent-reported symptoms of anxiety, child-reported symptoms of depression, and teacher-reported academic engagement. We estimated the cost of implementing the intervention in each condition and examined the probability that a support strategy for supervisors (TT vs TT +) is a good value for varying values of willingness to pay.

RESULTS

Therapists in the TT and TT + conditions obtained similarly high implementation fidelity and students in the conditions received similar treatment dosages. A mixed effects modeling approach for student outcomes revealed time effects for symptoms of anxiety and depression reported by students, and emotional disaffection reported by teachers. There were no condition or condition × times effects. For both conditions, the time effects indicated an improvement from pre-treatment to post-treatment in symptoms of anxiety and depression and academic emotional engagement. The average cost of therapist, supervisor, and consultant time required to implement the intervention in each condition was $1002 for TT and $1431 for TT + (p = 0.01). There was a greater than 80% chance that TT was a good value compared to TT + for all values of willingness to pay per one-point improvement in anxiety scores.

CONCLUSIONS

A TT implementation approach consisting of a thorough initial training workshop for therapists and supervisors as well as ongoing supervision for therapists resulted in adequate levels of fidelity and student outcomes but at a lower cost, compared to the TT + condition that also included ongoing external expert consultation for supervisors.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02651402.

Community-based Agency Delivery of Parent-Child Interaction Therapy: Comparing Outcomes for Children with and Without Autism Spectrum Disorder and/or Developmental Delays

While externalizing behaviors are common among children with autism spectrum disorder (ASD), there is a shortage of specialist community-based clinicians to provide treatment. Parent-Child Interaction Therapy (PCIT), an intervention designed to reduce child disruptive behaviors, may be effective for families of children with ASD but has rarely been studied outside of university-based research settings. We examined the effectiveness of PCIT delivered for children with (N = 109) and without (N = 2,324) ASD/developmental delays (DD) across community-based agencies in Oregon. Findings revealed significant reductions in disruptive behavior and positive changes in the parent-child relationship in both groups. These findings support PCIT as an efficacious intervention for children with ASD/DD and demonstrate PCIT's promise in community-based agencies with non-specialized clinicians.

Evaluation of a new online cognitive remediation therapy (CIRCuiTSTM ) training for mental health professionals

OBJECTIVE

Cognitive remediation (CR) improves cognition and aids recovery in people with psychosis. An active therapist provides increased benefit, but CR training for therapists is not routinely available, so CR has limited scalability. This study describes the development and evaluation of the first online CR therapist training programme.

METHODS

An online CR training, based on expert and novice therapist consultations, was developed, and then pilot tested with novice trainees and changes made to produce the evaluation version. Feasibility, acceptability, and training benefits were assessed in a group of naïve UK NHS mental health professionals. Training engagement with a group of clinicians who accessed the programme for professional development was compared to those who paid fees.

RESULTS

Most mental health professionals finished training and passed the knowledge test, indicating that training enhanced clinicians' knowledge. Fee-paying trainees had significantly faster completion times and a higher proportion finished in the recommended time. Those who were successful at passing the knowledge questionnaire had significantly fewer years in practice. The majority were satisfied with the programme, felt they had made considerable progress and that training would allow them to begin practicing CR, and would recommend the training to colleagues.

CONCLUSIONS

This online CR training programme was feasible, acceptable to participants and showed benefits for clinicians. It improved knowledge even in the most junior of staff who have had less time to develop clinical know-how.

An exposure-based implementation strategy to decrease clinician anxiety about implementing suicide prevention evidence-based practices: protocol for development and pilot testing (Project CALMER)

BACKGROUND

Clinicians often report that their own anxiety and low self-efficacy inhibit their use of evidence-based suicide prevention practices, including gold-standard screening and brief interventions. Exposure therapy to reduce clinician maladaptive anxiety and bolster self-efficacy use is a compelling but untested approach to improving the implementation of suicide prevention evidence-based practices (EBPs). This project brings together an interdisciplinary team to leverage decades of research on behavior change from exposure theory to design and pilot test an exposure-based implementation strategy (EBIS) to target clinician anxiety to improve suicide prevention EBP implementation.

METHODS

We will develop, iteratively refine, and pilot test an EBIS paired with implementation as usual (IAU; didactic training and consultation) in preparation for a larger study of the effect of this strategy on reducing clinician anxiety, improving self-efficacy, and increasing use of the Columbia Suicide Severity Rating Scale and the Safety Planning Intervention in outpatient mental health settings. Aim 1 of this study is to use participatory design methods to develop and refine the EBIS in collaboration with a stakeholder advisory board. Aim 2 is to iteratively refine the EBIS with up to 15 clinicians in a pilot field test using rapid cycle prototyping. Aim 3 is to test the refined EBIS in a pilot implementation trial. Forty community mental health clinicians will be randomized 1:1 to receive either IAU or IAU + EBIS for 12 weeks. Our primary outcomes are EBIS acceptability and feasibility, measured through questionnaires, interviews, and recruitment and retention statistics. Secondary outcomes are the engagement of target implementation mechanisms (clinician anxiety and self-efficacy related to implementation) and preliminary effectiveness of EBIS on implementation outcomes (adoption and fidelity) assessed via mixed methods (questionnaires, chart-stimulated recall, observer-coded role plays, and interviews).

DISCUSSION

Outcomes from this study will yield insight into the feasibility and utility of directly targeting clinician anxiety and self-efficacy as mechanistic processes informing the implementation of suicide prevention EBPs. Results will inform a fully powered hybrid effectiveness-implementation trial to test EBIS' effect on implementation and patient outcomes.

TRIAL REGISTRATION

Clinical Trials Registration Number: NCT05172609 . Registered on 12/29/2021.

Freely Available Training Videos for Suicide Prevention: Scoping Review

BACKGROUND

Freely available and asynchronous implementation supports can reduce the resource burden of evidence-based practice training to facilitate uptake. Freely available web-based training videos have proliferated, yet there have been no efforts to quantify their breadth, depth, and content for suicide prevention.

OBJECTIVE

This study presents results from a scoping review of freely available training videos for suicide prevention and describes a methodological framework for reviewing such videos.

METHODS

A scoping review of freely available training videos (≥2 minutes) for suicide prevention practices was conducted using 4 large video-sharing platforms: YouTube, Vimeo, Bing Video, and Google Video. Identified suicide prevention training videos (N=506) were reviewed and coded.

RESULTS

Most content was targeted toward gatekeepers or other lay providers (n=370) versus clinical providers (n=136). Videos most commonly provided content related to suicidal thoughts or behaviors (n=420). Many videos (n=274, 54.2%) included content designed for certain communities or organizations. Less than half (n=232, 45.8%) of training videos included formal clinical content pertaining to assessment or intervention for suicide prevention.

CONCLUSIONS

Results suggested an abundance of videos providing broad informational content (eg, "signs and symptoms of someone at risk for suicide") and a limited portion of videos with instructional content aimed at clinical providers delivering formal evidence-based assessments or interventions for suicide prevention. Development of resources to address identified gaps may be needed. Future work may leverage machine learning techniques to expedite the review process.

A Statewide Randomized Controlled Trial to Compare Three Models for Implementing Parent Child Interaction Therapy

OBJECTIVE

This study (NIMH RO1 MH095750; ClinicalTrials.gov Identifier: NCT02543359) evaluated the effectiveness of three training models to implement a well-established evidence-based treatment, Parent-Child Interaction Therapy (PCIT).

METHOD

Fifty licensed outpatient clinics, including 100 clinicians, 50 supervisors, and 50 administrators were randomized to one of three training conditions: 1) Learning Collaborative (LC), 2) Cascading Model (CM) or 3) Distance Education (DE). Data to assess training and implementation outcomes were collected at 4 time points coinciding with the training period: baseline, 6- (mid), 12- (post), and 24-months (1-year follow-up).

RESULTS

Multi-level hierarchical linear growth modeling was used to examine changes over time in training outcomes. Results indicate that clinicians in CM were more likely to complete training, reported high levels of training satisfaction and better learning experiences compared to the other training conditions. However, supervisors in the LC condition reported greater learning experiences, higher levels of knowledge, understanding of treatment, and satisfaction compared to supervisors in other conditions. Although clinicians and supervisors in the DE condition did not outperform their counterparts on any outcomes, their performance was comparable to both LC and CM in terms of PCIT use, supervisor perceived acceptability, feasibility, system support, and clinician satisfaction.

CONCLUSIONS

Through the use of a randomized controlled design and community implementation, this study contributes to the current understanding of the impact of training design on implementation of PCIT. Results also indicate that although in-person training methods may produce more positive clinician and supervisor outcomes, training is not a one-size-fits-all model, with DE producing comparable results on some variables.

Comparing In-Person and Synchronous Online Training for an Evidence-Based Treatment

Online trainings in evidence-based treatments (EBT) can be effective platforms and may provide better access to community providers as compared with traditional in-person trainings. However, questions remain as to whether online trainings can achieve similar rates of training engagement and model application to traditional in-person trainings. We compared training engagement and model application (e.g., extent of use, fidelity) between participants attending in-person (n = 127) and synchronous online (n = 277) trainings for an EBT (Alternatives for Families: a Cognitive Behavioral Therapy; AF-CBT). Data were collected through pre- and post-training questionnaires and trainers' records. Chi-square analyses and t-tests were used to test for differences between groups. Engagement regarding attendance at workshops and consultation calls was high for both groups, with no significant differences. A total of 81% and 76% presented at least one case and submitted at least one audio recording of an actual AF-CBT session, respectively. Participants rated the training workshop as high quality (M > 4.5/5), and the consultation calls as medium-to-high quality (M > 4/5) across both modalities, indicating good training engagement. In-person training participants were significantly more likely to submit two or more audio recorded sessions than online training participants. This was the only training requirement outcome that differed between the two groups. In examining model application, there were no significant differences between in-person and online training participants in self-reported delivery of AF-CBT, the number of clients with whom it was implemented, the extent they used the model, or the fidelity with which they delivered it. Both groups reported similar improvements in comfort when working with aggressive families, being directive, and using learning techniques like role plays. Online evidence-based treatment skills training appears to be feasible, efficient, and beneficial, with engagement and performance comparable to in-person training. We discuss potential advantages of online training (e.g., fewer costs, greater flexibility for staff from independent practices) and disadvantages (e.g., less satisfaction).

A systematic review of clinical psychological guidance for perinatal mental health

BACKGROUND

Guidelines on psychological and/or psychosocial assessment and intervention in the perinatal period can provide beneficial practice guidance for healthcare professions to reduce maternal distress and potential mortality. As little is known about the similarities in recommendations across guidelines, which could impact the quality of therapeutic intervention women receive, this systematic review was conducted to draw out the consistent guidance for perinatal psychological and/or psychosocial therapeutic input.

METHOD

Eight literature and two guideline databases were searched alongside guideline development institutions, and organisations of maternity or perinatal mental health care. All relevant guidance was searched for and extracted before guideline quality was assessed using the AGREE-II instrument. Included guidelines had a primary or secondary focus on psychological assessment and therapeutic intervention for perinatal mental health difficulties. Using a narrative synthesis approach, recommendation consistencies and inconsistencies were outlined.

RESULTS

From the 92 records screened, seven guidelines met the inclusion criteria. Only two guidelines were rated high (> 80%) across all assessed domains, with the other guidelines scoring between poor and excellent across domains. Highest rated domains across all seven guidelines were clarity of presentation (75%) and scope and purpose (70%). Recommendations for structured psychological assessment and intervention were most commonly reported in the guidelines; however, the level of detail and depth of information varied across guidelines. Whilst assessment and intervention recommendations for mother-infant dyad and partners were considered, research into working therapeutically with these client groups in perinatal mental health services is only just emerging. Hence, guideline recommendations for working with the mother-infant dyad and partners were based on consensus of expert opinion.

CONCLUSION

Perinatal mental health guidelines were consistent in scope but showed considerable variability in quality and depth of recommendations, which could have implications for standards of clinical practice. However, there is still a need to improve the evidence underpinning recommendations in perinatal mental health guidelines to advance the implementation of psychological and/or psychosocial interventions. High quality interventions in the perinatal period could improve outcomes for women and their families.

Relationship-Oriented Recovery System for Youth (RORSY): Clinical Protocol for Transition-Age Youth with Opioid Use Disorders

This article introduces the Relationship-Oriented Recovery System for Youth (RORSY) protocol, which is designed to increase uptake of Medications for Opioid Use Disorder (MOUD) and related services among adolescents and young adults. Youth exhibit alarmingly poor rates of MOUD initiation and adherence, OUD services involvement and long-term recovery success. RORSY attends to three developmentally unique recovery needs of this age group: assess and bolster youth recovery capital, prioritize involvement of concerned significant others, and use digital direct-to-consumer recovery supports. RORSY contains five evidence-informed intervention modules that can be flexibly tailored to meet the individual and relationship needs of a given youth: Relational Orientation, Youth Recovery Management Planning, Relational Recovery Management Planning, Relationship Skills Building, and Digital Recovery Support Planning. The article concludes with practice and policy recommendations for making relationship-building a top clinical priority for addressing youth OUD.

Implementing internet-delivered cognitive behavioral therapy in healthcare services: a qualitative exploration of stakeholder experience

Background

This study consisted of a qualitative exploration of stakeholder experience regarding the implementation of internet-delivered cognitive behavioral therapy (iCBT) as part of routine service provision within the UK's Improving Access to Psychological Therapies program.

Methods

Stakeholder groups included service providers (n = 6), commercial iCBT representatives (n = 6) and patients who received a course of iCBT as part of treatment at the service (n = 7). Participants took part in a semi-structured interview over the telephone, and subsequent data were qualitatively analyzed using the descriptive-interpretive approach.

Results

Service providers highlighted the importance of effective leadership and management, training initiatives, the provision of feedback to commercial iCBT representatives and creating work structures around iCBT to facilitate iCBT supporting staff in their use of it. Commercial iCBT representatives similarly reported the importance of training clinicians in iCBT use, identifying the appropriate individuals at all levels of the service to drive iCBT implementation, and the importance of being responsive to any problems or needs that arise from the service. Patients reported an overall positive experience of receiving iCBT but highlighted a need for more information from their supporter and the intervention to better structure their usage. Contextual factors, in terms of barriers and facilitators, were also highlighted by service provider and commercial participants; citing negative clinician attitudes and technological issues/bugs as barriers to implementation, and the exposure to iCBT created by COVID-19 and perseverance in using iCBT over time as facilitators.

Discussion

The findings contribute to a growing field of literature that seeks to understand the experience of relevant stakeholders who are involved with and contribute to iCBT implementation, including commercial iCBT representatives who, to our knowledge, have not been accounted for as part of published research to date.

Improving programme-led and focused interventions for eating disorders: An experts' consensus statement-A UK perspective

OBJECTIVE

Eating disorders are associated with significant illness burden and costs, yet access to evidence-based care is limited. Greater use of programme-led and focused interventions that are less resource-intensive might be part of the solution to this demand-capacity mismatch.

METHOD

In October 2022, a group of predominantly UK-based clinical and academic researchers, charity representatives and people with lived experience convened to consider ways to improve access to, and efficacy of, programme-led and focused interventions for eating disorders in an attempt to bridge the demand-capacity gap.

RESULTS

Several key recommendations were made across areas of research, policy, and practice. Of particular importance is the view that programme-led and focused interventions are suitable for a range of different eating disorder presentations across all ages, providing medical and psychiatric risk are closely monitored. The terminology used for these interventions should be carefully considered, so as not to imply that the treatment is suboptimal.

CONCLUSIONS

Programme-led and focused interventions are a viable option to close the demand-capacity gap for eating disorder treatment and are particularly needed for children and young people. Work is urgently needed across sectors to evaluate and implement such interventions as a clinical and research priority.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: study protocol for a hybrid type 2 effectiveness-implementation cluster-randomized trial using train-the-trainer

BACKGROUND

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes and (b) providers' perceptions of fit.

METHODS

TTT will be implemented in nine CMHCs in California, USA (N = 60 providers; N = 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality), and (3) evaluate other possible moderators.

DISCUSSION

This trial has potential to (a) inform the process of embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) add to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advance our understanding of providers' perceptions of EBPT "fit" across TTT generations.

TRIAL REGISTRATION

ClinicalTrials.gov identifier NCT05805657 . Registered on April 10, 2023.

Efficacy of stand-alone digital mental health applications for anxiety and depression: A meta-analysis of randomized controlled trials

BACKGROUND

Anxiety and depressive disorders affect 20% of the population, cause functional impairment, and represent a leading cause of disability. Although evidence-based treatments exist, the shortage of trained clinicians and high demand for mental health services have resulted in limited access to evidence-based care. Digital mental health applications (DMHA) present innovative, scalable, and sustainable solutions to address disparities in mental health care.

METHODS

The present study used meta-analytic techniques to evaluate the therapeutic effect of DMHAs in randomized controlled trials (RCTs) for individuals experiencing anxiety and/or depressive symptoms. Search terms were selected based on concepts related to digital mental health applications, mental health/wellness, intervention type, trial design, and anxiety and/or depression symptoms/diagnosis outcomes to capture all potentially eligible results. Potential demographic, DMHA, and trial design characteristics were examined as moderators of therapeutic effects.

RESULTS

Random effects meta-analyses found that stand-alone DMHAs produced a modest reduction in anxiety (g = 0.31) and depressive (g = 0.35) symptom severity. Several moderators influenced the therapeutic effects of DMHAs for anxiety and/or depressive symptoms including treatment duration, participant inclusion criteria, and outcome measures.

LIMITATIONS

Minimal information was available on DMHA usability and participant engagement with DMHAs within RCTs.

CONCLUSIONS

While DMHAs have the potential to be scalable and sustainable solutions to improve access and availability of evidence-based mental healthcare, moderator analyses highlight the considerations for implementation of DMHAs in practice. Further research is needed to understand factors that influence therapeutic effects of DMHAs and investigate strategies to optimize its implementation and overcome the extant research-to-practice gap.

The Impact of an Online Post-Graduate Interdisciplinary Mental Health Programme on Graduates' Confidence and Practice

This study aimed to examine the experiences of graduates of online interdisciplinary postgraduate mental health programmes in Australia. The program was delivered in 6-week terms. Seven graduates from diverse backgrounds were interviewed about their experiences with the course and its impact on their practice, confidence, professional identity, views on mental health service users, and their motivation for additional learning. The interviews were recorded and transcribed and underwent thematic content analysis. The graduates reported an increase in confidence and knowledge after completing the course, which led to a change in their views and attitudes towards service users. They appreciated the examination of psychotherapies and motivational interviewing, and applied their newly acquired skills and knowledge in their practice. The course was found to have improved their clinical practice. This study highlights a departure from traditional pedagogical approaches in mental health skill acquisition, as the entire program was delivered online. There is a need for further research to determine who might benefit most from this mode of delivery and to verify the competencies acquired by graduates in real-world situations. Online mental health courses are a feasible option and have been positively received by graduates. To enable graduates to participate in transforming mental health services, systemic change and recognition of their capabilities, particularly those from non-traditional backgrounds, is required. The results of this study suggest the potential for online postgraduate programs to play a significant role in transforming mental health services.

The role of implementation organizations in scaling evidence-based psychosocial interventions

BACKGROUND

To bring evidence-based interventions (EBIs) to individuals with behavioral health needs, psychosocial interventions must be delivered at scale. Despite an increasing effort to implement effective treatments in communities, most individuals with mental health and behavioral problems do not receive EBIs. We posit that organizations that commercialize EBIs play an important role in disseminating EBIs, particularly in the USA. The behavioral health and implementation industry is growing, bringing the implementation field to an important inflection point: how to scale interventions to improve access while maintaining EBI effectiveness and minimizing inequities in access to psychosocial intervention.

MAIN BODY

We offer a first-hand examination of five illustrative organizations specializing in EBI implementation: Beck Institute for Cognitive Behavioral Therapy; Incredible Years, Inc.; the PAXIS Institute; PracticeWise, LLC; and Triple P International. We use the Five Stages of Small Business Growth framework to organize themes. We discuss practical structures (e.g., corporate structures, intellectual property agreements, and business models) and considerations that arise when trying to scale EBIs including balancing fidelity and reach of the intervention. Business models consider who will pay for EBI implementation and allow organizations to scale EBIs.

CONCLUSION

We propose research questions to guide scaling: understanding the level of fidelity needed to maintain efficacy, optimizing training outcomes, and researching business models to enable organizations to scale EBIs.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: Study protocol for a hybrid type 2 effectiveness-implementation cluster- randomized trial using train-the-trainer

Background

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes (b) providers' perceptions of fit.

Methods

TTT will be implemented in nine CMHCs in California, United States (N= 60 providers; N= 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will: (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality); and (3) evaluate other possible moderators.

Discussion

This trial has potential to inform the process of (a) embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) adding to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advancing our understanding of providers' perceptions of EBPT 'fit' across TTT generations.

Trial registration

Clinicaltrials.gov identifier: NCT05805657. Registered on April 10, 2023. https://clinicaltrials.gov/ct2/show/NCT05805657.

From court to the community: improving access to evidence-based treatment for underserved youth involved in the juvenile legal system at-risk for suicide

BACKGROUND

Juvenile legal involved youth (JLIY) experience disproportionately high rates of suicidal and self-injurious thoughts and behaviors (SSITB). Many JLIY lack access to evidence-based treatment specifically designed to treat SSITB, thereby increasing the overall risk of suicide. The overwhelming majority of JLIY are not placed in secure facilities and almost all incarcerated youth are eventually released to the community. Consequently, SSITB are a major concern of JLIY residing in the community and it is critical that this population has access to evidence-based treatment for SSITB. Unfortunately, most community mental health providers who treat JLIY have not been trained in evidence-based interventions that are specifically designed to SSITB, which often leads to youth experiencing prolonged periods of SSITB. Training community mental health providers who serve JLIY in the detection and treatment of SSITB shows promise for decreasing the overall suicide risk for JLIY.

METHODS

The current proposal aims to reduce SSITB among JLIY, and thus reduce mental health disparities in this vulnerable and underserved youth population, by increasing access to evidence-based treatment strategies specifically designed to treat SSITB behaviors. We will implement an agency-wide training among at least 9 distinct community mental health agencies that serve JLIY referred to treatment by a statewide court system in the Northeast. Agencies will be trained in an adapted version of the COping, Problem Solving, Enhancing life, Safety, and Parenting (COPES+) intervention. Training will be implemented via a cluster-randomized stepped wedge trial that proceeds through multiple phases.

DISCUSSION

This research engages multiple systems (i.e., juvenile legal and mental health systems) serving JLIY and has the potential to directly inform treatment practices in juvenile legal and mental health systems. The current protocol has significant public health implications as the primary goals are to reduce SSITB among adolescents involved in the juvenile legal system. By implementing a training protocol with community-based providers to help them learn an evidence-based intervention, this proposal aims to reduce mental health disparities in a marginalized and underserved population.

TRIAL REGISTRATION

osf.io/sq9zt.

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

PURPOSE

Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address.

METHODS

The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session.

RESULTS

Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care.

CONCLUSION

Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

Implementation of a Low-Cost, Multi-component, Web-Based Training for Trauma-Focused Cognitive-Behavioral Therapy

Effective, interactive trainings in evidence-based practices remain expensive and largely inaccessible to most practicing clinicians. To address this need, the current study evaluated the impact of a low-cost, multi-component, web-based training for Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT) on clinicians' TF-CBT knowledge, strategy use, adherence and skill. Clinician members of a practice-based research network were recruited via email and randomized to either an immediate training group (N = 89 assigned) or waitlist control group (N = 74 assigned) that was offered access to the same training after six months, with half of each group further randomized to receive or not receive incentives for participation. Clinicians completed assessments at baseline, 6 months, and 12 months covering TF-CBT knowledge, strategy use, and for a subset of clinicians (n = 28), TF-CBT adherence and skill. Although significant differences in overall TF-CBT skillfulness and readiness were found, there were no significant differences between the training and waitlist control group on TF-CBT knowledge and strategy use at six months. However, there was considerable variability in the extent of training completed by clinicians. Subsequent post-hoc analyses indicated a significant, positive association between the extent of training completed by clinicians and clinician TF-CBT knowledge, strategy use, demonstrated adherence and skill across the three TF-CBT components, and overall TF-CBT readiness. We also explored whether incentives predicted training participation and found no differences in training activity participation between clinicians who were offered an incentive and those who were not. Findings highlight the limitations of self-paced web-based trainings. Implications for web-based trainings are discussed.

Supporting people affected by problematic alcohol, substance use and other behaviours under pandemic conditions: A pragmatic evaluation of how SMART recovery Australia responded to COVID-19

BACKGROUND

The COVID-19 pandemic prompted rapid, reflexive transition from face-to-face to online healthcare. For group-based addiction services, evidence for the impact on service delivery and participant experience is limited.

METHODS

A 12-month (plus 2-month follow-up) pragmatic evaluation of the upscaling of online mutual-help groups by SMART Recovery Australia (SRAU) was conducted using The Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework. Data captured by SRAU between 1st July 2020 and 31st August 2021 included participant questionnaires, Zoom Data Analytics and administrative logs.

RESULTS

Reach: The number of online groups increased from just 6 pre-COVID-19 to 132. These groups were delivered on 2786 (M = 232.16, SD = 42.34 per month) occasions, to 41,752 (M = 3479.33, SD = 576.34) attendees.

EFFECTIVENESS

Participants (n = 1052) reported finding the online group meetings highly engaging and a positive, recovery supportive experience. 91 % of people with experience of face-to-face group meetings rated their online experience as equivalent or better. Adoption: Eleven services (including SRAU) and five volunteers delivered group meetings for the entire 12-months.

IMPLEMENTATION

SRAU surpassed their goal of establishing 100 groups. Maintenance: The average number of meetings delivered [t(11.14) = -1.45, p = 0.1737] and attendees [t(1.95) = -3.28, p = 0.1880] per month were maintained across a two-month follow-up period.

CONCLUSIONS

SRAU scaled-up the delivery of online mutual-help groups in response to the COVID-19 pandemic. Findings support the accessibility, acceptability and sustainability of delivering SMART Recovery mutual-help groups online. Not only are these findings important in light of the global pandemic and public safety, but they demonstrate the potential for reaching and supporting difficult and under-served populations.

A Web-Based Therapist Training Tutorial on Prolonged Grief Disorder Therapy: Pre-Post Assessment Study

BACKGROUND

Prolonged grief disorder (PGD) is a newly recognized mental disorder characterized by pervasive intense grief that persists longer than cultural or social expectations and interferes with functioning. The COVID-19 epidemic has resulted in increased rates of PGD, and few clinicians feel confident in treating this condition. PGD therapy (PGDT) is a simple, short-term, and evidence-based treatment developed in tandem with the validation of the PGD diagnosis. To facilitate the dissemination of PGDT training, we developed a web-based therapist tutorial that includes didactic training on PGDT concepts and principles as well as web-based multimedia patient scenarios and examples of clinical implementation of PGDT.

OBJECTIVE

We aimed to evaluate user satisfaction with the tutorial and whether the tutorial increased trainees' knowledge of PGDT principles and procedures. Moreover, we included a small number of pilot questions to evaluate the PGDT-related clinical skills.

METHODS

This study evaluated tutorial learning using a pre- and poststudy design. Participants were recruited from professional organization mailing lists, announcements to graduates of the Columbia School of Social Work, and through word of mouth. After signing consent, participants completed a brief demographic survey, a 55-item multiple-choice prestudy test on the concepts and principles of PGD and PGDT covered in the tutorial, and a 4-item pilot web-based prestudy test to gauge PGD clinical implementation skills. The link to the course content was then activated, and participants were given 8 weeks to complete the 11-module tutorial containing information, web-based exercises, simulated patient and video examples, and self-tests.

RESULTS

Overall, 406 clinicians signed consent, and 236 (58.1%) started the tutorial. Of these, 83.1% (196/236) completed all 11 modules. Trainee scores on our PDGT assessment improved substantially from pretraining to the postmodule assessment, with the total number of correct answers increasing from a mean of 29 (SD 5.5; 52.7% correct) to 36.7 (SD 5.2; 66.7% correct; t₁₉₅=18.93; P<.001). In addition, the trainee's implementation scores on 4 clinical vignettes increased from 2.6 (SD 0.7) correct out of 4 to 3.1 (SD 0.4) out of 4 (t₁₈₈=7.02; P<.001). Effect sizes (Cohen d) were 1.44 (95% CI 1.23-1.65) for PDGT assessment and 1.06 (95% CI 0.84-1.29) for implementation. Trainees found the tutorial interesting, enjoyable, clearly presented, and useful for professional development. They endorsed a mean score of 3.7 (SD 0.47) on a 1 to 4 scale of agreement with recommending the course to others and feeling satisfied with the tutorial, and a mean of 3.3 (SD 0.57) with feeling able to apply the skills with clients.

CONCLUSIONS

This pilot study provides support for the usefulness of this web-based training for teaching clinicians how to administer PGDT. The addition of patient scenarios for clinical implementation strategies holds promise for increasing the effectiveness of PGDT training and other evidence-based treatments.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05121792; https://www.clinicaltrials.gov/ct2/show/NCT05121792.

Evidence-based Treatment for Substance Use Disorders in Community Mental Health Centers: the ACCESS Program

A significant gap remains in the availability and accessibility of evidence-based treatments (EBTs) in community substance use disorder (SUD) treatment. This study describes a 2-year statewide training initiative that sought to address this gap by training community-based therapists in motivational enhancement/cognitive behavioral therapy (MET/CBT). Therapists (N = 93) participated in a 2-day MET/CBT workshop followed by bi-weekly clinical consultation, fidelity monitoring, guided readings, and online resources. Therapists completed pre-training and follow-up assessments measuring knowledge, attitudes, confidence, and implementation barriers. Most therapists attended 10 or more consultation calls. Submission of session recordings for feedback was the least utilized training element. Therapists reported increased confidence in their ability to implement MET/CBT for SUD and demonstrated improvement in MI and CBT knowledge. Therapists reported several implementation barriers, including lack of time and opportunity to treat patients with MET/CBT. Recommendations for future training initiatives and addressing the barriers identified in this study are discussed.

Clinician factors related to the delivery of psychotherapy for autistic youth and youth with attention-deficit hyperactivity disorder

LAY ABSTRACT

Autistic children and youth often experience mental health problems, such as anxiety, depression and behavioural challenges. Although there are therapy programmes that have been found helpful in reducing these issues, such as cognitive behaviour therapy, autistic children often struggle to receive adequate mental health care. Clinicians' knowledge, attitudes, confidence and beliefs about treating mental health problems in autistic people may be related to their choices in providing psychotherapy. Across Ontario, Canada, 611 mental health clinicians, working in publicly funded agencies, completed an online survey about their experiences and opinions on delivering therapy for autistic clients compared to those with attention-deficit hyperactivity disorder. Clinician knowledge was associated with their intention to treat autistic clients or clients with attention-deficit hyperactivity disorder, partly because of their attitudes and the social pressures or values they felt. Clinicians reported feeling less intent on providing therapy to autistic youth compared to youth with attention-deficit hyperactivity disorder because of differences in their attitudes, social pressures and knowledge. This research can inform the training and educational initiatives for mental health practitioners.

Evaluating Dialectical Behavior Therapy Training With Mental Health Clinicians

A substantial body of research supports dialectical behavior therapy (DBT) as an evidence-based treatment for those with borderline personality disorder (BPD); however, there remains a lack of mental health clinicians trained in this modality, resulting in limited clinician competencies and skills. Furthermore, the effectiveness of DBT trainings with mental health clinicians remains understudied. The present study evaluated a comprehensive 5-day DBT-Linehan Board of Certification training program. Informed by the Theory of Planned Behavior, this study assessed changes in clinician knowledge, attitudes, perceived behavioral control (PBC), intentions, and behaviors relevant to DBT at baseline, posttraining, and 6-month follow-up. Results showed large, significant pre-to-post training improvements in clinicians' knowledge, attitudes, PBC, and intentions related to DBT implementation. Large improvements in knowledge, attitudes, and PBC were sustained at follow-up. A significant improvement in actual behaviors was also found at follow-up. Implications of the present study and directions for future research are discussed.

Preliminary Implementation Outcomes of a Free Online Toolkit to Support Exposure Therapy Implementation for Youth

Background

Exposure therapy ("exposure") for youth anxiety is highly underutilized in clinical practice. Asynchronous, online implementation strategies such as online toolkits hold promise as pragmatic approaches for extending the sustainability of evidence-based interventions, but their long-term usage, perceived utility, and impact are rarely studied.

Objective

This study presents three-year preliminary implementation outcomes for a free, online toolkit to support exposure therapy use with youth: the Resource for Exposure for Anxiety Disordered Youth (READY; www.bravepracticeforkids.com). Implementation outcomes of interest included READY usage statistics, adoption, perceived utility, and clinician exposure use.

Methods

Web analytics characterized usage patterns. A survey of READY users (N = 49; M age = 34.2, 82.9% female, 71% White) assessed adoption, perceived utility, clinician exposure use, and persistent barriers to exposure use.

Results

In its first three years, READY had 13,543 page views across 1,731 unique users; 442 (25.6%) registered as a site user to access specialized content. Survey data suggested variability in usage and perceived utility across toolkit components. Qualitative analyses highlighted persistent exposure barriers that pointed to potential READY refinements.

Conculsions

Overall, READY has been accessed by hundreds of clinicians, but its impact was limited by low return to the site. This study highlights strengths and limitations of standalone online implementation supports and identifies additional steps needed to optimally support clinicians to deliver exposure to youth in need.

What is the Status of Multi-Informant Treatment Fidelity Research?

OBJECTIVE

The precise measurement of treatment fidelity (quantity and quality in the delivery of treatment strategies in an intervention) is essential for intervention development, evaluation, and implementation. Various informants are used in fidelity assessment (e.g., observers, practitioners [clinicians, teachers], clients), but these informants often do not agree on ratings. This scoping review aims to ascertain the state of science around multi-informant assessment of treatment fidelity.

METHOD

A literature search of articles published through December 2021 identified 673 articles. Screening reduced the number of articles to 44, and the final study set included 35 articles.

RESULTS

There was substantial variability across studies regarding study design, how fidelity was operationalized, and how reliability was defined and assessed. Most studies evaluated the agreement between independent observers and practitioner-report, though several other informant pairs were assessed. Overall, findings suggest that concordance across fidelity informants was low to moderate, with a few key exceptions.

CONCLUSIONS

It is difficult to draw clear conclusions about the degree to which single versus multiple informant assessment is needed to produce an accurate and complete picture of treatment fidelity. The field needs to take steps to determine how to leverage multi-informant assessment to accurately assess treatment fidelity.

Parent-identified barriers to accessing exposure therapy: A qualitative study using process mapping

Background

Youth with anxiety and obsessive-compulsive disorder (OCD) rarely access exposure therapy, an evidence-based treatment. Known barriers include transportation, waitlists, and provider availability. Efforts to improve access to exposure require an understanding of the process that families take to find therapists, yet no prior studies have examined parents' perspectives of the steps involved.

Methods

Parents of children who have received exposure therapy for anxiety and/or OCD (N = 23) were recruited from a hospital-based specialty anxiety clinic where the majority of their children previously received exposure. Recruitment was ongoing until thematic saturation was reached. Parents completed questionnaires and attended an online focus group during which they were asked to describe each step they took-from recognizing their child needed treatment to beginning exposure. A process map was created and shown in real-time, edited for clarity, and emailed to parents for member checking. Authors analyzed process maps to identify common themes.

Results

Several themes emerged, as visually represented in a final process map. Participants identified a "search-outreach" loop, in which they repeated the cycle of looking for therapists, contacting them, and being unable to schedule an appointment due to factors such as cost, waitlists, and travel time. Parents often did not know about exposure and reported feeling guilty about their lack of knowledge and inability to find a suitable provider. Parents reported frustration that medical providers did not often know about exposure and sometimes dismissed parents' concerns. Participants emphasized the difficulty of navigating the mental health system; many reported that it took years to find an exposure therapist, and that the search was sometimes stalled due to fluctuating symptoms.

Conclusion

A common thread among identified barriers was the amount of burden placed on parents to find treatment with limited support, and the resultant feelings of isolation and guilt. Findings point to several directions for future research, such as the development of parent support groups for navigating the mental health system; enhancing coordination of care between medical and mental health providers; and streamlining referral processes.

Development of a Web-Based Training Platform for School Clinicians in Evidence-Based Practices for ADHD

Lack of training for school clinicians in evidence-based practices (EBPs) contributes to underutilization of such services for youth with attention-deficit/hyperactivity disorder (ADHD). Advances in web-based technology and videoconferencing have allowed for expanded access to and optimization of training. We describe the development and outcomes of a novel web-based platform for training school clinicians to gain skills in EBPs for school-age youth with ADHD. The training platform is adapted from an empirically supported, in-person training for a school-home behavioral intervention (Collaborative Life Skills program) and includes skill modules for working with teachers, parents, and students. Training methods include web-accessed manuals/handouts, skill example video clips, automated progress monitoring tools, and consultation/in-session coaching via videoconferencing. We gathered stakeholder qualitative and quantitative feedback during discovery and design phases of the iterative development. We then evaluated the usability, acceptability, fidelity and clinician and student outcomes of the remote training program. Focus group themes and qualitative feedback identified clinician preferences for remote training features (e.g., interactive, brief, role-plays/coaching methods), video tools (recorded samples of skills and therapy sessions), and progress monitoring tools (e.g., clear, easy to use). Clinician usability ratings of the platform were high with most components rated as moderately to very useful/easy to use. Clinician ratings of usability, fidelity implementing the treatment, and their EBP knowledge and confidence following training were favorable. Student's outcomes were similar to those achieved in prior studies of clinician in-person training. Results support the promise of remote, web-based clinician training for the dissemination of evidence-based practices.

Implementing service transformation for children and adolescents with eating disorders across England: the theory, politics, and pragmatics of large-scale service reform

BACKGROUND

Eating disorders are among the most serious mental health problems affecting children and young people and without appropriate treatment often have a protracted course with high levels of morbidity and mortality. While considerable progress has been made in recent years in developing effective evidence-based outpatient treatments, these are not always readily available. In England, until recently, the usual care pathway for young people with an eating disorder was referral from primary care to local generic Child and Adolescent Mental Health Services with varying levels of expertise in eating disorders and a mix of outpatient treatments available. Poor treatment progress or physical deterioration would usually result in inpatient admission. Admission rates were high, with children and young people with an eating disorder accounting for nearly a quarter of all child and adolescent psychiatric hospital admissions. Inpatient treatment is costly and has high relapse rates with some evidence that it may contribute to poorer long-term outcomes in eating disorders. Accumulating clinical and research evidence that early expert outpatient treatment can significantly reduce the need for inpatient care indicates,+ that investing in dedicated community-based eating disorders services is likely to be both clinically and economically beneficial.

OVERVIEW OF PAPER

This paper describes a large-scale transformation programme following a major government investment (initially £30 million/year, since then increased to over £50 million/year) aimed at service level change in the provision of eating disorder services for children and adolescents in England. We describe the history, background, political context, and clinical and research evidence that contributed to the government's decision to invest in eating disorders. We also provide a brief account of the implementation of an England-wide whole team training to support the creation of a network of over 70 dedicated community-based eating disorders services for children and young people.

Using readiness to understand implementation challenges in school mental health research

Schools and research partners are increasingly implementing complex, multicomponent interventions and school-wide frameworks to better meet students' social, emotional, behavioral, and academic needs; however, in the research and real-world contexts, implementation is often fraught with many challenges and barriers to success. This study explores implementation barriers encountered during a randomized controlled trial testing effects of one complex intervention strategy-the Interconnected Systems Framework-from the lens of a practical model for conceptualizing organizational readiness-the Interactive Systems Framework for Dissemination and Implementation. Implementation of the Interconnected Systems Framework was explored via focus group and key informant interviews with school and mental health professionals, and research team members responsible for implementing the intervention in randomly assigned study schools. Results from inductive thematic analysis of verbatim transcripts identified three primary implementation challenges: staff turnover, inadequate leadership buy-in, and insufficient time for training/planning. Each challenge is explored from interview participants' perspectives and the extant literature, then connected to recommendations from implementation science to help others avoid similar challenges in their well-intentioned efforts to address the mounting concern for students' wellbeing.

Cross-training needs among community-based clinicians in HIV and substance use

BACKGROUND

People with double burden of HIV and substance use have poorer treatment engagement and worse treatment outcomes. Cross-training of HIV and substance use disorder clinicians can potentially enhance the scale up and quality of integrated care. Research is needed on clinicians' areas of greatest training need in order to inform training development.

METHODS

Data from semi-structured individual interviews with 16 HIV and 13 substance use disorder clinicians (N = 29) examining clinician perspectives on their training needs were analyzed using thematic analysis focused on both a priori and emergent subthemes.

RESULTS

Several key emergent subthemes were identified across the a priori themes of: 1) past training experiences; 2) gaps in training; and 3) training and supervision format/structure. Both HIV and substance use clinicians reported they had received minimal formal cross-training and had mostly been trained "on the job." Clinicians also emphasized gaps in training regarding sensitivity and anti-stigma, the latest medications for opioid use disorder, and HIV prevention/treatment and referral resources. Regarding training and supervision format, clinicians cited didactic workshops and ongoing supervision as appealing strategies.

CONCLUSIONS

Results show that lack of formal and updated training for clinicians is an important gap in providing integrated HIV and substance use treatment. Didactic workshops and ongoing support strategies that address stigma, medications for HIV and substance use disorder, and referral resources are likely to be particularly valuable.

A Systematic Review of Cultural Competence Trainings for Mental Health Providers

We conducted a systematic review to characterize features and evaluate outcomes of cultural competence trainings delivered to mental health providers. We reviewed 37 training curricula described in 40 articles published between 1984-2019 and extracted information about curricular content (e.g., cultural identities), as well as training features (e.g., duration), methods (e.g., instructional strategies), and outcomes (i.e., attitudes, knowledge, skills). Training participants included graduate students and practicing professionals from a range of disciplines. Few studies (7.1%) employed a randomized-controlled trial design, instead favoring single-group (61.9%) or quasi-experimental (31.0%) designs. Many curricula focused on race/ethnicity (64.9%), followed by sexual orientation (45.9%) and general multicultural identity (43.2%). Few curricula included other cultural categorizations such as religion (16.2%), immigration status (13.5%), or socioeconomic status (13.5%). Most curricula included topics of sociocultural information (89.2%) and identity (78.4%), but fewer included topics such as discrimination and prejudice (54.1%). Lectures (89.2%) and discussions (86.5%) were common instructional strategies, whereas opportunities for application of material were less common (e.g., clinical experience: 16.2%; modeling: 13.5%). Cultural attitudes were the most frequently assessed training outcome (89.2%), followed by knowledge (81.1%) and skills (67.6%). To advance the science and practice of cultural competence trainings, we recommend that future studies include control groups, pre- and post-training assessment, and multiple methods for measuring multiple training outcomes. We also recommend consideration of cultural categories that are less frequently represented, how curricula might develop culturally competent providers beyond any single cultural category, and how best to leverage active learning strategies to maximize the impact of trainings.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Developing a statewide network of coaches to support youth access to evidence-based practices

Background: A national shortage of mental health providers for youth exists in the United States. Implementation support for mental health services in schools, where students are most likely to access care, can help to fill these gaps. Coaching consists of in vivo modeling and support during service delivery and is effective in supporting the implementation of evidence-based practices (EBPs). This implementation report describes the recruitment and training of community providers to become coaches as a part of a modified train-the-trainer model of implementation support. Method: An EBP implementation program, Transforming Research into Action to Improve the Lives of Students (TRAILS), trained community providers in Michigan to increase knowledge of cognitive behavioral therapy (CBT) and position them as coaches in schools. The development of the coach network involved five stages prior to the initiation of a randomized controlled trial: (1) recruitment, (2) a one-day clinical training, (3) 12 weeks of individualized consultation, (4) evaluation, and (5) training in the coaching protocol. Results: A total of 347 individuals attended an initial training, and 187 were paired with a consultant. Eighty-six clinicians from 47 of Michigan's 83 counties successfully became coaches by completing all required elements of training. Coaches showed significant improvements in the use and knowledge of CBT across consultation. Conclusion: Statewide networks of trained mental health professionals can address gaps in mental healthcare for youth. This article demonstrates one strategy for strengthening and leveraging community expertise to support the implementation of EPBs in schools.

Plain Language Summary

Although youth face many barriers in accessing effective mental health care, schools are one setting where they can more easily receive treatment. Research shows that training and supports are needed for school mental health professionals to provide effective care. Coaching, which involves in vivo support for school mental health professionals, is one helpful strategy. We describe the process of recruiting and training community clinicians to become coaches. The Transforming Research into Action to Improve the Lives of Students (TRAILS) program successfully recruited and trained a network of 86 community clinicians to become coaches. Clinicians attended two day-long trainings and participated in 12 weeks of personalized consultation. Clients to whom these clinicians provided CBT showed significant symptom improvement. Clinicians also reported that they increased their knowledge and use of core CBT strategies, including psychoeducation, exposure, and behavioral activation. Community mental health professionals who are trained as coaches can address gaps in access to care for youth. We demonstrate one strategy for strengthening and leveraging clinicians’ knowledge of CBT to support the school-based implementation of CBT.

Treating sleep and circadian problems to promote mental health: perspectives on comorbidity, implementation science and behavior change

Insufficient sleep and mistimed sleep are prominent, yet under-appreciated and understudied, contributors to poor mental health and to mental disorders. The evidence that improving sleep and circadian functioning is an important pathway to mental health continues to mount. The goal of this paper is to highlight three major challenges ahead. Challenge 1 points to the possibility that comorbidity is the norm not the exception for the sleep and circadian disorders that are associated with mental disorders. Hence, the sleep and circadian problems experienced by people diagnosed with a mental disorder may not fit into the neat diagnostic categories of existing nosologies nor be adequately treated with single disorder approaches. The Sleep Health Framework and the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) are discussed as alternative approaches. Challenge 2 points to the large time lag between the development of a treatment and the availability of that treatment in routine clinical practice. This is a key reason for the emergence of implementation science, which is a flourishing, well-developed, and quickly moving field. There is an urgent need for more applications of implementation science within sleep and circadian science. Challenge 3 describes one of the greatest puzzles of our time-the need to unlock the fundamental elements of behavior change. There is potential to harness the science of behavior change to encourage widespread engagement in sleep health behavior and thereby reduce the staggering burden of sleep and circadian problems and the associated mental health problems.

Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale

Plain Language Summary

Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.

The effectiveness of training community mental health therapists in an evidence-based intervention for ASD: Findings from a hybrid effectiveness-implementation trial in outpatient and school-based mental health services

LAY ABSTRACT

Publicly funded mental health services play an important role in caring for school-age children with autism spectrum disorder (ASD); however, therapists report a lack of specialized ASD training, which families identity as a barrier in obtaining mental health services for their children. An Individualized Mental Health Intervention for ASD (AIM HI) was developed in collaboration with community stakeholders to respond to identified needs of children and community therapists. The current study examined the effects of therapist training in AIM HI on the changes in therapist practice, including therapists' use of evidence-based intervention strategies in session. Data were collected from a study conducted in community outpatient and school based mental health programs randomly assigned to receive AIM HI therapist training or observation of routine care. Therapist and child clients were enrolled from participating programs. Therapists in AIM HI training received training and consultation for 6 months while delivering the AIM HI intervention to a participating client; therapists in usual care delivered routine care. Both groups of therapists video recorded psychotherapy sessions which were scored by trained raters. Differences between training groups were examined using multilevel modeling. Therapists trained in AIM HI were observed to use more extensive active teaching strategies with caregivers, engagement strategies with children, strategies promoting continuity of care, and had more structured sessions with more effective pursuit of caregiver and children skill teaching. Therapist licensure moderated some training outcomes.

Exploring perceptions of implementation practice capacity in community-based behavioral health organizations

Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.