Training Models for Implementing Evidence-Based Psychological Treatment: A Cluster-Randomized Trial in College Counseling Centers

Barriers and facilitators of help-seeking for eating, weight, and shape concerns among college students

Objective: Prevalence of disordered eating among college students is concerning, but professional help-seeking rates are low. This study examined barriers and facilitators of help-seeking for eating, weight, and shape concerns in this population. Participants: A non-clinical sample of undergraduates (N = 134; 64.7% females; 63.9% White; 61.7% freshman) were recruited from a research pool. Methods: Participants reported on help-seeking barriers, facilitators, intentions, and behaviors, as well as disordered eating, anxiety, and depression. Results: Commonly endorsed facilitators of help-seeking for disordered eating included desire to get better and other mental health issues. Commonly endorsed barriers highlighted themes of self-reliance. Recent and lifetime help-seeking behaviors suggested preferences for informal sources of help. Greater disordered eating predicted more endorsed facilitators of help-seeking, whereas greater depression predicted more endorsed barriers. Conclusion: Findings-highlighting self-reliance and preferences for informal sources of help-can facilitate efforts to better serve students who may be experiencing disordered eating.

A pilot study evaluating online training for therapist delivery of interpersonal psychotherapy for eating disorders

OBJECTIVE

Individuals with eating disorders (EDs) often do not receive evidence-based care, such as interpersonal psychotherapy (IPT), partly due to lack of accessible training in these treatments. The standard method of training (i.e., in-person workshops) is expensive and time consuming, prompting a need for more scalable training tools. The primary aim of this pilot and open trial was to examine the effects of an IPT online training platform on training outcomes (i.e., IPT fidelity, knowledge, and acceptance) and, secondarily, whether online training was different from in-person training (using a comparative sample from a separate study) in terms of training outcomes and patient symptoms.

METHOD

Participants were therapists (N = 60) and student patients (N = 42) at 38 college counseling centers. Therapists completed baseline questionnaires and collected data from a student patient with ED symptoms. Therapists then participated in an IPT online training program and completed post-training assessments.

RESULTS

Following online training, acceptance of evidence-based treatments, therapist knowledge of IPT, therapist acceptance of IPT, and treatment fidelity increased; acceptance of online training was high at baseline and remained stable after training. Using the 90% confidence interval on outcome effect sizes, results suggested IPT online training was not different from in-person training on most outcomes. Results are based on 60% of therapists who originally enrolled due to high dropout rate of therapist participants.

CONCLUSIONS

Findings from this preliminary pilot study support the use of IPT online training, which could increase access to evidence-based ED treatment and improve patient care.

PUBLIC SIGNIFICANCE

Lack of accessible therapist training has contributed to many therapists not delivering, and therefore many patients not receiving, evidence-based treatment. This study evaluated a highly disseminable online training and compared outcomes to traditional in-person training and found that training and patient outcomes were not different. Online training has the potential to enhance access to evidence-base care, which could in turn optimize patient outcomes.

Cost-effectiveness of train-the-trainer versus expert consultation training models for implementing interpersonal psychotherapy in college mental health settings: evidence from a national cluster randomized trial

BACKGROUND

This study is a cost-effectiveness study of two implementation strategies designed to train therapists in college and university counseling centers to deliver interpersonal psychotherapy. Costs of implementing a train-the-trainer (TTT) strategy versus an expert consultation strategy were estimated, and their relative effects upon therapist outcomes were calculated and compared.

METHODS

Twenty four counseling centers were recruited across the United States. These centers were randomized to either a TTT (experimental) condition, in which an in-house therapist trained other center therapists, or an expert consultation condition, in which center therapists participated in a workshop and received 12 months of ongoing supervision. The main outcome was therapist fidelity (adherence and competence) to interpersonal psychotherapy, assessed via audio recordings of therapy sessions, and analyzed using linear mixed models. Costs of each condition were quantified using time-driven activity-based costing methods, and involved a costing survey administered to center directors, follow up interviews and validation checks, and comparison of time tracking logs of trainers in the expert condition. Mean costs to produce one therapist were obtained for each condition. The costs to produce equivalent improvements in therapist-level outcomes were then compared between the two conditions.

RESULTS

Mean cost incurred by counseling centers to train one therapist using the TTT strategy was $3,407 (median = $3,077); mean cost to produce one trained therapist in the control condition was $2,055 (median = $1,932). Therapists in the TTT condition, on average, demonstrated a 0.043 higher adherence score compared to therapists in the control condition; however, this difference was not statistically significant. For the competence outcome, effect size for therapists in the TTT condition was in the large range (1.16; 95% CI: 0.85-1.46; p < .001), and therapists in this condition, on average, demonstrated a 0.073 higher competence score compared to those in the expert consultation condition (95% CI, 0.008-0.14; p = .03). Counseling centers that used the TTT model incurred $353 less in training costs to produce equivalent improvements in therapist competence.

CONCLUSIONS

Despite its higher short run costs, the TTT implementation strategy produces greater increases in therapist competence when compared to expert consultation. Expanding resources to support this platform for service delivery can be an effective way to enhance the mental health care of young people seeking care in college and university counseling centers.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02079142.

Commentary With Study Protocol: Implementation and Effectiveness of Mindfulness-Oriented Recovery Enhancement (MORE) as an Adjunct to Methadone Treatment for Opioid Use Disorder (IMPOWR-MORE)

Traditional methadone treatment (MT) for opioid use disorder (OUD) fails to systematically address the physical pain, emotion dysregulation, and reward processing deficits that co-occur with OUD, and novel interventions that address these issues are needed to improve MT outcomes. Mindfulness-Oriented Recovery Enhancement (MORE) remediates the hedonic dysregulation in brain reward systems that is associated with OUD. Our pilot and phase 2 randomized controlled trials of MORE were the first to demonstrate MORE's feasibility, acceptability, and efficacy as delivered in MT clinics; MORE significantly reduced drug use (eg, benzodiazepines, barbiturates, cocaine, marijuana, opioids, and other drugs), craving, depression, anxiety, and pain among people with OUD. However, uptake of novel, efficacious interventions like MORE may be slow in MT because time and resources are often limited. Therefore, to best address potential implementation issues and to optimize future MORE implementation and dissemination, in this study, we will utilize a Type 2, Hybrid Implementation-Effectiveness study design. We will not only evaluate MORE's effectiveness but also assess barriers and facilitators to integrating MORE into MT. MT clinicians will receive training in (1) a higher intensity MORE implementation strategy consisting of training in the full MORE treatment manual or (2) a minimal intensity implementation strategy consisting of a simple, scripted mindfulness practice (SMP) extracted from the MORE treatment manual with minimal training. We aim to: (1) using a Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework, examine barriers and facilitators to implementation of MORE and SMP in MT, and evaluate strategies for optimizing training, fidelity, and engagement, (2) optimize existing MORE and SMP training and implementation toolkits, including adaptable resources that can accelerate the translation of evidence into practice, and (3) compared to usual MT, evaluate the relative effectiveness of MORE plus MT or SMP plus MT (N = 450).

Calculating power for multilevel implementation trials in mental health: Meaningful effect sizes, intraclass correlation coefficients, and proportions of variance explained by covariates

Background

Despite the ubiquity of multilevel sampling, design, and analysis in mental health implementation trials, few resources are available that provide reference values of design parameters (e.g., effect size, intraclass correlation coefficient [ICC], and proportion of variance explained by covariates [covariate R 2]) needed to accurately determine sample size. The aim of this study was to provide empirical reference values for these parameters by aggregating data on implementation and clinical outcomes from multilevel implementation trials, including cluster randomized trials and individually randomized repeated measures trials, in mental health. The compendium of design parameters presented here represents plausible values that implementation scientists can use to guide sample size calculations for future trials.

Method

We searched NIH RePORTER for all federally funded, multilevel implementation trials addressing mental health populations and settings from 2010 to 2020. For all continuous and binary implementation and clinical outcomes included in eligible trials, we generated values of effect size, ICC, and covariate R2 at each level via secondary analysis of trial data or via extraction of estimates from analyses in published research reports. Effect sizes were calculated as Cohen d; ICCs were generated via one-way random effects ANOVAs; covariate R2 estimates were calculated using the reduction in variance approach.

Results

Seventeen trials were eligible, reporting on 53 implementation and clinical outcomes and 81 contrasts between implementation conditions. Tables of effect size, ICC, and covariate R2 are provided to guide implementation researchers in power analyses for designing multilevel implementation trials in mental health settings, including two- and three-level cluster randomized designs and unit-randomized repeated-measures designs.

Conclusions

Researchers can use the empirical reference values reported in this study to develop meaningful sample size determinations for multilevel implementation trials in mental health. Discussion focuses on the application of the reference values reported in this study.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: Study protocol for a hybrid type 2 effectiveness-implementation cluster- randomized trial using train-the-trainer

Background

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes (b) providers' perceptions of fit.

Methods

TTT will be implemented in nine CMHCs in California, United States (N= 60 providers; N= 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will: (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality); and (3) evaluate other possible moderators.

Discussion

This trial has potential to inform the process of (a) embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) adding to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advancing our understanding of providers' perceptions of EBPT 'fit' across TTT generations.

Trial registration

Clinicaltrials.gov identifier: NCT05805657. Registered on April 10, 2023. https://clinicaltrials.gov/ct2/show/NCT05805657.

An experimental test of increasing implementation support for college peer educators delivering an evidence-based prevention program

OBJECTIVE

College students are at particularly high risk for mental health problems, such as eating disorders, which are associated with functional impairment, distress, and morbidity, but barriers limit implementation of evidence-based interventions at colleges. We evaluated the effectiveness and implementation quality of a peer educator (PE) delivered eating disorder prevention program (the Body Project [BP]), which has a broad evidence-based using a train-the-trainer (TTT) approach and experimentally evaluated three levels of implementation support.

METHOD

We recruited 63 colleges with peer educator programs and randomly assigned them to (a) receive a 2-day TTT training in which peer educators were trained to implement the Body Project and supervisors were taught how to train future peer educators (TTT), (b) TTT training plus a technical assistance (TA) workshop (TTT + TA), or (c) TTT plus the TA workshop and quality assurance (QA) consultations over 1-year (TTT + TA + QA). Colleges recruited undergraduates (N = 1,387, 98% female, 55% White) to complete Body Project groups.

RESULTS

There were no significant differences across condition for attendance, adherence, competence, and reach, though nonsignificant trends suggested some benefit of TTT + TA + QA relative to TTT for adherence and competence (ds = .40 and .30). Adding TA and QA to TTT was associated with significantly larger reductions in risk factors and eating disorder symptoms.

CONCLUSIONS

Results suggest that the Body Project can be effectively implemented at colleges using peer educators and a TTT approach and that adding TA and QA resulted in significantly larger improvements in outcomes for group participants, and marginally higher adherence and competence. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A framework for conceptualising early intervention for eating disorders

OBJECTIVE

This paper outlines the evidence base for early intervention for eating disorders; provides a global overview of how early intervention for eating disorders is provided in different regions and settings; and proposes policy, service, clinician and research recommendations to progress early intervention for eating disorders.

METHOD AND RESULTS

Currently, access to eating disorder treatment often takes many years or does not occur at all. This is despite neurobiological, clinical and socioeconomic evidence showing that early intervention may improve outcomes and facilitate full sustained recovery from an eating disorder. There is also considerable variation worldwide in how eating disorder care is provided, with marked inequalities in treatment provision. Despite these barriers, there are existing evidence-based approaches to early intervention for eating disorders and progress is being made in scaling these.

CONCLUSIONS

We propose action steps for the field that will transform eating disorder service provision and facilitate early detection, treatment and recovery for everyone affected by eating disorders, regardless of age, socioeconomic status and personal characteristics.

Training home visitors in mentalization-based practice: A qualitative case study of clinical supervision in mothering from the inside out

Attachment-based interventions are important for improving parent-child outcomes. These interventions must be scaled and made available to under-resourced communities. An important part of scaling these interventions is delineating and reproducing high-quality training, including clinical training which often requires the completion of a supervised case. However, descriptions and guidelines for clinical training are frequently broad or not available in the literature. A detailed description of clinical training could lead to further research to improve the effectiveness and dissemination of evidence-based interventions. Mothering from the Inside Out (MIO) is an attachment-based parenting intervention effective at reducing substance use and depression, improving caregiving, and enhancing child attachment. It is now being brought from research to community settings. This paper outlines the didactic and clinical training components of MIO. We then present a qualitative case study of one community-based counselor participating in the clinical training of MIO and employ qualitative methods to describe the main themes that arose during the training. We aim to illustrate how the trainer assisted the counselor in implementing the core components of MIO, which included (a) refining the language used in MIO sessions, (b) making space to explore mental states, and (c) addressing trauma. We conclude by presenting the implications of these findings.

A computational approach to measure the linguistic characteristics of psychotherapy timing, responsiveness, and consistency

Although individual psychotherapy is generally effective for a range of mental health conditions, little is known about the moment-to-moment language use of effective therapists. Increased access to computational power, coupled with a rise in computer-mediated communication (telehealth), makes feasible the large-scale analyses of language use during psychotherapy. Transparent methodological approaches are lacking, however. Here we present novel methods to increase the efficiency of efforts to examine language use in psychotherapy. We evaluate three important aspects of therapist language use - timing, responsiveness, and consistency - across five clinically relevant language domains: pronouns, time orientation, emotional polarity, therapist tactics, and paralinguistic style. We find therapist language is dynamic within sessions, responds to patient language, and relates to patient symptom diagnosis but not symptom severity. Our results demonstrate that analyzing therapist language at scale is feasible and may help answer longstanding questions about specific behaviors of effective therapists.

Evaluating an implementation model of evidence-based therapy for eating disorders in non-specialist regional mental health settings

BACKGROUND

Many people with eating disorders (EDs) either do not access treatment, access it well after symptoms first start, or drop out of treatment. This study evaluated ways to improve early access to evidence-based interventions for those with EDs in a non-specialist community setting.

METHODS

In an Australian regional community, links were formed between general medical practitioners and treatment providers (psychologists, mental health social workers and dietitians), who received ongoing training, feedback and support. Service users had access to 20-40 subsidised treatment sessions. Data were collected from 143 patients over 18 months. Our outcomes are reported according to the RE-AIM implementation framework: Reach (we measured uptake and treatment completion); Effectiveness (impact on disordered eating cognitions, body mass index, remission, and moderators of effectiveness including illness duration, previous treatment, presence of comorbidities, presence of a normative level of disordered eating, presence of any ED behaviours, weighing in treatment, multidisciplinary case conferencing, number of dietetic sessions); Adoption (drop-out and predictors); Implementation (barriers encountered); Maintenance (subsequent activity designed to embed new practices).

RESULTS

Treatment was completed by 71%; significant large decreases in eating disorder cognitions were achieved; remission was obtained by 37% (intent-to-treat). Treatment completion was predicted by lower baseline levels of disordered eating, uptake of ≥ 3 dietetic sessions, and ≥ 2 team case conferences. Greater improvement over time was predicted by regular case conferencing and in-session weighing.

CONCLUSIONS

Implementation of this model in a regional community setting produced completion rates and outcomes comparable to those found in specialist clinical trials of ED treatments. Service providers identified care coordination as the most important factor to connect users to services and help navigate barriers to ongoing treatment.

TRIAL REGISTRATION

This research was an invited evaluation of a project implemented by the Australian Department of Health. The project did not introduce any new clinical practice but sought to improve access to evidence-based multidisciplinary treatment for people with EDs by removing four known systemic barriers: securing an accurate diagnosis, availability of multidisciplinary treatment, cost of treatment, and intensity of treatment. As such, the project did not require trial registration. Notwithstanding, this evaluation obtained ethics approval (Bellberry Human Research Ethics Committee, Application No: 2018-09-728-FR-1).

Binge eating disorder

Binge eating disorder (BED) is characterized by regular binge eating episodes during which individuals ingest comparably large amounts of food and experience loss of control over their eating behaviour. The worldwide prevalence of BED for the years 2018-2020 is estimated to be 0.6-1.8% in adult women and 0.3-0.7% in adult men. BED is commonly associated with obesity and with somatic and mental health comorbidities. People with BED experience considerable burden and impairments in quality of life, and, at the same time, BED often goes undetected and untreated. The aetiology of BED is complex, including genetic and environmental factors as well as neuroendocrinological and neurobiological contributions. Neurobiological findings highlight impairments in reward processing, inhibitory control and emotion regulation in people with BED, and these neurobiological domains are targets for emerging treatment approaches. Psychotherapy is the first-line treatment for BED. Recognition and research on BED has increased since its inclusion into DSM-5; however, continuing efforts are needed to understand underlying mechanisms of BED and to improve prevention and treatment outcomes for this disorder. These efforts should also include screening, identification and implementation of evidence-based interventions in routine clinical practice settings such as primary care and mental health outpatient clinics.

Maintenance of Training Effects of Two Models for Implementing Evidence-Based Psychological Treatment

OBJECTIVE

The authors compared maintenance of training outcomes for two approaches to training college therapists in interpersonal psychotherapy (IPT): train the trainer versus expert training.

METHODS

A cluster-randomized trial was conducted in 24 college counseling centers. Therapists were recruited from enrolled centers, and the therapists enrolled students with depression and eating disorder symptoms. The therapists (N=184) provided data during baseline, posttraining (during the 12 months of expert consultation offered to the expert training group), and maintenance (approximately 7 months after the expert consultation ended). Outcomes were therapist fidelity (i.e., adherence and competence) and IPT knowledge.

RESULTS

Both groups showed within-group improvement from baseline to the maintenance period for adherence, competence, and IPT knowledge; however, the train-the-trainer group had greater improvement over time in adherence and competence.

CONCLUSIONS

Given that the effects of the train-the-trainer approach were better maintained, and this model's potential to train more therapists over time, the train-the-trainer approach may help increase dissemination of evidence-based treatments such as IPT.

Cognitive Behavioral Therapy for the Eating Disorders

Research findings strongly suggest that cognitive behavioral therapy for the eating disorders (CBT-ED) is more effective than other treatments for bulimia nervosa (BN) and for binge eating disorder (BED), although interpersonal psychotherapy appears to be equally effective for BED. Evidence for the effectiveness of CBT-ED for the persistent (adult) form of anorexia nervosa (AN) is insufficient at present and is essentially absent for AN in adolescents except for some evidence from uncontrolled trials. This article begins with an overview of the early studies in the development of CBT-ED that showed a similar effectiveness of other symptom-focused psychotherapies-a finding that was neglected at the time. Later developments are then considered, including comparisons of CBT-ED with other psychotherapies, efforts to develop Internet-based training and treatment, and electronic applications for treatment. Finally, implications of the findings for future short- and long-term research and for clinical practice are considered.

Digital training for non-specialist health workers to deliver a brief psychological treatment for depression in India: Protocol for a three-arm randomized controlled trial

BACKGROUND

Training non-specialist health workers (NSHWs) at scale is a major barrier to increasing the coverage of depression care in India. This trial will test the effectiveness of two forms of digital training compared to conventional face-to-face training in changing the competence of NSHWs to deliver a brief evidence-based psychological treatment for depression.

METHODS

This protocol is for a three-arm, parallel group randomized controlled trial comparing three ways of training NSHWs to deliver the Healthy Activity Program (HAP), a brief manualized psychotherapy for depression, in primary care. The arms are: digital training (DGT); digital training combined with individualized coaching support (DGT+); and conventional face-to-face training (F2F). The target sample comprises N = 336 government contracted NSHWs in Madhya Pradesh, India. The primary outcome is change of competence to deliver HAP; secondary outcomes include cost-effectiveness of the training programs, change in participants' mental health knowledge, attitudes and behavior, and satisfaction with the training. Assessors blind to participant allocation status will collect outcomes pre- (baseline) and post- (endpoint) training to ascertain differences in outcomes between arms. Training program costs will be collected to calculate incremental costs of achieving one additional unit on the competency measure in the digital compared to face-to-face training programs. Health worker motivation, job satisfaction, and burnout will be collected as exploratory outcome variables.

DISCUSSION

This trial will determine whether digital training is an effective, cost-effective, and scalable approach for building workforce capacity to deliver a brief evidence-based psychological treatment for depression in primary care in a low-resource setting.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04157816.