MAPping Los Angeles County: taking an evidence-informed model of mental health care to scale

Pilot study of implementing Managing and Adapting Practice in a German psychotherapy master's program

Despite a significant accumulation of research, there has been little systemic implementation of evidence-based practices (EBP) in youth mental health care. The fragmentation of the evidence base complicates implementation efforts. In light of this challenge, we sought to pilot a system that consolidates and coordinates the entire evidence base in a single direct service model (i.e., Managing and Adapting Practice; MAP) in the context of a legal reform of psychotherapy training in Germany. This pilot study aimed to evaluate the feasibility of the implementation of MAP into the curriculum of the reformed German master's program. Eligible participants were students in the master's program at Philipps-University Marburg during the winter-term 2022/2023. Students first learned about MAP through introductions and role plays (seminar 1), followed by actively planning and conducting interventions using MAP resources for patients in a case seminar under supervision (seminar 2). A repeated-measures survey was conducted to investigate students' knowledge gains, perception of MAP and changes in their self-rated confidence to use EBP. Results indicated that students perceive MAP to be manageable to learn. Positive progress was achieved with regard to their knowledge and self-reported confidence to use EBP, although interpretation and generalization of the results are limited by small and homogeneous samples, lack of statistical power and missing comparison groups. The feasibility of the implementation and suitability of measures are discussed. Important implications could be drawn with regard to future investigations.

Effects of Training in Cognitive Behavioural Therapy and Motivational Interviewing on Mental Health Practitioner Behaviour: A Systematic Review and Meta-Analysis

Effective training of mental health professionals is crucial for bridging the gap between research and practice when delivering cognitive behavioural therapy (CBT) and motivational interviewing (MI) within community settings. However, previous research has provided inconclusive evidence regarding the impact of training efforts. The current study aimed to systematically search, review and synthesize the literature on CBT and MI training to assess its effect on practitioner behavioural outcomes. Following prospective registration, a literature search was conducted for studies where mental health practitioners were exposed to training in face-to-face CBT or MI, reporting on at least one quantitative practitioner behavioural outcome. A total of 116 studies were eligible for the systematic review, and 20 studies were included in four meta-analyses. The systematic review highlights the need to establish psychometrically valid outcome measures for practitioner behaviour. Results of the meta-analyses suggest that training has a greater effect on practitioner behaviour change compared to receiving no training or reading a treatment manual. Training combined with consultation/supervision was found to be more effective than training alone, and no differences were found between face-to-face and online training. Results should be interpreted with caution due to methodological limitations in the primary studies, large heterogeneity, and small samples in the meta-analyses. Future directions are discussed.

Getting More Out of Clinical Documentation: Can Clinical Dashboards Yield Clinically Useful Information?

This study investigated coded data retrieved from clinical dashboards, which are decision-support tools that include a graphical display of clinical progress and clinical activities. Data were extracted from clinical dashboards representing 256 youth (M age = 11.9) from 128 practitioners who were trained in the Managing and Adapting Practice (MAP) system (Chorpita & Daleiden in BF Chorpita EL Daleiden 2014 Structuring the collaboration of science and service in pursuit of a shared vision. 43(2):323 338. 2014, Chorpita & Daleiden in BF Chorpita EL Daleiden 2018 Coordinated strategic action: Aspiring to wisdom in mental health service systems. 25(4):e12264. 2018) in 55 agencies across 5 regional mental health systems. Practitioners labeled up to 35 fields (i.e., descriptions of clinical activities), with the options of drawing from a controlled vocabulary or writing in a client-specific activity. Practitioners then noted when certain activities occurred during the episode of care. Fields from the extracted data were coded and reliability was assessed for Field Type, Practice Element Type, Target Area, and Audience (e.g., Caregiver Psychoeducation: Anxiety would be coded as Field Type = Practice Element; Practice Element Type = Psychoeducation; Target Area = Anxiety; Audience = Caregiver). Coders demonstrated moderate to almost perfect interrater reliability. On average, practitioners recorded two activities per session, and clients had 10 unique activities across all their sessions. Results from multilevel models showed that clinical activity characteristics and sessions accounted for the most variance in the occurrence, recurrence, and co-occurrence of clinical activities, with relatively less variance accounted for by practitioners, clients, and regional systems. Findings are consistent with patterns of practice reported in other studies and suggest that clinical dashboards may be a useful source of clinical information. More generally, the use of a controlled vocabulary for clinical activities appears to increase the retrievability and actionability of healthcare information and thus sets the stage for advancing the utility of clinical documentation.

Implementation fidelity, student outcomes, and cost-effectiveness of train-the-trainer strategies for Masters-level therapists in urban schools: results from a cluster randomized trial

BACKGROUND

Little is known about the effectiveness and cost-effectiveness of train-the-trainer implementation strategies in supporting mental health evidence-based practices in schools, and about the optimal level of support needed for TT strategies.

METHODS

The current study is part of a larger type 2 hybrid cluster randomized controlled trial. It compares two train-the-trainer strategies, Train-the-Trainer (TT) and Train-the-Trainer plus ongoing consultation for trainers (TT +) on the delivery of a group cognitive behavioral treatment protocol for anxiety disorders. Participants were 33 therapists, 29 supervisors, and 125 students who were at risk for anxiety disorders from 22 urban schools. Implementation outcomes were implementation fidelity and treatment dosage. Student outcomes were child- and parent-reported symptoms of anxiety, child-reported symptoms of depression, and teacher-reported academic engagement. We estimated the cost of implementing the intervention in each condition and examined the probability that a support strategy for supervisors (TT vs TT +) is a good value for varying values of willingness to pay.

RESULTS

Therapists in the TT and TT + conditions obtained similarly high implementation fidelity and students in the conditions received similar treatment dosages. A mixed effects modeling approach for student outcomes revealed time effects for symptoms of anxiety and depression reported by students, and emotional disaffection reported by teachers. There were no condition or condition × times effects. For both conditions, the time effects indicated an improvement from pre-treatment to post-treatment in symptoms of anxiety and depression and academic emotional engagement. The average cost of therapist, supervisor, and consultant time required to implement the intervention in each condition was $1002 for TT and $1431 for TT + (p = 0.01). There was a greater than 80% chance that TT was a good value compared to TT + for all values of willingness to pay per one-point improvement in anxiety scores.

CONCLUSIONS

A TT implementation approach consisting of a thorough initial training workshop for therapists and supervisors as well as ongoing supervision for therapists resulted in adequate levels of fidelity and student outcomes but at a lower cost, compared to the TT + condition that also included ongoing external expert consultation for supervisors.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02651402.

A Statewide Randomized Controlled Trial to Compare Three Models for Implementing Parent Child Interaction Therapy

OBJECTIVE

This study (NIMH RO1 MH095750; ClinicalTrials.gov Identifier: NCT02543359) evaluated the effectiveness of three training models to implement a well-established evidence-based treatment, Parent-Child Interaction Therapy (PCIT).

METHOD

Fifty licensed outpatient clinics, including 100 clinicians, 50 supervisors, and 50 administrators were randomized to one of three training conditions: 1) Learning Collaborative (LC), 2) Cascading Model (CM) or 3) Distance Education (DE). Data to assess training and implementation outcomes were collected at 4 time points coinciding with the training period: baseline, 6- (mid), 12- (post), and 24-months (1-year follow-up).

RESULTS

Multi-level hierarchical linear growth modeling was used to examine changes over time in training outcomes. Results indicate that clinicians in CM were more likely to complete training, reported high levels of training satisfaction and better learning experiences compared to the other training conditions. However, supervisors in the LC condition reported greater learning experiences, higher levels of knowledge, understanding of treatment, and satisfaction compared to supervisors in other conditions. Although clinicians and supervisors in the DE condition did not outperform their counterparts on any outcomes, their performance was comparable to both LC and CM in terms of PCIT use, supervisor perceived acceptability, feasibility, system support, and clinician satisfaction.

CONCLUSIONS

Through the use of a randomized controlled design and community implementation, this study contributes to the current understanding of the impact of training design on implementation of PCIT. Results also indicate that although in-person training methods may produce more positive clinician and supervisor outcomes, training is not a one-size-fits-all model, with DE producing comparable results on some variables.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: study protocol for a hybrid type 2 effectiveness-implementation cluster-randomized trial using train-the-trainer

BACKGROUND

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes and (b) providers' perceptions of fit.

METHODS

TTT will be implemented in nine CMHCs in California, USA (N = 60 providers; N = 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality), and (3) evaluate other possible moderators.

DISCUSSION

This trial has potential to (a) inform the process of embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) add to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advance our understanding of providers' perceptions of EBPT "fit" across TTT generations.

TRIAL REGISTRATION

ClinicalTrials.gov identifier NCT05805657 . Registered on April 10, 2023.

Core Elements of Family Therapy for Adolescent Behavioral Health Problems: Validity Generalization in Community Settings

OBJECTIVE

The core elements of family therapy for adolescent mental health and substance use problems, originally distilled from high-fidelity sessions conducted by expert clinicians, were tested for validity generalization when delivered by community therapists in routine settings.

METHOD

The study sampled recorded sessions from 161 cases participating in one of three treatment pools: implementation trial of Functional Family Therapy (98 sessions/50 cases/22 therapists), adaptation trial of Multisystemic Therapy (115 sessions/59 cases/2 therapists), and naturalistic trial of non-manualized family therapy in usual care (107 sessions/52 cases/21 therapists). Adolescents were identified as 60% male and 40% female with an average age of 15.4 years; 49% were Latinx, 27% White Non-Latinx, 15% African American, 3% another race/ethnicity, 6% race/ethnicity unknown. Session recordings (n = 320) were randomly selected for each case and coded for 21 discrete family therapy techniques. Archived data of one-year clinical outcomes were gathered.

RESULTS

Confirmatory factor analyses replicated the factor structure from the original distillation study, retaining all four clinically coherent treatment modules comprised of all 21 techniques: Interactional Change (ICC = .77, Cronbach's α = .81); Relational Reframe (ICC = .75, α = .81); Adolescent Engagement (ICC = .72, α = .78); Relational Emphasis (ICC = .76, α = .80). Exploratory analyses found that greater use of core techniques predicted symptom improvements in one treatment pool.

CONCLUSIONS

Core techniques of family therapy distilled from manualized treatments for adolescent behavioral health problems showed strong evidence of validity generalization, and initial evidence of links to client outcomes, in community settings.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: Study protocol for a hybrid type 2 effectiveness-implementation cluster- randomized trial using train-the-trainer

Background

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes (b) providers' perceptions of fit.

Methods

TTT will be implemented in nine CMHCs in California, United States (N= 60 providers; N= 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will: (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality); and (3) evaluate other possible moderators.

Discussion

This trial has potential to inform the process of (a) embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) adding to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advancing our understanding of providers' perceptions of EBPT 'fit' across TTT generations.

Trial registration

Clinicaltrials.gov identifier: NCT05805657. Registered on April 10, 2023. https://clinicaltrials.gov/ct2/show/NCT05805657.

Future Directions in Youth and Family Treatment Engagement: Finishing the Bridge Between Science and Service

The field has spent more than 50 years investing in the quality of youth mental healthcare, with intervention science yielding roughly 1,300 efficacious treatments. In the latter half of this period, concurrent efforts in implementation science have developed effective methods for supporting front-line service organizations and therapists to begin to bridge the science to service gap. However, many youths and families still do not benefit fully from these strategic investments due to low treatment engagement: nearly half of youths in need of services pursue them, and among those who do, roughly another half terminate prematurely. The negative impact of low engagement is substantial, and is disproportionally and inequitably so for many. We contend that to build a robust and "finished" bridge connecting science and service, the field must go beyond its two historical foci of designing interventions and preparing therapists to deliver them, to include an intentional focus on the youths and families who participate in these interventions and who work with those therapists. In this paper, we highlight the significance of treatment engagement in youth mental healthcare and discuss the current state of the literature related to four priorities: conceptualization, theory, measurement, and interventions. Next, we offer an example from our own program of research as one illustration for advancing these priorities. Finally, we propose recommendations to act on these priorities.

Implementation of Evidence-Based Practices within Treatment-As-Usual and Evidence-Based Practice Initiatives

Publicly funded initiatives are underway to improve implementation of evidence-based practices (EBP) in youth mental health services. However, we know little about the success of these initiatives or about EBP implementation independent of such initiatives. We examined EBP implementation in a treatment as usual (TAU) state and in six states with publicly funded EBP initiatives (EBPIs). In Study 1, we examined providers' use of practices derived from the evidence base (PDEB) and their predictors among 780 providers in a TAU state. In Study 2, we conducted a systematic review of implementation strategies, outcomes, and predictors of EBP use in six state funded EBPIs. Study 1 suggests TAU providers use PDEB alongside practices without consistent research support; provider racial/ethnic minority status, learning theory orientation, and manual use predict greater PDEB use. Study 2 indicates EBPIs employ multiple recommended implementation strategies with variable outcomes across studies and measurement approaches. Predictors of EBP use in EBPIs also varied, though training, setting, and youth age were consistent predictors across studies. While sample differences and inconsistent measurement across studies made direct comparisons somewhat tenuous, rates of PDEB use in the TAU sample appeared similar to those in publicly funded EBPIs. However, two states reported comparisons with TAU samples and found higher EBP implementation under EBPI. Different predictors impacted EBP use in TAU versus EBPIs. Our findings highlight the need for improved evaluation of EBPIs including clear reporting standards for outcomes and more consistent, standardized measurement of EBP use in order to better understand and improve EBPIs.

Stakeholder-Generated Implementation Strategies to Promote Evidence-Based ADHD Treatment in Community Mental Health

Community implementation of evidence-based practices (EBPs) for Attention Deficit/Hyperactivity Disorder (ADHD) is greatly lacking. A recent randomized community-based trial of an EBP for ADHD (Supporting Teens' Autonomy Daily; STAND) demonstrated suboptimal implementation and effectiveness outcomes. In the present study, we conducted an Innovation Tournament (IT) with agency staff stakeholders (N = 26) to identify barriers to successful implementation of STAND and implementation strategies for a revised service delivery model. We conducted member-checking of agency staff-generated ideas with parents (N = 226) and subsequent querying of additional parent (N = 226) and youth-generated (N = 205) strategies to improve care. Go-Zone plots were utilized to identify strategies with the highest feasibility and importance. Practical barriers (i.e., transportation, scheduling difficulties) and parent/youth engagement were the most commonly cited obstacles to successful implementation of STAND in community contexts. Eighteen "winning" implementation strategies were identified that survived member checking. These were classified as train and educate stakeholders (n = 5; e.g., train agency supervisors to deliver supervision, digitize treatment materials and trainings), engage consumers (n = 9; e.g., begin treatment with rapport building sessions, increase psychoeducation), provide interactive assistance (n = 2; e.g., add group supervision, increase roleplay in supervision), and use of evaluative/iterative strategies (n = 2; e.g., perform fidelity checks, supervisor review of session recordings). Parents and youth desired longer duration of treatment and increased focus on maintenance. Strategies will be developed and tested as part of a pilot effectiveness trial designed to refine STAND's service delivery model.Trial Registration NCT02694939 www.clinicaltrials.gov.

The implementation potential of a method to monitor empirically-supported children's mental health treatment through claims data

Background

The delivery of evidence-supported treatments (EST) in children’s mental health could be a valuable measure for monitoring mental healthcare quality; however, efforts to monitor the use of EST in real world systems are hindered by the lack of pragmatic methods. This mixed methods study examined the implementation and agency response rate of a pragmatic, claims-based measure of EST designed to be applied as a universal quality measure for child psychotherapy encounters in a state Medicaid system.

Methods

Implementation potential of the EST measure was assessed with healthcare leader rankings of the reporting method’s acceptability, appropriateness and feasibility (n = 53), and post-implementation ratings of EST rate accuracy. Ability of the healthcare system to monitor EST through claims was measured by examining the agency responsivity in using the claims-based measure across 98 Medicaid-contracted community mental health (CMH) agencies in Washington State.

Results

The analysis found the reporting method had high implementation potential. The method was able to measure the use of an EST for 83% of children covered by Medicaid with 58% CMH agencies reporting > 0 ESTs in one quarter. Qualitative analyses revealed that the most significant barrier to reporting ESTs was the operability of electronic health record systems and agencies’ mixed views regarding the accuracy and benefits of reporting.

Conclusions

Measurement of child mental health ESTs through Medicaid claims reporting has acceptable implementation potential and promising real world responsiveness from CMH agencies in one state. Variation in reporting by agency site and low to moderate perceived value by agency leaders suggests the need for additional implementation supports for wider uptake.

Pilot Study of the MAP Curriculum for Psychotherapy Competencies in Child and Adolescent Psychiatry

OBJECTIVE

This pilot study aimed to evaluate the relevance, feasibility, acceptability, and instructional efficacy of the Managing and Adapting Practice (MAP) curriculum for enhancing the teaching of psychotherapy to child and adolescent psychiatry (CAP) fellows. MAP is a system of resources and decision models that supports practitioners in selecting and implementing psychotherapeutic interventions for children and adolescents. The MAP curriculum includes modules to guide education about psychotherapeutic procedures (e.g., behavioral activation) common in evidence-based treatments for an array of childhood problems and to support development of competencies in assessment, treatment planning, and reflective practice.

METHODS

Curriculum coding was used to examine the relevance of MAP's core components to the skills articulated in the Accreditation Council for Graduate Medical Education (ACGME) CAP milestones. Feasibility, acceptability, and learning outcomes were examined after delivery of the MAP curriculum to 12 CAP fellows at two sites, with instructional features tailored according to faculty preferences and training program structure.

RESULTS

Coding suggested that the MAP curriculum was relevant to 95% of the 21 ACGME CAP training subcompetencies. Feasibility was indicated by the successful delivery of 100% of the planned MAP curriculum across the two sites. Acceptability was supported by positive feedback from the CAP fellows, and psychotherapy knowledge increased significantly. Finally, case review scores (mean±SD=2.21±0.15) showed positive posttraining application of MAP to two patients and exceeded scores achieved by other samples of mental health professionals.

CONCLUSIONS

This pilot study demonstrated the potential for the MAP curriculum to support CAP education. MAP's versatility as a curriculum supports broader adoption, with continuing rigorous empirical evaluation.

Caregiver Attendance as a Quality Indicator in the Implementation of Multiple Evidence-Based Practices for Children

OBJECTIVE

This study investigated a quality indicator for children's mental health, caregiver attendance in youth psychotherapy sessions, within a system-driven implementation of multiple evidence-based practices (EBPs) in children's community mental health services.

METHOD

Administrative claims from nine fiscal years were analyzed to characterize and predict caregiver attendance. Data included characteristics of therapists (n = 8,626), youth clients (n = 134,368), sessions (e.g., individual, family), and the EBP delivered. Clients were primarily Latinx (63%), male (54%) and mean age was 11; they presented with a range of mental health problems. Three-level mixed models were conducted to examine the association between therapist, youth, service, EBP characteristics and caregiver attendance.

RESULTS

Caregivers attended, on average, 46.0% of sessions per client for the full sample and 59.6% of sessions for clients who were clinically indicated, based on age and presenting problem, to receive caregiver-focused treatment. Following initial EBP implementation, the proportion of caregiver attendance in sessions increased over time. Caregivers attended a higher proportion of youth psychotherapy sessions when clients were younger, had an externalizing disorder, were non-Hispanic White, and were male. Further, higher proportions of caregiver attendance occurred when services were delivered in a clinic setting (compared with school and other settings), by bilingual therapists, and the EBP prescribed caregiver attendance in all sessions.

CONCLUSIONS

Overall, the patterns of caregiver attendance appear consistent with evidence-informed practice parameters of client presenting problem and age. Yet, several improvement targets emerged such as client racial/ethnic background and service setting. Potential reasons for these disparities are discussed.

Aligning dissemination and implementation science with health policies to improve children's mental health

The prevalence of mental health problems among children (ages 0-21) in the United States remains unacceptably high and, post-COVID-19, is expected to increase dramatically. Decades of psychological knowledge about effective treatments should inform the delivery of better services. Dissemination and implementation (D&I) science has been heralded as a solution to the persistent problem of poor quality services and has, to some extent, improved our understanding of the contexts of delivery systems that implement effective practices. However, there are few studies demonstrating clear, population-level impacts of psychological interventions on children. Momentum is growing among communities, cities, states, and some federal agencies to build "health in all policies" to address broad familial, social, and economic factors known to affect children's healthy development and mental health. These health policy initiatives offer a rare opportunity to repurpose D&I science, shifting it from a primary focus on evidence-based practice implementation, to a focus on policy development and implementation to support child and family health and well-being. This shift is critical as states develop policy responses to address the health and mental health impacts of the COVID-19 pandemic on already-vulnerable families. We provide a typology for building research on D&I and children's mental health policy. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes

A lack of effective therapist training is a major barrier to evidence-based intervention (EBI) delivery in the community. Systematic reviews published nearly a decade ago suggested that traditional EBI training leads to higher knowledge but not more EBI use, indicating that more work is needed to optimize EBI training and implementation. This systematic review synthesizes the training literature published since 2010 to evaluate how different training models (workshop, workshop with consultation, online training, train-the-trainer, and intensive training) affect therapists' knowledge, beliefs, and behaviors. Results and limitations for each approach are discussed. Findings show that training has advanced beyond provision of manuals and brief workshops; more intensive training models show promise for changing therapist behavior. However, methodological issues persist, limiting conclusions and pointing to important areas for future research.

Service use by youth with autism within a system-driven implementation of evidence-based practices in children's mental health services

Public mental health systems play an important role in caring for youth with autism spectrum disorder. Like other dually diagnosed populations, youth with autism spectrum disorder may receive services in the context of evidence-based practice implementation efforts within public mental health systems. Little is known about service use patterns within the context of system-driven implementations efforts for this population. This case-control study examined mental health service patterns of 2537 youth with autism spectrum disorder compared to 2537 matched peers receiving care in the Los Angeles County Department of Mental Health, the largest public mental health department in the United States, within the context of a system-driven implementation of multiple evidence-based practices. Although not the primary target of this implementation effort, youth with autism spectrum disorder were served when they met criteria for the services based on their presenting mental health symptoms. Comparative analyses using administrative claims data were conducted to examine differences in mental health utilization patterns and clinical characteristics. Findings revealed significant differences in the volume and duration of mental health services as well as differences in the service type and evidence-based practice delivered between youth with and without autism spectrum disorder. Results provide direction targeting implementation efforts for youth with autism spectrum disorder within a public mental health system care reform.

How can adolescent aggression be reduced? A multi-level meta-analysis

Aggressive behaviour among adolescents has significant social and economic costs. Numerous attempts have been made to intervene to reduce aggression in adolescents. However, little is known about what factors enhance or diminish intervention effectiveness. The present systematic review and meta-analysis, therefore, seeks to quantify the effectiveness of interventions to reduce aggressive behaviour in adolescents and to identify when and for whom such interventions work best. Sixteen databases were searched for randomised controlled trials that assessed interventions to reduce aggression among adolescents. After screening 9795 records, 95 studies were included. A multi-level meta-analysis found a significant overall small-to-medium effect size (d = 0.28; 95% CI [0.17, 0.39]). More effective interventions were of shorter duration, were conducted in the Middle East, were targeted at adolescents with higher levels of risk, and were facilitated by intervention professionals. Potentially active ingredients were classified using the Behaviour Change Technique Taxonomy. Behavioural practice and problem solving were components of more effective interventions targeted at the general population. Overall the findings indicate that psychosocial interventions are effective in reducing adolescent aggression. Future trials need to assess the effect of individual techniques and their combination to identify the key components that can reduce aggression in adolescents.

Race and Equity in Statewide Implementation Programs: An Application of the Policy Ecology of Implementation Framework

Although the literature is growing regarding large-scale, system-wide implementation programs, the broader political and social contexts, including race and ethnicity, are frequently ignored. Using the Policy Ecology of Implementation framework (Raghavan et al., Implement Sci 3:26, 2008), Minnesota's CEMIG is examined to investigate the role of social and political contexts in the implementation process and the barriers they create. Data from 22 interview transcripts from DHS administrators, agency grant managers, university educators, advocacy group representatives, and mental health board members, along with more than 1000 grant documents were qualitatively analyzed using content analysis to reveal three themes concerning how the participants experienced program implementation: invisibility, isolation, and inequity. Findings demonstrate the participants perceived that the grant program perpetuated inequities by neglecting to promote the program, advocate for clinicians of color, and coordinate isolated policy ecology systems. Strategies for future large-scale, system-wide mental health program implementation are provided.

Implementing Parent-Teen Motivational Interviewing + Behavior Therapy for ADHD in Community Mental Health

Despite the promise of psychosocial interventions for adolescent Attention Deficit Hyperactivity Disorder (ADHD), there are no studies that examine their implementation in community mental health contexts. In this study, we evaluate the implementation of community-based Supporting Teens' Autonomy Daily (STAND), a parent-teen Motivational Interviewing + Behavior Therapy intervention for adolescents with ADHD. Adolescents with ADHD (N = 225), who were clients at four community mental health agencies, received treatment from 82 therapists. There was double randomization of adolescents and therapists to STAND or Usual Care (UC). Nearly all therapists randomized to STAND completed the training and regularly attended supervision, rating STAND as acceptable and lower burden than UC practices. In the STAND group, MI competence and implementation were lower than in university trials (benchmark range, 19.5% for reflection to question ratio to 83.1% for technical globals). MI integrity in the STAND group was significantly higher than UC across most MITI indices. Content fidelity was adequate in STAND's engagement and skills phases (76.4-85.0%), but not its planning phase (24.4%). Therapists commonly neglected weekly review of goals and home practice and deviated from manualized pace and sequencing of therapy tasks. Learning MI was more challenging for bilingual therapists and therapists with more years of experience. STAND was delivered with higher integrity in earlier sessions and office-based sessions. Discussion identifies future directions for exporting adolescent ADHD interventions to community settings. Patient outcome data for this trial is presented elsewhere. Trial Registration: NCT02694939 www.clinicaltrials.gov .

Common Elements of Childhood Universal Mental Health Programming

Despite the availability of multiple mental health prevention and promotion programs for children, challenges related to their dissemination limit their reach and impact. This review identifies the most common practice elements of effective childhood universal mental health programming for children ages 3-11, based on a structured interpretation and coding of program manuals and descriptions in peer-reviewed articles. Across a range of program goals and targeted outcomes, psychoeducation and problem solving emerged as the most common practice elements, followed by social skills training, insight building, and communication skills. These skills were largely taught via role-plays and modeling. Synthesizing what we know from the universal mental health programming literature has potential to facilitate dissemination of information to inform the development, adaptation or adoption of programs for children.

Community Mental Health Professionals' Perceptions About Engaging Underserved Populations

This study explored mental health professionals' perceptions about barriers and facilitators to engaging underserved populations. Responses were coded using an iterative thematic analysis based on grounded theory. Results revealed that many professionals endorsed barriers to engaging ethnic minorities and families receiving social services. Client-provider racial and linguistic matching, therapy processes and procedures (e.g., nonjudgmental stance), and implementation supports (e.g., supervision) were commonly nominated as engagement facilitators. Many professionals felt that an organizational culture focused on productivity is detrimental to client engagement. Findings shed light on professionals' perceived barriers to delivering high-quality care to underserved communities and illuminate potential engagement strategies.

A systematic review of prevention programs targeting depression, anxiety, and stress in university students

BACKGROUND

Given the prevalence of anxiety, depression, and stress among university students, it is important to assess the effectiveness of prevention programs for these problems. Beyond examining effect sizes, applying a common elements approach can enhance our understanding of which practice elements are most frequently included in symptom-reducing programs.

METHOD

This review examined effective (i.e., outcome-producing) prevention programs targeting depression, anxiety, and/or stress in university students. Programs could be delivered in a group-based, online/computer-delivered, or self-administered format and at the universal, selective, or indicated prevention level.

RESULTS

The resulting sample of 62 articles covered 68 prevention programs for college, graduate, or professional students across 15 countries. Average effect sizes for programs were moderate (overall g = 0.65), regardless of delivery format or prevention level. The most common practice elements (overall and for programs producing large effects) were: psychoeducation (72%), relaxation (69%), and cognitive monitoring/restructuring (47%). Many programs were limited by: (a) symptom target-outcome mismatches, (b) disproportionately female samples, and (c) inconsistently reported adherence data.

LIMITATIONS

Commonness of practice elements across outcome-producing interventions does not imply their extensiveness nor unique contribution to effectiveness. Coding was based on information in articles rather than manuals, and inter-rater reliability was moderate for some practice elements.

CONCLUSION

The outcome-producing prevention programs in our sample had common practice elements and produced moderate reduction in symptoms overall. Future research of depression, anxiety, and stress prevention programs for university students can investigate practice elements' unique and combined impact on outcomes, further explore under-tested practice elements, and use findings to inform intervention design.

Managing and Adapting Practice: Provider Perceptions of an Evidence-Informed Framework for Delivering Mental Health Services

This study examined providers' reflections on delivering managing and adapting practice (MAP), an evidence-informed framework that guides decision-making from scientific and client data. Consensual qualitative research methods were used to analyze the reflections of 201 youth mental health providers. Results indicated that providers approached MAP according to their own preferences and particular cases. While most appeared to approach MAP from a practice management standpoint, when faced with challenging cases, providers used coordination and outcomes management resources. Regardless of approach, most providers came to appreciate the full framework through reflective practice. Their diverse approaches offer lessons for evidence-based practice implementation and sustainment.

Unintended Consequences of Evidence-Based Treatment Policy Reform: Is Implementation the Goal or the Strategy for Higher Quality Care?

This study examined patterns of evidence-based treatment (EBT) delivery following a county-wide EBT reform initiative. Data were gathered from 60 youth and their 21 providers, who were instructed to deliver therapy as they normally would under the EBT initiative. Results showed limited applicability of county-supported EBTs to this service sample, and that most youth did not receive traditional delivery of EBTs. Findings suggest that it may be unrealistic to expect providers to deliver EBTs with fidelity with all clients, and that EBT implementation may be best thought of as a strategy for improving mental health services rather than a goal.

Comparing Agency Leader and Therapist Perspectives on Evidence-Based Practices: Associations with Individual and Organizational Factors in a Mental Health System-Driven Implementation Effort

Agency leaders and therapists are essential stakeholders in implementation of evidence-based practices (EBPs) within publicly-funded mental health services. Little is known about how these stakeholders differ in their perceptions of specific EBPs and which individual and organizational factors differentially influence these perceptions. Within the context of a system-driven implementation of multiple EBPs, survey data from 160 leaders and 720 therapists were examined to assess differences in perceptions of six EBPs. Findings indicated that leaders and therapists have unique perspectives and preferences regarding EBPs that are shaped by distinct sociodemographic and professional characteristics and aspects of organizational functioning.

Sustainability of an Evidence-Based Practice in Community Mental Health Agencies Serving Children

OBJECTIVE

The authors documented rates of sustained use of an evidence-based practice following training sponsored by New York State (NYS), and they identified clinician characteristics related to sustained use.

METHODS

Clinicians (N=89) who were employed in licensed NYS Office of Mental Health agencies serving children and adolescents and who were trained to proficiency in Managing and Adapting Practice (MAP) in 2016 were contacted between 9 and 18 months later and asked whether they were still using (users) or had stopped using (nonusers) MAP and their reason for doing so.

RESULTS

Responses were received from 57% of trainees and of those, 80% reported continued use of MAP. Score on the appeal subscale of the Evidence-Based Practices Attitude Scale (EBPAS) was the only significant difference between users and nonusers.

CONCLUSIONS

Most clinicians reported sustained use of MAP. The EBPAS appeal subscale can be used to identify clinicians who are likely to discontinue use.

Predicting Youth Improvement in Community-Based Residential Settings with Practices Derived from the Evidence-Base

The current investigation conducted descriptive analyses on key variables in community-based residential (CBR) settings and investigated the extent to which disruptive youth between the ages of 13 and 17 years improved based on therapists' reported alignment with using practices derived from the evidence-base (PDEBs). Results from both the descriptive analyses and multilevel modeling suggested that therapists are using practices that both do and do not align with the evidence-base for disruptive youth. In addition, both PDEBs and practices with minimal evidence-support predicted or marginally predicted final average progress rating for these youth. Findings are discussed as they relate to the importance of continued exploration of treatment outcomes for CBR youth.

Core Elements of Family Therapy for Adolescent Behavior Problems: Empirical Distillation of Three Manualized Treatments

Family therapy has the strongest evidence base for treating adolescent conduct and substance use problems, yet there remain substantial barriers to widespread delivery of this approach in community settings. This study aimed to promote the feasibility of implementing family-based interventions in usual care by empirically distilling the core practice elements of three manualized treatments. The study sampled 302 high-fidelity treatment sessions from 196 cases enrolled in 1 of 3 manualized family therapy models: multidimensional family therapy (102 sessions/56 cases), brief strategic family therapy (100 sessions/94 cases), or functional family therapy (100 sessions/46 cases). Adolescents were 57% male; 41% were African American, 31% White non-Hispanic, 9% Hispanic American, 6% another race/ethnicity, and 13% unknown. The observational fidelity measures of all three models were used to code all 302 sessions. Fidelity ratings were analyzed to derive model-shared treatment techniques via exploratory factor analyses on half the sample; the derived factors were then validated via confirmatory factor analyses supplemented by Bayesian structural equation modeling on the remaining half. Factor analyses distilled 4 clinically coherent practice elements with strong internal consistency: Interactional Change (6 treatment techniques; Cronbach's α = .93), Relational Reframe (7 techniques; α = .79), Adolescent Engagement (4 techniques; α = .68), and Relational Emphasis (4 techniques; α = .67). The 4 empirically derived factors represent the core elements of 3 manualized family therapy models for adolescent behavior problems, setting the foundation of a more sustainable option for delivering evidence-based family interventions in routine practice settings. Public Health Significance: Increasing implementation of high-fidelity family-based interventions would improve the quality of treatment services for adolescent conduct and substance use problems.

I heard it through the grapevine: Where and what parents learn about youth mental health treatments

OBJECTIVE

This study investigates where parents learn about, and what parents know about child mental health services. Parents who are better informed about mental health services may be more likely to utilize services for their children.

METHODS

In a national online survey, 196 parents of children between the ages of 4 and 17 years reported on their information-seeking behaviors and their familiarity and experience with psychosocial approaches.

RESULTS

Parents reported utilizing multiple information sources with mental health providers, pediatricians, and social networks being the most prominent. Parents' trust in different sources varied, with parents generally trusting healthcare professionals the most. Parents exposed to mental health services were more aware of specific therapeutic approaches.

CONCLUSIONS

Data on how parents receive and understand mental health-related information contributes to ongoing dissemination and implementation efforts.

A Preliminary Exploration of the Barriers to Delivering (and Receiving) Exposure-Based Cognitive Behavioral Therapy for Anxiety Disorders in Adult Community Mental Health Settings

Despite the effectiveness of exposure-based cognitive behavioral therapy (CBT) for anxiety disorders, few individuals in need receive this treatment, particularly in community mental health settings serving low-income adults. The present study took a preliminary step to understand these barriers by conducting a series of key informant interviews and focus groups among patients, providers, clinical administrators, and policy makers. Several themes emerged as barriers to the delivery of exposure-based CBT in these settings, including therapist training and compentency issues, logistical issues, and funding stream issues. Clinical implications and future research that can build from these data are discussed.

Community-Based Providers' Selection of Practices for Children and Adolescents With Comorbid Mental Health Problems

The goal of this study is to explore providers' patterns of implementation by investigating how community mental health providers selected therapy practice modules from a flexible, modular evidence-based treatment working with youths with comorbid mental health problems. Data were obtained from 57 youths, 5-15 years old, presenting with anxiety, depressive, and/or conduct problems and their 27 providers during their participation in an effectiveness trial involving a modular evidence-based treatment. Although all youths evidenced clinically elevated symptomatology in at least two problem areas, providers targeted youths' comorbid problems with only about half of their study cases. Practice modules indicated for youths' comorbid problems were typically used less frequently and with less depth relative to practice modules indicated for youths' principal clinical problem and were often transdiagnostic in nature (i.e., designed to target more than one problem area). To determine whether providers' decisions to target youths' comorbid problems were systematic, multilevel, logistic regression analyses were conducted and revealed that youths' pretreatment characteristics and time in therapy influenced providers' patterns of module selection. Providers tend to use, but not exploit, the flexibility allowed by modular EBTs and to focus treatment on youths' principal presenting problem. In addition, providers appear to make these practice choices in a systematic and rational manner, and whether and which choices are associated with improved outcomes is an important area of future study.

Qualitative Reports of How and When Therapists Adapt Children's Evidence-Based Practices during Community Implementation

This study analyzed qualitative therapist reports of adaptations to the delivery of multiple evidence-based practices (EBPs) within the context of a system-driven reform of children's community mental health services to understand how therapists adapt EBPs as well as contexts of these adaptations to identify when these adaptations are made. The study sought to complement and expand upon previous quantitative survey findings of two categories of Augmenting and Reducing/Reordering adaptations to EBPs. Data included interviews from 60 therapists (88.3% female, 61.7% Latina/o, 80.0% unlicensed) across 20 program sites in 11 mental health agencies that served racial/ethnically diverse children. Interviews were coded to identify themes surrounding the types of adaptations made and the contexts for these adaptations. The majority of therapists' qualitative descriptions of adaptations converged with the 2 broad categories in the Augmenting and Reducing/Reordering Framework, with therapists describing augmenting (e.g., modifying presentation, lengthening or extending pacing) most often, and reducing/reordering adaptations were discussed less frequently. Child and family characteristics were most frequently cited as indications prompting adaptations; however, the specific characteristics motivating adaptations differed by type. Therapists reporting using augmenting adaptations in the context of a wide range of client characteristics, whereas reducing/reordering adaptations occurred more specifically as a function of clinical presentation, family and caregiver functioning, and emergent life events. Therapists described making adaptations to improve the fit of multiple EBPs for the clients they served. Findings could have implications for implementation efforts with diverse clients served in community settings.

Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children's mental health services

OBJECTIVE

This study examined clinical adaptations reported by community therapists to multiple evidence-based practices (EBPs) currently implemented in children's mental health services. Based on an item set informed by Stirman and colleagues' model (2015), 2 factors emerged describing Augmenting adaptations and Reducing/Reordering adaptations. We used multilevel modeling to examine therapist- and practice-level predictors of therapist reports of each type of adaptation.

METHOD

Data were drawn from an online survey, including a novel therapist report measure of EBP adaptations, completed by 572 therapists (89.2% female, Mage = 37.08 years, 33.4% non-Hispanic White) delivering EBPs in the context of a system-driven, fiscally mandated implementation effort.

RESULTS

Analyses revealed that the 2 types of therapist adaptations (Augmenting and Reducing/Reordering) could be readily discriminated, with therapists reporting significantly more Augmenting than Reducing/Reordering adaptations. Therapists of Hispanic/Latino ethnicity and with fewer years of experience reported more extensive Augmenting adaptations, but no therapist background characteristics were associated with Reducing/Reordering adaptations. Therapists' general attitudes that EBPs diverged from their personal approach to therapy were associated with reporting more Augmenting and Reducing/Reordering adaptations. In contrast, negative perceptions toward the specific EBP predicted Reducing/Reordering adaptations, but not Augmenting adaptations.

CONCLUSIONS

Community therapist reports suggest that most adaptations undertaken involve engaging with the practice to augment the fit of the EBPs for local contexts; however, when practices were perceived negatively, therapists were more likely to make adaptations reducing or rearranging components. (PsycINFO Database Record

Distilling the Core Elements of Family Therapy for Adolescent Substance Use: Conceptual and Empirical Solutions

This article describes several barriers to widespread dissemination of manualized family-based treatments for adolescent substance use (ASU). We then offer a highly promising solution for adopting and sustaining family therapy in usual care: distilling the core practice elements of empirically validated family therapy models for ASU. We present a conceptual distillation of family therapy for ASU grounded in existing observational fidelity measures for three manualized models, a process that yielded four core elements: Family Engagement, Relational Reframing, Family Behavior Change, and Family Restructuring. We then introduce an innovative empirical method for distilling core elements that can serve as a template for rigorous distillation of other treatment approaches. Finally, we discuss how core elements can enhance family therapy services within the diverse workforce of usual care for ASU.

Addressing critical gaps in the treatment of eating disorders

Remarkable progress has been made in developing psychosocial interventions for eating disorders and other mental disorders. Two priorities in providing treatment consist of addressing the research-practice gap and the treatment gap. The research-practice gap pertains to the dissemination of evidence-based treatments from controlled settings to routine clinical care. Closing the gap between what is known about effective treatment and what is actually provided to patients who receive care is crucial in improving mental health care, particularly for conditions such as eating disorders. The treatment gap pertains to extending treatments in ways that will reach the large number of people in need of clinical care who currently receive nothing. Currently, in the United States (and worldwide), the vast majority of individuals in need of mental health services for eating disorders and other mental health problems do not receive treatment. This article discusses the approaches required to better ensure: (1) that more people who are receiving treatment obtain high-quality, evidence-based care, using such strategies as train-the-trainer, web-centered training, best-buy interventions, electronic support tools, higher-level support and policy; and (2) that a higher proportion of those who are currently underserved receive treatment, using such strategies as task shifting and disruptive innovations, including treatment delivery via telemedicine, the Internet, and mobile apps.

At the Intersection of Health Information Technology and Decision Support: Measurement Feedback Systems... and Beyond

We select and comment on concepts and examples from the target articles in this special issue on measurement feedback systems, placing them in the context of some of our own insights and ideas about measurement feedback systems, and where those systems lie at the intersection of technology and decision making. We contend that, connected to the many implementation challenges relevant to many new technologies, there are fundamental design challenges that await a more elaborate specification of the clinical information and decision models that underlie these systems. Candidate features of such models are discussed, which include referencing multiple evidence bases, facilitating observed and expected value comparisons, fostering collaboration, and allowing translation across multiple ontological systems. We call for a new metaphor for these technologies that goes beyond measurement feedback and encourages a deeper consideration of the increasingly complex clinical decision models needed to manage the uncertainty of delivering clinical care.

Implementation of transdiagnostic cognitive therapy in community behavioral health: The Beck Community Initiative

OBJECTIVE

Progress bringing evidence-based practice (EBP) to community behavioral health (CBH) has been slow. This study investigated feasibility, acceptability, and fidelity outcomes of a program to implement transdiagnostic cognitive therapy (CT) across diverse CBH settings, in response to a policy shift toward EBP.

METHOD

Clinicians (n = 348) from 30 CBH programs participated in workshops and 6 months of consultation. Clinician retention was examined to assess feasibility, and clinician feedback and attitudes were evaluated to assess implementation acceptability. Experts rated clinicians' work samples at baseline, mid-, and end-of-consultation with the Cognitive Therapy Rating Scale (CTRS) to assess fidelity.

RESULTS

Feasibility was demonstrated through high program retention (i.e., only 4.9% of clinicians withdrew). Turnover of clinicians who participated was low (13.5%) compared to typical CBH turnover rates, even during the high-demand training period. Clinicians reported high acceptability of EBP and CT, and self-reported comfort using CT improved significantly over time. Most clinicians (79.6%) reached established benchmarks of CT competency by the final assessment point. Mixed-effects hierarchical linear models indicated that CTRS scores increased significantly from baseline to the competency assessment (p < .001), on average by 18.65 points. Outcomes did not vary significantly between settings (i.e., outpatient vs. other).

CONCLUSIONS

Even clinicians motivated by policy-change rather than self-nomination may feasibly be trained to deliver a case-conceptualization driven EBP with high levels of competency and acceptability. (PsycINFO Database Record

Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research

Twenty years after Sobell's (1996) influential call to integrate advances in behavior therapy into clinical settings, significant progress has been made in implementation science. In this narrative review, we provide an overview of implementation research findings and highlight recent findings that can inform efforts to bridge the gap between research and practice in mental health service settings. Key findings are summarized, organized according to levels of influence described in two implementation frameworks: The Exploration, Planning, Implementation, and Sustainment Framework (EPIS; Aarons et al., 2011) and the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2009). Important levels of influence to consider when implementing new treatments include the outer context, inner context, characteristics of the individual, and characteristics of the innovation. Research on strategies to prepare clinicians to deliver evidence-based psychosocial treatments (EBPTs) and to address contextual barriers to implementation at each level is described, with discussion of implications for the implementation of EBPTs and next steps for research.

Using a Theory-Guided Learning Collaborative Model to Improve Implementation of EBPs in a State Children's Mental Health System: A Pilot Study

Learning collaboratives (LCs) are used widely to promote implementation of evidence-based practices. However, there has been limited research on the effectiveness of LCs and models vary widely in their structure, focus and components. The goal of the present study was to develop and field test a theory-based LC model to augment a state-led, evidence-based training program for clinicians providing mental health services to children. Analysis of implementation outcomes contrasted LC sites to matched comparison sites that participated in the clinical training program alone. Results suggested that clinicians from sites participating in the LC were more highly engaged in the state-led clinical training program and were more likely to complete program requirements.

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Dropouts from system-wide evidence-based practice trainings are high; yet there are few studies on what predicts dropouts. This study examined multilevel predictors of clinician dropout from a statewide training on the Managing and Adapting Practice program. Extra-organizational structural variables, intra-organizational variables and clinician variables were examined. Using multivariable logistic regression analysis, state administrative data and prospectively collected clinician participation data were used to predict dropout. Two characteristics were predictive: younger clinicians and those practicing in upstate-rural areas compared to downstate-urban areas were less likely to drop out from training. Implications for research and policy are described.

Providers' attitudes toward evidence-based practices: is it just about providers, or do practices matter, too?

Evidence-based practice (EBP) attitudes were measured in a sample of Los Angeles County mental health service providers. Three types of data were collected: provider demographic characteristics, attitudes toward EBP in general, and attitudes toward specific EBPs being implemented in the county. Providers could reliably rate characteristics of specific EBPs, and these ratings differed across interventions. Preliminary implementation data indicate that appealing features of an EBP relate to the degree to which providers use it. These findings suggest that assessing EBP-specific attitudes is feasible and may offer implementation-relevant information beyond that gained solely from providers' general attitudes toward EBP.

A hybrid effectiveness-implementation cluster randomized trial of group CBT for anxiety in urban schools: rationale, design, and methods

Background

Schools present a context with great potential for the implementation of psychosocial evidence-based practices. Cognitive behavioral therapy (CBT) is an evidence-based practice that has been found to be very effective in treating anxiety in various community settings, including schools. Friends for Life (FRIENDS) is an efficacious group CBT protocol for anxiety. Unfortunately, evidence-based practices for anxiety are seldom employed in under-resourced urban schools, because many treatment protocols are not a good fit for the urban school context or the population, existing behavioral health staff do not receive adequate training or support to allow them to implement the treatment with fidelity, or school districts do not have the resources to contract with external consultants. In our prior work, we adapted FRIENDS to create a more culturally sensitive, focused, and feasible CBT protocol for anxiety disorders (CBT for Anxiety Treatment in Schools (CATS)).

Methods/design

The aim of this 5-year study is to evaluate both the effectiveness of CATS for urban public schools compared to the original FRIENDS as well as compare the implementation strategies (train-the-trainer vs. train-the-trainer + ongoing consultation) by conducting a three-arm, parallel group, type 2 hybrid effectiveness-implementation trial in 18 K-8 urban public schools. We will also assess the cost-effectiveness and the mediators and moderators of fidelity. Ninety therapists, 18 agency supervisors, and 360 children will participate. The interactive systems framework for dissemination and implementation guides the training and support procedures for therapists and supervisors.

Discussion

This study has the potential to demonstrate that agency therapists and supervisors who have had little to no prior exposure to evidence-based practices (EBPs) can implement an anxiety disorder EBP with fidelity. Comparisons of the implementation strategies would provide large urban mental health systems with data to make decisions about the adoption of EBPs.

Trial registration

ClinicalTrials.gov, NCT02651402

Future Directions for the Implementation and Dissemination of Statewide Developmental-Behavioral Pediatric Integrated Health Care

The integration of mental health and pediatric health care services has long been a goal for both research and practice. With the advent of federal policies developed to mandate clinical efficiency across the health care spectrum, this issue is becoming more salient. Applied literature on this topic is only recently emerging, however, and there are limited contextual examples to guide program development, research, and refinement. This article presents background information relevant to the development of such a program (the Center for Advancement of Youth). The cultural and organizational contexts for the project are discussed, with particular emphasis on models for cooperation among several institutions of varying size and scope. The implications for the future of tangible research in this area are also discussed, with attention to extending lessons learned to diverse settings motivated to integrate various aspects of health care service provision.

Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination

Health information technology (HIT) and care coordination for individuals with complex needs are high priorities for quality improvement in health care. However, there is little empirical guidance about how best to design electronic health record systems and related technologies to facilitate implementation of care coordination models in behavioral health, or how best to apply user input to the design and testing process. In this paper, we describe an iterative development process that incorporated user/stakeholder perspectives at multiple points and resulted in an electronic behavioral health information system (EBHIS) specific to the wraparound care coordination model for youth with serious emotional and behavioral disorders. First, we review foundational HIT research on how EBHIS can enhance efficiency and outcomes of wraparound that was used to inform development. After describing the rationale for and functions of a prototype EBHIS for wraparound, we describe methods and results for a series of six small studies that informed system development across four phases of effort-predevelopment, development, initial user testing, and commercialization-and discuss how these results informed system design and refinement. Finally, we present next steps, challenges to dissemination, and guidance for others aiming to develop specialized behavioral health HIT. The research team's experiences reinforce the opportunity presented by EBHIS to improve care coordination for populations with complex needs, while also pointing to a litany of barriers and challenges to be overcome to implement such technologies.

Annual Research Review: Building a science of personalized intervention for youth mental health

BACKGROUND

Within the past decade, health care service and research priorities have shifted from evidence-based medicine to personalized medicine. In mental health care, a similar shift to personalized intervention may boost the effectiveness and clinical utility of empirically supported therapies (ESTs). The emerging science of personalized intervention will need to encompass evidence-based methods for determining which problems to target and in which order, selecting treatments and deciding whether and how to combine them, and informing ongoing clinical decision-making through monitoring of treatment response throughout episodes of care. We review efforts to develop these methods, drawing primarily from psychotherapy research with youths. Then we propose strategies for building a science of personalized intervention in youth mental health.

FINDINGS

The growing evidence base for personalizing interventions includes research on therapies adapted for specific subgroups; treatments targeting youths' environments; modular therapies; sequential, multiple assignment, randomized trials; measurement feedback systems; meta-analyses comparing treatments for specific patient characteristics; data-mining decision trees; and individualized metrics.

CONCLUSION

The science of personalized intervention presents questions that can be addressed in several ways. First, to evaluate and organize personalized interventions, we propose modifying the system used to evaluate and organize ESTs. Second, to help personalizing research keep pace with practice needs, we propose exploiting existing randomized trial data to inform personalizing approaches, prioritizing the personalizing approaches likely to have the greatest impact, conducting more idiographic research, and studying tailoring strategies in usual care. Third, to encourage clinicians' use of personalized intervention research to inform their practice, we propose expanding outlets for research summaries and case studies, developing heuristic frameworks that incorporate personalizing approaches into practice, and integrating personalizing approaches into service delivery systems. Finally, to build a richer understanding of how and why treatments work for particular individuals, we propose accelerating research to identify mediators within and across RCTs, to isolate mechanisms of change, and to inform the shift from diagnoses to psychopathological processes. This ambitious agenda for personalized intervention science, although challenging, could markedly alter the nature of mental health care and the benefit provided to youths and families.