Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy

Provider Self-Reported Use and Usefulness of Intervention Strategies for Externalizing Behaviors in Youths with ASD

OBJECTIVE

To examine predictors of implementation and perceived usefulness of four empirically supported strategies for treating externalizing behavior in youths with ASD.

METHOD

Participants were 557 providers in the United States with experience treating externalizing behavior in youths with ASD. Generalized estimating equations were used to determine whether self-reported use and usefulness of four empirically supported intervention strategies (functional communication training, functional behavior analysis, visual tools/supports, token economy) were predicted by key provider characteristics: professional discipline, experience, and practice specialization (across three indices) in ASD. Post-hoc contrasts were performed to identify provider groups reporting the greatest use and usefulness of the four strategies.

RESULTS

Strategies were most often used by providers with behavioral backgrounds, though perceived usefulness of strategies varied by providers' professional discipline. Compared to providers with more than 10 years of experience, less experienced providers endorsed the highest average use and usefulness of almost all strategies. Regarding ASD practice specialization, a lower volume of ASD cases, treating fewer youths with ASD over a 5-year period, and having a higher proportion of practice time working with youths with ASD reported were associated with greater use and usefulness of the strategies.

CONCLUSIONS

Empirically supported strategies are widely used by and perceived as useful by providers who treat youths with ASD and co-occurring externalizing behaviors. Use and usefulness varies based on provider discipline, experience, and ASD practice specialization.

De-implementation of Low-Value Practices for Autism Spectrum Disorder

Due to a variety of factors, Autism Spectrum Disorder (ASD) has long been tethered to use of low-value practice (LVP), arguably moreso than any other psychiatric or neurodevelopmental condition. Although dissemination of empirically supported treatments (EST) for autistic individuals has expanded markedly over the past decade, there has not been concomitant reduction in the use of LVP. It is critical that clinicians and scientists not only promote the implementation of EST, but also facilitate the de-implementation (abandonment and/or divestment) of ineffective or harmful practices. In this review, we describe a data-driven approach that can be used to identify LVP, drawing from established criteria for identification of evidence-based treatments (e.g., APA Division 12, National Clearinghouse on Autism Evidence and Practice; SAMHSA), as well as broader considerations such as social validity, cost, and parsimony. Herein, a data-based approach to LVP identification is proposed with a goal of improving quality of service access. Within an implementation science framework, we identify specific facilitators that sustain LVP use, and recommendations for subsequent de-implementation strategies are offered.

Measurement feedback system implementation in public youth mental health treatment services: a mixed methods analysis

BACKGROUND

Prior studies indicate the effectiveness of measurement-based care (MBC), an evidence-based practice, in improving and accelerating positive outcomes for youth receiving behavioral health services. MBC is the routine collection and use of client-reported progress measures to inform shared decision-making and collaborative treatment adjustments and is a relatively feasible and scalable clinical practice, particularly well-suited for under-resourced community mental health settings. However, uptake of MBC remains low, so information on determinants related to MBC practice patterns is needed.

METHODS

Quantitative and qualitative data from N = 80 clinicians who implemented MBC using a measurement feedback system (MFS) were merged to understand and describe determinants of practice over three study phases. Quantitative, latent class analysis identified clinician groups based on participants' ratings of MFS acceptability, appropriateness, and feasibility and describes similarities/differences between classes in clinician-level characteristics (e.g., age; perceptions of implementation climate; reported MFS use; phase I). Qualitative analyses of clinicians' responses to open-ended questions about their MFS use and feedback about the MFS and implementation supports were conducted separately to understand multi-level barriers and facilitators to MFS implementation (phase II). Mixing occurred during interpretation, examining clinician experiences and opinions across groups to understand the needs of different classes of clinicians, describe class differences, and inform selection of implementation strategies in future research (phase III).

RESULTS

We identified two classes of clinicians: "Higher MFS" and "Lower MFS," and found similarities and differences in MFS use across groups. Compared to Lower MFS participants, clinicians in the Higher MFS group reported facilitators at a higher rate. Four determinants of practice were associated with the uptake of MBC and MFS in youth-serving community mental health settings for all clinicians: clarity, appropriateness, and feasibility of the MFS and its measures; clinician knowledge and skills; client preferences and behaviors; and incentives and resources (e.g., time; continuing educational support). Findings also highlighted the need for individual-level implementation strategies to target clinician needs, skills, and perceptions for future MBC and MFS implementation efforts.

CONCLUSION

This study has implications for the adoption of evidence-based practices, such as MBC, in the context of community-based mental health services for youth.

Iterative redesign of a caregiver-mediated intervention for use in educational settings

LAY ABSTRACT

Teachers often report concerns about behavior challenges in their students with autism spectrum disorder (ASD) in the school setting. Furthermore, teachers often report that they do not have adequate training in how to manage these challenging behaviors effectively. The RUBI program is an intervention initially developed for parents of children with ASD and co-occurring challenging behavior in clinic settings. The present project used school staff input to systematically redesign RUBI to be used with educators in schools. School staff gave input at multiple stages of development to ensure the adapted intervention was appropriate to use in a school setting. Responses were coded and analyzed to identify strengths and weaknesses of the RUBI manual in schools and adaptations were made accordingly. Scores of how appropriate, possible, likable, and usable RUBI would be in schools rose after the intervention was redesigned. The redesigned RUBIES manual may give school staff the tools they need to manage disruptive behaviors. In addition, collaborating with providers over multiple stages to redesign established interventions for new contexts may be a promising way to help bring research tools to practice in the future.

Supporting the inclusion and retention of autistic students: Exploring teachers' and paraeducators' use of evidence-based practices in public elementary schools

INTRODUCTION

Educators in public schools are required to serve students in their least restrictive environment. While many evidence-based practices (EBPs), defined as practices and strategies shown by research to have meaningful effectson outcomes for autistic students are documented in the literature, less is known about EBP use among educators in public schools.

METHODS

Eighty-six general and special education teachers and para educators completed a survey about familiarity, training, and EBP use for included autistic children.

RESULTS

Across roles, educators reported familiarity (98.8%), use (97.7%), and training (83.7%) in reinforcement. They reported the least familiarity with behavioral momentum (29.1%), training in both video modeling and peer-mediated instruction and intervention (18.6%), and use of video modeling (14.0%). Follow-up interviews (n = 80) highlighted mixed understanding of EBP definitions and use.

DISCUSSION

Implications for inclusive education are discussed including autism-specific EBP training within pre-service teacher preparation programs.

Usual care for youth with autism spectrum disorder: Community-based providers' reported familiarity with treatment practices

OBJECTIVE

To examine patterns and predictors of familiarity with transdisciplinary psychosocial (e.g., non-pharmacologic) practices for practitioners treating youths with autism spectrum disorder (ASD) in the United States.

METHOD

Practitioners (n = 701) from behavioral, education, medical, and mental health backgrounds who worked with youth (ages 7-22) with ASD completed the Usual Care for Autism Survey, which assessed provider demographics and self-reported familiarity with transdisciplinary treatment practices for the most common referral problems of ASD. We examined relations between provider-, setting-, and client-level characteristics with familiarity of key groups of the treatment practices (practice sets). Practice sets were identified using exploratory factor analysis (EFA), and demographic predictors of practice subsets were examined using generalized estimating equations (GEE).

RESULTS

The EFA yielded a three-factor solution: (1) environmental modifications/antecedent strategies; (2) behavior analytic strategies; and (3) cognitive strategies, with overall familiarity ranked in this order. Medical providers indicated the least familiarity across disciplines. More experience with ASD and treating those with intellectual disabilities predicted greater familiarity with only environmental modifications/antecedent strategies and behavior analytic, but not cognitive strategies. Experience treating low SES clients predicted familiarity with environmental modification and behavior analytic strategies while experience treating high SES clients predicted familiarity with behavior analytic and cognitive strategies.

CONCLUSION

This is the first study to identify transdisciplinary, interpretable sets of practices for treating youth with ASD based on community providers' reported familiarity. Results highlight factors associated with familiarity with practice sets, which is essential for mapping practice availability, and optimizing training and dissemination efforts for youth with ASD.

Therapist adaptations to evidence-based practices and associations with implementation outcomes in child therapy sessions

OBJECTIVE

Community therapists inevitably adapt evidence-based practices (EBPs) to meet the needs of their clients and practice settings. Yet, the implications of spontaneous, therapist-driven adaptations for EBP implementation outcomes are not well understood. We used a sequential QUAN → qual mixed-methods design to examine how different types of therapist-described adaptations were associated with observer-rated extensiveness of therapist delivery of EBP content and technique strategies at the session level.

METHOD

Data were drawn from an observational study of a system-driven implementation of multiple EBPs into public children's mental health services. Community therapists (n = 103) described adaptations they made in 680 sessions with 273 clients (50.92% female, 49.08% male, M_age = 9.72 years, 70.70% Hispanic/Latinx). Coders classified therapist-described adaptations into five types: (a) Modifying Presentation, (b) Integrating, (c) Extending, (d) Reducing, and (e) Generalizing. Independent observers rated the extensiveness of EBP strategy delivery from session recordings using the EBP Concordant Care Assessment (ECCA) Observational Coding System.

RESULTS

Quantitative analyses using multilevel regression revealed that Modifying Presentation adaptations were associated with higher extensiveness of EBP technique delivery, whereas Extending adaptations were associated with lower extensiveness of EBP content and technique delivery. Qualitative analysis of adaptation descriptions identified explanations for the quantitative findings.

CONCLUSIONS

Findings suggest that Modifying Presentation adaptations, associated with higher extensiveness, involved creative use of activities and materials, language modification, and personalization of EBP content to meet clients' diverse needs, whereas Extending adaptations, associated with lower extensiveness, involved slowing EBP pacing in response to client challenges. Implications for provider training are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Clinical Supervision in Community Mental Health: Characterizing Supervision as Usual and Exploring Predictors of Supervision Content and Process

Clinical supervision can be leveraged to support implementation of evidence-based practices in community mental health settings, though it has been understudied. This study focuses on 32 supervisors at 23 mental health organizations in Philadelphia. We describe characteristics of supervisors and organizations and explore predictors of supervision content and process. Results highlight a low focus on evidence-based content and low use of active supervision processes. They underscore the need for further attention to the community mental health context when designing supervision-targeted implementation strategies. Future work should assess whether supervision models specific to community mental health are needed.

Concordance between Community Supervisor and Provider Ratings of Fidelity: Examination of Multi-Level Predictors and Outcomes

Fidelity is conceptualized as a key mechanism impacting treatment outcomes, yet community examination of fidelity is limited, partly due to limited feasible training methods and tools. Provider-report tools represent a feasible method for improving routine fidelity monitoring. Additional work examining the effectiveness of these methods and concordance with other fidelity sources is needed. Further, provider and client factors impact both intervention implementation and concordance, but their impact on fidelity measurement is poorly understood. Using a train-the-trainer methodology, we examine concordance between three methods of assessing fidelity (trained independent coders, supervisor evaluation and provider self-report) using a fidelity assessment tool adapted for community use. Multilevel models examined predictors (provider- and child- level factors) and outcomes (provider average fidelity) of concordance. Results suggest supervisors and providers are able to use the fidelity tool, but demonstrated variable concordance, with higher concordance with trained coders for supervisors than providers. Provider credentials and child language were marginally predictive of rater concordance. Higher supervisor accuracy was associated with higher provider fidelity. Findings inform broader efforts to improve the development and implementation of feasible fidelity tools for routine use in community settings and highlight multi-level factors impacting the adoption and implementation of such tools.

Practitioners' Use and Evaluation of Transdiagnostic Youth Psychotherapy Years After Training and Consultation Have Ended

We examined practitioners' use of the transdiagnostic Modular Approach to Therapy for Children (MATCH) 7 years after learning MATCH for a clinical trial. The practitioners (N = 29; M_age = 52.10, SD = 12.29, 86% women, 97% white) reported using MATCH with 55% of their caseload; use of the various MATCH modules ranged from 39 to 70%. Use was positively associated with amount of MATCH experience in the trial, perceived effectiveness, and ease of implementation. Patterns of specific module use did not consistently match strength of prior evidence (e.g., exposure was least used of the anxiety modules), suggesting challenges for implementation science.

Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency

Measurement feedback systems (MFSs) that routinely collect and report client progress to mental health therapists have demonstrated beneficial impact on outcomes in numerous studies, with evidence that there is a dose-response relationship related to the implementation of the MFS. The current study examined the impact of MFS implementation (Implementation Index) on youth symptom outcomes separately by caregiver and youth self-report. Additionally, we tested the extent to which Implementation Index rates varied by individual therapists and clients, and whether therapist and client characteristics predicted MFS implementation. Methods: Administrative data (client charts, youth- and caregiver-reported Youth Outcome Questionnaires) for 229 youth (52.83% Latinx, 42.79% girls, M age = 10.33) treated during a 1-year period at a community mental health organization in Central Texas were analyzed using multi-level modeling. Caregiver-reported symptoms decreased faster for those with a higher MFS Implementation Index. Between-group differences among therapists accounted for a significant proportion of variance in the Implementation Index for caregiver report, whereas client differences accounted for most of the variance in the Implementation Index for youth self-report. Therapist trainee status predicted a significant increase in the Implementation Index for caregiver-report data. Youth symptom improvement as reported by caregivers varied with the extent of MFS implementation fidelity, and MFS implementation fidelity was higher for clients treated by trainees relative to staff therapists for caregiver report of symptoms.

Practices Derived from the Evidence Base for Depression Predict Disruptive Behavior Progress in Adolescent Community Mental Health Care

Disruptive behavior problems develop along multiple causal pathways and are associated with a wide variety of co-occurring problems, including mood disorders. In usual care, effective treatment practices for youth disruptive behavior might differ from what the efficacy research suggests, given treatment setting and population demographic differences. The current study examined whether practices derived from the evidence base for disruptive behavior and/or depressed mood predicted progress on disruptive behavior problems in an adolescent usual care sample. Monthly clinical data, including therapeutic practices, treatment targets, and progress on selected treatment targets, for 1210 youth ages 13-17 who received intensive in-home services and were treated for disruptive behavior problems were examined utilizing multilevel modeling techniques. Practices derived from the evidence base for only depressed mood and practices derived from both disruptive behavior and depressed mood literatures predicted disruptive behavior progress, while practices derived from only the disruptive behavior evidence-based literature did not. All five practice elements exclusive to depressed mood treatment predicted positive disruptive behavior progress, while two of eleven disruptive behavior practices and four of seven practices derived from both problem areas predicted positive progress. Findings held when other predictors were included as covariates, including youth age and functional impairment. Although directionality remains unclear and further research is vital, usual care settings might present barriers to disruptive behavior treatment as prescribed by the evidence base, and youth-focused treatments based on depressed mood treatments merit further examination as a potentially promising route to effective treatment in such settings.

Therapist and Youth Predictors of Specific Practices Derived from the Evidence-Base in Community Mental Health

Over the past several years, youth treatment research has moved toward understanding the dissemination and implementation of evidence-based practices (EBPs). As a result, studies have focused on identifying predictors that aid in successful adoption and sustainment of EBPs. Theories of behavior change posit that therapist knowledge and attitudes play a fundamental role in EBP adoption; however, studies have produced mixed findings, which may be an artifact of broad definitions of both EBP knowledge and EBP itself. The current study was an examination of 46 youth community therapists and the extent to which varying types of knowledge and attitudes as well as youth characteristics predicted specific practices derived from the evidence-base. Results suggested that specific EBP knowledge predicted specific practices, highlighting the need for more specificity when examining predictors of EBP use. Therapists' attitudes, demographic characteristics, and youth characteristics were also significant predictors of EBP use. Future research should consider examining discrete and specific practices to better understand and predict therapists' future behavior.

Where Does It Begin? Community-Based Therapists' Intentions for Treating Non-comorbid Youth

This study examined patterns and predictors of 79 public sector therapists' practice element (PE) intentions for treating hypothetical single problem area youth with either anxiety or disruptive behavior problems. Analyses of intention profiles suggested that PE intentions varied by diagnosis and included both a majority of practices derived from the evidence base (PDEBs) and a large number of practices with minimal evidence support (PMESs) for each problem area. Hierarchical multiple regression results indicated the only significant predictor of higher PDEB intentions for both problem areas was reporting more PMES intentions. Implications for community-based research and implementation efforts are discussed.

Factors Associated With Caregiver Attendance in Implementation of Multiple Evidence-Based Practices in Youth Mental Health Services

OBJECTIVE

The implementation of evidence-based practices (EBPs) in community mental health settings for youths has consistently yielded weakened effects compared with controlled trials. There is a need to feasibly measure the quality of large-scale implementation efforts to inform improvement targets. This study used therapist-reported caregiver attendance in treatment sessions as a quality indicator in the community implementation of EBPs.

METHODS

Data were collected from therapists practicing in agencies contracted to provide publicly funded children's mental health services following a system-driven implementation of multiple EBPs. Community therapists (N=101) provided information about youth clients (N=267) and psychotherapy sessions (N=685). Multivariable binomial logistic regressions were conducted to examine associations between caregiver attendance and therapist factors (e.g., licensure status, education), youth factors (e.g., gender, age), and the type of EBP delivered.

RESULTS

Caregiver attendance occurred in 42% of sessions. The following factors were associated with increased odds of caregiver attendance: younger client age, male sex of client, externalizing presenting problem, and delivery of an EBP that prescribes caregiver attendance at all sessions. Caregiver attendance at sessions targeting trauma or externalizing disorders appeared to explain the differences between boys and girls in levels of caregiver engagement.

CONCLUSIONS

Overall, the patterns of actual caregiver attendance appeared consistent with empirically informed practice parameters for involvement of caregivers in treatment. Still, the rates of caregiver attendance in externalizing-focused sessions were suboptimal, and the gender difference in these rates-which clearly disfavored girls-suggests targeted areas for quality improvement. Potential reasons for these quality gaps are discussed.

Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field

BACKGROUND

Scientists have developed evidence-based interventions that improve the symptoms and functioning of youth with psychiatric disorders; however, these interventions are rarely used in community settings. Eliminating this research-to-practice gap is the purview of implementation science, the discipline devoted to the study of methods to promote the use of evidence-based practices in routine care.

METHODS

We review studies that have tested factors associated with implementation in child psychology and psychiatry, explore applications of social science theories to implementation, and conclude with recommendations to advance implementation science through the development and testing of novel, multilevel, causal theories.

RESULTS

During its brief history, implementation science in child psychology and psychiatry has documented the implementation gap in routine care, tested training approaches and found them to be insufficient for behavior change, explored the relationships between variables and implementation outcomes, and initiated randomized controlled trials to test implementation strategies. This research has identified targets related to implementation (e.g., clinician motivation, organizational culture) and demonstrated the feasibility of activating these targets through implementation strategies. However, the dominant methodological approach has been atheoretical and predictive, relying heavily on a set of variables from heuristic frameworks.

CONCLUSIONS

Optimizing the implementation of effective treatments in community care for youth with psychiatric disorders is a defining challenge of our time. This review proposes a new direction focused on developing and testing integrated causal theories. We recommend implementation scientists: (a) move from observational studies of implementation barriers and facilitators to trials that include causal theory; (b) identify a core set of implementation determinants; (c) conduct trials of implementation strategies with clear targets, mechanisms, and outcomes; (d) ensure that behaviors that are core to EBPs are clearly defined; and (e) agree upon standard measures. This agenda will help fulfill the promise of evidence-based practice for improving youth behavioral health.

Implementing systems-based innovations to improve access to early screening, diagnosis, and treatment services for children with autism spectrum disorder: An Autism Spectrum Disorder Pediatric, Early Detection, Engagement, and Services network study

In 2013, the National Institute of Mental Health funded five trials of unique, multicomponent, systems-based innovations designed to improve access to early screening, diagnosis, and treatment of autism spectrum disorder-collectively known as the Autism Spectrum Disorder Pediatric, Early Detection, Engagement, and Services Network. As part of an ongoing effort to pool data and learn from shared experience, we collected information across all studies about innovation components and implementation strategies. First, each study group completed standardized checklists based on the Template for Intervention Description and Replication and the Expert Recommendation for Implementing Change. Then, we interviewed principal and co-investigators of each study (n = 9) to further explore innovation components and assess barriers and facilitators to implementation. Innovation strategies were diverse (five different autism spectrum disorder screeners were used, 40% included early intervention trainings, 60% involved new technology). Common implementation strategies included developing stakeholder relationships and provider trainings. Barriers included inefficient systems of care, difficulty engaging families in the innovations, provider attitudes, and organizational culture (e.g. difficulty changing clinic processes). These findings suggest that-despite diverse settings and a variety of innovation content-common facilitators and challenges exist in implementing innovations to enhance access to early autism spectrum disorder screening, diagnosis, and treatment.

Predicting Youth Improvement in Community-Based Residential Settings with Practices Derived from the Evidence-Base

The current investigation conducted descriptive analyses on key variables in community-based residential (CBR) settings and investigated the extent to which disruptive youth between the ages of 13 and 17 years improved based on therapists' reported alignment with using practices derived from the evidence-base (PDEBs). Results from both the descriptive analyses and multilevel modeling suggested that therapists are using practices that both do and do not align with the evidence-base for disruptive youth. In addition, both PDEBs and practices with minimal evidence-support predicted or marginally predicted final average progress rating for these youth. Findings are discussed as they relate to the importance of continued exploration of treatment outcomes for CBR youth.

Transforming Mental Health Delivery Through Behavioral Economics and Implementation Science: Protocol for Three Exploratory Projects

BACKGROUND

Efficacious psychiatric treatments are not consistently deployed in community practice, and clinical outcomes are attenuated compared with those achieved in clinical trials. A major focus for mental health services research is to develop effective and cost-effective strategies that increase the use of evidence-based assessment, prevention, and treatment approaches in community settings.

OBJECTIVE

The goal of this program of research is to apply insights from behavioral economics and participatory design to advance the science and practice of implementing evidence-based practice (EBP) for individuals with psychiatric disorders across the life span.

METHODS

Project 1 (Assisting Depressed Adults in Primary care Treatment [ADAPT]) is patient-focused and leverages decision-making heuristics to compare ways to incentivize adherence to antidepressant medications in the first 6 weeks of treatment among adults newly diagnosed with depression. Project 2 (App for Strengthening Services In Specialized Therapeutic Support [ASSISTS]) is provider-focused and utilizes normative pressure and social status to increase data collection among community mental health workers treating children with autism. Project 3 (Motivating Outpatient Therapists to Implement: Valuing a Team Effort [MOTIVATE]) explores how participatory design can be used to design organizational-level implementation strategies to increase clinician use of EBPs. The projects are supported by a Methods Core that provides expertise in implementation science, behavioral economics, participatory design, measurement, and associated statistical approaches.

RESULTS

Enrollment for project ADAPT started in 2018; results are expected in 2020. Enrollment for project ASSISTS will begin in 2019; results are expected in 2021. Enrollment for project MOTIVATE started in 2018; results are expected in 2019. Data collection had begun for ADAPT and MOTIVATE when this protocol was submitted.

CONCLUSIONS

This research will advance the science of implementation through efforts to improve implementation strategy design, measurement, and statistical methods. First, we will test and refine approaches to collaboratively design implementation strategies with stakeholders (eg, discrete choice experiments and innovation tournaments). Second, we will refine the measurement of mechanisms related to heuristics used in decision making. Third, we will develop new ways to test mechanisms in multilevel implementation trials. This trifecta, coupled with findings from our 3 exploratory projects, will lead to improvements in our knowledge of what causes successful implementation, what variables moderate and mediate the effects of those causal factors, and how best to leverage this knowledge to increase the quality of care for people with psychiatric disorders.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03441399; https://www.clinicaltrials.gov/ct2/show/NCT03441399 (Archived by WebCite at http://www.webcitation.org/74dRbonBD).

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/12121.

Effectiveness and Efficiency of Observationally Assessing Fidelity to a Family-Centered Child Intervention: A Quasi-Experimental Study

Assessment of fidelity that is effective, efficient, and differentiates from usual practices is critical for effectively implementing evidence-based programs for families. This quasi-experiemntal study sought to determine whether observational ratings of fidelity to the Family Check-Up (FCU) could differentiate between levels of clinician training in the model, and from services as usual, and whether rating segments of sessions could be equivalent to rating complete sessions. Coders rated 75 videotaped sessions-complete and 20-min segments-for fidelity, using a valid and reliable rating system across three groups: (a) highly trained in FCU with universal, routine monitoring; (b) minimally trained in FCU with optional, variable monitoring; and (c) services as usual with no training in the FCU. We hypothesized that certain dimensions of fidelity would differ by training, whereas others would not. The results indicated that, as expected, one dimension of fidelity to the FCU, Conceptually accurate to the FCU, was reliably different between the groups (χ² = 44.63, p < .001). The differences observed were in the expected direction, showing higher scores for therapists with more training. The rating magnitude of session segments largely did not differ from those of complete session ratings; however, interrater reliabilities were low for the segments. Although observational ratings were shown to be sensitive to the degree of training in the FCU on a unique and theoretically critical dimension, observational coding of complete sessions is resource intensive and limits scalability. Additional work is needed to reduce the burden of assessing fidelity to family-centered programs.

Evidence-Based Treatment Strategies in Youth Mental Health Services: Results from a National Survey of Providers

Previous surveys indicate infrequent use of evidence-based treatment (EBT) manuals in usual care youth mental health, but the extent to which providers use core and common EBT strategies and what contextual factors impact EBT strategy implementation need further study. In a national, multidisciplinary survey of 1092 youth-serving providers, providers reported regular use of many EBT strategies. Provider learning theory orientation, more recent degree, more standardized and ongoing assessment use, more positive attitudes toward innovation and evidence, fewer low-income clients, and perceptions that their agency valued quality care and provided fewer training resources predicted more frequent EBT strategy use.

Family factors mediate discrimination related stress and externalizing symptoms in rural Latino adolescents

INTRODUCTION

Externalizing disorders are more prevalent in rural than urban settings and account for disproportionately high mental health service costs for rural adolescents. Although cultural stressors such as discrimination have been associated with externalizing problems in ethnic minority youth broadly, this relationship is understudied in Latinos, particularly those in rural settings. Further, though the associations of family processes such as familism and family conflict have been studied in relation to youth externalizing symptoms, whether these processes change in the face of adolescent discrimination stress remains unknown.

METHODS

A moderated multiple mediation model was used to examine the association between perceived discrimination, externalizing symptoms, and the indirect effect of family factors (familism, and family conflict) in a large sample (n = 455) of rural Latino youth. We also evaluated whether indirect and direct effects of discrimination on externalizing symptoms differed in boys versus girls.

RESULTS

Familism and family conflict each independently mediated the relationship between discrimination related stress and externalizing symptoms. However, discrimination had a direct effect on externalizing symptoms for boys only. In girls, this association held only when family factors were accounted for. Post-hoc analyses reveal that the moderating effect of sex on discrimination is driven by differences in rule-breaking behavior, as opposed to aggressive behavior.

CONCLUSION

Findings suggest that discrimination is associated with changes in the family environment which in turn invoke elevated risk for externalizing problems. Further, family-focused interventions that address externalizing problems may be especially effective for adolescent girls.

Implementation Climate and Time Predict Intensity of Supervision Content Related to Evidence Based Treatment

Objective: Children infrequently receive evidence-based treatments (EBTs) for mental health problems due to a science-to-practice implementation gap. Workplace-based clinical supervision, in which supervisors provide oversight, feedback, and training on clinical practice, may be a method to support EBT implementation. Our prior research suggests that the intensity of supervisory focus on EBT (i.e., thoroughness of coverage) during workplace-based supervision varies. This study explores predictors of supervisory EBT intensity.

Methods: Participants were twenty-eight supervisors and 70 clinician supervisees. They completed a baseline survey, and audio recorded supervision sessions over 1 year. Four hundred and thirty eight recordings were coded for supervision content. We chose to explore predictors of two EBT content elements due to their strong evidence for effectiveness and sufficient variance to permit testing. These included a treatment technique (“exposure”) and a method to structure treatment (“assessment”). We also explored predictors of non-EBT content (“other topics”). Mixed-effects models explored predictors at organizational/supervisor, clinician, and session levels.

Results: Positive implementation climate predicted greater intensity of EBT content coverage for assessment (coefficient = 0.82, p = 0.004) and exposure (coefficient = 0.87, p = 0.001). Intensity of exposure coverage was also predicted by more time spent discussing each case (coefficient = 0.04, p < 0.001). Predictors of greater non-EBT content coverage included longer duration of supervision sessions (coefficient = 0.05, p < 0.001) and lower levels of supervisor EBT knowledge (coefficient = −0.17, p = 0.013). No other supervisor- or clinician-level variables were significant predictors in the mixed effects models.

Conclusion: This was the first study to explore multi-level predictors of objectively coded workplace-based supervision content. Results suggest that organizations that expect, support and reward EBT are more likely to have greater intensity of EBT supervision coverage, which in turn may positively impact clinician EBT fidelity and client outcomes. There was evidence that supervisor knowledge of the EBT contributes to greater coverage, although robust supervisor and clinician factors that drive supervision are yet to be identified. Findings highlight the potential effectiveness of implementation strategies that simultaneously address organizational implementation climate and supervisor practices. More research is needed to identify mechanisms that support integration of EBT into supervision.

Overlapping and Non-overlapping Practices in Usual and Evidence-Based Care for Youth Anxiety

This study compared consistencies and discrepancies in usual care with practices derived from the evidence-base (PDEB) for youth anxiety in a public mental health system. Youth-level factors (diagnosis, functional impairment) as predictors of the discrepancies were also examined. Psychosocial and service data from 2485 youth with an anxiety disorder and/or receiving services for an anxiety treatment target were extracted. Therapists (N = 616) identified the treatment targets and practices youth received. Although many PDEB for youth anxiety were used by therapists in this sample, Exposure was only used in 15% of cases. Practices not consistent with youth anxiety treatment were also reported and included: PDEB for other conditions, practices common to all therapies, and practices that are not consistent with evidence-based care. Age and diagnosis predicted the delivery of PDEB for youth anxiety. Usual care incorporated many components of evidence-based care but was more diffuse and less focused on well-supported practices.

Training community-based treatment providers to implement contingency management for opioid addiction: Time to and frequency of adoption

Contingency management (CM) is a well-established treatment for opioid use, yet its adoption remains low in community clinics. This manuscript presents a secondary analysis of a study comparing a comprehensive implementation strategy (Science to Service Laboratory; SSL) to didactic training-as-usual (TAU) as a means of implementing CM across a multi-site opioid use disorder program. Hypotheses predicted that providers who received the SSL implementation strategy would 1) adopt CM faster and 2) deliver CM more frequently than TAU providers. In addition, we examined whether the effect of implementation strategy varied as a function of a set of theory-driven moderators, guided by the Consolidated Framework for Implementation Research: perceived intervention characteristics, perceived organizational climate, and provider characteristics (i.e., race/ethnicity, gender). Sixty providers (39 SSL, 21 TAU) across 15 clinics (7 SSL, 8 TAU) completed a comprehensive set of measures at baseline and reported biweekly on CM use for 52 weeks. All participants received didactic CM training; SSL clinics received 9 months of enhanced training, including access to an external coach, an in-house innovation champion, and a collaborative learning community. Discrete-time survival analysis found that SSL providers more quickly adopted CM; provider characteristics (i.e., race/ethnicity) emerged as the sole moderator of time to adoption. Negative binomial regression revealed that SSL providers also delivered CM more frequently than TAU providers. Frequency of CM adoption was moderated by provider (i.e., gender and race/ethnicity) and intervention characteristics (i.e., compatibility). Implications for implementation strategies for community-based training are discussed.

Exposure therapy for youth with anxiety: Utilization rates and predictors of implementation in a sample of practicing clinicians from across the United States

Exposure therapy is a highly effective, evidence-based treatment technique for children and adolescents with anxiety disorders. Regardless, therapists in the community are reported to use exposure relatively rarely compared with other approaches. The goal of the present study was to identify how practicing clinicians treat youth with anxiety disorders across the United States and what factors contribute to their use of exposure therapy. Recruited from public directories, 257 private practice therapists who treat anxious youth were surveyed. Non-exposure cognitive-behavioral techniques like cognitive restructuring and relaxation techniques were used significantly more frequently than exposure. Providers with more training in exposure therapy and fewer negative beliefs about this approach reported using exposure significantly more in the treatment of youth with social anxiety, obsessive-compulsive, and panic disorders. Self-identification as an anxiety disorder specialist significantly predicted exposure use for youth with posttraumatic stress disorder. Most therapists in private practice have minimal training in exposure therapy, perceive a lack of training options, and believe there would be a benefit to acquiring more training. The implications of these findings are discussed, including how to optimally design training opportunities in exposure therapy.

Supervision in Community Mental Health: Understanding Intensity of EBT Focus

The goal of the present study was to examine clinician, supervisor, and organizational factors that are associated with the intensity of evidence-based treatment (EBT) focus in workplace-based clinical supervision of a specific EBT, Trauma-Focused Cognitive Behavioral Therapy (TF-CBT). Supervisors (n = 56) and clinicians (n = 207) from mental health organizations across Washington State completed online self-report questionnaires. Multilevel modeling (MLM) analyses were used to examine the relative influence of nested clinician and supervisor factors on the intensity of EBT focus in supervision. We found that 33% of the variance in clinician report of EBT supervision intensity clustered at the supervisor level and implementation climate was the only significant factor associated with EBT supervision intensity. While individual clinician and supervisor factors may play a role in EBT coverage in supervision, our results suggest that an implementation climate that supports EBT may be the most critical factor for improving intensity of EBT coverage. Thus, implementation efforts that address the extent to which EBTs are expected, rewarded, and supported within an organization may be needed to support greater coverage of EBT during workplace-based supervision.

Observational Assessment of Engagement Strategies to Promote Parent Homework Planning in Community-Based Child Mental Health Treatment: A Pilot Study

Therapy homework includes tasks given to clients to complete outside of session to facilitate new knowledge/skills or to advance treatment goals. Homework completion, an important element of parent engagement in child mental health (MH) treatment, has been associated with improved child outcomes. The current pilot study assessed the design/assign phase of the therapy homework process to examine a) the extent to which therapists implemented engagement strategies with parents and b) whether therapist deployment of engagement strategies in early treatment predicted subsequent parent participation in homework planning. We included an ethnically-diverse sample of 10 therapists and 11 parent/child dyads receiving community-based MH services who participated in a pilot intervention study. Two observational coding systems were developed to code treatment session recordings for the extent to which a) therapists implemented engagement strategies with parents and b) parents contributed to therapy homework planning. Findings revealed low extensiveness of therapist implementation of engagement strategies with parents. As hypothesized, therapist use of engagement strategies (Collaboration, Empowerment, and Psychoeducation) in early treatment significantly predicted subsequent parent homework planning (sharing perspective on homework planning). However, therapist use of Alliance was unrelated to parent homework planning. These preliminary results suggest that therapist implementation of engagement strategies in early treatment may promote parent participation in homework planning, which is an important precursor to homework completion. This pilot study suggests potential future directions for both research on and training for community-based therapists in implementing successful strategies to promote parent homework planning in child MH treatment.

Characterizing Intervention Strategies Used in Community-Based Mental Health Care for Infants and Their Families

Mental health interventions for infants typically target high-risk groups and can prevent long-term negative outcomes. Despite federal initiatives promoting early intervention, minimal research has examined usual care services for infants, which is important to improve routine care. The current study characterized usual care practices in infant mental health through the adaptation and administration of a provider survey. Providers (n = 126) reported using a wide range of intervention strategies and few intervention programs with varied evidence. Findings can inform future research to identify quality improvement targets of usual mental health care for high-risk infants and their families.

Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

BACKGROUND

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

METHODS

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

RESULTS

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

CONCLUSIONS

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

TRIAL REGISTRATION

NCT01800266 , Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results]).

Social workers' perceptions of barriers to interpersonal therapy implementation for treating postpartum depression in a primary care setting in Israel

Research on evidence-based practice (EBP) implementation in social work often neglects to include evaluation of application barriers. This qualitative study examined social workers' perspectives of provider- and organisational-related barriers to implementing a brief eight-session interpersonal therapy (IPT) intervention, a time-limited EBP that addresses reducing depressive symptoms and improving interpersonal functioning. Implementation took place in a primary care setting in Israel and was aimed at treating women who have postpartum depression (PPD) symptoms. Using purposeful sampling, 25 primary care licensed social workers were interviewed between IPT training and implementation regarding their perceived barriers to implementing IPT in practice. Data analysis was facilitated using a phenomenological approach, which entails identifying the shared themes and shared experiences of research participants regarding barriers to implementing IPT. Three themes emerged from the analysis of interviews: Perceived lack of flexibility of IPT intervention in comparison with more familiar methods social workers previously applied, specifically regarding the number of sessions and therapeutic topics included in the IPT protocol; insecurity and hesitance to gain experience with a new method of intervention; and organisational barriers, including difficulties with referrals, the perception of HMOs as health facilities not suitable for therapy, and time constraints. Addressing perceived barriers of social workers toward implementing EBPs, such as IPT for postpartum depression, during the training phase is crucial for enabling appropriate implementation. Future training should include examining practitioners' attitudes toward implementation of EBPs, as part of standardised training protocols.

Does the Delivery of CBT for Youth Anxiety Differ Across Research and Practice Settings?

Does delivery of the same manual-based individual cognitive-behavioral treatment (ICBT) program for youth anxiety differ across research and practice settings? We examined this question in a sample of 89 youths (M age = 10.56, SD = 1.99; 63.70% Caucasian; 52.80% male) diagnosed with a primary anxiety disorder. The youths received (a) ICBT in a research setting, (b) ICBT in practice settings, or (c) non-manual-based usual care (UC) in practice settings. Treatment delivery was assessed using four theory-based subscales (Cognitive-behavioral, Psychodynamic, Client-Centered, Family) from the Therapy Process Observational Coding System for Child Psychotherapy-Revised Strategies scale (TPOCS-RS). Reliable independent coders, using the TPOCS-RS, rated 954 treatment sessions from two randomized controlled trials (1 efficacy and 1 effectiveness trial). In both settings, therapists trained and supervised in ICBT delivered comparable levels of cognitive-behavioral interventions at the beginning of treatment. However, therapists trained in ICBT in the research setting increased their use of cognitive-behavioral interventions as treatment progressed whereas their practice setting counterparts waned over time. Relative to the two ICBT groups, the UC therapists delivered a significantly higher dose of psychodynamic and family interventions and a significantly lower dose of cognitive-behavioral interventions. Overall, results indicate that there were more similarities than differences in manual-based ICBT delivery across research and practice settings. Future research should explore why the delivery of cognitive-behavioral interventions in the ICBT program changed over time and across settings, and whether the answers to these questions could inform implementation of ICBT programs.

Predictors of clinician use of exposure therapy in community mental health settings

Exposure therapy is recognized as the key component of cognitive-behavioral treatment for anxiety. However, exposure is the least used evidence-based treatment in community mental health settings and is the most challenging technique for clinicians to adopt within the context of effectiveness and implementation trials. Little work has examined clinician and organizational characteristics that predict use of exposure, which is important for identifying implementation strategies that may increase its use. In a large sample of community health clinicians (N=335) across 31 clinical practice sites, this study characterized clinician and organizational predictors of exposure use and relaxation for anxiety. Mixed effects regression analyses indicated that both clinician attitudes and an organization's implementation climate may be important levers for interventions seeking to increase clinician exposure use. Greater clinician use of relaxation strategies was also associated with less exposure use. Results point to important implications for implementing cognitive-behavioral therapy for anxiety, including de-emphasizing relaxation and attending to organizational climate.

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess "analogue fidelity" in a children's mental health quality improvement initiative. Results indicated low-but representative-clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Dropouts from system-wide evidence-based practice trainings are high; yet there are few studies on what predicts dropouts. This study examined multilevel predictors of clinician dropout from a statewide training on the Managing and Adapting Practice program. Extra-organizational structural variables, intra-organizational variables and clinician variables were examined. Using multivariable logistic regression analysis, state administrative data and prospectively collected clinician participation data were used to predict dropout. Two characteristics were predictive: younger clinicians and those practicing in upstate-rural areas compared to downstate-urban areas were less likely to drop out from training. Implications for research and policy are described.

Factor Analysis of Therapist-Identified Treatment Targets in Community-Based Children's Mental Health

The present study used exploratory and confirmatory factor analyses to identify underlying latent factors affecting variation in community therapists' endorsement of treatment targets. As part of a statewide practice management program, therapist completed monthly reports of treatment targets (up to 10 per month) for a sample of youth (n = 790) receiving intensive in-home therapy. Nearly 75 % of youth were diagnosed with multiple co-occurring disorders. Five factors emerged: Disinhibition, Societal Rules Evasion, Social Engagement Deficits, Emotional Distress, and Management of Biodevelopmental Outcomes. Using logistic regression, primary diagnosis predicted therapist selection of Disinhibition and Emotional Distress targets. Client age predicted endorsement of Societal Rules Evasion targets. Practice-to-research implications are discussed.

Providers' attitudes toward evidence-based practices: is it just about providers, or do practices matter, too?

Evidence-based practice (EBP) attitudes were measured in a sample of Los Angeles County mental health service providers. Three types of data were collected: provider demographic characteristics, attitudes toward EBP in general, and attitudes toward specific EBPs being implemented in the county. Providers could reliably rate characteristics of specific EBPs, and these ratings differed across interventions. Preliminary implementation data indicate that appealing features of an EBP relate to the degree to which providers use it. These findings suggest that assessing EBP-specific attitudes is feasible and may offer implementation-relevant information beyond that gained solely from providers' general attitudes toward EBP.

Therapist- and Client-Level Predictors of Use of Therapy Techniques During Implementation in a Large Public Mental Health System

OBJECTIVE

Many youths receiving community mental health treatment do not receive evidence-based interventions. Research suggests that community mental health therapists use a broad range of therapeutic techniques at low intensities. This study examined the relationship between therapist- and client-level predictors of community-based therapists' report of cognitive, behavioral, psychodynamic, and family techniques within the context of implementation efforts.

METHODS

A total of 130 therapists participated from 23 organizations in an urban, publicly funded behavioral health system implementing evidence-based practices. Therapist-level predictors included age, gender, clinical experience, licensure status, and participation in evidence-based practice initiatives. Child-level predictors included therapist-reported child primary disorder (externalizing, internalizing, or other) and child age. Therapists completed the Therapist Procedures Checklist-Family Revised, a self-report measure of therapeutic techniques used.

RESULTS

Unlicensed therapists were more likely than licensed therapists to report using psychodynamic and behavioral techniques. Therapists who did not participate in an evidence-based practice initiative were less likely to report use of cognitive techniques. Those with clients with externalizing disorders were more likely to report use of behavioral and family techniques. Therapists with the youngest clients (ages three to seven years) were most likely to report use of behavioral techniques and less likely to report use of cognitive and psychodynamic techniques.

CONCLUSIONS

Results suggest that both therapist and client factors predict self-reported use of therapy techniques. Participating in an evidence-based practice initiative was associated with increased reports of using cognitive techniques. Therapists reported using behavioral and family techniques more than other techniques when working with youths with externalizing disorders and using fewer cognitive and psychodynamic techniques with young clients.

Therapist self-report of evidence-based practices in usual care for adolescent behavior problems: factor and construct validity

This study introduces a therapist-report measure of evidence-based practices for adolescent conduct and substance use problems. The Inventory of Therapy Techniques-Adolescent Behavior Problems (ITT-ABP) is a post-session measure of 27 techniques representing four approaches: cognitive-behavioral therapy (CBT), family therapy (FT), motivational interviewing (MI), and drug counseling (DC). A total of 822 protocols were collected from 32 therapists treating 71 adolescents in six usual care sites. Factor analyses identified three clinically coherent scales with strong internal consistency across the full sample: FT (8 items; α = .79), MI/CBT (8 items; α = .87), and DC (9 items, α = .90). The scales discriminated between therapists working in a family-oriented site versus other sites and showed moderate convergent validity with therapist reports of allegiance and skill in each approach. The ITT-ABP holds promise as a cost-efficient quality assurance tool for supporting high-fidelity delivery of evidence-based practices in usual care.

Evidence Base Update: 50 Years of Research on Treatment for Child and Adolescent Anxiety

Anxiety disorders are the most common mental health disorder among children and adolescents. We examined 111 treatment outcome studies testing 204 treatment conditions for child and adolescent anxiety published between 1967 and mid-2013. Studies were selected for inclusion in this review using the PracticeWise Evidence-Based Services database. Using guidelines identified by this journal (Southam-Gerow & Prinstein, 2014), studies were included if they were conducted with children and/or adolescents (ages 1-19) with anxiety and/or avoidance problems. In addition to reviewing the strength of the evidence, the review also examined indicators of effectiveness, common practices across treatment families, and mediators and moderators of treatment outcome. Six treatments reached well-established status for child and adolescent anxiety, 8 were identified as probably efficacious, 2 were identified as possibly efficacious, 6 treatments were deemed experimental, and 8 treatments of questionable efficacy emerged. Findings from this review suggest substantial support for cognitive-behavioral therapy (CBT) as an effective and appropriate first-line treatment for youth with anxiety disorders. Several other treatment approaches emerged as probably efficacious that are not primarily CBT based, suggesting that there are alternative evidence-based treatments that practitioners can turn to for children and adolescents who do not respond well to CBT. The review concludes with a discussion of treatments that improve functioning in addition to reducing symptoms, common practices derived from evidence-based treatments, mediators and moderators of treatment outcomes, recommendations for best practice, and suggestions for future research.

A review of parent participation engagement in child and family mental health treatment

Engagement in child and family mental health treatment has critically important clinical, implementation, and policy implications for efforts to improve the quality and effectiveness of care. This article describes a review of the existing literature on one understudied element of engagement, parent participation. Twenty-three published articles were identified. Questions asked of the literature include what terms are used to represent parent participation engagement, how parent participation engagement is measured, what are the rates of parent participation engagement reported in studies of child and family mental health treatment, whether parent participation engagement has been found to overlap with attendance engagement, what factors have been identified as associated with parent participation engagement, whether parent participation engagement is associated with improved outcomes, and what strategies have been designed to improve PPE and whether such strategies are associated with improved outcomes. Results indicate varied terms and measures of parent participation engagement, moderate overall rates, and high overlap with measures of attendance engagement. The extant literature on factors associated with parent participation engagement was somewhat limited and focused primarily on parent-/family-level factors. Evidence of links between parent participation engagement and outcome improvements was found across some outcome domains, and strategies designed to target parent participation engagement were found to be effective overall. A framework for organizing efforts to examine the different elements of engagement is described, and findings are discussed in terms of suggestions for consistent terminology, clinical implications, and areas for the future research.

A review of parent participation engagement in child and family mental health treatment

Engagement in child and family mental health treatment has critically important clinical, implementation, and policy implications for efforts to improve the quality and effectiveness of care. This article describes a review of the existing literature on one understudied element of engagement, parent participation. Twenty-three published articles were identified. Questions asked of the literature include what terms are used to represent parent participation engagement, how parent participation engagement is measured, what are the rates of parent participation engagement reported in studies of child and family mental health treatment, whether parent participation engagement has been found to overlap with attendance engagement, what factors have been identified as associated with parent participation engagement, whether parent participation engagement is associated with improved outcomes, and what strategies have been designed to improve PPE and whether such strategies are associated with improved outcomes. Results indicate varied terms and measures of parent participation engagement, moderate overall rates, and high overlap with measures of attendance engagement. The extant literature on factors associated with parent participation engagement was somewhat limited and focused primarily on parent-/family-level factors. Evidence of links between parent participation engagement and outcome improvements was found across some outcome domains, and strategies designed to target parent participation engagement were found to be effective overall. A framework for organizing efforts to examine the different elements of engagement is described, and findings are discussed in terms of suggestions for consistent terminology, clinical implications, and areas for the future research.

Community-based treatment for youth with co- and multimorbid disruptive behavior disorders

Little is known about the types of psychotherapeutic practices delivered to youth with comorbid and multimorbid diagnoses in community settings. The present study, based on therapists' self-reported practices with 569 youth diagnosed with a disruptive behavior disorder (ODD or CD), examined whether specific therapeutic practice applications varied as a function of the number and type of comorbid disorders. While type of comorbid disorder (AD/HD or internalizing) did not predict therapists' practices, youth with more than two diagnoses (multimorbid) received treatment characterized by a more diverse set and a higher dosage of practices.