Understanding the common elements of evidence-based practice: misconceptions and clinical examples

Expanding the Toolkit or Changing the Paradigm: Are We Ready for a Public Health Approach to Mental Health?

Kazdin and Blase aptly describe the enormous mental health burden facing our nation and suggest several ways to reform the workforce, setting, and content of services to address this long-standing unmet need. We propose that current health care reform legislation and associated advances in service delivery provide a unique and timely opportunity for a paradigm shift in mental health research, practice, and training to support services that are comprehensive, readily accessible, and relevant to a broad range of mental health needs and capacities. Using the recent public health initiative to contain the H1N1 virus for comparison, and informed by a long-standing and extensive literature documenting the need for a public health model for mental health, we describe the rationale for a three-tiered public mental health model, illustrated with examples from ongoing research, to minimize universal risk for mental health difficulties via capacity building in natural settings; reduce onset and severity of symptoms by prioritizing high-risk groups via screening and services for targeted populations; and reduce psychiatric impairment among individuals with more intensive needs via individual, family, and group interventions. New priorities for clinical science to support a public health approach are proposed.

Evidence Base Update: 50 Years of Research on Treatment for Child and Adolescent Anxiety

Anxiety disorders are the most common mental health disorder among children and adolescents. We examined 111 treatment outcome studies testing 204 treatment conditions for child and adolescent anxiety published between 1967 and mid-2013. Studies were selected for inclusion in this review using the PracticeWise Evidence-Based Services database. Using guidelines identified by this journal (Southam-Gerow & Prinstein, 2014), studies were included if they were conducted with children and/or adolescents (ages 1-19) with anxiety and/or avoidance problems. In addition to reviewing the strength of the evidence, the review also examined indicators of effectiveness, common practices across treatment families, and mediators and moderators of treatment outcome. Six treatments reached well-established status for child and adolescent anxiety, 8 were identified as probably efficacious, 2 were identified as possibly efficacious, 6 treatments were deemed experimental, and 8 treatments of questionable efficacy emerged. Findings from this review suggest substantial support for cognitive-behavioral therapy (CBT) as an effective and appropriate first-line treatment for youth with anxiety disorders. Several other treatment approaches emerged as probably efficacious that are not primarily CBT based, suggesting that there are alternative evidence-based treatments that practitioners can turn to for children and adolescents who do not respond well to CBT. The review concludes with a discussion of treatments that improve functioning in addition to reducing symptoms, common practices derived from evidence-based treatments, mediators and moderators of treatment outcomes, recommendations for best practice, and suggestions for future research.

Emergent approaches to the meta-analysis of multiple heterogeneous complex interventions

BACKGROUND

Multiple interventions meta-analysis has been recommended in the methodological literature as a tool for evidence synthesis when a heterogeneous set of interventions is included in the same review—and, more recently, when a heterogeneous set of complex interventions is included. However, there is little guidance on the use of this method with complex interventions. This article suggests two approaches to model complexity and heterogeneity through this method.

DISCUSSION

'Clinically meaningful units' groups interventions by modality or similar theory of change, whereas 'components and dismantling' separates out interventions into combinations of components and either groups interventions by the combination of components they demonstrate or extracts effects for each identified component and, possibly, interactions between components. Future work in systematic review methodology should aim to understand how to develop taxonomies of components or theories of change that are internally relevant to the studies in these multiple interventions meta-analyses.

SUMMARY

Despite little meaningful prior guidance to its use in this context, multiple interventions meta-analysis has the potential to be a useful tool for synthesising heterogeneous sets of complex interventions. Researchers should choose an approach in accordance with their specific aims in their systematic review.

Parenting skills and parent readiness for treatment are associated with child disruptive behavior and parent participation in treatment

OBJECTIVE

Parent management training programs for parents of children with disruptive behaviors are efficacious treatments; however, in order to maximize efficiency it is necessary to develop approaches to understand which parents are most likely to participate in treatment. Accordingly, the present study used a person-centered methodology to determine clinically relevant parenting profiles that capture the breadth of parents' readiness to engage in parenting treatment, and their self-reported parenting skills. Further, identified profiles were compared on the severity of children's behavior problems and used to predict participation in parent management training.

METHOD

One hundred and forty-three parents completed assessments at an urban children's mental health clinic. Parents were given measures to assess personal readiness to participate in parenting treatment, parenting skills, and child behavior. A subset of these parents participated in parent management training.

RESULTS

Three profiles emerged that differed in parents' treatment readiness and level of skills. Forty-one percent of parents were classified as "ready." They showed relatively higher rates of inconsistent discipline, but also somewhat higher levels of positive parenting. Thirty-nine percent of parents were classified as "less in need." These parents reported relatively less inconsistent discipline and poor supervision skills and greater positive parenting. Finally, approximately 20% of parents were classified as "almost ready." They showed high levels of inconsistent discipline and poor supervision skills, and low levels of positive parenting. Almost ready and ready parents reported the most problems with their children's behavior. Further, parents classified as less in need participated in the fewest treatment sessions.

CONCLUSIONS

Consideration of parent readiness and skills, in addition to symptom severity, may inform clinical decision making and screening procedures.

Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: correspondence between therapists and observers

Developing therapist-report fidelity tools to support quality delivery of evidence-based practices in usual care is a top priority for implementation science. This study tested the reliability and accuracy of two groups of community therapists who reported on their use of family therapy (FT) and motivational interviewing/cognitive-behavioral therapy (MI/CBT) interventions during routine treatment of inner-city adolescents with conduct and substance use problems. Study cases (n = 45) were randomized into two conditions: (a) Routine Family Therapy (RFT), consisting of a single site that featured family therapy as its standard of care for behavioral treatment; or (b) Treatment As Usual (TAU), consisting of five sites that featured non-family approaches. Therapists and trained observational raters provided FT and MI/CBT adherence ratings on 157 sessions (104 RFT, 53 TAU). Overall therapist reliability was adequate for averaged FT ratings (ICC = .66) but almost non-existent for MI/CBT (ICC = .06); moreover, both RFT and TAU therapists were more reliable in reporting on FT than on MI/CBT. Both groups of therapists overestimated the extent to which they implemented FT and MI/CBT interventions. Results offer support for the feasibility of using existing therapist-report methods to anchor quality assurance procedures for FT interventions in real-world settings, though not for MI/CBT.

Child welfare caseworkers as brokers of mental health services: a pilot evaluation of Project Focus Colorado

Youth in the child welfare system (CWS) have substantially higher rates of mental health needs compared to the general population, yet they rarely receive targeted, evidence-based practices (EBPs). Caseworkers play the critically important role of "service broker" for CWS youth and families. This study examines preliminary caseworker-level outcomes of Project Focus Colorado (PF-C), a training and consultation program designed to improve access to EBPs for CWS youth. PF-C evaluation occurred in four child welfare offices (two intervention [n = 16 caseworkers] vs. two practice-as-usual, wait-list control [WLC; n = 12 caseworkers]). Receipt of PF-C was associated with significantly increased caseworker knowledge of (a) EBPs, (b) child mental health problems, (c) evidence-based treatment components targeting mental health problem areas, and (d) mental health screening instruments, compared to WLC. Dose of training and consultation was associated with greater ability to correctly classify mental health problems and match them to EBPs. These preliminary results suggest that targeted training and consultation help to improve caseworker knowledge of children's mental health needs, EBPs for mental health, and mental health screening instruments.

Clinical Decision-Making in Community Children's Mental Health: Using Innovative Methods to Compare Clinicians With and Without Training in Evidence-Based Treatment

BACKGROUND

Mental health professionals' decision-making practice is an area of increasing interest and importance, especially in the pediatric research and clinical communities.

OBJECTIVE

The present study explored the role of prior training in evidence-based treatments on clinicians' assessment and treatment formulations using case vignettes. Specifically, study aims included using the Naturalistic Decision Making (NDM) cognitive theory to 1) examine potential associations between EBT training and decision-making processes (novice versus expert type), and 2) explore how client and family contextual information affects clinical decision-making.

METHODS

Forty-eight clinicians across two groups (EBT trained=14, Not EBT trained=34) participated. Clinicians were comparable on professional experience, demographics, and discipline. The quasi-experimental design used an analog "think aloud" method where clinicians read case vignettes about a child with disruptive behavior problems and verbalized case conceptualization and treatment planning out-loud. Responses were coded according to NDM theory.

RESULTS

MANOVA results were significant for EBT training status such that EBT trained clinicians' displayed cognitive processes more closely aligned with "expert" decision-makers and non-EBT trained clinicians' decision processes were more similar to "novice" decision-makers, following NDM theory. Non-EBT trained clinicians assigned significantly more diagnoses, provided less detailed treatment plans and discussed fewer EBTs. Parent/family contextual information also appeared to influence decision-making.

CONCLUSION

This study offers a preliminary investigation of the possible broader impacts of EBT training and potential associations with development of expert decision-making skills. Targeting clinicians' decision-making may be an important avenue to pursue within dissemination-implementation efforts in mental health practice.

A behavioral intervention for war-affected youth in Sierra Leone: a randomized controlled trial

OBJECTIVE

Youth in war-affected regions are at risk for poor psychological, social, and educational outcomes. Effective interventions are needed to improve mental health, social behavior, and school functioning. This randomized controlled trial tested the effectiveness of a 10-session cognitive-behavioral therapy (CBT)-based group mental health intervention for multisymptomatic war-affected youth (aged 15-24 years) in Sierra Leone.

METHOD

War-affected youth identified by elevated distress and impairment via community screening were randomized (stratified by sex and age) to the Youth Readiness Intervention (YRI) (n = 222) or to a control condition (n = 214). After treatment, youth were again randomized and offered an education subsidy immediately (n = 220) or waitlisted (n = 216). Emotion regulation, psychological distress, prosocial attitudes/behaviors, social support, functional impairment, and posttraumatic stress disorder (PTSD) symptoms were assessed at pre- and postintervention and at 6-month follow-up. For youth in school, enrollment, attendance, and classroom performance were assessed after 8 months. Linear mixed-effects regressions evaluated outcomes.

RESULTS

The YRI showed significant postintervention effects on emotion regulation, prosocial attitudes/behaviors, social support, and reduced functional impairment, and significant follow-up effects on school enrollment, school attendance, and classroom behavior. In contrast, education subsidy was associated with better attendance but had no effect on mental health or functioning, school retention, or classroom behavior. Interactions between education subsidy and YRI were not significant.

CONCLUSION

YRI produced acute improvements in mental health and functioning as well as longer-term effects on school engagement and behavior, suggesting potential to prepare war-affected youth for educational and other opportunities. Clinical trial registration information-Trial of the Youth Readiness Intervention (YRI); http://clinicaltrials.gov; NCT01684488.

Bridging the gap between research-supported interventions and everyday social work practice: a new approach

This article describes a rationale for a focus on case studies that would provide a database of single-group pre-post mean effect sizes that could be analyzed to identify which service provision characteristics are associated with more desirable outcomes when interventions supported by randomized clinical trials are adapted in everyday practice settings. In addition, meta-analyses are proposed that would provide benchmarks that agency practitioners could compare with their mean effect size to inform their decisions about whether to continue, modify, or replace existing efforts to adopt or adapt a specific research-supported treatment. Social workers should be at the forefront of the recommended studies in light of the profession's emphasis on applied research in real-world settings and the prominence of social work practitioners in such settings.

The Evidence-Based Practice of Applied Behavior Analysis

Evidence-based practice (EBP) is a model of professional decision-making in which practitioners integrate the best available evidence with client values/context and clinical expertise in order to provide services for their clients. This framework provides behavior analysts with a structure for pervasive use of the best available evidence in the complex settings in which they work. This structure recognizes the need for clear and explicit understanding of the strength of evidence supporting intervention options, the important contextual factors including client values that contribute to decision making, and the key role of clinical expertise in the conceptualization, intervention, and evaluation of cases. Opening the discussion of EBP in this journal, Smith (The Behavior Analyst, 36, 7-33, 2013) raised several key issues related to EBP and applied behavior analysis (ABA). The purpose of this paper is to respond to Smith's arguments and extend the discussion of the relevant issues. Although we support many of Smith's (The Behavior Analyst, 36, 7-33, 2013) points, we contend that Smith's definition of EBP is significantly narrower than definitions that are used in professions with long histories of EBP and that this narrowness conflicts with the principles that drive applied behavior analytic practice. We offer a definition and framework for EBP that aligns with the foundations of ABA and is consistent with well-established definitions of EBP in medicine, psychology, and other professions. In addition to supporting the systematic use of research evidence in behavior analytic decision making, this definition can promote clear communication about treatment decisions across disciplines and with important outside institutions such as insurance companies and granting agencies.

The integration of behavioral health interventions in children's health care: services, science, and suggestions

Because the integration of mental or behavioral health services in pediatric primary care is a national priority, a description and evaluation of the interventions applied in the healthcare setting is warranted. This article examines several intervention research studies based on alternative models for delivering behavioral health care in conjunction with comprehensive pediatric care. This review describes the diverse methods applied to different clinical problems, such as brief mental health skills, clinical guidelines, and evidence-based practices, and the empirical outcomes of this research literature. Next, several key treatment considerations are discussed to maximize the efficiency and effectiveness of these interventions. Some practical suggestions for overcoming key service barriers are provided to enhance the capacity of the practice to deliver behavioral health care. There is moderate empirical support for the feasibility, acceptability, and clinical utility of these interventions for treating internalizing and externalizing behavior problems. Practical strategies to extend this work and address methodological limitations are provided that draw upon recent frameworks designed to simplify the treatment enterprise (e.g., common elements). Pediatric primary care has become an important venue for providing mental health services to children and adolescents due, in part, to its many desirable features (e.g., no stigma, local setting, familiar providers). Further adaptation of existing delivery models may promote the delivery of effective integrated interventions with primary care providers as partners designed to address mental health problems in pediatric healthcare.

The integration of behavioral health interventions in children's health care: services, science, and suggestions

Because the integration of mental or behavioral health services in pediatric primary care is a national priority, a description and evaluation of the interventions applied in the healthcare setting is warranted. This article examines several intervention research studies based on alternative models for delivering behavioral health care in conjunction with comprehensive pediatric care. This review describes the diverse methods applied to different clinical problems, such as brief mental health skills, clinical guidelines, and evidence-based practices, and the empirical outcomes of this research literature. Next, several key treatment considerations are discussed to maximize the efficiency and effectiveness of these interventions. Some practical suggestions for overcoming key service barriers are provided to enhance the capacity of the practice to deliver behavioral health care. There is moderate empirical support for the feasibility, acceptability, and clinical utility of these interventions for treating internalizing and externalizing behavior problems. Practical strategies to extend this work and address methodological limitations are provided that draw upon recent frameworks designed to simplify the treatment enterprise (e.g., common elements). Pediatric primary care has become an important venue for providing mental health services to children and adolescents due, in part, to its many desirable features (e.g., no stigma, local setting, familiar providers). Further adaptation of existing delivery models may promote the delivery of effective integrated interventions with primary care providers as partners designed to address mental health problems in pediatric healthcare.

A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions

OBJECTIVE

This systematic review examines experimental studies that test the effectiveness of strategies intended to integrate empirically supported mental health interventions into routine care settings. Our goal was to characterize the state of the literature and to provide direction for future implementation studies.

METHODS

A literature search was conducted using electronic databases and a manual search.

RESULTS

Eleven studies were identified that tested implementation strategies with a randomized (n = 10) or controlled clinical trial design (n = 1). The wide range of clinical interventions, implementation strategies, and outcomes evaluated precluded meta-analysis. However, the majority of studies (n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome.

CONCLUSIONS

There is a clear need for more rigorous research on the effectiveness of implementation strategies, and we provide several suggestions that could improve this research area.

A case for modular design: Implications for implementing evidence-based interventions with culturally-diverse youth

Community-based therapists are frequently faced with the complex task of applying existing research knowledge to clients who may differ markedly from those enrolled in controlled outcome studies. The current paper examines the utility of modular psychotherapy design as one method of facilitating the flexible delivery of evidence-based mental health services to ethnically and culturally diverse children and families. Modularity complements existing approaches to the provision of culturally-sensitive, empirically-informed treatment through its ability to balance the prioritization of research evidence and local practitioner cultural knowledge. Specific applications of modular principles to clinical work with diverse youth are highlighted. Special considerations and limitations relevant to modular psychotherapy and the overall mental health services research literature are discussed, as well as the continued importance of individual clinicians' cultural competence and use of treatment progress monitoring, both of which should be combined with identified treatment modules to support the delivery of high-quality care.

Statewide implementation of the 4 Rs and 2 Ss for strengthening families

Embedding evidence-informed practices for children with mental health needs into "real-world" community settings has proven challenging. In this article, we discuss how the Practical, Robust, Implementation, and Sustainability Model (PRISM) guided statewide (New York) implementation of an evidence-informed intervention targeting families and youth with oppositional defiant and conduct disorders, collectively referred to as disruptive behavior disorders. Additionally, we present qualitative findings based on provider reports of integrating a novel, evidence-informed intervention within their respective community mental health settings. Finally, we discuss a process of modifying the intervention to address agency-level factors, as well as inform more widespread implementation efforts.

Family voice with informed choice: coordinating wraparound with research-based treatment for children and adolescents

The wraparound process is a type of individualized, team-based care coordination that has become central to many state and system efforts to reform children's mental health service delivery for youths with the most complex needs and their families. Although the emerging wraparound research base is generally positive regarding placements and costs, effect sizes are smaller for clinical and functional outcomes. This article presents a review of literature on care coordination and wraparound models, with a focus on theory and research that indicates the need to better connect wraparound-enrolled children and adolescents to evidence-based treatment (EBT). The article goes on to describe how recently developed applications of EBT that are based on quality improvement and flexible application of "common elements" of research-based care may provide a more individualized approach that better aligns with the philosophy and procedures of the wraparound process. Finally, this article presents preliminary studies that show the feasibility and potential effectiveness of coordinating wraparound with the Managing and Adapting Practice system, and discusses intervention development and research options that are currently under way.

Developing a systematic evaluation approach for training programs within a train-the-trainer model for youth cognitive behavior therapy

The purpose of this small pilot study was three-fold: (a) to begin development of a coding scheme for supervisor and therapist skill acquisition, (b) to preliminarily investigate a pilot train-the-trainer paradigm for skill development, and (c) to evaluate self-reported versus observed indicators of skill mastery in that pilot program. Participants included four supervisor-therapist dyads (N = 8) working with public mental health sector youth. Master trainers taught cognitive-behavioral therapy techniques to supervisors, who in turn trained therapists on these techniques. Supervisor and therapist skill acquisition and supervisor use of teaching strategies were repeatedly assessed through coding of scripted role-plays with a multiple-baseline across participants and behaviors design. The coding system, the Practice Element Train the Trainer - Supervisor/Therapist Versions of the Therapy Process Observational Coding System for Child Psychotherapy, was developed and evaluated though the course of the investigation. The coding scheme demonstrated excellent reliability (ICCs [1,2] = 0.81-0.91) across 168 video recordings. As calculated through within-subject effect sizes, supervisor and therapist participants, respectively, evidenced skill improvements related to teaching and performing therapy techniques. Self-reported indicators of skill mastery were inflated in comparison to observed skill mastery. Findings lend initial support for further developing an evaluative approach for a train-the-trainer effort focused on disseminating evidence-based practices.

What must you know and do to get good outcomes with DBT?

Because little research has been conducted on which therapist-client interactions lead to intermediate and end-point improvements in Dialectical Behavior Therapy (DBT), we have a small evidence-base from which to specify what therapists must know and do in order to obtain good outcomes using DBT. As with other evidence-based practices, dissemination of DBT has defaulted to assumptions and methods from the "psychotherapy technology model," which emphasizes transfer of the validated treatment package from the research clinic to routine settings with high fidelity (Morgenstern & McKay, 2007). However, serious limitations of the psychotherapy technology model require pursuit of alternative complementary models to guide dissemination. One complementary approach is to use well-designed practice-based training research. In this approach, therapists learn modular competencies linked to a highly structured yet flexible clinical decision-making framework. Modular training of therapist competencies emphasizes the continuity of the component therapist strategies across evidence-based protocols rather than emphasizing the packages or manuals as separate and distinct. Key hypotheses about the change processes responsible for client change and the associated treatment strategies used to influence these change processes should be specified and measured at the level of client, therapist, and service delivery setting. Adopting this approach may offer advantages that apply to the dissemination and implementation of DBT and other evidence-based practices (EBPs).

Implementing an evidence-based practices training curriculum to U.S. Army child and family behavioral health providers

Military Children who have experienced multiple deployments of one or both parents are more likely to have emotional and behavioral difficulties compared with their civilian peers (e.g., Chandra et al., 2010 ). The U.S. Army Medical Command has tasked the Child, Adolescent and Family Behavioral Health Office (CAF-BHO) to develop programs to address the behavioral health (BH) needs of Army Children and Families. This article will describe the efforts of the CAF-BHO Training Section to disseminate and implement an evidence based practice training curriculum for Army Child and Family Behavioral Health Providers. Specifically, this article will detail: (a) the decision making strategy used to identify the training protocol for dissemination, (b) adaptations to the training program and treatment protocol to fit a Military context, and (c) efforts to implement, maximize and sustain utilization of evidence-based practices by Military BH providers over a large geographical area with limited resources.

Structuring the collaboration of science and service in pursuit of a shared vision

The enduring needs of our society highlight the importance of a shared vision to improve human functioning and yield better lives for families and communities. Science offers a powerful strategy for managing the inevitable uncertainty in pursuit of these goals. This article presents ideas and examples of methods that could preserve the strengths of the two major paradigms in children's mental health, evidence-based treatments and individualized care models, but that also have the potential to extend their applicability and impact. As exemplified in some of the articles throughout this issue, new models to connect science and service will likely emerge from novel consideration of better ways to structure and inform collaboration within mental health systems. We contend that the future models for effective systems will involve increased attention to (a) client and provider developmental pathways, (b) explicit frameworks for coordinating people and the knowledge and other resources they use, and (c) a balance of evidence-based planning and informed adaptation. We encourage the diverse community of scientists, providers, and administrators in our field to come together to enhance our collective wisdom through consideration of and reflection on these concepts and their illustrations.

Engineering youth service system infrastructure: Hawaii's continued efforts at large-scale implementation through knowledge management strategies

Hawaii's Child and Adolescent Mental Health Division provides a unique illustration of a youth public mental health system with a long and successful history of large-scale quality improvement initiatives. Many advances are linked to flexibly organizing and applying knowledge gained from the scientific literature and move beyond installing a limited number of brand-named treatment approaches that might be directly relevant only to a small handful of system youth. This article takes a knowledge-to-action perspective and outlines five knowledge management strategies currently under way in Hawaii. Each strategy represents one component of a larger coordinated effort at engineering a service system focused on delivering both brand-named treatment approaches and complimentary strategies informed by the evidence base. The five knowledge management examples are (a) a set of modular-based professional training activities for currently practicing therapists, (b) an outreach initiative for supporting youth evidence-based practices training at Hawaii's mental health-related professional programs, (c) an effort to increase consumer knowledge of and demand for youth evidence-based practices, (d) a practice and progress agency performance feedback system, and (e) a sampling of system-level research studies focused on understanding treatment as usual. We end by outlining a small set of lessons learned and a longer term vision for embedding these efforts into the system's infrastructure.

The Effectiveness of Cultural Adjustment and Trauma Services (CATS): generating practice-based evidence on a comprehensive, school-based mental health intervention for immigrant youth

A collaborative study of Cultural Adjustment and Trauma Services (CATS), a comprehensive, school-based mental health program for traumatized immigrant children and adolescents, was conducted to generate practice-based evidence on the service delivery model across two school districts. Program effectiveness was assessed by testing whether client functioning and PTSD symptoms improved as a result of 7 separate service elements. An array of clinical services including CBT, supportive therapy, and coordinating services were provided to all students, and an evidence-based intervention for trauma, TF-CBT, was implemented with a subset of students. Greater quantities of CBT and supportive therapy increased functioning, while greater quantities of coordinating services decreased symptoms of PTSD. TF-CBT services were associated with both improved functioning and PTSD symptoms, although TF-CBT was implemented with fidelity to the overall comprehensive service model rather than the structured intervention model. Results suggest the comprehensive school-based model was effective, though different service components affected different student outcomes. Implications of these findings for immigrant mental health interventions and implementing structured evidence-based practices into community mental health programs are discussed. Suggestions are made for future research on existing mental health practices with immigrants.

Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers

Enhancing the public health impact of evidence-based practices (EBPs) in usual care settings is a key priority of the National Institute of Mental Health. Longitudinal data from community mental health providers (N = 268) participating in a series of state-sponsored workshops in modular approaches to EBPs for youth are presented. EBP workshop attendance for youth anxiety resulted in increased knowledge for EBPs for anxiety (and not other conditions) and EBP workshop attendance for youth disruptive behaviors resulted in increased knowledge for EBPs for disruptive behaviors (and not other conditions). Providers' tendencies toward incorrectly classifying non-EBP therapies as evidence-based increased over time, suggesting that providers over-generalize the EBP label as a result of attending these types of workshops. Regarding EBP attitudes, most measures of attitudes improved when providers attended a workshop. Additionally, an overly inclusive view of what constitutes an EBP at intake was related to significant decreases in openness to trying EBPs over time, whereas more positive attitudes at intake was related to achieving a more refined view of what constitutes an EBP over the course of attending trainings. Study limitations and implications for implementation of EBPs in usual care settings are discussed.

The effect of neighborhood on crime and safety: a review of the evidence

There is a growing, multidisciplinary body of evidence on the effects that neighborhoods have on family outcomes. This evidence is important for social workers as we work with clients and communities from a person-in-environment perspective. In this article the authors present findings from a systematic, integrative review of neighborhood effects specifically for crime and safety. Thirty-seven research studies using random samples from urban, U.S. areas between 2002 and 2008 are reviewed. Findings suggest socio-demographic characteristics of neighborhoods and neighborhood processes are both predictive of crime and safety. Further, some neighborhood conditions may affect crime and safety in unexpected ways. Implications for social work practice, neighborhood interventions, and evidence-based practice are discussed.

A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders

While a plethora of cognitive behavioral empirically supported treatments (ESTs) are available for treating child and adolescent anxiety and depressive disorders, research has shown that these are not as effective when implemented in routine practice settings. Research is now indicating that is partly due to ineffective EST training methods, resulting in a lack of therapist competence. However, at present, the specific competencies that are required for the effective implementation of ESTs for this population are unknown, making the development of more effective EST training difficult. This study therefore aimed to develop a model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders using a version of the well-established Delphi technique. In doing so, the authors: (1) identified and reviewed cognitive behavioral ESTs for child and adolescent anxiety and depressive disorders, (2) extracted therapist competencies required to implement each treatment effectively, (3) validated these competency lists with EST authors, (4) consulted with a panel of relevant local experts to generate an overall model of therapist competence for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders, and (5) validated the overall model with EST manual authors and relevant international experts. The resultant model offers an empirically derived set of competencies necessary for effectively treating children and adolescents with anxiety and depressive disorders and has wide implications for the development of therapist training, competence assessment measures, and evidence-based practice guidelines for working with this population. This model thus brings us one step closer to bridging the gap between science and practice when treating child and adolescent anxiety and depression.

Training research: practical recommendations for maximum impact

This review offers practical recommendations regarding research on training in evidence-based practices for mental health and substance abuse treatment. When designing training research, we recommend: (a) aligning with the larger dissemination and implementation literature to consider contextual variables and clearly defining terminology, (b) critically examining the implicit assumptions underlying the stage model of psychotherapy development, (c) incorporating research methods from other disciplines that embrace the principles of formative evaluation and iterative review, and (d) thinking about how technology can be used to take training to scale throughout all stages of a training research project. An example demonstrates the implementation of these recommendations.

Interventions for families affected by HIV

Family-based interventions are efficacious for human immunodeficiency virus (HIV) detection, prevention, and care, but they are not broadly diffused. Understanding intervention adaptation and translation processes can support evidence-based intervention (EBI) diffusion processes. This paper provides a narrative review of a series of EBI for families affected by HIV (FAH) that were adapted across five randomized controlled trials in the US, Thailand, and South Africa over 15 years. The FAH interventions targeted parents living with HIV and their children or caregiver supports. Parents with HIV were primarily mothers infected through sexual transmission. The EBIs for FAH are reviewed with attention to commonalities and variations in risk environments and intervention features. Frameworks for common and robust intervention functions, principles, practice elements, and delivery processes are utilized to highlight commonalities and adaptations for each location, time period, and intervention delivery settings. Health care, housing, food, and financial security vary dramatically in each risk environment. Yet, all FAH face common health, mental health, transmission, and relationship challenges. The EBIs efficaciously addressed these common challenges and were adapted across contexts with fidelity to robust intervention principles, processes, factors, and practices. Intervention adaptation teams have a series of structural decision points: mainstreaming HIV with other local health priorities or not; selecting an optimal delivery site (clinics, homes, community centers); and how to translate intervention protocols to local contexts and cultures. Replication of interventions with fidelity must occur at the level of standardized functions and robust principles, processes, and practices, not manualized protocols. Adopting a continuous quality improvement paradigm will enhance rapid and global diffusion of EBI for FAH.

Evaluation of the sustainability and clinical outcome of Alternatives for Families: A Cognitive-Behavioral Therapy (AF-CBT) in a child protection center

This paper examines the sustainability and outcome of Alternatives for Families: A Cognitive-Behavioral Therapy (AF-CBT) as delivered by practitioners in a community-based child protection program who had received training in the model several years earlier. Formerly described as Abuse-Focused CBT, AF-CBT is an evidence-based treatment (EBT) for child physical abuse and family aggression/conflict that was included in the National Child Traumatic Stress Network's initial EBT dissemination efforts in 2002. Seven practitioners participated in a year-long learning collaborative in AF-CBT and in similar training programs for 4 other EBTs. The agency's routine data collection system was used to document the clinical and adjustment outcomes of 52 families presenting with a physically abused child who received their services between 2 and 5 years after the AF-CBT training had ended. Measures of the use of all 5 EBTs documented their frequency, internal consistency, and intercorrelations. Controlling for the unique content of the other four EBTs, the amount of AF-CBT Abuse-specific content delivered was related to improvements on standardized parent rating scales (i.e., child externalizing behavior, anger, anxiety, social competence) and both parent and clinician ratings of the child's adjustment at discharge (i.e., child more safe, less scared/sad, more appropriate with peers). The amount of AF-CBT General content was related to a few discharge ratings (better child prognosis, helpfulness to parents). These novel data provide suggestive evidence for the sustainability and clinical benefits of AF-CBT in an existing community clinic serving physically abused children and their families, and are discussed in the context of key developments in the treatment model and dissemination literature.

Mental health care for children with disruptive behavior problems: a view inside therapists' offices

OBJECTIVES

In the United States, more money is spent on treatment for children's mental health problems than for any other childhood medical condition, yet little is known about usual care treatment for children. Objectives of this study were to characterize usual care outpatient psychotherapy for children with disruptive behavior problems and to identify consistencies and inconsistencies between usual care and common elements of evidence-based practices in order to inform efforts to implement evidence-based practices in usual care.

METHODS

Participants included 96 psychotherapists and 191 children aged four to 13 who were presenting for treatment for disruptive behavior to one of six usual care clinics. An adapted version of the Therapy Process Observational Coding System for Child Psychotherapy-Strategies scale (TPOCS-S) was used to assess psychotherapy processes in 1,215 randomly selected (out of 3,241 collected) videotaped treatment sessions; treatment sessions were recorded for up to 16 months.

RESULTS

Most children received a large amount of treatment (mean number of sessions=22, plus children received other auxiliary services), and there was great variability in the amount and type of care received. Therapists employed a wide array of treatment strategies directed toward children and parents within and across sessions, but on average all strategies were delivered at a low intensity. Several strategies that were conceptually consistent with evidence-based practices were observed frequently (for example, affect education and using positive reinforcement); however, others were observed rarely (for example, assigning or reviewing homework and role-playing).

CONCLUSIONS

Usual care treatment for these youths reflected great breadth but not depth. The results highlight specific discrepancies between evidence-based care and usual care, thus identifying potentially potent targets for improving the effectiveness of usual care.

Mental health care for children with disruptive behavior problems: a view inside therapists' offices

OBJECTIVES

In the United States, more money is spent on treatment for children's mental health problems than for any other childhood medical condition, yet little is known about usual care treatment for children. Objectives of this study were to characterize usual care outpatient psychotherapy for children with disruptive behavior problems and to identify consistencies and inconsistencies between usual care and common elements of evidence-based practices in order to inform efforts to implement evidence-based practices in usual care.

METHODS

Participants included 96 psychotherapists and 191 children aged four to 13 who were presenting for treatment for disruptive behavior to one of six usual care clinics. An adapted version of the Therapy Process Observational Coding System for Child Psychotherapy-Strategies scale (TPOCS-S) was used to assess psychotherapy processes in 1,215 randomly selected (out of 3,241 collected) videotaped treatment sessions; treatment sessions were recorded for up to 16 months.

RESULTS

Most children received a large amount of treatment (mean number of sessions=22, plus children received other auxiliary services), and there was great variability in the amount and type of care received. Therapists employed a wide array of treatment strategies directed toward children and parents within and across sessions, but on average all strategies were delivered at a low intensity. Several strategies that were conceptually consistent with evidence-based practices were observed frequently (for example, affect education and using positive reinforcement); however, others were observed rarely (for example, assigning or reviewing homework and role-playing).

CONCLUSIONS

Usual care treatment for these youths reflected great breadth but not depth. The results highlight specific discrepancies between evidence-based care and usual care, thus identifying potentially potent targets for improving the effectiveness of usual care.

The role of therapist training in the implementation of psychosocial treatments: a review and critique with recommendations

Evidence-based treatments (EBT) are underutilized in community settings, where consumers are often seen for treatment. Underutilization of EBTs may be related to a lack of empirically informed and supported training strategies. The goals of this review are to understand the state of the literature for training therapists in psychotherapy skills and to offer recommendations to improve research in this area. Results of this review of 55 studies evaluating six training methods indicate that multi-component trainings have been studied most often and have most consistently demonstrated positive training outcomes relative to other training methods. Studies evaluating utility of reading, self-directed trainings, and workshops have documented that these methods do not routinely produce positive outcomes. Workshop follow-ups help to sustain outcomes. Little is known about the impact of train-the-trainer methods. Methodological flaws and factors that may influence training outcome and future directions are also reviewed.

Methodological challenges of characterizing usual care psychotherapeutic practice

There is minimal existing research providing detailed, reliable data characterizing usual community-based psychotherapy practice, and, thus, limited established methods for such research. This article identifies methodological challenges of usual care descriptive research, including, (a) general design considerations, (b) measurement, (c) data analytic, and (d) ethical challenges. Case examples drawn from studies reported in this special issue are used to illustrate the implications, strengths, and weaknesses of different methodological decisions. Central themes include achieving an acceptable balance of scientific rigor, feasibility, and generalizable practice relevance, as well as working collaboratively with practice partners to select and implement study methods.

Disruptive and oppositional behavior in an 11-year old boy

Tony is an 11-year old boy in the fifth grade whose mother describes him as "really a good kid who is bright and tries to be friendly. But he's always doing things that get him in trouble at school and sometimes at home." Tony was diagnosed with ADHD (combined type) 2 years ago. Stimulant therapy improved his attention and concentration during school, decreased hyperactivity in the classroom and improved educational achievements. However, Tony is oppositional and disruptive on the playground, during team sports and at home. His teacher observed that he wants to fit in, but he quickly gets in arguments with other children. He has difficulty sustaining friendships because he typically annoys others with unreasonable demands. He often has temper tantrums when things do not go his way; the tantrums are not prolonged but frequent. At home, on several occasions Tony hit his younger sister, and he once threw a dinner plate against the wall during a family meal. Although his mother describes these behaviors as present for many years, they seem to be escalating. Tony lives with both parents and his younger sister. There is no history of marital discord or major life event change in the past year. Standardized achievement tests demonstrate average to above average achievement scores. He continues to get mostly B grades and an occasional C. Tony's parents have tried to limit television time as a punishment for disruptive behaviors without any apparent effect. His mother reports that she yelled at him on several occasions when he refused to carry out household chores. "He gets angry at the simplest request for help." After meeting with Tony and his mother and completing a normal physical examination, the pediatrician referred Tony to a child psychologist for behavioral therapy.

INTEGRATED MODELS OF SCHOOL-BASED PREVENTION: LOGIC AND THEORY

School-based prevention programs can positively impact a range of social, emotional, and behavioral outcomes. Yet the current climate of accountability pressures schools to restrict activities that are not perceived as part of the core curriculum. Building on models from public health and prevention science, we describe an integrated approach to school-based prevention. These models leverage the most effective structural and content components of social-emotional and behavioral health prevention interventions. Integrated interventions are expected to have additive and synergistic effects that result in greater impacts on multiple student outcomes. Integrated programs are also expected to be more efficient to deliver, easier to implement with high quality and integrity, and more sustainable. We provide a detailed example of the process through which the PAX-Good Behavior Game and the Promoting Alternative Thinking Strategies (PATHS) curriculum were integrated into the PATHS to PAX model. Implications for future research are proposed.

Cognitive behavior therapy for anxious adolescents: developmental influences on treatment design and delivery

Anxiety disorders in adolescence are common and disruptive, pointing to a need for effective treatments for this age group. Cognitive behavior therapy (CBT) is one of the most popular interventions for adolescent anxiety, and there is empirical support for its application. However, a significant proportion of adolescent clients continue to report anxiety symptoms post-treatment. This paper underscores the need to attend to the unique developmental characteristics of the adolescent period when designing and delivering treatment, in an effort to enhance treatment effectiveness. Informed by the literature from developmental psychology, developmental psychopathology, and clinical child and adolescent psychology, we review the 'why' and the 'how' of developmentally appropriate CBT for anxious adolescents. 'Why' it is important to consider developmental factors in designing and delivering CBT for anxious adolescents is addressed by examining the age-related findings of treatment outcome studies and exploring the influence of developmental factors, including cognitive capacities, on engagement in CBT. 'How' clinicians can developmentally tailor CBT for anxious adolescents in six key domains of treatment design and delivery is illustrated with suggestions drawn from both clinically and research-oriented literature. Finally, recommendations are made for research into developmentally appropriate CBT for anxious adolescents.

Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: The promise of transdiagnostic interventions

Assessing treatment fidelity is a core methodological consideration in the study of treatment outcome; it influences both the degree to which changes can be attributed to the intervention and the ability to replicate and disseminate the intervention. Efforts to increase access to evidence-based psychological treatments are receiving unprecedented support; but pressures exist to adapt treatments to service settings, running the risk of compromising fidelity. However, little evidence is available to inform the necessary conditions for the transportation of interventions to service provision settings, and the degree to which fidelity is even evaluated or emphasized in dissemination and implementation programs varies dramatically. Moreover, adaptation is associated with several benefits for dissemination efforts and may address relevant barriers to adoption. A particularly promising strategy for maximizing the benefits of both fidelity and adaptation is the use of transdiagnostic interventions. Such treatments allow for greater flexibility of the pacing and content of treatment, while still providing structure to facilitate testing and replication. Preliminary evidence supports the efficacy of this strategy, which may be particularly conducive to dissemination into service provision settings. At this time, further research is needed to evaluate the relationships among fidelity, adaptation, and outcome, and to determine the potential for transdiagnostic treatments to facilitate dissemination.

Impact of teen depression on academic, social, and physical functioning

OBJECTIVE

This study aimed to determine the impact of teen depression on peer, family, school, and physical functioning and the burden on parents.

METHODS

Patients participated in a longitudinal study of teens with and without probable depression, drawn from 11 primary care offices in Los Angeles, California, and Washington, DC. A total of 4856 teens completed full screening assessments; 4713 were eligible for the study, and 187 (4.0%) met the criteria for probable depression and were invited to participate, as were teens who were not depressed. A total of 184 baseline assessments for teens with probable depression and 184 for nondepressed teens were completed, as were 339 (90%) parent interviews. Follow-up interviews were conducted with 328 teens (89%) and 302 parents (82%). Measures included teen reports of peer and parent support, 2 measures of school functioning, grades, physical health, and days of impairment. Parent reports included peer, school, and family functioning and subjective and objective burdens on parents.

RESULTS

Teens with depression and their parents reported more impairment in all areas, compared with teens without depression at baseline, and reported more coexisting emotional and behavioral problems. Both depression and coexisting problems were related to impairment. There was a lasting impact of depressive symptoms on most measures of peer, family, and school functioning 6 months later, but controlling for coexisting baseline emotional and behavioral problems attenuated this relationship for some measures.

CONCLUSION

Improvements in teen depression might have benefits that extend beyond clinical symptoms, improving peer, family, and school functioning over time.