Evidence‐based treatments for children and adolescents: An updated review of indicators of efficacy and effectiveness

Effects of a video feedback parent training program during child welfare visitation

Behavioral parent training programs have documented efficacy for improving behaviors among parents and their children and are frequently used by child welfare agencies to prevent removal of a child from the parental home or to facilitate reunification. Although an ideal time for parent training might be during supervised visits where parents may practice skills with their children under the guidance and support of a therapist or caseworker, this is not typically the case. Most often, parents within the child welfare system receive parent training in small groups without their children present, and to date, few studies have examined effects of behavioral parent training interventions during supervised visitation. In this study, concurrent multiple baseline across behaviors design was used to examine effects of a behavioral parent training program, Filming Interactions to Nurture Development (FIND), on parental skill acquisition with four mothers who had lost custody of their children but were being considered for reunification. Children emitted little or no problem behaviors during baseline or intervention, so parenting behavior was the primary dependent variable. Results obtained across participants documented a clear functional relation between implementation of the FIND intervention and increases in developmentally supportive parenting behaviors. Results of social validity and contextual fit measures suggest the intervention was perceived by mothers to be positive, feasible, and appropriate within the child welfare context. Practical and conceptual implications, limitations of this study, and directions for future research are discussed.

Guided self-help interventions for mental health disorders in children with neurological conditions: study protocol for a pilot randomised controlled trial

BACKGROUND

Rates of mental health disorders are significantly greater in children with physical illnesses than in physically well children. Children with neurological conditions, such as epilepsy, are known to have particularly high rates of mental health disorders. Despite this, mental health problems in children with neurological conditions have remained under-recognised and under-treated in clinical settings. Evidence-based guided self-help interventions are efficacious in reducing symptoms of mental health disorders in children, but their efficacy in reducing symptoms of common mental health disorders in children with neurological conditions has not been investigated. We aim to pilot a guided self-help intervention for the treatment of mental health disorders in children with neurological conditions.

METHODS/DESIGN

A pilot randomised controlled trial with 18 patients with neurological conditions and mental health disorders will be conducted. Participants attending specialist neurology clinics at a National UK Children's Hospital will be randomised to receive guided self-help for common mental health disorders or to a 12-week waiting list control. Participants in the treatment group will receive 10 sessions of guided self-help delivered over the telephone. The waiting list control group will receive the intervention after a waiting period of 12 weeks. The primary outcome measure is reduction in symptoms of mental health disorders. Exclusion criteria are limited to those at significant risk of harm to self or others, the presence of primary mental health disorder other than anxiety, depression or disruptive behaviour (e.g. psychosis, eating disorder, obsessive-compulsive disorder) or intellectual disability at a level meaning potential participants would be unable to access the intervention. The study has ethical approval from the Camden and Islington NHS Research Ethics Committee, registration number 14.LO.1353. Results will be disseminated to patients, the wider public, clinicians and researchers through publication in journals and presentation at conferences.

DISCUSSION

This is the first study to investigate guided self-help interventions for mental health problems in children with neurological conditions, a group which is currently under-represented in mental health research. The intervention is modular and adapted from an empirically supported cognitive behavioural treatment. The generalisability and broad inclusion criteria are strengths but may also lead to some weaknesses.

TRIAL REGISTRATION

Current Controlled Trials: ISRCTN21184717 . Registered on 25 September 2015.

Perspectives on "Disease" and "Disability" in Child Health: The Case of Childhood Neurodisability

Chronic health conditions are often associated with what is termed disability. Traditional thinking has focused on diagnosis and treatment of chronic diseases and disorders, with less attention to people's functional abilities and their contextual determinants. Understanding all of these factors is integral to addressing the predicaments and needs of persons with chronic conditions. However, these complementary yet distinct "worldviews" reflected in what we call disease and disability perspectives often remain, at best, only vaguely articulated. In this paper, we explore and expand on these perspectives in light of conceptual advances, specifically the framework of the World Health Organization's International Classification of Functioning, Disability and Health, and their epistemic underpinnings with reference to Wilhelm Windelband's notions of nomothetic and idiographic types of knowledge. Our primary focus is the children with neurodisability - life-long conditions that onset early in life and have functional consequences that impact developmental trajectories. We critically review and analyze conceptual material, along with clinical and research evidence relevant to the experiential and clinical realities of this population, to demonstrate the limitations of a biomedically based diagnostic-therapeutic paradigm at the expense of a developmental and disability-oriented perspective. Our main aim in this paper is to argue for an explicit recognition of both disease and disability perspectives, and a more balanced and appropriate deployment of these concepts across the continuum of clinical services, research, policy-making and professional and public education in relation to children with neurodisability; we also provide concrete recommendations to advance this progressive strategy. The relevance of these aims and strategies, however, extends beyond this particular population.

Validation of a Brief Structured Interview: The Children's Interview for Psychiatric Syndromes (ChIPS)

Evidence-based assessment is important in the treatment of childhood psychopathology. While researchers and clinicians frequently use structured diagnostic interviews to ensure reliability, the most commonly used instrument, the Schedule for Affective Disorders and Schizophrenia for School Aged Children (K-SADS) is too long for most clinical applications. The Children's Interview for Psychiatric Syndromes (ChIPS/P-ChIPS) is a highly-structured brief diagnostic interview. The present study compared K-SADS and ChIPS/P-ChIPS diagnoses in an outpatient clinical sample of 50 parent-child pairs aged 7-14. Agreement between most diagnoses was moderate to high between the instruments and with consensus clinical diagnoses. ChIPS was significantly briefer to administer than the K-SADS. Interviewer experience level and participant demographics did not appear to affect agreement. Results provide further evidence for the validity of the ChIPS and support its use in clinical and research settings.

A first-level evaluation of a school-based family programme for adolescent social, emotional and behavioural difficulties

This study is a first-level evaluation of an intervention targeted at adolescents with social, emotional and behavioural difficulties in Irish post-primary schools. It is a combined implementation of the Working Things Out adolescent programme and the Parents Plus Adolescent Programme (WTOPPAP). Overall, 47 parents and their children (mean age: 13.81 years) took part in the study. The study used a repeated measures design to assess change at pre- and post-intervention and 5-month follow-up using the Strengths and Difficulties Questionnaire, McMaster General Functioning Scale, Goal Attainment (parent- and adolescent-rated), Parent Stress Scale and Kansas Parenting Satisfaction Scale (parent-rated) as assessment measures. This study found that parent-rated child total difficulties and adolescent-rated emotional difficulties significantly improved from pre-test to 5-month follow-up. Parent- and adolescent-rated goals, and parent-rated child conduct difficulties, parental stress and satisfaction with parenting also significantly improved from pre- to post-test. These gains were largely maintained at 5-month follow-up. These findings indicate that the WTOPPAP may be an effective intervention for adolescents with emotional and behavioural difficulties and their parents. It was demonstrated that a manualised family intervention could be effectively rolled out at a number of school locations, with delivery and evaluation being conducted by school staff. Further implications are also discussed.

Digital Parent Training for Children with Disruptive Behaviors: Systematic Review and Meta-Analysis of Randomized Trials

OBJECTIVES

Digital-based parent training (DPT) programs for parents of children with disruptive behaviors have been developed and tested in randomized trials. The aim of this study was to quantitatively assess the efficacy of these programs versus a control condition.

METHODS

We conducted a systematic review and random effects meta-analysis of peer-reviewed randomized studies comparing DPT targeting children with disruptive behaviors versus a control group (wait list or no treatment).

RESULTS

Altogether, seven studies (n = 718) were meta-analyzed. Compared to the control groups, DPT resulted in significantly greater improvement in child behavior (effect size [ES] = 0.44, 95% confidence interval [CI] = 0.21-0.66, studies = 7), parent behavior (ES = 0.41, 95% CI = 0.25-0.57, studies = 6), and parental confidence (ES = 0.36, 95% CI = 0.12-0.59, studies = 4). The improvement in child behavior was moderated by age group and severity of clinical presentation, which overlapped 100%. While DPT was superior to control conditions in studies of young children (mean age <7 years) with a clinical range of disruptive behaviors (ES = 0.61, 95% CI = 0.40-0.82, studies = 4), results were nonsignificant in studies of older children (mean age >11 years) with a nonclinical range of symptoms (ES = 0.21, 95% CI = -0.01 to 0.42, studies = 3). Analyses yielded similar results of higher ESs favoring studies of young children with clinical range disruptive behaviors for parent behavior and parental confidence, but the differences were not significant. Results further suggested that in studies of younger children, interactive programs (e.g., computerized programs) were more effective in improving child behavior compared to noninteractive programs (e.g., watching video clips) (p < 0.05).

CONCLUSION

Although additional studies are needed, DPT holds promise as a potentially scalable evidence-based treatment of children with disruptive behaviors that can save human resources.

Do Treatment Plans Matter? Moving From Recommendations to Action

We investigated whether a service-planning document outlining recommendations for what providers should address in treatment (i.e., targets) and the associated clinical techniques they should employ (i.e., practices) influenced the targets and practices that providers reported actually implementing during the subsequent treatment episode. Participants included 94 youths ages 4 to 17 (M = 13.57, SD = 3.59) who received community-based mental health services from the Hawai'i Child and Adolescent Mental Health Division. Data on targets and practices were compared across initial Mental Health Treatment Plans and Monthly Treatment and Progress Summaries. Data were analyzed using two-level, generalized mixed effects models with two-way cross-classification or linear mixed effects models. Providers were more likely to report the use of targets and practices in treatment if they were included within the treatment plan. In addition, the more closely targets addressed during treatment followed the recommended targets from the treatment plan, the more closely implemented practices followed the recommended practices listed in the treatment plan. Furthermore, as providers shifted their focus to different targets, a shift in their use of practices was also evident over time. Last, practices for which there is demonstrated efficacy for particular targets were more likely to be used. Service planning documents appear to help organize care; however, results also suggest possible limitations to the current system. These findings highlight potential areas for improvement in planning and care delivery.

A systematic review of community-based parenting interventions for adolescents with challenging behaviours

Parenting skills training is an established means of treating challenging behaviours among young children, but there has been limited research on its efficacy when used to treat challenging adolescent behaviour. The aim of this systematic review was to evaluate the efficacy and effectiveness of community-based parenting interventions designed for families with adolescents, as judged in terms of increased knowledge and skills among parents, improvements in adolescent behaviour, and program feasibility within community settings. Results indicated that intervention group parents typically made greater gains than did control group parents on measures of good parenting, with positive flow-on effects to some aspects of challenging adolescent behaviours. Limited evidence suggests that group and individual intervention formats may be equally effective and that there is no advantage to the participation of the target adolescent in the intervention.

Adverse effects of psychological therapy: An exploratory study of practitioners' experiences from child and adolescent psychiatry

The scientific knowledge about adverse effects of psychological therapies and how such effects should be detected is limited. It is possible that children and adolescents are particularly vulnerable and need specific support in order to express adverse effects. In this exploratory study, we used a qualitative approach to explore practitioners' experiences of this phenomenon. Fourteen practitioners providing psychological therapy within the Child and Adolescent Psychiatric Service were interviewed. Qualitative content analysis was applied to the data. Four overarching categories brought up by the practitioners were identified: vagueness of the concept (reflecting that the concept was novel and hard to define), psychotherapist-client interaction (encompassing aspects of the interaction possibly related to adverse effects), consequences for the young person (including a range of emotional, behavioural and social consequences) and family effects (e.g. professional complications and decreased autonomy for the parent). Professional discussions on these issues could improve psychological therapy for children and adolescents. Based on our findings and previous research, we propose three basic aspects to consider when adverse effects are detected and managed in this context: typology (form, severity and duration), aetiology (hypothesis about the causes) and perspective (adverse effects seen from the points of view of different interested parties).

Factors associated with practitioners' use of exposure therapy for childhood anxiety disorders

The current study examines factors related to use of exposure therapy by clinicians who treat children with anxiety disorders. A sample of 331 therapists from a variety of backgrounds (i.e., social workers, doctoral psychologists, masters level counselors, and marriage and family therapists) completed a survey regarding use of exposure and other treatment techniques for childhood anxiety disorders, as well as beliefs about exposure and child resiliency. Although the majority of therapists endorsed a CBT orientation (81%) and use of CBT techniques, exposure therapy was rarely endorsed. Holding a PhD in psychology as well as more positive beliefs about exposure and child resiliency were associated with greater use of exposure. The results suggest that exposure-based therapy is rarely offered in community settings and that dissemination should focus on individual evidence-based principles and correcting therapist misconceptions.

Cross-Cultural Validation of the Modified Practice Attitudes Scale: Initial Factor Analysis and a New Factor Model

OBJECTIVE

The objective of this study was to create the Korean version of the Modified Practice Attitudes Scale (K-MPAS) to measure clinicians' attitudes toward evidence-based treatments (EBTs) in the Korean mental health system.

METHOD

Using 189 U.S. therapists and 283 members from the Korean mental health system, we examined the reliability and validity of the MPAS scores. We also conducted the first exploratory and confirmatory factor analysis on the MPAS and compared EBT attitudes across U.S. and Korean therapists.

RESULTS

Results revealed that the inclusion of both "reversed-worded" and "non-reversed-worded" items introduced significant method effects that compromised the integrity of the one-factor MPAS model. Problems with the one-factor structure were resolved by eliminating the "non-reversed-worded" items. Reliability and validity were adequate among both Korean and U.S. therapists. Korean therapists also reported significantly more negative attitudes toward EBTs on the MPAS than U.S. therapists.

CONCLUSIONS

The K-MPAS is the first questionnaire designed to measure Korean service providers' attitudes toward EBTs to help advance the dissemination of EBTs in Korea. The current study also demonstrated the negative impacts that can be introduced by incorporating oppositely worded items into a scale, particularly with respect to factor structure and detecting significant group differences.

The Revised Child Anxiety and Depression Scale 25-Parent Version: Scale Development and Validation in a School-Based and Clinical Sample

To help facilitate the dissemination and implementation of evidence-based assessment practices, we examined the psychometric properties of the shortened 25-item version of the Revised Child Anxiety and Depression Scale-parent report (RCADS-25-P), which was based on the same items as the previously published shortened 25-item child version. We used two independent samples of youth-a school sample ( N = 967, Grades 3-12) and clinical sample ( N = 433; 6-18 years)-to examine the factor structure, reliability, and validity of the RCADS-25-P scale scores. Results revealed that the two-factor structure (i.e., depression and broad anxiety factor) fit the data well in both the school and clinical sample. All reliability estimates, including test-retest indices, exceeded benchmark for good reliability. In the school sample, the RCADS-25-P scale scores converged significantly with related criterion measures and diverged with nonrelated criterion measures. In the clinical sample, the RCADS-25-P scale scores successfully discriminated between those with and without target problem diagnoses. In both samples, child-parent agreement indices were in the expected ranges. Normative data were also reported. The RCADS-25-P thus demonstrated robust psychometric properties across both a school and clinical sample as an effective brief screening instrument to assess for depression and anxiety in children and adolescents.

Mechanisms of Behavioral and Affective Treatment Outcomes in a Cognitive Behavioral Intervention for Boys

Evidence for effective treatment for behavioral problems continues to grow, yet evidence about the effective mechanisms underlying those interventions has lagged behind. The Stop Now and Plan (SNAP) program is a multicomponent intervention for boys between 6 and 11. This study tested putative treatment mechanisms using data from 252 boys in a randomized controlled trial of SNAP versus treatment as usual. SNAP includes a 3 month group treatment period followed by individualized intervention, which persisted through the 15 month study period. Measures were administered in four waves: at baseline and at 3, 9 and 15 months after baseline. A hierarchical linear modeling strategy was used. SNAP was associated with improved problem-solving skills, prosocial behavior, emotion regulation skills, and reduced parental stress. Prosocial behavior, emotion regulation skills and reduced parental stress partially mediated improvements in child aggression. Improved emotion regulation skills partially mediated treatment-related child anxious-depressed outcomes. Improvements in parenting behaviors did not differ between treatment conditions. The results suggest that independent processes may drive affective and behavioral outcomes, with some specificity regarding the mechanisms related to differing treatment outcomes.

Development and Pilot Evaluation of a Tablet-Based Application to Improve Quality of Care in Child Mental Health Treatment

Background

Children need access to high quality mental health care. Effective treatments now exist for a wide range of mental health conditions. However, these interventions are delivered with variable effectiveness in traditional mental health service settings. Innovative solutions are needed to improve treatment delivery quality and effectiveness.

Objective

The aim of this study was to develop a scalable, sustainable technology-based approach to improve the quality of care in child mental health treatment.

Methods

A tablet-based resource was developed with input from mental health training experts, mental health providers, and patients. A series of qualitative data collection phases (ie, expert interviews, patient and provider focus groups, usability testing) guided the initial concept and design of the resource, and then its refinement. The result was an iPad-based “e-workbook” designed to improve child engagement and provider fidelity in implementation of a best-practice treatment. We are currently conducting a small scale randomized controlled trial to evaluate the feasibility of e-workbook facilitated child mental health treatment with 10 providers and 20 families recruited from 4 local community-based mental health clinics.

Results

Usability and focus group testing yielded a number of strong, favorable reactions from providers and families. Recommendations for refining the e-workbook also were provided, and these guided several improvements to the resource prior to initiating the feasibility trial, which is currently underway.

Conclusions

This study aimed to develop and preliminarily evaluate a tablet-based application to improve provider fidelity and child engagement in child mental health treatment. If successful, this approach may serve as a key step toward making best-practice treatment more accessible to children and families. As various technologies continue to increase in popularity worldwide and within the health care field more specifically, it is essential to rigorously test the usability, feasibility, acceptability, and effectiveness of novel health technology solutions. It is also essential to ensure that patients and providers drive decision making that supports the development of these resources to ensure that they can be seamlessly integrated into practice.

Trial Registration

Clinicaltrials.gov NCT01915160; https://clinicaltrials.gov/ct2/show/NCT01915160 (Archived by WebCite at http://www.webcitation.org/6cPIiQDpu)

Therapist self-report of evidence-based practices in usual care for adolescent behavior problems: factor and construct validity

This study introduces a therapist-report measure of evidence-based practices for adolescent conduct and substance use problems. The Inventory of Therapy Techniques-Adolescent Behavior Problems (ITT-ABP) is a post-session measure of 27 techniques representing four approaches: cognitive-behavioral therapy (CBT), family therapy (FT), motivational interviewing (MI), and drug counseling (DC). A total of 822 protocols were collected from 32 therapists treating 71 adolescents in six usual care sites. Factor analyses identified three clinically coherent scales with strong internal consistency across the full sample: FT (8 items; α = .79), MI/CBT (8 items; α = .87), and DC (9 items, α = .90). The scales discriminated between therapists working in a family-oriented site versus other sites and showed moderate convergent validity with therapist reports of allegiance and skill in each approach. The ITT-ABP holds promise as a cost-efficient quality assurance tool for supporting high-fidelity delivery of evidence-based practices in usual care.

Evidence-Based Practice: The Psychology of EBP Implementation

Evidence-based practice (EBP) is an approach used in numerous professions that focuses attention on evidence quality in decision making and action. We review research on EBP implementation, identifying critical underlying psychological factors facilitating and impeding its use. In describing EBP and the forms of evidence it employs, we highlight the challenges individuals face in appraising evidence quality, particularly that of their personal experience. We next describe critical EBP competencies and the challenges underlying their acquisition: foundational competencies of critical thinking and domain knowledge, and functional competencies such as question formulation, evidence search and appraisal, and outcome evaluation. We then review research on EBP implementation across diverse fields from medicine to management and organize findings around three key contributors to EBP: practitioner ability, motivation, and opportunity to practice (AMO). Throughout, important links between psychology and EBP are highlighted, along with the contributions psychological research can make to further EBP development and implementation.

Evidence Base Update: 50 Years of Research on Treatment for Child and Adolescent Anxiety

Anxiety disorders are the most common mental health disorder among children and adolescents. We examined 111 treatment outcome studies testing 204 treatment conditions for child and adolescent anxiety published between 1967 and mid-2013. Studies were selected for inclusion in this review using the PracticeWise Evidence-Based Services database. Using guidelines identified by this journal (Southam-Gerow & Prinstein, 2014), studies were included if they were conducted with children and/or adolescents (ages 1-19) with anxiety and/or avoidance problems. In addition to reviewing the strength of the evidence, the review also examined indicators of effectiveness, common practices across treatment families, and mediators and moderators of treatment outcome. Six treatments reached well-established status for child and adolescent anxiety, 8 were identified as probably efficacious, 2 were identified as possibly efficacious, 6 treatments were deemed experimental, and 8 treatments of questionable efficacy emerged. Findings from this review suggest substantial support for cognitive-behavioral therapy (CBT) as an effective and appropriate first-line treatment for youth with anxiety disorders. Several other treatment approaches emerged as probably efficacious that are not primarily CBT based, suggesting that there are alternative evidence-based treatments that practitioners can turn to for children and adolescents who do not respond well to CBT. The review concludes with a discussion of treatments that improve functioning in addition to reducing symptoms, common practices derived from evidence-based treatments, mediators and moderators of treatment outcomes, recommendations for best practice, and suggestions for future research.

The effectiveness of the Stop Now and Plan (SNAP) program for boys at risk for violence and delinquency

Among the available treatments for disruptive behavior problems, a need remains for additional service options to reduce antisocial behavior and prevent further development along delinquent and violent pathways. The Stop Now and Plan (SNAP) Program is an intervention for antisocial behavior among boys between 6 and 11. This paper describes a randomized controlled treatment effectiveness study of SNAP versus standard behavioral health services. The treatment program was delivered to youth with aggressive, rule-breaking, or antisocial behavior in excess of clinical criterion levels. Outcomes were measured at 3, 9, and 15 months from baseline. Youth in the SNAP condition showed significantly greater reduction in aggression, conduct problems, and overall externalizing behavior, as well as counts of oppositional defiant disorder and attention deficit hyperactivity disorder symptoms. Additional benefits for SNAP were observed on measures of depression and anxiety. Further analyses indicated that the SNAP program was more effective among those with a higher severity of initial behavioral problems. At 1 year follow-up, treatment benefits for SNAP were maintained on some outcome measures (aggression, ADHD and ODD, depression and anxiety) but not others. Although overall juvenile justice system contact was not significantly different, youth in SNAP had significantly fewer charges against them relative to those standard services. The SNAP Program, when contrasted with standard services alone, was associated with greater, clinically meaningful, reductions in targeted behaviors. It may be particularly effective for youth with more severe behavioral problems and may result in improvements in internalizing problems as well.

Qualitative and mixed methods research in dissemination and implementation science: introduction to the special issue

This special issue provides examples of how qualitative and mixed methods research approaches can be used in dissemination and implementation science. In this introductory article, we provide a brief rationale for why and how qualitative and mixed methods approaches can be useful in moving the field forward. Specifically, we provide a brief primer on common qualitative methods, including a review of guidelines provided by the National Institutes of Health. Next, we introduce the six articles in the issue. The first of the articles by Palinkas represents a more thorough and authoritative discussion related to qualitative methods, using the other five articles in the issue (and other published works) as examples. The remaining five articles are empirical and/or descriptive articles of recently completed or ongoing qualitative or mixed methods studies related to dissemination and implementation of evidence-based practices for children and adolescents.

Randomized Trial of Family Therapy Versus Nonfamily Treatment for Adolescent Behavior Problems in Usual Care

A major focus of implementation science is discovering whether evidence-based approaches can be delivered with fidelity and potency in routine practice. This randomized trial compared usual care family therapy (UC-FT), implemented without a treatment manual or extramural support as the standard-of-care approach in a community clinic, to nonfamily treatment (UC-Other) for adolescent conduct and substance use disorders. The study recruited 205 adolescents (M age = 15.7 years; 52% male; 59% Hispanic American, 21% African American) from a community referral network, enrolling 63% for primary mental health problems and 37% for primary substance use problems. Clients were randomly assigned to either the UC-FT site or one of five UC-Other sites. Implementation data confirmed that UC-FT showed adherence to the family therapy approach and differentiation from UC-Other. Follow-ups were completed at 3, 6, and 12 months postbaseline. There was no between-group difference in treatment attendance. Both conditions demonstrated improvements in externalizing, internalizing, and delinquency symptoms. However, UC-FT produced greater reductions in youth-reported externalizing and internalizing among the whole sample, in delinquency among substance-using youth, and in alcohol and drug use among substance-using youth. The degree to which UC-FT outperformed UC-Other was consistent with effect sizes from controlled trials of manualized family therapy models. Nonmanualized family therapy can be effective for adolescent behavior problems within diverse populations in usual care, and it may be superior to nonfamily alternatives.

The Promise of Neurotechnology in Clinical Translational Science

Neurotechnology is broadly defined as a set of devices used to understand neural processes and applications that can potentially facilitate the brain's ability to repair itself. In the past decade, an increasingly explicit understanding of basic biological mechanisms of brain-related illnesses has produced applications that allow a direct yet noninvasive method to index and manipulate the functioning of the human nervous system. Clinical scientists are poised to apply this technology to assess, treat, and better understand complex socioemotional processes that underlie many forms of psychopathology. In this review, we describe the potential benefits and hurdles, both technical and methodological, of neurotechnology in the context of clinical dysfunction. We also offer a framework for developing and evaluating neurotechnologies that is intended to expedite progress at the nexus of clinical science and neural interface designs by providing a comprehensive vocabulary to describe the necessary features of neurotechnology in the clinic.

Risperidone added to parent training and stimulant medication: effects on attention-deficit/hyperactivity disorder, oppositional defiant disorder, conduct disorder, and peer aggression

OBJECTIVE

In this study, we aimed to expand on our prior research into the relative efficacy of combining parent training, stimulant medication, and placebo (Basic therapy) versus parent training, stimulant, and risperidone (Augmented therapy) by examining treatment effects for attention-deficit/hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and conduct disorder (CD) symptoms and peer aggression, symptom-induced impairment, and informant discrepancy.

METHOD

Children (6-12 years of age; N = 168) with severe physical aggression, ADHD, and co-occurring ODD/CD received an open trial of parent training and stimulant medication for 3 weeks. Participants failing to show optimal clinical response were randomly assigned to Basic or Augmented therapy for an additional 6 weeks.

RESULTS

Compared with Basic therapy, children receiving Augmented therapy experienced greater reduction in parent-rated ODD severity (p = .002, Cohen's d = 0.27) and peer aggression (p = .02, Cohen's d = 0.32) but not ADHD or CD symptoms. Fewer children receiving Augmented (16%) than Basic (40%) therapy were rated by their parents as impaired by ODD symptoms at week 9/endpoint (p = .008). Teacher ratings indicated greater reduction in ADHD severity (p = .02, Cohen's d = 0.61) with Augmented therapy, but not for ODD or CD symptoms or peer aggression. Although both interventions were associated with marked symptom reduction, a relatively large percentage of children were rated as impaired for at least 1 targeted disorder at week 9/endpoint by parents (Basic 47%; Augmented 27%) and teachers (Basic 48%; Augmented 38%).

CONCLUSION

Augmented therapy was superior to Basic therapy in reducing severity of ADHD and ODD symptoms, peer aggression, and symptom-induced impairment, but clinical improvement was generally context specific, and effect sizes ranged from small to moderate. Clinical trial registration information-Treatment of Severe Childhood Aggression (The TOSCA Study); http://clinicaltrials.gov/; NCT00796302.

A 5-year follow-up study of adolescents who sought treatment for substance misuse in Sweden

Previous studies have shown that substance misuse in adolescence is associated with increased risks of hospitalizations for mental and physical disorders, convictions for crimes, poverty, and premature death from age 21 to 50. The present study examined 180 adolescent boys and girls who sought treatment for substance misuse in Sweden. The adolescents and their parents were assessed independently when the adolescents first contacted the clinic to diagnose mental disorders and collect information on maltreatment and antisocial behavior. Official criminal files were obtained. Five years later, 147 of the ex-clients again completed similar assessments. The objectives were (1) to document the prevalence of alcohol use disorders (AUD) and drug use disorders (DUD) in early adulthood; and (2) to identify family and individual factors measured in adolescence that predicted these disorders, after taking account of AUD and DUD in adolescence and treatment. Results showed that AUD, DUD, and AUD + DUD present in mid-adolescence were in most cases also present in early adulthood. Prediction models detected no positive effect of treatment in limiting persistence of these disorders. Thus, treatment-as-usual provided by the only psychiatric service for adolescents with substance misuse in a large urban center in Sweden failed to prevent the persistence of substance misuse. Despite extensive clinical assessments of the ex-clients and their parents, few factors assessed in mid-adolescence were associated with substance misuse disorders 5 years later. It may be that family and individual factors in early life promote the mental disorders that precede adolescent substance misuse.

Doing more with what we know: introduction to the special issue

This article introduces a special issue that provides an overarching conceptual model for advancing the impact of science on service delivery and includes some illustrations of these concepts in action from a variety of research teams in a diversity of contexts. Themes of the special issue include balancing considerations of efficacy, effectiveness, and extensiveness--for example, ensuring that treatments are not only reliable but also robust and widely relevant. It is argued that such a balance might be achieved through an increased focus on improving coordination of system resources (e.g., clients, providers, treatments, training programs) and through dynamic and developmental designs. The special issue is intended to raise the broader question of whether our current paradigms are satisfactory in moving us toward our shared vision, or whether we could do more with what we already know.

Future directions in the design, development, and investigation of technology as a service delivery vehicle

Treatment outcome research with children and adolescents has progressed to such an extent that numerous handbooks have been devoted to reviewing and summarizing the evidence base. Ensuring that consumers of these advancements in state-of-the-field interventions have the opportunity to access, engage in, and benefit from this evidence base, however, has been wrought with challenge. As such, much discussion exists about innovative strategies for overcoming the gap between research and practice; yet no other potential solution that has received more attention in both the popular and academic press than technology. The promise of technology is not surprising given the fast-paced evolution in development and, in turn, a seemingly endless range of possibilities for novel service delivery platforms. Yet this is precisely the most formidable challenge threatening to upset the very promise of this potential solution: The rate of emerging technologies is far outpacing the field's capacity to demonstrate the conceptual or empirical benefits of such an approach. Accordingly, this article aims to provide a series of recommendations that better situate empirical enquiry at the core of a collaborative development, testing, and deployment process that must define this line of work if the promise of mental health technologies is going to be a reality for front-line clinicians and the clients they serve.

Evidence base updates: the evolution of the evaluation of psychological treatments for children and adolescents

This article introduces a new feature in the journal: Evidence Base Updates. Starting with this issue of the journal, there will be one such update in each issue. The updates will focus on reviewing the treatments studies focused on a specific child/adolescent problem area and identifying those treatments with the strongest evidence base. Updates will use a revised set of criteria for evaluating the evidence, based on past work, but modified to emphasize methodological rigor of studies and designed to identify those treatments with questionable efficacy. The article also places the evaluation of psychological treatments in historical context. As well, the changes made in the criteria are discussed.

MAP as a model for practice-based learning and improvement in child psychiatry training

Not only is there a growing literature demonstrating the positive outcomes that result from implementing evidence based treatments (EBTs) but also studies that suggest a lack of delivery of these EBTs in "usual care" practices. One way to address this deficit is to improve the quality of psychotherapy teaching for clinicians-in-training. The Accreditation Council for Graduate Medical Education (ACGME) requires all training programs to assess residents in a number of competencies including Practice-Based Learning and Improvements (PBLI). This article describes the piloting of Managing and Adapting Practice (MAP) for child psychiatry fellows, to teach them both EBT and PBLI skills. Eight child psychiatry trainees received 5 full days of MAP training and are delivering MAP in a year-long outpatient teaching clinic. In this setting, MAP is applied to the complex, multiply diagnosed psychiatric patients that present to this clinic. This article describes how MAP tools and resources assist in teaching trainees each of the eight required competency components of PBLI, including identifying deficits in expertise, setting learning goals, performing learning activities, conducting quality improvement methods in practice, incorporating formative feedback, using scientific studies to inform practice, using technology for learning, and participating in patient education. A case example illustrates the use of MAP in teaching PBLI. MAP provides a unique way to teach important quality improvement and practice-based learning skills to trainees while training them in important psychotherapy competence.

More practice, less preach? the role of supervision processes and therapist characteristics in EBP implementation

Identifying predictors of evidence-based practice (EBP) use, such as supervision processes and therapist characteristics, may support dissemination. Therapists (N = 57) received training and supervision in EBPs to treat community-based youth (N = 136). Supervision involving modeling and role-play predicted higher overall practice use than supervision involving discussion, and modeling predicted practice use in the next therapy session. No therapist characteristics predicted practice use, but therapist sex and age moderated the supervision and practice use relation. Supervision involving discussion predicted practice use for male therapists only, and modeling and role-play in supervision predicted practice use for older, not younger, therapists.

Group therapy for anxiety in children with autism spectrum disorder

AIM

To investigate the acceptability and feasibility of adapted group therapy for anxiety in children with autism spectrum disorder in a pilot randomised controlled trial.

METHOD

A total of 32 children aged 9-13 years were randomised to immediate or delayed therapy using the 'Exploring Feelings' manual (Attwood, 2004). Child and parent groups were run in parallel, for seven weekly sessions, under the supervision of experienced psychologists. The primary blinded outcome measures addressed change in overall functioning and in severity of the primary anxiety diagnosis after 3 months.

RESULTS

Children met diagnostic criteria for 1-6 anxiety disorders (median 3). At end point, both parents and children in the immediate therapy group were more likely to report a reduction in anxiety symptoms. Fidelity of delivery of the group therapy was high, and attendance was 91%.

CONCLUSIONS

This pilot trial established that children and families were willing to be recruited and randomised, the outcome measures were acceptable, the format and content of the groups were feasible within UK child and adolescent mental health services, the intervention was appreciated by families and attrition was very small.

From distal to proximal: Routine educational data monitoring in school-based mental health

Research and practice in school-based mental health (SBMH) typically includes educational variables only as distal outcomes, resulting from improvements in mental health symptoms rather than directly from mental health intervention. Although sometimes appropriate, this approach also has the potential to inhibit the integration of mental health and schools. The current paper applies an existing model of data-driven decision making (Daleiden & Chorpita, 2005) to detail how SBMH can better integrate routine monitoring of school and academic outcomes into four evidence bases: general services research evidence, case histories, local aggregate, and causal mechanisms. The importance of developing new consultation protocols specific to data-driven decision making in SBMH as well as supportive infrastructure (e.g., measurement feedback systems) to support the collection and use of educational data is also described.

MAPping Los Angeles County: taking an evidence-informed model of mental health care to scale

We describe the scaling up of an evidence-informed model of care, Managing and Adapting Practice (MAP) in Los Angeles County, California. MAP complemented an array of evidence-based programs selected by the county as part of a large system reform effort designed to improve care for children and adolescents. In addition, we discuss the MAP model for training therapists and present data both on how the training model performed and on the outcomes of youths treated by therapists trained in MAP. We examined the success of two different training pathways for MAP therapists: (a) national training model and (b) MAP agency supervisor model (i.e., train the trainer). We also examined utilization of MAP and outcomes of clients served by MAP. Both the national training and MAP agency supervisor model were successful in producing MAP therapists in a timely fashion and with acceptable competency scores. Furthermore, a large number of clients were receiving MAP services. Finally, outcomes for youth treated with MAP were strong, with effect sizes ranging from .59 to .80 on the Youth Outcome Questionnaire. These data support the notion that scaling up a mental health services approach in a system can be achieved through a strong and broad partnership among relevant stakeholders, can involve a train-the-trainer model, and can result in strong outcomes for clients.

Technology-enhanced program for child disruptive behavior disorders: development and pilot randomized control trial

Early onset disruptive behavior disorders are overrepresented in low-income families; yet these families are less likely to engage in behavioral parent training (BPT) than other groups. This project aimed to develop and pilot test a technology-enhanced version of one evidence-based BPT program, Helping the Noncompliant Child (HNC). The aim was to increase engagement of low-income families and, in turn, child behavior outcomes, with potential cost-savings associated with greater treatment efficiency. Low-income families of 3- to 8-year-old children with clinically significant disruptive behaviors were randomized to and completed standard HNC (n = 8) or Technology-Enhanced HNC (TE-HNC; n = 7). On average, caregivers were 37 years old; 87% were female, and 80% worked at least part-time. More than half (53%) of the youth were boys; the average age of the sample was 5.67 years. All families received the standard HNC program; however, TE-HNC also included the following smartphone enhancements: (a) skills video series, (b) brief daily surveys, (c) text message reminders, (d) video recording home practice, and (e) midweek video calls. TE-HNC yielded larger effect sizes than HNC for all engagement outcomes. Both groups yielded clinically significant improvements in disruptive behavior; however, findings suggest that the greater program engagement associated with TE-HNC boosted child treatment outcome. Further evidence for the boost afforded by the technology is revealed in family responses to postassessment interviews. Finally, cost analysis suggests that TE-HNC families also required fewer sessions than HNC families to complete the program, an efficiency that did not compromise family satisfaction. TE-HNC shows promise as an innovative approach to engaging low-income families in BPT with potential cost-savings and, therefore, merits further investigation on a larger scale.

Evidence base update for psychosocial treatments for pediatric obsessive-compulsive disorder

Pediatric obsessive-compulsive disorder (OCD) is a chronic and impairing condition that often persists into adulthood. Barrett, Farrell, Pina, Peris, and Piacentini (2008), in this journal, provided a detailed review of evidence-based psychosocial treatments for youth with OCD. The current review provides an evidence base update of the pediatric OCD psychosocial treatment literature with particular attention to advances in the field as well as to the methodological challenges inherent in evaluating such findings. Psychosocial treatment studies conducted since the last review are described and evaluated according to methodological rigor and evidence-based classification using the JCCAP evidence-based treatment evaluation criteria (Southam-Gerow & Prinstein, this issue). Findings from this review clearly converge in support of cognitive-behavioral therapy as an effective and appropriate first line treatment for youth with OCD (either alone or in combination with medication). Although no treatment for pediatric OCD has yet to be designated as "well-established," both individual and individual family-based treatments have been shown to be "probably efficacious." Moderators and predictors of treatment outcome are discussed as are the areas where we have advanced the field and the areas where we have room to grow. The methodological and clinical challenges inherent in a review of the evidence base are reviewed. Finally, future research directions are outlined.

The Timing of Exposure in Clinic-Based Treatment for Childhood Anxiety Disorders

The present study examines treatment length and timing of exposure from two child anxiety disorders clinics. Data regarding symptoms and treatment characteristics for 28 youth were prospectively obtained through self, parent, and therapist report at each session. Information regarding length of treatment, timing of exposure initiation, and drop-out rates were compared with those obtained through efficacy and effectiveness trials of manualized treatment for anxious youth. Findings from the authors’ clinical data revealed significantly shorter treatment duration with exposures implemented sooner than in the previous studies. Dropout rates were significantly higher than in the efficacy trial but comparable with the effectiveness trial. Outcome data from a subset of eight patients revealed large effect sizes. These findings suggest that effective treatment can be shorter and more focused on exposure than is often outlined in manuals and have important implications for outcome research and dissemination.

Assessing fidelity to evidence-based practices in usual care: the example of family therapy for adolescent behavior problems

This study describes a multimethod evaluation of treatment fidelity to the family therapy (FT) approach demonstrated by front-line therapists in a community behavioral health clinic that utilized FT as its routine standard of care. Study cases (N=50) were adolescents with conduct and/or substance use problems randomly assigned to routine family therapy (RFT) or to a treatment-as-usual clinic not aligned with the FT approach (TAU). Observational analyses showed that RFT therapists consistently achieved a level of adherence to core FT techniques comparable to the adherence benchmark established during an efficacy trial of a research-based FT. Analyses of therapist-report measures found that compared to TAU, RFT demonstrated strong adherence to FT and differentiation from three other evidence-based practices: cognitive-behavioral therapy, motivational interviewing, and drug counseling. Implications for rigorous fidelity assessments of evidence-based practices in usual care settings are discussed.

Making a Case for Treatment Integrity as a Psychosocial Treatment Quality Indicator for Youth Mental Health Care

Measures of treatment integrity are needed to advance clinical research in general and are viewed as particularly relevant for dissemination and implementation research. Although some efforts to develop such measures are underway, a conceptual and methodological framework will help guide these efforts. The purpose of this article is to demonstrate how frameworks adapted from the psychosocial treatment, therapy process, healthcare, and business literatures can be used to address this gap. We propose that components of treatment integrity (i.e., adherence, differentiation, competence, alliance, client involvement) pulled from the treatment technology and process literatures can be used as quality indicators of treatment implementation and thereby guide quality improvement efforts in practice settings. Further, we discuss how treatment integrity indices can be used in feedback systems that utilize benchmarking to expedite the process of translating evidence-based practices to service settings.