Innovations: child and adolescent psychiatry: measuring outcomes of real-world youth psychotherapy: whom to ask and what to ask?

Are We Comparing Apples with Oranges? Assessing Improvement Across Symptoms, Functioning, and Goal Progress for Adolescent Anxiety and Depression

Strategies for comparing routinely collected outcome data across services or systems include focusing on a common indicator (e.g., symptom change) or aggregating results from different measures or outcomes into a comparable core metric. The implications of either approach for judging treatment success are not fully understood. This study drew on naturalistic outcome data from 1641 adolescents with moderate or severe anxiety and/or depression symptoms who received routine specialist care across 60 mental health services in England. The study compared rates of meaningful improvement between the domains of internalizing symptoms, functioning, and progress towards self-defined goals. Consistent cross-domain improvement was observed in only 15.6% of cases. Close to one in four (24.0%) young people with reliably improved symptoms reported no reliable improvement in functioning. Inversely, one in three (34.8%) young people reported meaningful goal progress but no reliable symptom improvement. Monitoring systems that focus exclusively on symptom change risk over- or under-estimating actual impact, while aggregating different outcomes into a single metric can mask informative differences in the number and type of outcomes showing improvement. A move towards harmonized outcome measurement approaches across multiple domains is needed to ensure fair and meaningful comparisons.

A comprehensive mapping of outcomes following psychotherapy for adolescent depression: The perspectives of young people, their parents and therapists

As mental health systems move towards person-centred care, outcome measurement in clinical research and practice should track changes that matter to young people and their families. This study mapped the types of change described by three key stakeholder groups following psychotherapy for depression, and compared the salience of these outcomes with the frequency of their measurement in recent quantitative treatment effectiveness studies for adolescent depression.Using qualitative content analysis, this study identified and categorized outcomes across 102 semi-structured interviews that were conducted with depressed adolescents, their parents, and therapists, as part of a randomized superiority trial. Adolescents had been allocated to Cognitive-Behavioral Therapy, Short-Term Psychoanalytic Psychotherapy, or a Brief Psychosocial Intervention.The study mapped seven high-level outcome domains and 29 outcome categories. On average, participants discussed change in four domains and six outcome categories. The most frequently discussed outcome was an improvement in mood and affect (i.e., core depressive symptoms), but close to half of the participants also described changes in family functioning, coping and resilience, academic functioning, or social functioning. Coping had specific importance for adolescents, while parents and therapists showed particular interest in academic functioning. There was some variation in the outcomes discussed beyond these core themes, across stakeholder groups and treatment arms.Of the outcomes that were frequently discussed in stakeholder narratives, only symptomatic change has been commonly reported in recent treatment studies for adolescent depression. A shift towards considering multiple outcome domains and perspectives is needed to reflect stakeholder priorities and enable more nuanced insights into change processes.

Systematic Review and Meta-analysis: Outcomes of Routine Specialist Mental Health Care for Young People With Depression and/or Anxiety

OBJECTIVE

Depression and anxiety are the most prevalent mental health problems in youth, yet almost nothing is known about what outcomes are to be expected at the individual level following routine treatment. This paper sets out to address this gap by undertaking a systematic review of outcomes following treatment as usual (TAU) with a particular focus on individual-level outcomes.

METHOD

MEDLINE, Embase and PsycInfo were searched for articles published between 1980 and January 2019 that assessed TAU outcomes for youth depression and anxiety accessing specialist mental health care. Meta-analysis considered change at both group-level pre-post effect size (ES) and individual-level recovery, reliable change, and reliable recovery. Temporal analysis considered stability of primary and secondary outcomes over time. Subgroup analysis considered the moderating effect of informant; presenting problem; study design; study year; mean age of youth; use of medication; intervention dosage and type of treatment offered on outcomes. A protocol was preregistered on PROSPERO (CRD42017063914).

RESULTS

Initial screening of 6,350 publications resulted in 38 that met the inclusion criteria, and that were subsequently included in meta-analyses. This resulted in a final full pooled sample of 11,739 young people (61% of whom were female, mean age 13.8 years). The pre-post ES (Hedges' g) at first/final outcome (13/26 weeks) was -0.74/-0.87. The individual-level change on measures of self-report was 38% reliable improvement, 44% no reliable change, and 6% reliable deterioration. Outcomes varied according to moderators, informant, problem type and dosage.

CONCLUSION

Poor data quantity and quality are limitations, but this is the first study that indicates likely rates of reliable improvement for those accessing TAU. We propose the need for improved reporting of both individual-level metrics and details of TAU to enable greater understanding of likely current outcomes from routine care for youths with depression and anxiety in order to allow the potential for further improvement of impact.

Review: What Outcomes Count? A Review of Outcomes Measured for Adolescent Depression Between 2007 and 2017

OBJECTIVE

Measurement of treatment outcomes in childhood depression has traditionally focused on assessing symptoms from the clinician's perspective, without exploring other outcome domains or considering young people's perspectives. This systematic review explored the extent to which multidimensional and multi-informant outcome measurements have been used in clinical research for adolescent depression in the past decade and how patterns have evolved over time.

METHOD

Embase, Medline, and PsycINFO were searched, and studies that were published from 2007 through 2017 and assessed the effectiveness of treatments or service provision for adolescent depression were included. Of 7,483 studies screened, 95 met the inclusion criteria and were included for data extraction and analysis.

RESULTS

Ten outcomes domains were identified, 2 of which were assessed on average using 4 outcome measures. Most studies (94%) measured symptoms, followed by functioning (52%). Other domains such as personal growth, relationships, quality of life, and service satisfaction were each considered by less than 1 in 10 studies. Youth self-report was considered by 54% but tended to focus on secondary outcomes. Multidimensional and multi-informant measurements were more frequent in studies published since 2015.

CONCLUSION

Recent clinical research continues to prioritize symptoms measurement based on clinician report and has not yet fully embraced multidimensional and multi-informant approaches. In the context of significant policy shifts toward patient-centered and evidence-based care, measuring what matters most to patients has become a priority, but this is not yet widely reflected in clinical research.

Capitalizing on Scientific Advances to Improve Access to and Quality of Children's Mental Health Care

The majority of mental health problems begin in childhood or adolescence. The potential benefits of early identification and treatment of such problems are well established, and models of effective mental health interventions for children have proliferated in recent decades. However, barriers in access to care and challenges in assuring delivery of high-quality care significantly limit the public health impact of services for children and families. Specifically, the majority of children who need mental health care do not receive it, and when children are in care, many do not receive interventions that are most likely to have the greatest positive impact. A commitment to social justice requires significant improvement in access to care and quality of care to maximize human potential. The purpose of this manuscript is to highlight promising scientific advances in the development of effective mental health services for children and families, as well as the vexing challenges of actually delivering these services to those most in need. Key challenges to be discussed include disparities in access to care and quality of care, including race/ethnic disparities and complexities of navigating the multi-sector mental health service system for children, and difficulties in implementing effective intervention models more consistently in community care. The authors will propose practice and policy reform recommendations to address these challenges. Copyright © 2017 John Wiley & Sons, Ltd.

The clinical effectiveness of cognitive behavior therapy and an alternative medicine approach in reducing symptoms of depression in adolescents

The main aim of the study was to investigate the effectiveness of two psychotherapeutic approaches, cognitive behavioral therapy (CBT) and a complementary medicine method Reiki, in reducing depression scores in adolescents. We recruited 188 adolescent patients who were 12-17 years old. Participants were randomly assigned to CBT, Reiki or wait-list. Depression scores were assessed before and after the 12 week interventions or wait-list. CBT showed a significantly greater decrease in Child Depression Inventory (CDI) scores across treatment than both Reiki (p<.001) and the wait-list control (p<.001). Reiki also showed greater decreases in CDI scores across treatment relative to the wait-list control condition (p=.031). The analyses indicated a significant interaction between gender, condition and change in CDI scores, such that male participants showed a smaller treatment effect for Reiki than did female participants. Both CBT and Reiki were effective in reducing the symptoms of depression over the treatment period, with effect for CBT greater than Reiki. These findings highlight the importance of early intervention for treatment of depression using both cognitive and complementary medicine approaches. However, research that tests complementary therapies over a follow-up period and against a placebo treatment is required.

Searching for elements of evidence-based practices in children's usual care and examining their impact

Most of the knowledge generated to bridge the research-practice gap has been derived from experimental studies implementing specific treatment models. Alternatively, this study uses observational methods to generate knowledge about community-based treatment processes and outcomes. Aims are to (a) describe outcome trajectories for children with disruptive behavior problems (DBPs), and (b) test how observed delivery of a benchmark set of practice elements common in evidence-based treatments may be associated with outcome change while accounting for potential confounding variables. Participants included 190 children ages 4 to 13 with DBPs and their caregivers, plus 85 psychotherapists, recruited from six clinics. All treatment sessions were videotaped and a random sample of 4 sessions in the first 4 months of treatment was reliably coded for intensity on 27 practice elements (benchmark set and others). Three outcomes (child symptom severity, parent discipline, and family functioning) were assessed by parent report at intake, 4, and 8 months. Data were collected on several potential covariates including child, parent, therapist, and service use characteristics. Multilevel modeling was used to assess relationships between observed practice and outcome slopes while accounting for covariates. Children and families demonstrated improvements in all 3 outcomes, but few significant associations between treatment processes and outcome change were identified. Families receiving greater intensity on the benchmark practice elements did demonstrate greater improvement in the parental discipline outcome. Observed changes in outcomes for families in community care were generally not strongly associated with the type or amount of treatment received.

Improving community-based mental health care for children: translating knowledge into action

There is urgent need for improvement in community-based mental health care for children and families. Multiple studies have documented serious limitations in the effectiveness of "usual care." Fortunately, many empirically-supported strategies to improve care have been developed, and thus there is now a great deal of knowledge available to address this significant public health problem. The goal of this selective review is to highlight and synthesize that empirically-supported knowledge to stimulate and facilitate the needed translation of knowledge into action. The review provides a sound foundation for constructing improved services by consolidating descriptive data on the status quo in children's mental health care, as well as evidence for an array of promising strategies to improve (a) Service access and engagement; (b) Delivery of evidence-based practices; and (c) Outcome accountability. A multi-level framework is used to highlight recommended care improvement targets.

Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems

This study describes the characteristics of children with autism spectrum disorders (ASD) with disruptive behavior problems served in community-based mental health clinics, characterizes psychotherapy process and outcome, and examines differences between children with ASD and a non-ASD comparison group. Results indicate that children with ASD served in this setting are high functioning and diagnostically complex. Certain research-based behavioral and cognitive behavioral psychotherapeutic strategies were observed frequently, while parent training strategies and active teaching strategies were observed less frequently. The intensity or thoroughness with which strategies were pursued was relatively low. Outcome analyses indicate improvement in child symptoms and family functioning. Treatment delivery and outcome were similar for children with and without ASD. These findings represent the first detailed observational data characterizing community-based mental health services for children with ASD.