Embracing Scientific Humility and Complexity: Learning "What Works for Whom" in Youth Psychotherapy Research

New Brunswick's mental health action plan: A quantitative exploration of program efficacy in children and youth using the Canadian Community Health Survey

In 2011, the New Brunswick government released the New Brunswick Mental Health Action Plan 2011-2018 (Action Plan). Following the release of the Action Plan in 2011, two progress reports were released in 2013 and 2015, highlighting the implementation status of the Action Plan. While vague in their language, these reports indicated considerable progress in implementing the Action Plan, as various initiatives were undertaken to raise awareness and provide additional resources to facilitate early prevention and intervention in children and youth. However, whether these initiatives have yielded measurable improvements in population-level mental health outcomes in children and youth remains unclear. The current study explored the impact of the Action Plan by visualizing the trend in psychosocial outcomes and service utilization of vulnerable populations in New Brunswick before and after the implementation of the Action Plan using multiple datasets from the Canadian Community Health Survey. Survey-weighted ordinary least square regression analyses were performed to investigate measurable improvements in available mental health outcomes. The result revealed a declining trend in the mental wellness of vulnerable youth despite them consistently reporting higher frequencies of mental health service use. This study highlights the need for a concerted effort in providing effective mental health services to New Brunswick youth and, more broadly, Canadian youth, as well as ensuring rigorous routine outcome monitoring and evaluation plans are consistently implemented for future mental health strategies at the time of their initiation.

Timing matters in (mis)identifying moderators and mediators of digital interventions for eating disorders: Commentary on McClure et al. (2023)

This commentary addresses the challenges in identifying consistent moderators and mediators of psychological treatments for eating disorders (EDs), as highlighted by McClure et al. (International Journal of Eating Disorders, 2023) in their systematic review. Specifically, we discuss the often-overlooked importance of temporal context (when an intervention is delivered), alongside sociodemographic and symptom type (for whom an intervention is delivered), in understanding and optimizing treatment engagement and effectiveness. We outline how individuals' fluctuating levels of motivation and receptivity across different "pivotal moments" in the help-seeking process-including initial outreach and self-screening, ongoing care engagement, and post-discharge-can dynamically impact interventions' relevance and impacts. We also overview how Just-In-Time Adaptive Interventions in digital mental health interventions can be harnessed to simultaneously consider "when" and "for whom" ED interventions can exert the greatest benefits. We conclude with several recommendations for conducting ED intervention and implementation research that integrate timing into support delivery and study design, enabling a deeper understanding of not just how and for whom, but when, ED interventions can be most effective.

A collaborative realist review of remote measurement technologies for depression in young people

Digital mental health is becoming increasingly common. This includes use of smartphones and wearables to collect data in real time during day-to-day life (remote measurement technologies, RMT). Such data could capture changes relevant to depression for use in objective screening, symptom management and relapse prevention. This approach may be particularly accessible to young people of today as the smartphone generation. However, there is limited research on how such a complex intervention would work in the real world. We conducted a collaborative realist review of RMT for depression in young people. Here we describe how, why, for whom and in what contexts RMT appear to work or not work for depression in young people and make recommendations for future research and practice. Ethical, data protection and methodological issues need to be resolved and standardized; without this, RMT may be currently best used for self-monitoring and feedback to the healthcare professional where possible, to increase emotional self-awareness, enhance the therapeutic relationship and monitor the effectiveness of other interventions.

A Metascientific Review of the Evidential Value of Acceptance and Commitment Therapy for Depression

In the past three-and-a-half decades, nearly 500 randomized controlled trials (RCTs) have examined Acceptance and Commitment Therapy (ACT) for a range of health problems, including depression. However, emerging concerns regarding the replicability of scientific findings across psychology and mental health treatment outcome research highlight a need to re-examine the strength of evidence for treatment efficacy. Therefore, we conducted a metascientific review of the evidential value of ACT in treating depression. Whereas reporting accuracy was generally high across all trials, we found important differences in evidential value metrics corresponding to the types of control conditions used. RCTs of ACT compared to weaker controls (e.g., no treatment, waitlist) were well-powered, with sample sizes appropriate for detecting plausible effect sizes. They typically yielded stronger Bayesian evidence for (and larger posterior estimates of) ACT efficacy, though there was some evidence of significance inflation among these effects. RCTs of ACT against stronger controls (e.g., other psychotherapies), meanwhile, were poorly powered, designed to detect implausibly large effect sizes, and yielded ambiguous-if not contradicting-Bayesian evidence and estimates of efficacy. Although our review supports a view of ACT as efficacious for treating depression compared to weaker controls, future RCTs must provide more transparent reporting with larger groups of participants to properly assess the difference between ACT and competitor treatments such as behavioral activation and other forms of cognitive behavioral therapy. Clinicians and health organizations should reassess the use of ACT for depression if costs and resources are higher than for other efficacious treatments. Clinical trials contributing effects to our synthesis can be found at https://osf.io/qky35.

Predictors of Treatment Response to a Community-Delivered Group Social Skills Intervention for Youth with ASD

Group social skills interventions (GSSIs) are among the most commonly used treatments for improving social competence in youth with ASD, however, results remain variable. The current study examined predictors of treatment response to an empirically-supported GSSI for youth with ASD delivered in the community (Ntotal=75). Participants completed a computer-based emotion recognition task and their parents completed measures of broad psychopathology, ASD symptomatology, and social skills. We utilized generalized estimating equations in an ANCOVA-of-change framework to account for nesting. Results indicate differential improvements in emotion recognition by sex as well as ADHD-specific improvements in adaptive functioning. Youth with both co-occurring anxiety and ADHD experienced iatrogenic effects, suggesting that SDARI may be most effective for youth with ASD without multiple co-occurring issues. Findings provide important directions for addressing variability in treatment outcomes for youth with ASD.

Effect modification of an effective transdiagnostic cognitive behavioral psychotherapy in youths with common mental health problems: Secondary analyses of the randomized mind-my-mind trial

Mind My Mind (MMM) cognitive behavioral therapy (CBT) manualized treatment is effective in the management of common emotional and behavioral mental health problems in youth, yet not all individuals respond satisfactorily to treatment. This study explored potential effect modifiers, i.e., baseline factors associated with a differential treatment effect. We conducted secondary effect modifier analyses with MMM trial data, which involved randomization of 396 youths aged 6-16 years to either MMM CBT treatment (9-13 sessions) or management as usual in local community settings. We examined sociodemographic- (sex, age, family composition, ethnicity, parental education, and income) and clinical variables (mental disorders and duration of mental health problems) as potential effect modifiers of the a) change in parent-rated impact of mental health problems measured by the Strengths and Difficulties Questionnaire (SDQ) or b) response (reduction of ≥1 on SDQ-impact). In intention-to-treat analyses, superior treatment (net) benefits from the MMM intervention were found among youths who met criteria for any mental disorder at baseline (-1.25 [95%CI: -1.67;-0.82]) compared to youths that did not meet diagnostic criteria (-0.22 [95%CI:-1.09;0.65]). Comorbidity vs no comorbidity (-1.84 [95%CI:-2.58;-1.10] vs -0.72 [95%CI:-1.15;-0.29]) and longer duration of untreated mental health problems, i.e., more vs less than 6 months (-1.16 [95%CI:-1.55;-0.78] vs 0.43 [95%CI:-1.01;1.86]) were also associated with superior treatment benefits. The sociodemographic factors were not associated with differential treatment effects in the intention-to-treat analyses. These findings suggest that community-based programs like the MMM are well-suited for youths with substantial mental health problems. Clinical Trials Identifier: NCT03535805.

Evaluating Effect Moderators in Cognitive Versus Behavioral Based CBT-Modules and Sequences Towards Preventing Adolescent Depression

OBJECTIVE

The aim of this study was to investigate age group, gender, and baseline depressive symptom severity as possible effect moderators in (1) cognitive versus behavioral based CBT-modules and (2) sequences of modules that started either with cognitive or behavioral modules in indicated depression prevention in adolescents.

METHOD

We conducted a pragmatic cluster-randomized trial under four parallel conditions. Each condition consisted of four CBT-modules of three sessions (cognitive restructuring, problem solving, behavioral activation, relaxation), but the sequencing of modules differed. The CBT-modules and sequences were clustered into more cognitive versus more behavioral based approaches. The sample involved 282 Dutch adolescents with elevated depressive symptoms (Mage = 13.8; 55.7% girls, 92.9% Dutch). Assessments were conducted at baseline, after three sessions, at post-intervention and 6-month follow-up with self-reported depressive symptoms as the primary outcome.

RESULTS

We found no evidence for substantial moderation effects. Age group, gender, and depressive symptom severity level at baseline did not moderate the effects of cognitive versus behavioral modules after three sessions. No evidence was also found that these characteristics moderated the effectiveness of sequences of modules that started either with cognitive or behavioral modules at post-intervention and 6-month follow-up.

CONCLUSION

Cognitive and behavioral based modules and sequences in the prevention of depression in adolescents might apply to a relatively wide range of adolescents in terms of age group, gender, and severity levels of depressive symptoms.Abbreviation: CDI-2:F: Children's Depression Inventory-2 Full-length version; CDI-2:S: Children's Depression Inventory-2 Short version; STARr: Solve, Think, Act, Relax, and repeat.

Behavioural and nondirective parent training for children with externalising disorders: First steps towards personalised treatment recommendations

For children with externalising disorders, parent training programmes with different theoretical foundations are available. Currently, there is little knowledge concerning which programme should be recommended to a family based on their individual needs (e.g., single parenthood). The personalised advantage index (PAI) indicates the predicted treatment advantage of one treatment over another. The aim of the present study was to examine the usefulness of this score in providing individualised treatment recommendations. The analysis considered 110 parents (per-protocol sample) of children (4-11 years) with attention-deficit/hyperactivity (ADHD) or oppositional defiant disorder (ODD), randomised to either a behavioural or a nondirective telephone-assisted self-help parent training. In multiple moderator analyses with four different regression algorithms (linear, ridge, k-nearest neighbors, and tree), the linear model was preferred for computing the PAI. For ODD, families randomised to their PAI-predicted optimal intervention showed a treatment advantage of d = 0.54, 95% CI [0.17, 0.97]; for ADHD, the advantage was negligible at d = 0.35, 95% CI [-0.01, 0.78]. For children with conduct problems, it may be helpful if the PAI includes the treatment moderators single parent status and ODD baseline symptoms when providing personalised treatment recommendations for the selection of behavioural versus nondirective parent training. TRIAL REGISTRATION: The study was registered prospectively with ClinicalTrials.gov (Identifier NCT01350986).

Measuring general mental health in early-mid adolescence: A systematic meta-review of content and psychometrics

Background

Adolescent mental health is a major concern and brief general self-report measures can facilitate insight into intervention response and epidemiology via large samples. However, measures' relative content and psychometrics are unclear.

Method

A systematic search of systematic reviews was conducted to identify relevant measures. We searched PsycINFO, MEDLINE, EMBASE, COSMIN, Web of Science, and Google Scholar. Theoretical domains were described, and item content was coded and analysed, including via the Jaccard index to determine measure similarity. Psychometric properties were extracted and rated using the COSMIN system.

Results

We identified 22 measures from 19 reviews, which considered general mental health (GMH) (positive and negative aspects together), life satisfaction, quality of life (mental health subscales only), symptoms, and wellbeing. Measures were often classified inconsistently within domains at the review level. Only 25 unique indicators were found and several indicators were found across the majority of measures and domains. Most measure pairs had low Jaccard indexes, but 6.06% of measure pairs had >50% similarity (most across two domains). Measures consistently tapped mostly emotional content but tended to show thematic heterogeneity (included more than one of emotional, cognitive, behavioural, physical and social themes). Psychometric quality was generally low.

Conclusions

Brief adolescent GMH measures have not been developed to sufficient standards, likely limiting robust inferences. Researchers and practitioners should attend carefully to specific items included, particularly when deploying multiple measures. Key considerations, more promising measures, and future directions are highlighted. PROSPERO registration: CRD42020184350 https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020184350.

Parent and Child Risk Profiles as Predictors of Response to a Conduct Problem Preventive Intervention

Current evidence-based prevention programming targeting child externalizing problems demonstrates modest overall effect sizes and is largely ineffective for a sizable proportion of youth who participate. However, our understanding of the youth and family characteristics associated with response to specific programming is quite limited. The current study used child and family risk profiles as predictors of response trajectories to the Early Risers conduct problem preventive intervention. A sample of 240 kindergarten-aged youth displaying elevated school-based aggression were randomized by school to either the Early Risers intervention or a control condition. Using a number of child and family risk variables, a latent profile analysis produced a solution consisting of five unique risk profiles. Three low and mixed risk profiles were associated with a limited response to the intervention. One high-risk profile characterized by maladaptive parenting and elevated child externalizing demonstrated notably improved trajectories of externalizing behavior over a 3-year period relative to the control condition. Another high-risk profile characterized by inconsistent discipline, high parental distress, and elevated child internalizing and externalizing symptoms seemed to have positive developmental trends disrupted by the intervention relative to the control condition, potentially consistent with an iatrogenic effect relative to the control condition. The study results support continued efforts to use broader risk profiles to examine heterogeneity in response to preventive interventions and, with replication, will have implications for intervention tailoring.