Service Use Findings from the Child STEPs Effectiveness Trial: Additional Support for Modular Designs

Group-based parent training programme for children with neurological conditions: a feasibility study

OBJECTIVE AND DESIGN

This study aimed to determine the feasibility and effectiveness of a parent training programme for parents of children with neurological conditions and behaviours that challenge.

SETTING

Child and adolescent mental health service within a specialist children's hospital.

PARTICIPANTS

Parents of 31 children with neurological conditions and behaviours that challenge.

INTERVENTIONS

Parents attended a 6-week evidence-based behavioural parenting programme delivered in a group format, either face-to-face or remote.

MAIN OUTCOME MEASURES

Feasibility was determined by attendance rates. Effectiveness was analysed primarily using parent-reported measures of child behaviour (Strengths and Difficulties Questionnaire, Paediatric Quality of Life and Goal-Based Outcomes). Secondary measures of parental well-being were also reported (Brief Parental Self-Efficacy Scale, Depression Anxiety Stress Scale Short Form and Parental Sense of Competence). Paired t-tests or Wilcoxon rank-sum tests were conducted to analyse differences preintervention and postintervention.

RESULTS

The attendance rates for the face-to-face and remote groups were 80% and 79%, respectively. Medium to large effect sizes were reported for most measures of child behaviour and parental well-being. There were statistically significant improvements found postintervention in children's behaviour (p=0.014), quality of life (p<0.001), goal-based outcomes (p<0.001), parental self-efficacy (p<0.001) and parental anxiety (p=0.030). Anecdotal feedback showed that parents indicated the group format was acceptable.

CONCLUSIONS

The group parenting intervention for parents of children with heterogeneous neurological conditions and behaviours that challenge appears feasible and effective in improving child behaviour and parental well-being.

Assessing practical implementation of modular psychotherapy for youth in community-based settings using benchmarking

Background

Achieving high quality outcomes in a community context requires the strategic coordination of many activities in a service system, involving families, clinicians, supervisors, and administrators. In modern implementation trials, the therapy itself is guided by a treatment manual; however, structured supports for other parts of the service system may remain less well-articulated (e.g., supervision, administrative policies for planning and review, information/feedback flow, resource availability). This implementation trial investigated how a psychosocial intervention performed when those non-therapy supports were not structured by a research team, but were instead provided as part of a scalable industrial implementation, testing whether outcomes achieved would meet benchmarks from published research trials.

Method

In this single-arm observational benchmarking study, a total of 59 community clinicians were trained in the Modular Approach to Therapy for Children (MATCH) treatment program. These clinicians delivered MATCH treatment to 166 youth ages 6 to 17 naturally presenting for psychotherapy services. Clinicians received substantially fewer supports from the treatment developers or research team than in the original MATCH trials and instead relied on explicit process management tools to facilitate implementation. Prior RCTs of MATCH were used to benchmark the results of the current initiative. Client improvement was assessed using the Top Problems Assessment and Brief Problem Monitor.

Results

Analysis of client symptom change indicated that youth experienced improvement equal to or better than the experimental condition in published research trials. Similarly, caregiver-reported outcomes were generally comparable to those in published trials.

Conclusions

Although results must be interpreted cautiously, they support the feasibility of using process management tools to facilitate the successful implementation of MATCH outside the context of a formal research or funded implementation trial. Further, these results illustrate the value of benchmarking as a method to evaluation industrial implementation efforts. Plain Language Summary: Randomized effectiveness trials are inclusive of clinicians and cases that are routinely encountered in community-based settings, while continuing to rely on the research team for both clinical and administrative guidance. As a result, the field still struggles to understand what might be needed to support sustainable implementation and how interventions will perform when brought to scale in community settings without those clinical trial supports. Alternative approaches are needed to delineate and provide the clinical and operational support needed for implementation and to efficiently evaluate how evidence-based treatments perform. Benchmarking findings in the community against findings of more rigorous clinical trials is one such approach. This paper offers two main contributions to the literature. First, it provides an example of how benchmarking is used to evaluate how the Modular Approach to Therapy for Children (MATCH) treatment program performed outside the context of a research trial. Second, this study demonstrates that MATCH produced comparable symptom improvements to those seen in the original research trials and describes the implementation strategies associated with this success. In particular, although clinicians in this study had less rigorous expert clinical supervision as compared with the original trials, clinicians were provided with process management tools to support implementation. This study highlights the importance of evaluating the performance of intervention programs when brought to scale in community-based settings. This study also provides support for the use of process management tools to assist providers in effective implementation.

Tackling Mental Health in Youth Sporting Programs: A Pilot Study of a Holistic Program

Linking mental health services to organised sport offers an avenue to identify and improve mental health among adolescents. In this study, we investigated the efficacy, acceptability and feasibility of an integrated mental health system embedded within a junior sports development program. A three-step integrated mental health program for 12- to 15-year-old rugby league players (N = 74) was delivered in urban (n = 44) and rural (n = 33) areas. Specifically, this system (a) assessed participant mental health on primary outcome measures of anxiety, depression, and anger/conduct problems (and secondary outcome measures of personal attributes and relationships), (b) provided feedback to participants, parents and program coordinators, and (c) connected participants and parents to a multi-component intervention including online resources, a group-based workshop program (4 × 30-min sessions), and tailored individual-level follow-up and referral to further care for participants at high risk of mental health problems. From pre- to post-program, boys' anxiety symptoms declined significantly (with only a trend-level reduction in depression), and there were significant improvements in grit (for urban boys only), efficacy to manage negative emotions, and prosocial behaviour. In addition, when boys reported symptoms associated with high risk for mental health problems, providing parents with feedback enhanced boys' access to care and was associated with significant declines in anxiety symptoms. The program was generally acceptable and feasible, with very high retention in the youth sports development program. Overall, early findings support further deployment and evaluation of integrated mental health systems embedded within sporting contexts to address mental health problems among adolescent boys.

Turning Back to Treatment: The Effect of Attendance and Symptom Outcomes on Subsequent Service Use

This study explored whether post-treatment symptom severity moderated the association between session attendance during an initial treatment episode and subsequent mental health service use. Data on attendance, symptom severity, and service use were gathered from an effectiveness trial testing a modular treatment for youth anxiety, depression, disruptive behavior, and traumatic stress. Multilevel logistic regression analyses showed a significant interaction between attendance and post-treatment symptom severity on subsequent service use, such that attendance significantly predicted subsequent service use when post-treatment symptom severity was in the normal range. Implications regarding the influence of treatment engagement on future help-seeking are discussed.

Community-Based Providers' Selection of Practices for Children and Adolescents With Comorbid Mental Health Problems

The goal of this study is to explore providers' patterns of implementation by investigating how community mental health providers selected therapy practice modules from a flexible, modular evidence-based treatment working with youths with comorbid mental health problems. Data were obtained from 57 youths, 5-15 years old, presenting with anxiety, depressive, and/or conduct problems and their 27 providers during their participation in an effectiveness trial involving a modular evidence-based treatment. Although all youths evidenced clinically elevated symptomatology in at least two problem areas, providers targeted youths' comorbid problems with only about half of their study cases. Practice modules indicated for youths' comorbid problems were typically used less frequently and with less depth relative to practice modules indicated for youths' principal clinical problem and were often transdiagnostic in nature (i.e., designed to target more than one problem area). To determine whether providers' decisions to target youths' comorbid problems were systematic, multilevel, logistic regression analyses were conducted and revealed that youths' pretreatment characteristics and time in therapy influenced providers' patterns of module selection. Providers tend to use, but not exploit, the flexibility allowed by modular EBTs and to focus treatment on youths' principal presenting problem. In addition, providers appear to make these practice choices in a systematic and rational manner, and whether and which choices are associated with improved outcomes is an important area of future study.

[Modular psychotherapy with children and adolescents]

The implementation of evidence-based psychotherapy with children and adolescents has been limited so far. This is mainly due to the fact that patients in service settings tend to have higher rates of comorbidities and more frequently changing therapy needs than those in research settings. Thus, modular psychotherapies are promising, as they allow the treatment protocol to be adapted to patients’ individual needs. Because no review on modular psychotherapy for children and adolescents exists, we conducted a systematic literature research. The results of the 15 randomized controlled trials identified demonstrate that modular psychotherapy is associated with significant reductions in symptom levels as well as with higher rates of diagnostic remission compared to control conditions. Because of the lack of evidence, future studies should investigate the incremental efficacy of modular approaches and test the validity of underlying theoretical models as well as of decision flowcharts. Modular psychotherapy approaches have the potential to personalize evidence-based interventions for children and adolescents across various therapeutical traditions, and to facilitate their implementation into clinical practice.

Acceptance and Commitment Therapy modules: Differential impact on treatment processes and outcomes

A modular, transdiagnostic approach to treatment design and implementation may increase the public health impact of evidence-based psychosocial interventions. Such an approach relies on algorithms for selecting and implementing treatment components intended to have a specific therapeutic effect, yet there is little evidence for how components function independent of their treatment packages when employed in clinical service settings. This study aimed to demonstrate the specificity of treatment effects for two components of Acceptance and Commitment Therapy (ACT), a promising candidate for modularization. A randomized, nonconcurrent, multiple-baseline across participants design was used to examine component effects on treatment processes and outcomes in 15 adults seeking mental health treatment. The ACT OPEN module targeted acceptance and cognitive defusion; the ACT ENGAGED module targeted values-based activation and persistence. According to Tau-U analyses, both modules produced significant improvements in psychiatric symptoms, quality of life, and targeted therapeutic processes. ACT ENGAGED demonstrated greater improvements in quality of life and values-based activation. ACT OPEN showed greater improvements in symptom severity, acceptance, and defusion. Both modules improved awareness and non-reactivity, which were mutually targeted, though using distinct intervention procedures. Both interventions demonstrated high treatment acceptability, completion, and patient satisfaction. Treatment effects were maintained at 3-month follow up. ACT components should be considered for inclusion in a modular approach to implementing evidence-based psychosocial interventions for adults.