Who benefits from guided internet-based interventions? A systematic review of predictors and moderators of treatment outcome

Impact of an Online Discussion Forum on Self-Guided Internet-Delivered Cognitive Behavioral Therapy for Public Safety Personnel: Randomized Trial

BACKGROUND

Internet-delivered cognitive behavioral therapy (ICBT) is an effective and accessible treatment for various mental health concerns. ICBT has shown promising treatment outcomes among public safety personnel (PSP), who experience high rates of mental health problems and face barriers to accessing other mental health services. Client engagement and clinical outcomes are better in ICBT with therapist guidance, but ICBT is easier to implement on a large scale when it is self-guided. Therefore, it is important to identify strategies to improve outcomes and engagement in self-guided ICBT and other self-guided digital mental health interventions. One such strategy is the use of online discussion forums to provide ICBT clients with opportunities for mutual social support. Self-guided interventions accompanied by online discussion forums have shown excellent treatment outcomes, but there is a need for research experimentally testing the impact of online discussion forums in ICBT.

OBJECTIVE

We aimed to evaluate a transdiagnostic, self-guided ICBT intervention tailored specifically for PSP (which had not previously been assessed), assess the impact of adding a therapist-moderated online discussion forum on outcomes, and analyze participants' feedback to inform future research and implementation efforts.

METHODS

In this randomized trial, we randomly assigned participating PSP (N=107) to access an 8-week transdiagnostic, self-guided ICBT course with or without a built-in online discussion forum. Enrollment and participation were entirely web-based. We assessed changes in depression, anxiety, and posttraumatic stress as well as several secondary outcome measures (eg, treatment engagement and satisfaction) using questionnaires at the pre-enrollment, 8-week postenrollment, and 20-week postenrollment time points. Mixed methods analyses included multilevel modeling and qualitative content analysis.

RESULTS

Participants engaged minimally with the forum, creating 9 posts. There were no differences in treatment outcomes between participants who were randomly assigned to access the forum (56/107, 52.3%) and those who were not (51/107, 47.7%). Across conditions, participants who reported clinically significant symptoms during enrollment showed large and statistically significant reductions in symptoms (P<.05 and d>0.97 in all cases). Participants also showed good treatment engagement and satisfaction, with 43% (46/107) of participants fully completing the intervention during the course of the study and 96% (79/82) indicating that the intervention was worth their time.

CONCLUSIONS

Previous research has shown excellent clinical outcomes for self-guided ICBT accompanied by discussion forums and good engagement with those forums. Although clinical outcomes in our study were excellent across conditions, engagement with the forum was poor, in contrast to previous research. We discuss several possible interpretations of this finding (eg, related to the population under study or the design of the forum). Our findings highlight a need for more research evaluating the impact of online discussion forums and other strategies for improving outcomes and engagement in self-guided ICBT and other digital mental health interventions.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05145582; https://clinicaltrials.gov/study/NCT05145582.

Exploration of the individual and combined effects of predictors of engagement, dropout, and change from digital interventions for recurrent binge eating

OBJECTIVE

Our ability to predict responsiveness to digital interventions for eating disorders has thus far been poor, potentially for three reasons: (1) there has been a narrow set of predictors explored; (2) prediction has mostly focused on symptom change, ignoring other aspects of the user journey (uptake, early engagement); and (3) there is an excessive focus on the unique effects of predictors rather than the combined contributions of a predictor set. We evaluated the univariate and multivariate effects of outcome predictors in the context of a randomized trial (n = 398) of digitally delivered interventions for recurrent binge eating.

METHOD

Thirty baseline variables were selected as predictors, ranging from specific symptoms, to key protective factors, to technological acceptance, and to online treatment attitudes. Outcomes included uptake, early engagement, and remission. Univariate (d) and multivariate (D) standardized mean differences were calculated to estimate the individual and combined effects of predictors, respectively.

RESULTS

At the univariate level, few predictors produced an effect size larger than what is considered small (d > .20) across outcomes. However, our multivariate approach enhanced prediction (Ds = .65 to 1.12), producing accuracy rates greater than chance (63%-71% accuracy). Less than half of the chosen variables proved to be useful in contributing to predictions in multivariate models.

CONCLUSION

Findings suggest that accuracy in outcome prediction from digitally delivered interventions may be better driven by the aggregation of many small effects rather than one or several largely influential predictors. Replication with different data streams (sensor, neuroimaging) would be useful.

PUBLIC SIGNIFICANCE

Our ability to predict who will and will not benefit from digital interventions for eating disorders has been poor. We highlight the viability of a multivariate approach to outcome prediction, whereby prediction may be better driven by the aggregation of many small effects rather than one or a few influential predictors.

Predictors and moderators of outcome of ICBT for loneliness with guidance or automated messages - A secondary analysis of a randomized controlled trial

Internet-based cognitive behavioral therapy (ICBT) is promising in alleviating loneliness in adults. Identifying individuals who benefit from ICBT for loneliness is pivotal to offering this intervention in a more targeted way and improving the intervention for those who do not benefit. This secondary analysis of a randomized controlled trial (RCT) aimed to identify predictors and moderators of outcome of an ICBT with guidance or automated messages for loneliness. In the RCT, 243 participants suffering from loneliness were randomly assigned to an ICBT with guidance (n = 98), automated messages (n = 97), or a waitlist-control condition (n = 48). In total, 180 participants completed the post-assessment (i.e., 10 weeks post-randomization). Outcomes were treatment outcome assessed with the UCLA-9 Loneliness Scale at post-assessment and treatment response, i.e., reliable improvement on the UCLA-9 from pre- to post. The relationship between a wide range of patient characteristics (grouped into socio-demographic, clinical, loneliness-specific, and treatment-related variables) and outcome was analyzed using multiple linear and logistic regressions. Feeling less burdened by loneliness resulted in higher odds of reliable improvement in guided ICBT compared to the waitlist-control condition. No treatment outcome or response moderators were identified for ICBT with automated messages compared to the waitlist-control group. Across active intervention groups, loneliness at baseline, age and fit between the tasks and goals of the intervention and participants' need predicted treatment outcome. Predictors of treatment response for ICBT with guidance and automated messages were not identified, and no variables differentially predicted the effects of ICBT with guidance or automated messages on the outcomes. In conclusion, individuals less burdened by their feelings of loneliness benefited more from guided ICBT. Lower baseline loneliness scores, younger age, and a better match between tasks and goals of the intervention and participants' needs also predicted a more favorable treatment outcome for both ICBT with guidance and automated messages.

Evaluating the impact of motivational interviewing on engagement and outcomes in a web-based self-help intervention for gambling disorder: A randomised controlled trial

Background

Self-paced internet interventions for gambling problems offer cost-effective, accessible, and private alternatives to traditional psychotherapy for a population that rarely seeks help. However, these interventions have been relatively slow to develop, evaluate, and deploy at scale relative to those for other addictive behaviors. Moreover, user engagement remains low despite the high interest. Motivational interviews have improved the effectiveness gambling bibliotherapy but have not been augmented with an analogous web-based self-guided program.

Objectives

This trial aimed to replicate and extend prior work by translating a paperback workbook to the internet and pairing it with a single motivational interview. It was hypothesized that the motivational interview would enhance program engagement and gambling outcomes.

Methods

A two-arm randomised controlled trial was conducted. Treatment-seeking Canadian adults recruited solely via social media received one year of access to a web-based self-guided program, either alone (N = 158) or in combination with a virtual motivational interview completed upon enrolment (N = 155). The program was based on principles of cognitive-behavioral therapy and motivational interviewing. Gambling severity, expenditures, frequency, and duration were assessed via online questionnaires at baseline and 3-, 6-, and 12-months post-baseline, along with secondary outcomes (i.e., depression, anxiety, nonspecific psychological distress, alcohol consumption).

Results

Baseline characteristics were indicative of severe gambling problems and concurrent mental health problems but not problematic alcohol consumption in this sample. Both treatment groups demonstrated roughly equal improvements across all gambling outcomes and most secondary outcomes over time, except alcohol consumption, which did not meaningfully change. Changes were most prominent by 3 months, followed by more gradual change by 6 and 12 months. Only 57 % of gamblers who were assigned to receive a motivational interview completed that interview. About 40 % of users did not complete any program modules and 11 % completed all four. No group differences in program engagement were observed, although the number of modules completed was associated with greater reductions in gambling behaviors in both groups.

Discussion

The problem of user engagement with web-based self-help programs remains. There is a dose-response relationship between engagement and outcomes when engagement is measured in terms of therapeutic content completed.

Conclusions

The addition of a motivational interview to a web-based self-help program for gambling problems was unsuccessful in improving engagement or outcomes. Future work should aim to make self-guided programs more engaging rather than solely making users more engaged.

Trial registration

Registered on 7 July 2020 (ISRCTN13009468).

The latest developments with internet-based psychological treatments for depression

INTRODUCTION

Internet-based psychological treatments for depression have been around for more than 20 years. There has been a continuous line of research with new research questions being asked and studies conducted.

AREAS COVERED

In this paper, the author reviews studies with a focus on papers published from 2020 and onwards based on a Medline and Scopus search. Internet-based cognitive behavior therapy (ICBT) programs have been developed and tested for adolescents, older adults, immigrant groups and to handle a societal crisis (e.g. COVID-19). ICBT works in regular clinical settings and long-term effects can be obtained. Studies on different treatment orientations and approaches such as acceptance commitment therapy, unified protocol, and tailored treatments have been conducted. Effects on quality-of-life measures, knowledge acquisition and ecological momentary assessment as a research tool have been reported. Factorial design trials and individual patient data meta-analysis are increasingly used in association with internet intervention research. Finally, prediction studies and recent advances in artificial intelligence are mentioned.

EXPERT OPINION

Internet-delivered treatments are effective, in particular if therapist guidance is provided. More target groups have been covered but there are many remaining challenges including how new tools like artificial intelligence will be used when treating depression.

Dropout or Drop-In Experiences in an Internet-Delivered Intervention to Prevent Depression and Enhance Subjective Well-Being During the Perinatal Period: Qualitative Study

Background

The perinatal period is a vulnerable time when women are at increased risk of depression. "Mamma Mia" is a universal preventive internet-delivered intervention offered to pregnant women, with the primary goals of preventing the onset or worsening of depression and enhancing subjective well-being during the perinatal period. However, treatment dropout from internet-delivered interventions is often reported.

Objective

The study aim was to acquire an understanding of the different experiences among participants who dropped out of the Mamma Mia intervention during pregnancy, compared to participants who dropped out during the postpartum follow-up phase.

Methods

A total of 16 women from a larger randomized controlled trial (Mamma Mia) participated in individual semistructured interviews following a strengths, weaknesses, opportunities, and threats format. Of the 16 participants included, 8 (50%) women dropped out early from the intervention during pregnancy (pregnancy group), whereas 8 (50%) women dropped out later, after giving birth (postpartum follow-up group). Data were analyzed using the framework approach.

Results

The results showed that there were differences between the groups. In general, more participants in the postpartum follow-up group reported that the program was user-friendly. They became more aware of their own thoughts and feelings and perceived that the program had provided them with more new knowledge and practical information than participants in the pregnancy group. Participants in both groups suggested several opportunities for improving the program.

Conclusions

There were differences between women who dropped out of the intervention during pregnancy and the postpartum follow-up phase. The reported differences between groups should be further examined.