Web-Based Single Session Intervention for Perceived Control Over Anxiety During COVID-19: Randomized Controlled Trial

Improving transportability of randomized controlled trial inference using robust prediction methods

Randomized trials have been the gold standard for assessing causal effects since their introduction by Fisher in the 1920s, since they can eliminate both observed and unobserved confounding. Estimates of causal effects at the population level from randomized controlled trials can still be biased if there are both effect modification and systematic differences between the trial sample and the ultimate population of inference with respect to these modifiers. Recent advances in the survey statistics literature to improve inference in nonprobability samples by using information from probability samples can provide an avenue for improving population causal inference in randomized controlled trials when relevant probability samples of the patient population are available. We review some recent work in "transporting" causal effect estimates from trials to populations, focusing on the setting where there is a "benchmark" or population-representative sample along with the RCT sample. We then propose estimators using either inverse probability weighting (IPWT) or prediction that can accommodate unequal probability of selection in the "benchmark" or population, and use Bayesian additive regression trees for both inverse probability of treatment weighting and prediction estimation that do not require specification of functional form or interaction. We also consider how the assumption of ignorability may be assessed from observed data and propose a sensitivity analysis under the failure of this assumption. We compare our proposed approach with existing methods in simulation and apply these alternative approaches to a study of pulmonary artery catheterization in critically ill patients. We also suggest next steps for future work.

Efficacy of an Unguided, Digital Single-Session Intervention for Internalizing Symptoms in Web-Based Workers: Randomized Controlled Trial

BACKGROUND

The Common Elements Toolbox (COMET) is an unguided digital single-session intervention (SSI) based on principles of cognitive behavioral therapy and positive psychology. Although unguided digital SSIs have shown promise in the treatment of youth psychopathology, the data are more mixed regarding their efficacy in adults.

OBJECTIVE

This study aimed to investigate the efficacy of COMET-SSI versus a waiting list control in depression and other transdiagnostic mental health outcomes for Prolific participants with a history of psychopathology.

METHODS

We conducted an investigator-blinded, preregistered randomized controlled trial comparing COMET-SSI (n=409) with an 8-week waiting list control (n=419). Participants were recruited from the web-based workspace Prolific and assessed for depression, anxiety, work and social functioning, psychological well-being, and emotion regulation at baseline and at 2, 4, and 8 weeks after the intervention. The main outcomes were short-term (2 weeks) and long-term (8 weeks) changes in depression and anxiety. The secondary outcomes were the 8-week changes in work and social functioning, well-being, and emotion regulation. Analyses were conducted according to the intent-to-treat principle with imputation, without imputation, and using a per-protocol sample. In addition, we conducted sensitivity analyses to identify inattentive responders.

RESULTS

The sample comprised 61.9% (513/828) of women, with a mean age of 35.75 (SD 11.93) years. Most participants (732/828, 88.3%) met the criteria for screening for depression or anxiety using at least one validated screening scale. A review of the text data suggested that adherence to the COMET-SSI was near perfect, there were very few inattentive respondents, and satisfaction with the intervention was high. However, despite being powered to detect small effects, there were negligible differences between the conditions in the various outcomes at the various time points, even when focusing on subsets of individuals with more severe symptoms.

CONCLUSIONS

Our results do not support the use of the COMET-SSI in adult Prolific participants. Future work should explore alternate ways of intervening with paid web-based participants, including matching individuals to SSIs they may be most responsive to.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05379881, https://clinicaltrials.gov/ct2/show/NCT05379881.

A Digital Single-Session Intervention Platform for Youth Mental Health: Cultural Adaptation, Evaluation, and Dissemination

BACKGROUND

Despite the proliferation of evidence-based digital mental health programs for young people, their low uptake and inconsistent implementation preclude them from benefiting youths at scale. Identifying effective implementation strategies for evidence-based supports is especially critical in regions where treatment access is lowest owing to mental health provider shortages.

OBJECTIVE

The goal of this academic-community partnership, funded by the City of San Antonio Metropolitan Health District, was to culturally adapt, disseminate, and gauge the acceptability and utility of an evidence-based digital mental health platform-Project Youth Empowerment and Support (YES)-among English- and Spanish-speaking youths living in south Texas.

METHODS

Project YES is an open-access, anonymous platform containing 3 evidence-based, self-guided interventions for youth mental health. Project YES was culturally adapted via focus groups and co-design sessions with San Antonio youths with lived experience of depression and anxiety; translated into Spanish; and disseminated throughout San Antonio, Texas, via community and school partnerships.

RESULTS

During the project period (April 2021 to December 2021), 1801 San Antonio youths began and 894 (49.64%) of them completed a 30-minute, single-session intervention within Project YES (aged 11-17 years; n=718, 39.87% male; n=961, 53.36% female; and n=3, 0.17% intersex; n=1477, 82.01% Hispanic; n=77, 4.28% non-Hispanic White; n=113, 6.27% Black; n=28, 1.55% Asian; and n=93, 5.16% other). This completion rate (49.64%) surpassed those previously observed for Project YES (eg, 34% when disseminated via social media). San Antonio youths rated Project YES as highly acceptable across all metrics, both in English and Spanish. In addition, the youths who completed Project YES-ENGLISH reported significant improvements in hopelessness (Cohen d=0.33; P<001), self-hate (Cohen d=0.27; P<001), and perceived agency (Cohen d=0.25; P<001) from before to after the intervention, and the youths who completed Project YES-SPANISH reported significant improvements in self-hate (Cohen d=0.37; P=.049) from before to after the intervention.

CONCLUSIONS

The results indicate that Project YES-an open-access, free, and anonymous web-based single-session intervention platform-is an acceptable, accessible, and applicable mental health support for English- and Spanish-speaking San Antonio youths.