Interrelations between participant and intervention characteristics, process variables and outcomes in online interventions: A protocol for overarching analyses within and across seven clinical trials in ICare

Digital Smoking Cessation Intervention for Cancer Survivors: Analysis of Predictors and Moderators of Engagement and Outcome Alongside a Randomized Controlled Trial

BACKGROUND

Recent studies have shown positive, though small, clinical effects of digital smoking cessation (SC) interventions for cancer survivors. However, research on associations among participant characteristics, intervention engagement, and outcomes is limited.

OBJECTIVE

This study aimed to explore the predictors and moderators of engagement and outcome of MyCourse-Quit Smoking (in Dutch: "MijnKoers-Stoppen met Roken"), a digital minimally guided intervention for cancer survivors.

METHODS

A secondary analysis of data from the randomized controlled trial was performed. The number of cigarettes smoked in the past 7 days at 6-month follow-up was the primary outcome measure. We analyzed interactions among participant characteristics (11 variables), intervention engagement (3 variables), and outcome using robust linear (mixed) modeling.

RESULTS

In total, 165 participants were included in this study. Female participants accessed the intervention less often than male participants (B=-11.12; P=.004). A higher Alcohol Use Disorders Identification Test score at baseline was associated with a significantly higher number of logins (B=1.10; P<.001) and diary registrations (B=1.29; P<.001). A higher Fagerström Test for Nicotine Dependence score at baseline in the intervention group was associated with a significantly larger reduction in tobacco use after 6 months (B=-9.86; P=.002). No other associations and no moderating effects were found.

CONCLUSIONS

Overall, a limited number of associations was found between participant characteristics, engagement, and outcome, except for gender, problematic alcohol use, and nicotine dependence. Future studies are needed to shed light on how this knowledge can be used to improve the effects of digital SC programs for cancer survivors.

TRIAL REGISTRATION

Netherlands Trial register NTR6011/NL5434; https://onderzoekmetmensen.nl/nl/trial/22832.

Using web-based, guided self-help to bridge the waiting time for face-to-face out-patient treatment for bulimic-spectrum disorders: randomised controlled trial

BACKGROUND

Although effective treatments for bulimic-spectrum eating disorders exist, access is often delayed because of limited therapist availability and lengthy waiting lists. Web-based self-help interventions have the potential to bridge waiting times for face-to-face treatment and overcome existing treatment gaps.

AIMS

This study aims to assess the effectiveness of a web-based guided self-help intervention (everyBody Plus) for patients with bulimia nervosa, binge eating disorder and other specified feeding and eating disorders who are waiting for out-patient treatment.

METHOD

A randomised controlled trial was conducted in Germany and the UK. A total of 343 patients were randomly assigned to the intervention 'everyBody Plus' or a waitlist control condition. The primary outcome was the number of weeks after randomisation until a patient achieved a clinically relevant improvement in core symptoms for the first time. Secondary outcomes included eating disorder attitudes and behaviours, and general psychopathology.

RESULTS

At 6- and 12-month follow-up, the probability of being abstinent from core symptoms was significantly larger for the intervention group compared with the control group (hazard ratio: 1.997, 95% CI 1.09-3.65; P = 0.0249). The intervention group also showed larger improvements in eating disorder attitudes and behaviours, general psychopathology, anxiety, depression and quality of life, compared with the control group at most assessment points. Working alliance ratings with the online therapist were high.

CONCLUSIONS

The self-help intervention everyBody Plus, delivered with relatively standardised online guidance, can help bridge treatment gaps for patients with bulimic-spectrum eating disorders, and achieve faster and greater reductions in core symptoms.

Moderators of the Effects of mySmartSkin, a Web-Based Intervention to Promote Skin Self-examination and Sun Protection Among Individuals Diagnosed With Melanoma

BACKGROUND

Identifying the characteristics of persons who benefit more from behavioral interventions can help health care providers decide which individuals should be offered particular interventions because this is the subgroup of persons who are more likely to derive greater benefit from the intervention and refine the underlying constructs of the model guiding the intervention.

PURPOSE

This study evaluated possible demographic, medical, knowledge and attitudinal, and psychosocial variables that may moderate the impact of an online intervention, called mySmartSkin (MSS), on engagement in skin self-examination (SSE) and sun protection behaviors among melanoma survivors.

METHODS

Participants completed a baseline survey and were then randomized to the MSS condition or usual care. Follow-up surveys were completed by participants at 8-, 24-, and 48-week postrandomization.

RESULTS

A greater impact of MSS on SSE was illustrated among participants with more phenotypic skin cancer risk factors and participants reporting lower baseline self-efficacy in conducting SSE. A more favorable response of MSS on sun protection behaviors was shown when initial knowledge about abnormal lesions and sun protection barriers were high. Greater use of MSS and more favorable evaluations of it were also associated with higher intervention response.

CONCLUSIONS

Future studies seeking to improve SSE and sun protection among melanoma survivors might benefit from focusing on survivors who report more skin cancer risk factors, lower self-efficacy in conducting SSE, less knowledge about what abnormal skin lesions look like, more perceived barriers to sun protection behaviors, and less worry about recurrence and cancer-related distress.

Preliminary Evaluation of the Engagement and Effectiveness of a Mental Health Chatbot

Background: Mental health difficulties are highly prevalent, yet access to support is limited by barriers of stigma, cost, and availability. These issues are even more prevalent in low- and middle-income countries, and digital technology is one potential way to overcome these barriers. Digital mental health interventions are effective but often struggle with low engagement rates, particularly in the absence of human support. Chatbots could offer a scalable solution, simulating human support at a lower cost.

Objective: To complete a preliminary evaluation of engagement and effectiveness of Vitalk, a mental health chatbot, at reducing anxiety, depression and stress.

Methods: Real world data was analyzed from 3,629 Vitalk users who had completed the first phase of a Vitalk program (“less anxiety,” “less stress” or “better mood”). Programs were delivered through written conversation with a chatbot. Engagement was calculated from the number of responses sent to the chatbot divided by days in the program.

Results: Users sent an average of 8.17 responses per day. For all three programs, target outcome scores reduced between baseline and follow up with large effect sizes for anxiety (Cohen's d = −0.85), depression (Cohen's d = −0.91) and stress (Cohen's d = −0.81). Increased engagement resulted in improved post-intervention values for anxiety and depression.

Conclusion: This study highlights a chatbot's potential to reduce mental health symptoms in the general population within Brazil. While findings show promise, further research is required.

Immediate and long-term effectiveness of adding an Internet intervention for depression to routine outpatient psychotherapy: Subgroup analysis of the EVIDENT trial

OBJECTIVE

To examine immediate and long-term effectiveness of an adjunctive Internet intervention for depression in a large sample of patients undergoing routine psychotherapy.

METHOD

The current study evaluated a subgroup of patients from the Evident trial, a randomized investigation of a 12-week minimally guided Internet intervention (Deprexis) for the treatment of mild to moderate depression. 340 adults (mean age = 43.3 years; 71.7 % female) of the original sample received routine outpatient psychotherapy during the trial period, resulting in a standard psychotherapy group (n = 174) and an augmented therapy group (n = 166). Outcomes were assessed at baseline, post-treatment and 6-month follow-up.

RESULTS

Intention-to-treat analyses indicated that combined treatment led to a greater reduction in symptoms of depression (effect size d = 0.32; p = .002), improved therapeutic progress (d = 0.36; p = .003), and higher mental health-related quality of life (d = 0.34; p = .004). There was no intervention effect on physical health-related quality of life. The same pattern was found at 6-month follow-up, and adjunctive treatment also resulted in increased rates of clinical improvement. Treatment success was independent from therapeutic orientation of combined face-to-face therapy.

CONCLUSION

Results indicate that the adjunctive use of the investigated intervention can produce additional and lasting effects in routine outpatient psychotherapy for mild to moderate levels of depression. The study adds to the ongoing evidence on augmented effects of blended treatment. Future studies should investigate different types of blends in diverse populations by means of change-sensitive assessment strategies.

The Therapeutic Alliance in Digital Mental Health Interventions for Serious Mental Illnesses: Narrative Review

BACKGROUND

Digital mental health interventions offer unique advantages, and research indicates that these interventions are effective for a range of mental health concerns. Although these interventions are less established for individuals with serious mental illnesses, they demonstrate significant promise. A central consideration in traditional face-to-face therapies is the therapeutic alliance, whereas the nature of a digital therapeutic alliance and its relationship with outcomes requires further attention, particularly for individuals with serious mental illnesses.

OBJECTIVE

This narrative review aims to encourage further consideration and critical evaluation of the therapeutic alliance in digital mental health, specifically for individuals with serious mental illnesses.

METHODS

A narrative review was conducted by combining 3 main areas of the literature: the first examining the evidence for digital mental health interventions for serious mental illnesses, the second illuminating the nature and role of the therapeutic alliance in digital interventions, and the third surrounding practical considerations to enhance a digital therapeutic alliance.

RESULTS

Results indicated that a therapeutic alliance can be cultivated in digital interventions for those with serious mental illnesses, but that it may have unique, yet-to-be-confirmed characteristics in digital contexts. In addition, a therapeutic alliance appears to be less directly associated with outcomes in digital interventions than with those in face-to-face therapies. One possibility is that the digital therapeutic alliance is associated with increased engagement and adherence to digital interventions, through which it appears to influence outcomes. A number of design and implementation considerations may enhance the digital therapeutic alliance, including human support and technological features.

CONCLUSIONS

More research is required to further understand the nature and specific role of a therapeutic alliance in digital interventions for serious mental illnesses, particularly in informing their design. This review revealed several key research priorities to advance the therapeutic alliance in digital interventions.

Examining the Usage, User Experience, and Perceived Impact of an Internet-Based Cognitive Behavioral Therapy Program for Adolescents With Anxiety: Randomized Controlled Trial

BACKGROUND

Internet-based cognitive behavioral therapy (iCBT) increases treatment access for adolescents with anxiety; however, completion rates of iCBT programs are typically low. Understanding adolescents' experiences with iCBT, what program features and changes in anxiety (minimal clinically important difference [MCID]) are important to them, may help explain and improve iCBT program use and impact.

OBJECTIVE

Within a randomized controlled trial comparing a six-session iCBT program for adolescent anxiety, Being Real, Easing Anxiety: Tools Helping Electronically (Breathe), with anxiety-based resource webpages, we aimed to (1) describe intervention use among adolescents allocated to Breathe or webpages and those who completed postintervention assessments (Breathe or webpage respondents); (2) describe and compare user experiences between groups; and (3) calculate an MCID for anxiety and explore relationships between iCBT use, experiences, and treatment response among Breathe respondents.

METHODS

Enrolled adolescents with self-reported anxiety, aged 13 to 19 years, were randomly allocated to Breathe or webpages. Self-reported demographics and anxiety symptoms (Multidimensional Anxiety Scale for Children-2nd edition [MASC-2]) were collected preintervention. Automatically-captured Breathe or webpage use and self-reported symptoms and experiences (User Experience Questionnaire for Internet-based Interventions) were collected postintervention. Breathe respondents also reported their perceived change in anxiety (Global Rating of Change Scale [GRCS]) following program use. Descriptive statistics summarized usage and experience outcomes, and independent samples t tests and correlations examined relationships between them. The MCID was calculated using the mean MASC-2 change score among Breathe respondents reporting somewhat better anxiety on the GRCS.

RESULTS

Adolescents were mostly female (382/536, 71.3%), aged 16.6 years (SD 1.7), with very elevated anxiety (mean 92.2, SD 18.1). Intervention use was low for adolescents allocated to Breathe (mean 2.2 sessions, SD 2.3; n=258) or webpages (mean 2.1 visits, SD 2.7; n=278), but was higher for Breathe (median 6.0, range 1-6; 81/258) and webpage respondents (median 2.0, range 1-9; 148/278). Total user experience was significantly more positive for Breathe than webpage respondents (P<.001). Breathe respondents reported program design and delivery factors that may have challenged (eg, time constraints and program support) or facilitated (eg, demonstration videos, self-management activities) program use. The MCID was a mean MASC-2 change score of 13.8 (SD 18.1). Using the MCID, a positive treatment response was generated for 43% (35/81) of Breathe respondents. Treatment response was not correlated with respondents' experiences or use of Breathe (P=.32 to P=.88).

CONCLUSIONS

Respondents reported positive experiences and changes in their anxiety with Breathe; however, their reports were not correlated with program use. Breathe respondents identified program design and delivery factors that help explain their experiences and use of iCBT and inform program improvements. Future studies can apply our measures to compare user experiences between internet-based interventions, interpret treatment outcomes and improve treatment decision making for adolescents with anxiety.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02970734 https://clinicaltrials.gov/ct2/show/NCT02970734.

Usability and Engagement Evaluation of an Unguided Online Program for Promoting a Healthy Lifestyle and Reducing the Risk for Eating Disorders and Obesity in the School Setting

Implementing integrated online prevention to reduce the risk of both obesity and eating disorders, in the school setting, is a promising approach. The challenge is to develop highly user-friendly and motivating programs, to foster adherence and effectiveness. The purpose of this study was to evaluate the usability of such a universal prevention program for students aged 14⁻19 years, and to address engagement issues. A mixed-methods approach was chosen, consisting of a think-aloud task, a semi-structured interview, and a questionnaire including items on sociodemographic characteristics and the System Usability Scale (SUS). Usability tests were conducted in two rounds, with five adolescents participating per round. Mean score in the SUS was 92.5 of 100 points (range 85⁻100), in the second round, after some adaptations from the participants' feedback. In the course of the think-aloud tasks and interviews, five major themes emerged-visual design, navigation, mode of transfer, content, and engagement conditions. Interesting headlines, gamification, and monitoring tools are crucial for engagement. Apart from the importance of using the program during school hours, the study showed that problems currently perceived as important by the target group, need to be considered and addressed, prior to offering them prevention programs, which highlights the importance of a user-centered design.