Effect of Engagement With Digital Interventions on Mental Health Outcomes: A Systematic Review and Meta-Analysis

Process model of emotion regulation-based digital intervention for emotional problems

Background

To address the lack of mental health practitioners in developing countries, the current study explored the feasibility of a newly developed self-guided digital intervention program TEA (training for emotional adaptation) in alleviating depressive and anxiety symptoms, as one of a few studies which adapted from theoretical models with effective intervention techniques.

Methods

The first part of this study involved 11 professional mental health practitioners giving feedback on the feasibility of the TEA; while the second part involved a mixed-method single-arm study with 32 participants recruited online, who went through the seven intervention sessions within 14 days. The questionnaires were collected before, after, 14 days after, and 30 days after intervention. Additionally, 10 participants were invited to semi-structured interviews regarding their suggestions.

Results

Practitioners thought that the TEA showed high professionalism (8.91/10) and is suitable for treating emotional symptoms (8.09/10). The generalized estimating equation model showed that the TEA significantly reduced participants' depressive and anxiety symptoms, while the effects of the intervention remained 30 days post intervention (Cohen's d > 1). Thematic analysis revealed three main themes about future improvement, including content improvement, interaction improvement, and bug-fixing.

Conclusions

To address the current needs for digital mental health intervention programs to account for the insufficient availability of mental health services in China, the current study provides preliminary evidence of the effectiveness of TEA, with the potential to address the urgent need for remote mental health services.

Trial registration

The study was registered at the Chinese Clinical Trial Register (ChiCTR), with number [ChiCTR2200065944].

Facilitating engagement of universal school-based digital mental health solutions through user experience: A qualitative exploration

Digital mental health intervention (DMHI) programs offered in schools present a readily-accessible and flexible means for educating, empowering, and supporting adolescents in maintaining a balanced mental health, especially during uncertain and stressful times such as the COVID-19 pandemic. Recent studies indicate that the effectiveness of DMHI programs in improving students' mental well-being and in preventing from their mental health complications depends on the users' engagement. This study focuses on identifying the user experience factors that can facilitate user engagement with universal school-based DMHI programs (i.e., the DMHI programs delivered to the students regardless of their mental health risks or conditions). To identify said factors, we sought to gain a deeper understanding of perceptions, opinions, and preferences of actual end-users (i.e., the adolescents) regarding their experiences with both digital and non-digital mental health resources. Specifically, interviews were conducted with two participant groups to uncover the reasons that could lead the adolescents to better engage with school-based DMHI programs, as well as the shortcomings that could prevent that from happening: (a) adolescent users who had either a high or a low level of engagement with universal DMHI programs of a specific school-based digital mental health solution; and (b) adolescents who had voluntarily used non-digital or non-school-based digital mental health resources for purposes other than treatment. Through a thematic analysis of interview data, the most important (or primary) and the additionally desirable (or secondary) factors that could lead to a higher engagement level for school-based DMHI programs were identified. Lastly, using the evidence gathered from our interviews, specific recommendations are proposed that could help in targeting each identified engagement factor and in increasing the likelihood that school-based DMHI programs achieve their desired outcome for high school students.

Does loneliness affect how young adults engage with and benefit from a smartphone intervention targeting suicidal ideation?: Randomised Controlled Trial (Preprint)

BACKGROUND

Loneliness is commonly reported by young people and has been shown to contribute to the rapid onset and escalation of depression and suicidal ideation during adolescence. Lonely people may also be particularly susceptible to disengaging from treatment early given the likelihood of their more complex clinical profiles leading to cognitive fatigue. While a smartphone intervention (LifeBuoy) has been shown to effectively reduce suicidal ideation in young adults, poor engagement is a well-documented issue for this therapeutic modality and has been shown to result in poorer treatment outcomes.

OBJECTIVE

This study aims to determine whether loneliness affects how young people experiencing suicidal ideation engage with and benefit from a therapeutic smartphone intervention (LifeBuoy).

METHODS

A total of 455 community-based Australian young adults (aged 18-25 years) experiencing recent suicidal ideation were randomized to use a dialectical behavioral therapy-based smartphone intervention (LifeBuoy) or an attention-matched control app (LifeBuoy-C) for 6 weeks. Participants completed measures of suicidal ideation, depression, anxiety, and loneliness at baseline (T0), post intervention (T1), and 3 months post intervention (T2). Piecewise linear mixed models were used to examine whether loneliness levels moderated the effect of LifeBuoy and LifeBuoy-C on suicidal ideation and depression across time (T0 to T1; T1 to T2). This statistical method was then used to examine whether app engagement (number of modules completed) influenced the relationship between baseline loneliness and suicidal ideation and depression across time.

RESULTS

Loneliness was positively associated with higher levels of overall suicidal ideation (B=0.75, 95% CI 0.08-1.42; P=.03) and depression (B=0.88, 95% CI 0.45-1.32; P<.001), regardless of time point or allocated condition. However, loneliness did not affect suicidal ideation scores across time (time 1: B=1.10, 95% CI -0.25 to 2.46; P=.11; time 2: B=0.43, 95% CI -1.25 to 2.12; P=.61) and depression scores across time (time 1: B=0.00, 95% CI -0.67 to 0.66; P=.99; time 2: B=0.41, 95% CI -0.37 to 1.18; P=.30) in either condition. Similarly, engagement with the LifeBuoy app was not found to moderate the impact of loneliness on suicidal ideation (B=0.00, 95% CI -0.17 to 0.18; P=.98) or depression (B=-0.08, 95% CI -0.19 to 0.03; P=.14).

CONCLUSIONS

Loneliness was not found to affect young adults' engagement with a smartphone intervention (LifeBuoy) nor any clinical benefits derived from the intervention. LifeBuoy, in its current form, can effectively engage and treat individuals regardless of how lonely they may be.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12619001671156; https://tinyurl.com/yvpvn5n8.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/23655.

Linking music streaming platform advertisements with a digital mental health assessment and interventions

Accessibility issues and low rates of help-seeking hinder engagement with mental health resources and treatment. Pragmatic, (cost-)effective solutions are required to increase engagement with efficacious digital mental health interventions (DMHIs) including for hard-to-reach individuals. As an example, music-based interventions have been positively used in health care to reduce stress, anxiety and depression through music medicine, music therapy and recreational use. Although, enhanced mental health awareness from music listening has yet to be converted into engagement with a DMH assessment (DMHA) and DMHIs. Therefore, a new study is proposed to place linked advertisements on Spotify, the most used music streaming platform. MindSpot's vetted DMHA is suitable to use as an example for linking unto because it measures depression, anxiety, general mental well-being problems and psychological distress in Australian adults and provides access to DMHIs. The primary aim is to provide a convenient, robust and scalable consumer pathway to reduce engagement barriers and maximize facilitation to a vetted DMHA and DMHIs. The proposed study is important because it addresses notorious help-seeking difficulties in the adult population (e.g., young people and men). It also expands outreach to the underserved and the unserved and streamlines the integration of digital solutions with mental health services.

Appreciating the Good Things in Life During the Covid-19 Pandemic: A Randomized Controlled Trial and Evaluation of a Gratitude App

The Covid-19 pandemic has had many negative consequences on the general public mental health. The aim of this study was to test the effectiveness of and satisfaction with an app with gratitude exercises to improve the mental health of people with reduced mental well-being due to the Covid-19 pandemic, as well as potential mechanisms of well-being change and dose-response relationships. A two-armed randomized controlled trial design was used, with two groups receiving the 6-week gratitude intervention app either immediately (intervention group, n = 424) or after 6 weeks (waiting list control group, n = 425). Assessments took place online at baseline (T0), six weeks later (T1) and at 12 weeks (T2), measuring outcomes (i.e., mental well-being, anxiety, depression, stress), and potential explanatory variables (i.e., gratitude, positive reframing, rumination). Linear mixed models analyses showed that when controlled for baseline measures, the intervention group scored better on all outcome measures compared to the control group at T1 (d = .24-.49). These effects were maintained at T2. The control group scored equally well on all outcome measures at T2 after following the intervention. Effects of the intervention on well-being were partially explained by gratitude, positive reframing, and rumination, and finishing a greater number of modules was weakly related to better outcomes. The intervention was generally appealing, with some room for improvement. The results suggest that a mobile gratitude intervention app is a satisfactory and effective way to improve the mental health of the general population during the difficult times of a pandemic.

Building Emotional Awareness and Mental Health (BEAM): study protocol for a phase III randomized controlled trial of the BEAM app-based program for mothers of children 18-36 months

BACKGROUND

The prevalence of maternal depression and anxiety has increased during the COVID-19 pandemic, and pregnant individuals are experiencing concerningly elevated levels of mental health symptoms worldwide. Many individuals may now be at heightened risk of postpartum mental health disorders. There are significant concerns that a cohort of children may be at-risk for impaired self-regulation and mental illness due to elevated exposure to perinatal mental illness. With both an increased prevalence of depression and limited availability of services due to the pandemic, there is an urgent need for accessible eHealth interventions for mothers of young children. The aims of this trial are to evaluate the efficacy of the Building Emotion Awareness and Mental Health (BEAM) app-based program for reducing maternal depression symptoms (primary outcome) and improve anxiety symptoms, parenting stress, family relationships, and mother and child functioning (secondary outcomes) compared to treatment as usual (TAU).

METHODS

A two-arm randomized controlled trial (RCT) with repeated measures will be used to evaluate the efficacy of the BEAM intervention compared to TAU among a sample of 140 mothers with children aged 18 to 36 months, who self-report moderate-to-severe symptoms of depression and/or anxiety. Individuals will be recruited online, and those randomized to the treatment group will participate in 10 weeks of psychoeducation modules, an online social support forum, and weekly group teletherapy sessions. Assessments will occur at 18-36 months postpartum (pre-test, T1), immediately after the last week of the BEAM intervention (post-test, T2), and at 3 months after the intervention (follow-up, T3).

DISCUSSION

eHealth interventions have the potential to address elevated maternal mental health symptoms, parenting stress, and child functioning concerns during and after the COVID-19 pandemic and to provide accessible programming to mothers who are in need of support. This RCT will build on an open pilot trial of the BEAM program and provide further evaluation of this evidence-based intervention. Findings will increase our understanding of depression in mothers with young children and reveal the potential for long-term improvements in maternal and child health and family well-being.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05306626 . Registered on April 1, 2022.

Analyzing the Impact of Mobile App Engagement on Mental Health Outcomes: Secondary Analysis of the Unwinding Anxiety Program

BACKGROUND

App-based interventions provide a promising avenue for mitigating the burden on mental health services by complimenting therapist-led treatments for anxiety. However, it remains unclear how specific systems' use of app features may be associated with changes in mental health outcomes (eg, anxiety and worry).

OBJECTIVE

This study was a secondary analysis of engagement data from a stage 1 randomized controlled trial testing the impact of the Unwinding Anxiety mobile app among adults with generalized anxiety disorder. The aims of this study were 2-fold: to investigate whether higher microengagement with the primary intervention feature (ie, educational modules) is associated with positive changes in mental health outcomes at 2 months (ie, anxiety, worry, interoceptive awareness, and emotional reactivity) and to investigate whether the use of adjunctive app features is also associated with changes in mental health outcomes.

METHODS

We analyzed the intervention group during the stage 1 trial of the Unwinding Anxiety mobile app. The total use of specific mobile app features and the use specific to each feature were calculated. We used multivariate linear models with a priori significance of α=.05 to investigate the impact of cumulative app use on anxiety, worry, interoceptive awareness, and emotional regulation at 2 months, controlling for baseline scores, age, and education level in all models. Significant relationships between system use metrics and baseline participant characteristics were assessed for differences in use groupings using between-group testing (ie, 2-tailed t tests for continuous data and chi-square analyses for categorical data).

RESULTS

The sample was primarily female (25/27, 93%), and the average age was 42.9 (SD 15.6) years. Educational module completion, the central intervention component, averaged 20.2 (SD 11.4) modules out of 32 for the total sample. Multivariate models revealed that completing >75% of the program was associated with an average 22.6-point increase in interoceptive awareness (b=22.6; SE 8.32; P=.01; 95% CI 5.3-39.8) and an 11.6-point decrease in worry (b=-11.6; SE 4.12; P=.01; 95% CI -20.2 to -3.1). In addition, a single log unit change in the total number of meditations was associated with a 0.62-point reduction in the Generalized Anxiety Disorder-7 scale scores (b=0.62; SE 0.27; P=.005; 95% CI -1.2 to -0.6), whereas a single log unit use of the stress meter was associated with an average of a 0.5-point increase in emotional regulation scores (Five Facet Mindfulness Questionnaire; b=0.5; SE 0.21; P=.03; 95% CI 0.1-0.9).

CONCLUSIONS

This study offers a clearer understanding of the impact of engagement with app features on broader engagement with the health outcomes of interest. This study highlights the importance of comprehensive investigations of engagement during the development of evidence-based mobile apps.

Achieving Inclusivity by Design: Social and Contextual Information in Medical Knowledge

OBJECTIVES

To select, present, and summarize the most relevant papers published in 2020 and 2021 in the field of Knowledge Representation and Knowledge Management, Medical Vocabularies and Ontologies, with a particular focus on health inclusivity and bias.

METHODS

A broad search of the medical literature indexed in PubMed was conducted. The search terms 'ontology'/'ontologies' or 'medical knowledge management' for the dates 2020-2021 (search conducted November 26, 2021) returned 9,608 records. These were pre-screened based on a review of the titles for relevance to health inclusivity, bias, social and contextual factors, and health behaviours. Among these, 109 papers were selected for in-depth reviewing based on full text, from which 22 were selected for inclusion in this survey.

RESULTS

Selected papers were grouped into three themes, each addressing one aspect of the overall challenge for medical knowledge management. The first theme addressed the development of ontologies for social and contextual factors broadening the scope of health information. The second theme addressed the need for synthesis and translation of knowledge across historical disciplinary boundaries to address inequities and bias. The third theme encompassed a growing interest in the semantics of datasets used to train medical artificial intelligence systems and on how to ensure they are free of bias.

CONCLUSIONS

Medical knowledge management and semantic resources have much to offer efforts to tackle bias and enhance health inclusivity. Tackling inequities and biases requires relevant, semantically rich data, which needs to be captured and exchanged.

Three-arm randomised controlled trial of an m-health app and digital engagement strategy for improving treatment adherence and reducing suicidal ideation in young people: study protocol

INTRODUCTION

Youth suicidal ideation and behaviour is concerning due to its widespread prevalence, morbidity and potentially fatal consequences. Digital mental health interventions have been found to improve access to low-cost and high-quality support for a range of mental health issues, yet there are few digital interventions available for suicide prevention in young people. In addition, no studies have examined how digital engagement strategies may impact the engagement and efficacy of digital interventions in suicide prevention. The current protocol describes a three-arm parallel randomised controlled trial. A therapeutic smartphone application ('LifeBuoy'; intervention condition) will be tested against a condition that consists of the LifeBuoy application plus access to a digital engagement strategy ('LifeBuoy+engagement'; intervention condition) to determine whether the addition of the digital strategy improves app engagement metrics. To establish the efficacy of the LifeBuoy application, both of these intervention conditions will be tested against an attention-matched control condition (a placebo app).

METHODS AND ANALYSIS

669 young Australians aged 17-24 years who have experienced suicidal ideation in the past 30 days will be recruited by Facebook advertisement. The primary outcomes will be suicidal ideation severity and level of app engagement. Primary analyses will use an intention-to-treat approach and compare changes from baseline to 30-day, 60-day and 120-day follow-up time points relative to the control group using mixed-effect modelling. A subset of participants in the intervention groups will be interviewed on their experience with the app and engagement strategy. Qualitative data will be analysed using an inductive approach, independent of a theoretical confirmative method to identify the group themes.

ETHICS AND DISSEMINATION

The study has been approved by the University of New South Wales Human Research Ethics Committee (HC210400). The results of the trial will be disseminated via peer-reviewed publications in scientific journals and conferences.

TRIAL REGISTRATION NUMBER

ACTRN12621001247864.

The effect of a therapeutic smartphone application on suicidal ideation in young adults: Findings from a randomized controlled trial in Australia

BACKGROUND

Suicidal ideation is a major risk for a suicide attempt in younger people, such that reducing severity of ideation is an important target for suicide prevention. Smartphone applications present a new opportunity for managing ideation in young adults; however, confirmatory evidence for efficacy from randomized trials is lacking. The objective of this study was to assess whether a therapeutic smartphone application ("LifeBuoy") was superior to an attention-matched control application at reducing the severity of suicidal ideation.

METHODS AND FINDINGS

In this 2-arm parallel, double-blind, randomized controlled trial, 455 young adults from Australia experiencing recent suicidal ideation and aged 18 to 25 years were randomly assigned in a 2:2 ratio to use a smartphone application for 6 weeks in May 2020, with the final follow-up in October 2020. The primary outcome was change in suicidal ideation symptom severity scores from baseline (T0) to postintervention (T1) and 3-month postintervention follow-up (T2), measured using the Suicidal Ideation Attributes Scale (SIDAS). Secondary outcomes were symptom changes in depression (Patient Health Questionnaire-9, PHQ-9), generalized anxiety (Generalized Anxiety Disorder-7, GAD-7), distress (Distress Questionnaire-5, DQ5), and well-being (Short Warwick-Edinburgh Mental Well-Being Scale, SWEMWBS). This trial was conducted online, using a targeted social media recruitment strategy. The intervention groups were provided with a self-guided smartphone application based on dialectical behavior therapy (DBT; "LifeBuoy") to improve emotion regulation and distress tolerance. The control group were provided a smartphone application that looked like LifeBuoy ("LifeBuoy-C"), but delivered general (nontherapeutic) information on a range of health and lifestyle topics. Among 228 participants randomized to LifeBuoy, 110 did not complete the final survey; among 227 participants randomized to the control condition, 91 did not complete the final survey. All randomized participants were included in the intent-to-treat analysis for the primary and secondary outcomes. There was a significant time × condition effect for suicidal ideation scores in favor of LifeBuoy at T1 (p < 0.001, d = 0.45) and T2 (p = 0.007, d = 0.34). There were no superior intervention effects for LifeBuoy on any secondary mental health outcomes from baseline to T1 or T2 [p-values: 0.069 to 0.896]. No serious adverse events (suicide attempts requiring medical care) were reported. The main limitations of the study are the lack of sample size calculations supporting the study to be powered to detect changes in secondary outcomes and a high attrition rate at T2, which may lead efficacy to be overestimated.

CONCLUSIONS

LifeBuoy was associated with superior improvements in suicidal ideation severity, but not secondary mental health outcomes, compared to the control application, LifeBuoy-C. Digital therapeutics may need to be purposefully designed to target a specific health outcome to have efficacy.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12619001671156.

Associations Between Behavior Change Techniques and Engagement With Mobile Health Apps: Protocol for a Systematic Review

Background

Digitally enabled care along with an emphasis on self-management of health is steadily growing. Mobile health apps provide a promising means of supporting health behavior change; however, engagement with them is often poor and evidence of their impact on health outcomes is lacking. As engagement is a key prerequisite to health behavior change, it is essential to understand how engagement with mobile health apps and their target health behaviors can be better supported. Although the importance of engagement is emphasized strongly in the literature, the understanding of how different components of engagement are associated with specific techniques that aim to change behaviors is lacking.

Objective

The purpose of this systematic review protocol is to provide a synthesis of the associations between various behavior change techniques (BCTs) and the different components and measures of engagement with mobile health apps.

Methods

The review protocol was structured using the PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols) and the PICOS (Population, Intervention, Comparator, Outcome, and Study type) frameworks. The following seven databases will be systematically searched: PubMed, Embase, Cumulative Index to Nursing and Allied Health Literature, APA PsycInfo, ScienceDirect, Cochrane Library, and Web of Science. Title and abstract screening, full-text review, and data extraction will be conducted by 2 independent reviewers. Data will be extracted into a predetermined form, any disagreements in screening or data extraction will be discussed, and a third reviewer will be consulted if consensus cannot be reached. Risk of bias will be assessed using the Cochrane Collaboration Risk of Bias 2 and the Risk Of Bias In Non-Randomized Studies - of Interventions (ROBINS-I) tools; descriptive and thematic analyses will be conducted to summarize the relationships between BCTs and the different components of engagement.

Results

The systematic review has not yet started. It is expected to be completed and submitted for publication by May 2022.

Conclusions

This systematic review will summarize the associations between different BCTs and various components and measures of engagement with mobile health apps. This will help identify areas where further research is needed to examine BCTs that could potentially support effective engagement and help inform the design and evaluation of future mobile health apps.

Trial Registration

PROSPERO CRD42022312596; https://tinyurl.com/nhzp8223

International Registered Report Identifier (IRRID)

PRR1-10.2196/35172