Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements

Understanding users’ perspectives on mobile apps for anxiety management

Anxiety disorders are the most common type of mental health problem. The potential of apps to improve mental health has led to an increase in the number of anxiety apps available. Even though anxiety apps hold the potential to enhance mental health care for individuals, there is relatively little knowledge concerning users’ perspectives. This mixed-methods study aims to understand the nature of user burden and engagement with mental health apps (MHapps) targeting anxiety management, in order to identify ways to improve the design of these apps. Users’ perspectives on these apps were gathered by analyzing 600 reviews from 5 apps on the app stores (Study 1), and conducting 15 interviews with app users (Study 2). The results shed light on several barriers to adoption and sustained use. Users appreciate apps that offer content variation, customizability, and good interface design, and often requested an enhanced, personalized experience to improve engagement. We propose addressing the specific app quality issues identified through human-centered design, more personalized content delivery, and by improving features for social and therapeutic support.

Feasibility, Acceptability, and Potential Utility of Peer-supported Ecological Momentary Assessment Among People with Serious Mental Illness: a Pilot Study

To examine the feasibility, acceptability, and initial validity of using smartphone-based peer-supported ecological momentary assessment (EMA) as a tool to assess loneliness and functioning among adults with a serious mental illness diagnosis. Twenty-one adults with a diagnosis of a serious mental illness (i.e., schizophrenia, schizoaffective disorder, bipolar disorder, or treatment-refractory major depressive disorder) and at least one medical comorbidity (i.e., cardiovascular disease, obesity, diabetes, chronic obstructive pulmonary disease, hypertension, and/or high cholesterol) aged 18 years and older completed EMA surveys via smartphones once per day for 12-weeks. Nine peer support specialists prompted patients with SMI to complete the EMA surveys. Data were collected at baseline and 12-weeks. EMA acceptability (15.9%) was reported, and participants rated their experience with EMA methods positively. EMA responses were correlated with higher social support at 3 months. Higher levels of EMA-measured loneliness were significantly correlated with levels of social support, less hope, and less empowerment at 3 months. Lastly, those who contacted their peer specialist reported higher levels of loneliness and lower levels of functioning on that day suggesting that participants were able to use their peers for social support. Peer-supported EMA via smartphones is a feasible and acceptable data collection method among adults with SMI and appears to be a promising mobile tool to assess loneliness and functioning. These preliminary findings indicate EMA-measured loneliness and functioning are significantly predicted by baseline variables and such variables may impact engagement in EMA. EMA may contribute to future research examining the clinical utility of peer support specialists to alleviate feelings of loneliness and improve functioning.

I Need to Know: Using the CeHRes Roadmap to Develop a Treatment Feedback Tool for Youngsters with Mental Health Problems

Patient-Reported Outcome Measures (PROMs) are often used to monitor treatment outcomes in youth mental health care. Unfortunately, youngsters are rarely informed about the results of their PROMs or, when they are, it is in an insufficient manner. Therefore, a web application was developed-together with youngsters-aimed at giving them feedback about their PROMs. The aim of this study is to describe the development process of the application. An expert panel consisting of youngsters, web designers and researchers, as well as a representative from a client organisation, developed the e-health application INK (short for 'I Need to Know') in an iterative process based on the Centre for eHealth Research roadmap (CeHRes roadmap). Youngsters prefer, among other aspects, a simple, easy-to-use e-health application with a colourful appearance and want to be able to compare their results across different time points and informants. The INK tool provides youngsters with insight into their PROM results. Based on the youngsters' preferences, INK users can choose which feedback information is visible. INK facilitates youngsters' active participation in their treatment as well as shared decision-making with their professional caregivers.

Potential and Pitfalls of Mobile Mental Health Apps in Traditional Treatment: An Umbrella Review

While the rapid growth of mobile mental health applications has offered an avenue of support unbridled by physical distance, time, and cost, the digitalization of traditional interventions has also triggered doubts surrounding their effectiveness and safety. Given the need for a more comprehensive and up-to-date understanding of mobile mental health apps in traditional treatment, this umbrella review provides a holistic summary of their key potential and pitfalls. A total of 36 reviews published between 2014 and 2022—including systematic reviews, meta-analyses, scoping reviews, and literature reviews—were identified from the Cochrane library, Medline (via PubMed Central), and Scopus databases. The majority of results supported the key potential of apps in helping to (1) provide timely support, (2) ease the costs of mental healthcare, (3) combat stigma in help-seeking, and (4) enhance therapeutic outcomes. Our results also identified common themes of apps’ pitfalls (i.e., challenges faced by app users), including (1) user engagement issues, (2) safety issues in emergencies, (3) privacy and confidentiality breaches, and (4) the utilization of non-evidence-based approaches. We synthesize the potential and pitfalls of mental health apps provided by the reviews and outline critical avenues for future research.

Feasibility randomized controlled trial of a self-guided online intervention to promote psychosocial adjustment to unmet parenthood goals

STUDY QUESTION

Is it feasible to implement and evaluate an online self-guided psychosocial intervention for people with an unmet parenthood goal (UPG), aimed to improve well-being, in an online randomized controlled trial (RCT)?

SUMMARY ANSWER

The evaluation of an online bilingual self-guided psychosocial intervention for people with a UPG is feasible, reflected by high demand, good acceptability, good adaptation and promise of efficacy, but minor adjustments to the intervention and study design of the RCT should be made to enhance practicality.

WHAT IS KNOWN ALREADY

Self-identifying as having a UPG, defined as being unable to have children or as many as desired, is associated with impaired well-being and mental health. Practice guidelines and regulatory bodies have highlighted the need to address the lack of evidence-based support for this population. It is unknown if MyJourney (www.myjourney.pt), the first online self-guided intervention for people with UPGs, can be implemented and evaluated in an RCT.

STUDY DESIGN, SIZE, DURATION

To evaluate the feasibility of MyJourney, we conducted a registered, two-arm, parallel group, non-blinded feasibility RCT, with a 1:1 computer-generated randomized allocation and embedded qualitative process evaluation. Participants were included between November 2020 and March 2021. Assessments were made before randomization (T1), 10 weeks (T2) and 6 months after (T3, intervention group only). Participants allocated to the intervention group received an email to access MyJourney immediately after randomization. Participants in the waitlist control group were given access to MyJourney after completing the 10-week assessment (T2).

PARTICIPANTS/MATERIALS, SETTING, METHODS

Participants were recruited via social media advertising of MyJourney and its feasibility study. People who self-identified as having a UPG could click on a link to participate, and of these 235 were randomized. Outcome measures related to demand, acceptability, implementation, practicality, adaptation and limited efficacy were assessed via online surveys. The primary outcome in limited efficacy testing was hedonic well-being, measured with the World Health Organisation Wellbeing Index (WHO-5).

MAIN RESULTS AND THE ROLE OF CHANCE

Participation and retention rates were 58.3%, 31.7% (T2) and 45.2% (T3, intervention group only), respectively. Of participants invited to register with MyJourney, 91 (76.5%) set up an account, 51 (47.2%) completed the first Step of MyJourney, 12 (11.1%) completed six Steps (sufficient dose) and 6 (5.6%) completed all Steps within the 10-week recommended period. Acceptability ranged from 2.79 (successful at supporting) to 4.42 (easy to understand) on a 1 (not at all) to 5 (extremely acceptable) scale. Average time to complete sufficient dose was 15.6 h (SD = 18.15) and to complete all Steps was 12.4 h (SD = 18.15), with no differences found for participants using MyJourney in Portuguese and English. Modified intention-to-treat analysis showed a moderate increase in well-being from T1 to T2 in the intervention group (η_p² = 0.156, mean difference (MD) = 9.300 (2.285, 16.315)) and no changes in the control group (η_p² = 0.000, MD = 0.047 (−3.265, 3.358)). Participants in the process evaluation reported MyJourney was needed and answered their needs for support (reflecting high demand and acceptability), the recommended period to engage with MyJourney was short, and their engagement was influenced by multiple factors, including personal (e.g. lack of time) and MyJourney related (e.g. reminders).

LIMITATIONS, REASONS FOR CAUTION

Participants were mostly white, well-educated, employed, childless women. Non-blinded allocation, use of self-reported questionnaire assessments and high attrition in the intervention group could have triggered bias favourable to positive evaluations of MyJourney and resulted in low power to detect T2 to T3 changes in limited efficacy outcomes.

WIDER IMPLICATIONS OF THE FINDINGS

MyJourney can proceed to efficacy testing, but future work should eliminate barriers for engagement and explore strategies to maximize adherence. Entities wanting to support people with UPGs now have a freely accessible and promising resource that can be further tested and evaluated in different settings.

STUDY FUNDING/COMPETING INTEREST(S)

MyJourney’s development was funded by the charity Portuguese Fertility Association, Cardiff University and University of Coimbra (CINEICC). Dr S.G. reports consultancy fees from Ferring Pharmaceuticals A/S, speaker fees from Access Fertility, SONA-Pharm LLC, Meridiano Congress International and Gedeon Richter and grants from Merck Serono Ltd. Bethan Rowbottom holds a PhD scholarship funded by the School of Psychology, Cardiff University. The other authors have no conflicts of interest.

TRIAL REGISTRATION NUMBER

Clinical Trials.gov NCT04850482.

Did Usage of Mental Health Apps Change during COVID-19? A Comparative Study Based on an Objective Recording of Usage Data and Demographics

This paper aims to objectively compare the use of mental health apps between the pre-COVID-19 and during COVID-19 periods and to study differences amongst the users of these apps based on age and gender. The study utilizes a dataset collected through a smartphone app that objectively records the users' sessions. The dataset was analyzed to identify users of mental health apps (38 users of mental health apps pre-COVID-19 and 81 users during COVID-19) and to calculate the following usage metrics; the daily average use time, the average session time, the average number of launches, and the number of usage days. The mental health apps were classified into two categories: guidance-based and tracking-based apps. The results include the increased number of users of mental health apps during the COVID-19 period as compared to pre-COVID-19. Adults (aged 24 and above), compared to emerging adults (aged 15-24 years), were found to have a higher usage of overall mental health apps and guidance-based mental health apps. Furthermore, during the COVID-19 pandemic, males were found to be more likely to launch overall mental health apps and guidance-based mental health apps compared to females. The findings from this paper suggest that despite the increased usage of mental health apps amongst males and adults, user engagement with mental health apps remained minimal. This suggests the need for these apps to work towards improved user engagement and retention.

Smoking Cessation Smartphone App Use Over Time: Predicting 12-Month Cessation Outcomes in a 2-Arm Randomized Trial

BACKGROUND

Little is known about how individuals engage over time with smartphone app interventions and whether this engagement predicts health outcomes.

OBJECTIVE

In the context of a randomized trial comparing 2 smartphone apps for smoking cessation, this study aimed to determine distinct groups of smartphone app log-in trajectories over a 6-month period, their association with smoking cessation outcomes at 12 months, and baseline user characteristics that predict data-driven trajectory group membership.

METHODS

Functional clustering of 182 consecutive days of smoothed log-in data from both arms of a large (N=2415) randomized trial of 2 smartphone apps for smoking cessation (iCanQuit and QuitGuide) was used to identify distinct trajectory groups. Logistic regression was used to determine the association of group membership with the primary outcome of 30-day point prevalence of smoking abstinence at 12 months. Finally, the baseline characteristics associated with group membership were examined using logistic and multinomial logistic regression. The analyses were conducted separately for each app.

RESULTS

For iCanQuit, participants were clustered into 3 groups: "1-week users" (610/1069, 57.06%), "4-week users" (303/1069, 28.34%), and "26-week users" (156/1069, 14.59%). For smoking cessation rates at the 12-month follow-up, compared with 1-week users, 4-week users had 50% higher odds of cessation (30% vs 23%; odds ratio [OR] 1.50, 95% CI 1.05-2.14; P=.03), whereas 26-week users had 397% higher odds (56% vs 23%; OR 4.97, 95% CI 3.31-7.52; P<.001). For QuitGuide, participants were clustered into 2 groups: "1-week users" (695/1064, 65.32%) and "3-week users" (369/1064, 34.68%). The difference in the odds of being abstinent at 12 months for 3-week users versus 1-week users was minimal (23% vs 21%; OR 1.16, 95% CI 0.84-1.62; P=.37). Different baseline characteristics predicted the trajectory group membership for each app.

CONCLUSIONS

Patterns of 1-, 3-, and 4-week smartphone app use for smoking cessation may be common in how people engage in digital health interventions. There were significantly higher odds of quitting smoking among 4-week users and especially among 26-week users of the iCanQuit app. To improve study outcomes, strategies for detecting users who disengage early from these interventions (1-week users) and proactively offering them a more intensive intervention could be fruitful.

Operationalizing Engagement With an Interpretation Bias Smartphone App Intervention: Case Series

BACKGROUND

Engagement with mental health smartphone apps is an understudied but critical construct to understand in the pursuit of improved efficacy.

OBJECTIVE

This study aimed to examine engagement as a multidimensional construct for a novel app called HabitWorks. HabitWorks delivers a personalized interpretation bias intervention and includes various strategies to enhance engagement such as human support, personalization, and self-monitoring.

METHODS

We examined app use in a pilot study (n=31) and identified 5 patterns of behavioral engagement: consistently low, drop-off, adherent, high diary, and superuser.

RESULTS

We present a series of cases (5/31, 16%) from this trial to illustrate the patterns of behavioral engagement and cognitive and affective engagement for each case. With rich participant-level data, we emphasize the diverse engagement patterns and the necessity of studying engagement as a heterogeneous and multifaceted construct.

CONCLUSIONS

Our thorough idiographic exploration of engagement with HabitWorks provides an example of how to operationalize engagement for other mental health apps.

Analyzing the Impact of Mobile App Engagement on Mental Health Outcomes: Secondary Analysis of the Unwinding Anxiety Program

BACKGROUND

App-based interventions provide a promising avenue for mitigating the burden on mental health services by complimenting therapist-led treatments for anxiety. However, it remains unclear how specific systems' use of app features may be associated with changes in mental health outcomes (eg, anxiety and worry).

OBJECTIVE

This study was a secondary analysis of engagement data from a stage 1 randomized controlled trial testing the impact of the Unwinding Anxiety mobile app among adults with generalized anxiety disorder. The aims of this study were 2-fold: to investigate whether higher microengagement with the primary intervention feature (ie, educational modules) is associated with positive changes in mental health outcomes at 2 months (ie, anxiety, worry, interoceptive awareness, and emotional reactivity) and to investigate whether the use of adjunctive app features is also associated with changes in mental health outcomes.

METHODS

We analyzed the intervention group during the stage 1 trial of the Unwinding Anxiety mobile app. The total use of specific mobile app features and the use specific to each feature were calculated. We used multivariate linear models with a priori significance of α=.05 to investigate the impact of cumulative app use on anxiety, worry, interoceptive awareness, and emotional regulation at 2 months, controlling for baseline scores, age, and education level in all models. Significant relationships between system use metrics and baseline participant characteristics were assessed for differences in use groupings using between-group testing (ie, 2-tailed t tests for continuous data and chi-square analyses for categorical data).

RESULTS

The sample was primarily female (25/27, 93%), and the average age was 42.9 (SD 15.6) years. Educational module completion, the central intervention component, averaged 20.2 (SD 11.4) modules out of 32 for the total sample. Multivariate models revealed that completing >75% of the program was associated with an average 22.6-point increase in interoceptive awareness (b=22.6; SE 8.32; P=.01; 95% CI 5.3-39.8) and an 11.6-point decrease in worry (b=-11.6; SE 4.12; P=.01; 95% CI -20.2 to -3.1). In addition, a single log unit change in the total number of meditations was associated with a 0.62-point reduction in the Generalized Anxiety Disorder-7 scale scores (b=0.62; SE 0.27; P=.005; 95% CI -1.2 to -0.6), whereas a single log unit use of the stress meter was associated with an average of a 0.5-point increase in emotional regulation scores (Five Facet Mindfulness Questionnaire; b=0.5; SE 0.21; P=.03; 95% CI 0.1-0.9).

CONCLUSIONS

This study offers a clearer understanding of the impact of engagement with app features on broader engagement with the health outcomes of interest. This study highlights the importance of comprehensive investigations of engagement during the development of evidence-based mobile apps.

College student engagement with mental health apps: analysis of barriers to sustained use

Objective: College students'demand for mental health resources is straining the services offered by colleges. While mobile apps demonstrate potential to help, students' engagement with these apps remains low. This study examines why college students show poor engagement with mental health apps and how apps may be adapted to suit this population. Participants: Participants were a convenience sample of 100 college students. Methods: Qualitative data was gathered through individual online interviews concerningattitudes toward mental health apps, and quantitative data was gathered through a survey about phone and app use. Results: Students were interested in mental health apps. 53% haddownloaded an app at one point, but only 19% currently used a mental health app. Stress and costdrove mental health app choices. Responses around engagement centered on: Data privacy, user interface, credibility, and customization. Conclusions: Students have specific wants for mental health apps including safety, simplicity, credibility, and customizability.

Single-Session Interventions Embedded Within Tumblr: Acceptability, Feasibility, and Utility Study

Background

Existing mental health treatments are insufficient for addressing mental health needs at scale, particularly for teenagers, who now seek mental health information and support on the web. Single-session interventions (SSIs) may be particularly well suited for dissemination as embedded web-based support options that are easily accessible on popular social platforms.

Objective

We aimed to evaluate the acceptability and effectiveness of three SSIs, each with a duration of 5 to 8 minutes (Project Action Brings Change, Project Stop Adolescent Violence Everywhere, and REFRAME)—embedded as Koko minicourses on Tumblr—to improve three key mental health outcomes: hopelessness, self-hate, and the desire to stop self-harm behavior.

Methods

We used quantitative data (ie, star ratings and SSI completion rates) to evaluate acceptability and short-term utility of all 3 SSIs. Paired 2-tailed t tests were used to assess changes in hopelessness, self-hate, and the desire to stop future self-harm from before to after the SSI. Where demographic information was available, the analyses were restricted to teenagers (13-19 years). Examples of positive and negative qualitative user feedback (ie, written text responses) were provided for each program.

Results

The SSIs were completed 6179 times between March 2021 and February 2022. All 3 SSIs generated high star ratings (>4 out of 5 stars), with high completion rates (approximately 25%-57%) relative to real-world completion rates among other digital self-help interventions. Paired 2-tailed t tests detected significant pre-post reductions in hopelessness for those who completed Project Action Brings Change (P<.001, Cohen d_z=−0.81, 95% CI −0.85 to −0.77) and REFRAME (P<.001, Cohen d_z=−0.88, 95% CI −0.96 to −0.80). Self-hate significantly decreased (P<.001, Cohen d_z=−0.67, 95% CI −0.74 to −0.60), and the desire to stop self-harm significantly increased (P<.001, Cohen d_z=0.40, 95% CI 0.33 to 0.47]) from before to after the completion of Project Stop Adolescent Violence Everywhere. The results remained consistent across sensitivity analyses and after correcting for multiple tests. Examples of positive and negative qualitative user feedback point toward future directions for SSI research.

Conclusions

Very brief SSIs, when embedded within popular social platforms, are one promising and acceptable method for providing free, scalable, and potentially helpful mental health support on the web. Considering the unique barriers to mental health treatment access that many teenagers face, this approach may be especially useful for teenagers without access to other mental health supports.

Adhoc Setup of an Online Mental Health Self-Help Program During the COVID-19 Pandemic: Description of the Development and Implementation Processes and Analysis of Its Users’ and Usage Profiles

Background

The COVID-19 pandemic hit Austria in March 2020. This led to a considerable reduction in outpatient psychiatric therapies. People with mental disorders as well as with newly emerging mental health issues found themselves with very limited treatment options. Within only a few days our hospital set up an online mental health self-help program which went online in its first version on the first day of the lockdown in Austria. The process of this development and implementation process alongside with the user’s and usage data for the program are presented here.

Methods

A small core team initiated the development of the program on a low-budget basis and using mostly freely available digital resources. The program had to be free of costs for its users and easy to navigate. Each self-help module contains a text description of the topic, a self-rating questionnaire and several psychoeducational 2–5 min videos. These videos explain, e.g., interactions of mental stress and the immune system or the vicious circle of anxiety. Additional videos provide easy to learn techniques like breathing and relaxation exercises.

Results

We illustrate the implementation of this program following the replicating effective program (REP) model. We provide a detailed description of the implementation process starting from a simple website to a smartphone-based application with registered user area and instantaneous reporting of self-rating questionnaire results to users. The described process could be used as a model for the setup of similar programs in a very short time. As an indicator of acceptance, we report 46,100 unique video views and 3,937 completed questionnaires in the first year of use. The most accessed videos were those on anxiety, relaxation and resilience. Analysis of the sociodemographic user data indicate that they were mostly young (&lt; 45 years; 59.7%), females (77.5%) and previously mentally healthy individuals (74.5%). An example of the collected psychometric questionnaire data over time is given.

Conclusion

We show that it is possible to set up an online mental health self-help program ad hoc and without extensive prior planning, which enabled us to dynamically respond to a new situation. We are now planning on keeping the program active for a longer period of time to supplement and expand traditional treatment settings also outside the COVID-19 pandemic.

Efficacy of a transdiagnostic cognitive-behavioral intervention for eating disorder psychopathology delivered through a smartphone app: a randomized controlled trial

BACKGROUND

Although effective treatments exist for diagnostic and subthreshold-level eating disorders (EDs), a significant proportion of affected individuals do not receive help. Interventions translated for delivery through smartphone apps may be one solution towards reducing this treatment gap. However, evidence for the efficacy of smartphones apps for EDs is lacking. We developed a smartphone app based on the principles and techniques of transdiagnostic cognitive-behavioral therapy for EDs and evaluated it through a pre-registered randomized controlled trial.

METHODS

Symptomatic individuals (those who reported the presence of binge eating) were randomly assigned to the app (n = 197) or waiting list (n = 195). Of the total sample, 42 and 31% exhibited diagnostic-level bulimia nervosa and binge-eating disorder symptoms, respectively. Assessments took place at baseline, 4 weeks, and 8 weeks post-randomization. Analyses were intention-to-treat. The primary outcome was global levels of ED psychopathology. Secondary outcomes were other ED symptoms, impairment, and distress.

RESULTS

Intervention participants reported greater reductions in global ED psychopathology than the control group at post-test (d = -0.80). Significant effects were also observed for secondary outcomes (d's = -0.30 to -0.74), except compensatory behavior frequency. Symptom levels remained stable at follow-up. Participants were largely satisfied with the app, although the overall post-test attrition rate was 35%.

CONCLUSION

Findings highlight the potential for this app to serve as a cost-effective and easily accessible intervention for those who cannot receive standard treatment. The capacity for apps to be flexibly integrated within current models of mental health care delivery may prove vital for addressing the unmet needs of people with EDs.

Information sharing across mental health service providers and criminal legal system stakeholders: Perspectives of people with serious mental illnesses and their family members

OBJECTIVE

The overrepresentation of people with serious mental illnesses in the criminal legal system has spurred information-sharing initiatives to transmit information between mental health service providers and criminal legal system stakeholders with the goal of improving resources and streamlining access to care. However, no research to date has examined the perspectives of people with mental illnesses who have their information shared across these systems or the perspectives of their family members. This study examined the perspectives on mental health-criminal legal system information sharing among people with serious mental illnesses and a history of arrest, as well as their family members.

METHODS

Researchers interviewed 24 clients with serious mental illnesses and a history of arrest who are enrolled in a randomized, controlled trial of a police-mental health Linkage System as well as 11 of their family members. Participants were recruited and interviewed between November 2020 and February 2021. A thematic analysis was used to code and analyze all interview transcripts.

RESULTS

Study participants articulated perceived benefits and concerns around cross-system information sharing. There was strong support for information sharing in both directions, with the anticipation that such information sharing can prevent unnecessary arrest and/or incarceration, promote positive and safe interactions with criminal legal system professionals, and foster greater understanding and access to treatment. Concerns were more limited and largely related to perceived stigma around mental illnesses and the potential consequences of such stigma.

CONCLUSIONS

While concerns about information sharing should be considered, study participants overwhelmingly perceived the sharing of information between mental health providers and criminal legal stakeholders as a positive intervention. Such perspectives can be understood as a pragmatic choice in the face of criminal legal system contact and additional research could guide programmatic and policy changes.

How Far Can Conversational Agents Contribute to IBD Patient Health Care—A Review of the Literature

Modern societies are facing health and healthcare challenges as never seen before. The digital world in which we are living today considers digital health interventions such as “internet-delivered” therapy (e-Therapy) or mobile apps as an integrated part of healthcare systems. Digital transformation in health care requires the active involvement of patients as the central part of healthcare interventions. In the case of chronic health conditions, such as inflammatory bowel disease (IBD), it is believed that the adoption of new digital tools helps to maintain and extend the health and care of patients, optimizing the course of the treatment of the disease. The study goal was to undertake a literature review associating the use of chatbot technology with IBD patients' health care. This study intends to support digital product developments, mainly chatbot for IBD or other chronic diseases. The work was carried out through two literature review phases. The first one was based on a systematic approach and the second was a scoping review focused only on Frontiers Journals. This review followed a planned protocol for search and selection strategy that was created by a research team discussion. Chatbot technology for chronic disease self-management can have high acceptance and usability levels. The more interaction with a chatbot, the more patients are able to increase their self-care practice, but there is a challenge. The chatbot ontology to personalize the communication still needed to have strong guidelines helping other researchers to define which Electronic Medical Records (EMRs) should be used in the chatbots to improve the user satisfaction, engagement, and dialog quality. The literature review showed us both evidence and success of these tools in other health disorders. Some of them revealed a huge potential for conversational agents as a part of digital health interventions.

Evaluation of Parental Acceptability and Use of Intervention Components to Reduce Pre-School Children's Intake of Sugar-Rich Food and Drinks

Knowledge is needed about effective tools that reach public health objectives focused on reducing the intake of sugar-rich foods and drinks. The purpose of this study was to assess the parental acceptability, use and motivational potential of intervention components developed in the randomized family-based trial ‘Are you too sweet?’ aimed at reducing the intake of sugar-rich foods and drinks among children (5–7 y). Intervention components included guidance on sugar-rich foods and drinks at a school health nurse consultation, a box with home-use materials and a digital platform. The methods used were a questionnaire among intervention families (n = 83) and semi-structured interviews with parents in selected intervention families (n = 24). Results showed the good acceptability and usefulness of the components, with reported frequencies of use of materials ranging from 48% to 94% and a high satisfaction rate with the school health nurse consultation. Personalized feedback and guidance from the school health nurse seemed to be a motivational trigger, and components that were compatible with existing practices were most frequently used. However, the components were not considered engaging by all families. Overall, intervention components were well received and hold the potential for enhancing parental knowledge and parenting practices regarding limiting the intake of sugar-rich foods and drinks.

Digital Screening and Automated Resource Identification System to Address COVID-19-Related Behavioral Health Disparities: Feasibility Study

BACKGROUND

Digital mental health (DMH) tools use technology (eg, websites and mobile apps) to conveniently deliver mental health resources to users in real time, reducing access barriers. Underserved communities facing health care provider shortages and limited mental health resources may benefit from DMH tools, as these tools can help improve access to resources.

OBJECTIVE

This study described the development and feasibility evaluation of the Emotional Needs Evaluation and Resource Guide for You (ENERGY) System, a DMH tool to meet the mental health and resource needs of youth and their families developed in the context of the COVID-19 pandemic. The ENERGY System offers a brief assessment of resource needs; problem-solving capabilities; and symptoms of depression, anxiety, trauma, and alcohol and substance use followed by automated, personalized feedback based on the participant's responses.

METHODS

Individuals aged ≥15 years were recruited through community partners, community events, targeted electronic health record messages, and social media. Participants completed screening questions to establish eligibility, entered demographic information, and completed the ENERGY System assessment. Based on the participant's responses, the ENERGY System immediately delivered digital resources tailored to their identified areas of need (eg, relaxation). A subset of participants also voluntarily completed the following: COVID-19 Exposure and Family Impact Survey (CEFIS) or COVID-19 Exposure and Family Impact Survey Adolescent and Young Adult Version (CEFIS-AYA); resource needs assessment; and feedback on their experience using the ENERGY System. If resource needs (eg, housing and food insecurity) were endorsed, lists of local resources were provided.

RESULTS

A total of 212 individuals accessed the ENERGY System link, of which 96 (45.3%) completed the screening tool and 86 (40.6%) received resources. Participant responses on the mental health screening questions triggered on average 2.04 (SD 1.94) intervention domains. Behavioral Activation/Increasing Activities was the most frequently launched intervention domain (56%, 54/96), and domains related to alcohol or substance use were the least frequent (4%, 4/96). The most frequently requested support areas were finances (33%, 32/96), transportation (26%, 25/96), and food (24%, 23/96). The CEFIS and CEFIS-AYA indicated higher than average impacts from the pandemic (ie, average scores >2.5). Participants were satisfied with the ENERGY System overall (65%, 39/60) as well as the length of time it took to answer the questions (90%, 54/60), which they found easy to answer (87%, 52/60).

CONCLUSIONS

This study provided initial support for the feasibility of the ENERGY System, a DMH tool capable of screening for resource and mental health needs and providing automated, personalized, and free resources and techniques to meet the identified needs. Future studies should seek direct feedback from community members to further improve the ENERGY System and its dissemination to encourage use.

Human-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review

BACKGROUND

Digital mental health interventions have a great potential to alleviate mental illness and increase access to care. However, these technologies face significant challenges, especially in terms of user engagement and adoption. It has been suggested that this issue stems from a lack of user perspective in the development process; accordingly, several human-centered design approaches have been developed over the years to consider this important aspect. Yet, few human-centered design approaches to digital solutions exist in the field of mental health, and rarely are end users involved in their development.

OBJECTIVE

The main objective of this literature review is to understand how human-centered design is considered in e-mental health intervention research.

METHODS

An exploratory mapping review was conducted of mental health journals with the explicit scope of covering e-mental health technology. The human-centered design approaches reported and the core elements of design activity (ie, object, context, design process, and actors involved) were examined among the eligible studies.

RESULTS

A total of 30 studies met the inclusion criteria, of which 22 mentioned using human-centered design approaches or specific design methods in the development of an e-mental health solution. Reported approaches were classified as participatory design (11/27, 41%), codesign (6/27, 22%), user-centered design (5/27, 19%), or a specific design method (5/27, 19%). Just over half (15/27, 56%) of the approaches mentioned were supported by references. End users were involved in each study to some extent but not necessarily in designing. About 27% (8/30) of all the included studies explicitly mentioned the presence of designers on their team.

CONCLUSIONS

Our results show that some attempts have indeed been made to integrate human-centered design approaches into digital mental health technology development. However, these attempts rely very little on designers and design research. Researchers from other domains and technology developers would be wise to learn the underpinnings of human-centered design methods before selecting one over another. Inviting designers for assistance when implementing a particular approach would also be beneficial. To further motivate interest in and use of human-centered design principles in the world of e-mental health, we make nine suggestions for better reporting of human-centered design approaches in future research.

Digital smartphone intervention to recognise and manage early warning signs in schizophrenia to prevent relapse: the EMPOWER feasibility cluster RCT

BACKGROUND

Relapse is a major determinant of outcome for people with a diagnosis of schizophrenia. Early warning signs frequently precede relapse. A recent Cochrane Review found low-quality evidence to suggest a positive effect of early warning signs interventions on hospitalisation and relapse.

OBJECTIVE

How feasible is a study to investigate the clinical effectiveness and cost-effectiveness of a digital intervention to recognise and promptly manage early warning signs of relapse in schizophrenia with the aim of preventing relapse?

DESIGN

A multicentre, two-arm, parallel-group cluster randomised controlled trial involving eight community mental health services, with 12-month follow-up.

SETTINGS

Glasgow, UK, and Melbourne, Australia.

PARTICIPANTS

Service users were aged > 16 years and had a schizophrenia spectrum disorder with evidence of a relapse within the previous 2 years. Carers were eligible for inclusion if they were nominated by an eligible service user.

INTERVENTIONS

The Early signs Monitoring to Prevent relapse in psychosis and prOmote Wellbeing, Engagement, and Recovery (EMPOWER) intervention was designed to enable participants to monitor changes in their well-being daily using a mobile phone, blended with peer support. Clinical triage of changes in well-being that were suggestive of early signs of relapse was enabled through an algorithm that triggered a check-in prompt that informed a relapse prevention pathway, if warranted.

MAIN OUTCOME MEASURES

The main outcomes were feasibility of the trial and feasibility, acceptability and usability of the intervention, as well as safety and performance. Candidate co-primary outcomes were relapse and fear of relapse.

RESULTS

We recruited 86 service users, of whom 73 were randomised (42 to EMPOWER and 31 to treatment as usual). Primary outcome data were collected for 84% of participants at 12 months. Feasibility data for people using the smartphone application (app) suggested that the app was easy to use and had a positive impact on motivations and intentions in relation to mental health. Actual app usage was high, with 91% of users who completed the baseline period meeting our a priori criterion of acceptable engagement (> 33%). The median time to discontinuation of > 33% app usage was 32 weeks (95% confidence interval 14 weeks to ∞). There were 8 out of 33 (24%) relapses in the EMPOWER arm and 13 out of 28 (46%) in the treatment-as-usual arm. Fewer participants in the EMPOWER arm had a relapse (relative risk 0.50, 95% confidence interval 0.26 to 0.98), and time to first relapse (hazard ratio 0.32, 95% confidence interval 0.14 to 0.74) was longer in the EMPOWER arm than in the treatment-as-usual group. At 12 months, EMPOWER participants were less fearful of having a relapse than those in the treatment-as-usual arm (mean difference -4.29, 95% confidence interval -7.29 to -1.28). EMPOWER was more costly and more effective, resulting in an incremental cost-effectiveness ratio of £3041. This incremental cost-effectiveness ratio would be considered cost-effective when using the National Institute for Health and Care Excellence threshold of £20,000 per quality-adjusted life-year gained.

LIMITATIONS

This was a feasibility study and the outcomes detected cannot be taken as evidence of efficacy or effectiveness.

CONCLUSIONS

A trial of digital technology to monitor early warning signs that blended with peer support and clinical triage to detect and prevent relapse is feasible.

FUTURE WORK

A main trial with a sample size of 500 (assuming 90% power and 20% dropout) would detect a clinically meaningful reduction in relapse (relative risk 0.7) and improvement in other variables (effect sizes 0.3-0.4).

TRIAL REGISTRATION

This trial is registered as ISRCTN99559262.

FUNDING

This project was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 27. See the NIHR Journals Library website for further project information. Funding in Australia was provided by the National Health and Medical Research Council (APP1095879).

Digital technology for addressing cognitive impairment in recent-onset psychosis: A perspective

Cognitive impairments in psychosis negatively impact functional recovery and quality of life. Existing interventions for improving cognitive impairment in recent-onset psychosis show inconsistent treatment efficacy, small effects, suboptimal engagement and limited generalizability to daily life functioning. In this perspective we explore how digital technology has the potential to address these limitations in order to improve cognitive and functional outcomes in recent-onset psychosis. Computer programs can be used for standardized, automated delivery of cognitive remediation training. Virtual reality provides the opportunity for learning and practicing cognitive skills in real-world scenarios within a virtual environment. Smartphone apps could be used for notification reminders for everyday tasks to compensate for cognitive difficulties. Internet-based technologies can offer psychoeducation and training materials for enhancing cognitive skills. Early findings indicate some forms of digital interventions for cognitive enhancement can be effective, with well-established evidence for human-supported computer-based cognitive remediation in recent-onset psychosis. Emerging evidence regarding virtual reality is favorable for improving social cognition. Overall, blending digital interventions with human support improves engagement and effectiveness. Despite the potential of digital interventions for enhancing cognition in recent-onset psychosis, few studies have been conducted to date. Implementation challenges affecting application of digital technologies for cognitive impairment in recent-onset psychosis are sustained engagement, clinical integration, and lack of quality in the commercial marketplace. Future opportunities lie in including motivational frameworks and behavioral change interventions, increasing service engagement in young people and lived experience involvement in digital intervention development.

Pilot Testing in the Wild: Feasibility, Acceptability, Usage Patterns, and Efficacy of an Integrated Web and Smartphone Platform for Bipolar II Disorder

Background

Bipolar II disorder (BD-II) is associated with significant burden, disability, and mortality; however, there continues to be a dearth of evidence-based psychological interventions for this condition. Technology-mediated interventions incorporating self-management have untapped potential to help meet this need as an adjunct to usual clinical care.

Objective

The objective of this pilot study is to assess the feasibility, acceptability, and clinical utility of a novel intervention for BD-II (Tailored Recovery-oriented Intervention for Bipolar II Experiences; TRIBE), in which mindfulness-based psychological content is delivered via an integrated web and smartphone platform. The focus of the study is evaluation of the dynamic use patterns emerging from ecological momentary assessment and intervention to assist the real-world application of mindfulness skills learned from web-delivered modules.

Methods

An open trial design using pretest and posttest assessments with nested qualitative evaluation was used. Individuals (aged 18-65 years) with a diagnosis of BD-II were recruited worldwide and invited to use a prototype of the TRIBE intervention over a 3-week period. Data were collected via web-based questionnaires and phone interviews at baseline and 3-week follow-up.

Results

A total of 25 participants completed baseline and follow-up assessments. Adherence rates (daily app use) were 65.6% across the 3-week study, with up to 88% (22/25) of participants using the app synergistically alongside the web-based program. Despite technical challenges with the prototype intervention (from user, hardware, and software standpoints), acceptability was adequate, and most participants rated the intervention positively in terms of concept (companion app with website: 19/25, 76%), content (19/25, 76%), and credibility and utility in supporting their management of bipolar disorder (17/25, 68%). Evaluation using behavioral archetypes identified important use pathways and a provisional model to inform platform refinement. As hypothesized, depression scores significantly decreased after the intervention (Montgomery-Asberg Depression Rating Scale baseline mean 8.60, SD 6.86, vs follow-up mean 6.16, SD 5.11; t₂₄=2.63; P=.01; Cohen d=0.53, 95% CI 0.52-4.36).

Conclusions

Our findings suggest that TRIBE is feasible and represents an appropriate and acceptable self-management program for patients with BD-II. Preliminary efficacy results are promising and support full development of TRIBE informed by the present behavioral archetype analysis. Modifications suggested by the pilot study include increasing the duration of the intervention and increasing technical support.

Three-arm randomised controlled trial of an m-health app and digital engagement strategy for improving treatment adherence and reducing suicidal ideation in young people: study protocol

INTRODUCTION

Youth suicidal ideation and behaviour is concerning due to its widespread prevalence, morbidity and potentially fatal consequences. Digital mental health interventions have been found to improve access to low-cost and high-quality support for a range of mental health issues, yet there are few digital interventions available for suicide prevention in young people. In addition, no studies have examined how digital engagement strategies may impact the engagement and efficacy of digital interventions in suicide prevention. The current protocol describes a three-arm parallel randomised controlled trial. A therapeutic smartphone application ('LifeBuoy'; intervention condition) will be tested against a condition that consists of the LifeBuoy application plus access to a digital engagement strategy ('LifeBuoy+engagement'; intervention condition) to determine whether the addition of the digital strategy improves app engagement metrics. To establish the efficacy of the LifeBuoy application, both of these intervention conditions will be tested against an attention-matched control condition (a placebo app).

METHODS AND ANALYSIS

669 young Australians aged 17-24 years who have experienced suicidal ideation in the past 30 days will be recruited by Facebook advertisement. The primary outcomes will be suicidal ideation severity and level of app engagement. Primary analyses will use an intention-to-treat approach and compare changes from baseline to 30-day, 60-day and 120-day follow-up time points relative to the control group using mixed-effect modelling. A subset of participants in the intervention groups will be interviewed on their experience with the app and engagement strategy. Qualitative data will be analysed using an inductive approach, independent of a theoretical confirmative method to identify the group themes.

ETHICS AND DISSEMINATION

The study has been approved by the University of New South Wales Human Research Ethics Committee (HC210400). The results of the trial will be disseminated via peer-reviewed publications in scientific journals and conferences.

TRIAL REGISTRATION NUMBER

ACTRN12621001247864.

Chatbots to Support Young Adults’ Mental Health: an Exploratory Study of Acceptability

Despite the prevalence of mental health conditions, stigma, lack of awareness and limited resources impede access to care, creating a need to improve mental health support. The recent surge in scientific and commercial interest in conversational agents and their potential to improve diagnosis and treatment seems a potentially fruitful area in this respect, particularly for young adults who widely use such systems in other contexts. Yet, there is little research that considers the acceptability of conversational agents in mental health. This study, therefore, presents three research activities that explore whether conversational agents and, in particular, chatbots can be an acceptable solution in mental healthcare for young adults. First, a survey of young adults (in a university setting) provides an understanding of the landscape of mental health in this age group and of their views around mental health technology, including chatbots. Second, a literature review synthesises current evidence relating to the acceptability of mental health conversational agents and points to future research priorities. Third, interviews with counsellors who work with young adults, supported by a chatbot prototype and user-centred design techniques, reveal the perceived benefits and potential roles of mental health chatbots from the perspective of mental health professionals, while suggesting preconditions for the acceptability of the technology. Taken together, these research activities: provide evidence that chatbots are an acceptable solution to offering mental health support for young adults; identify specific challenges relating to both the technology and environment; and argue for the application of user-centred approaches during development of mental health chatbots and more systematic and rigorous evaluations of the resulting solutions.

Ownership, Use of, and Interest in Digital Mental Health Technologies Among Clinicians and Young People Across a Spectrum of Clinical Care Needs: Cross-sectional Survey

BACKGROUND

There is currently an increased interest in and acceptance of technology-enabled mental health care. To adequately harness this opportunity, it is critical that the design and development of digital mental health technologies be informed by the needs and preferences of end users. Despite young people and clinicians being the predominant users of such technologies, few studies have examined their perspectives on different digital mental health technologies.

OBJECTIVE

This study aims to understand the technologies that young people have access to and use in their everyday lives and what applications of these technologies they are interested in to support their mental health. The study also explores the technologies that youth mental health clinicians currently use within their practice and what applications of these technologies they are interested in to support their clients' mental health.

METHODS

Youth mental health service users (aged 12-25 years) from both primary and specialist services, young people from the general population (aged 16-25 years), and youth mental health clinicians completed a web-based survey exploring technology ownership, use of, and interest levels in using different digital interventions to support their mental health or that of their clients.

RESULTS

A total of 588 young people and 73 youth mental health clinicians completed the survey. Smartphone ownership or private access among young people within mental health services and the general population was universal (611/617, 99%), with high levels of access to computers and social media. Youth technology use was frequent, with 63.3% (387/611) using smartphones several times an hour. Clinicians reported using smartphones (61/76, 80%) and video chat (69/76, 91%) commonly in clinical practice and found them to be helpful. Approximately 50% (296/609) of the young people used mental health apps, which was significantly less than the clinicians (χ²₃=28.8, n=670; P<.001). Similarly, clinicians were significantly more interested in using technology for mental health support than young people (H₃=55.90; P<.001), with 100% (73/73) of clinicians being at least slightly interested in technology to support mental health compared with 88% (520/591) of young people. Follow-up tests revealed no difference in interest between young people from the general population, primary mental health services, and specialist mental health services (all P>.23). Young people were most interested in web-based self-help, mobile self-help, and blended therapy.

CONCLUSIONS

Technology access is pervasive among young people within and outside of youth mental health services; clinicians are already using technology to support clinical care, and there is widespread interest in digital mental health technologies among these groups of end users. These findings provide important insights into the perspectives of young people and clinicians regarding the value of digital mental health interventions in supporting youth mental health.

A Comparative Utility Score for Digital Health Tools

Digital health tools (DHT) are increasingly poised to change healthcare delivery given the Coronavirus Disease 2019 (COVID-19) pandemic and the drive to telehealth. Establishing the potential utility of a given DHT could aid in identifying how it could be best used and further opportunities for healthcare improvement. We propose a metric, a Utility Factor Score, which quantifies the benefits of a DHT by explicitly defining adherence and linking it directly to satisfaction and health goals met. To provide data for how the comparative utility score can or should work, we illustrate in detail the application of our metrics across four DHTs with two simulated users. The Utility Factor Score can potentially facilitate integration of DHTs into various healthcare settings and should be evaluated within a clinical study.

Delivering Mindfulness-Based Interventions for Insomnia, Pain, and Dysfunctional Eating Through a Text Messaging App: Three Randomized Controlled Trials Investigating the Effectiveness and Mediating Mechanisms

Background

Although text messaging has the potential to be the core intervention modality, it is often used as an adjunct only. To improve health and alleviate the distress related to insomnia, pain, and dysregulated eating of people living in urban areas, text messaging–based mindfulness-based interventions were designed and evaluated in 3 randomized controlled trials.

Objective

This study investigated the effectiveness and mediating mechanisms of text messaging–based mindfulness-based interventions for people with distress related to insomnia, pain, or dysregulated eating.

Methods

In these trials, 333, 235, and 351 participants were recruited online and randomized to intervention and wait-list control conditions for insomnia, pain, and dysregulated eating, respectively. Participants experienced 21 days of intervention through WhatsApp Messenger. Participants completed pre-, post-, 1-month follow-up, and 3-month follow-up self-report questionnaires online. The retention rates at postmeasurements were 83.2% (139/167), 77.1% (91/118), and 72.9% (129/177) for intervention groups of insomnia, pain, and dysregulated eating, respectively. Participants’ queries were answered by a study technician. Primary outcomes included insomnia severity, presleep arousal, pain intensity, pain acceptance, and eating behaviors. Secondary outcomes included mindfulness, depression, anxiety, mental well-being, and functional impairments. Mindfulness, dysfunctional beliefs and attitudes about sleep, pain catastrophizing, and reactivity to food cues were hypothesized to mediate the relationship between the intervention and outcomes.

Results

For all 3 studies, the intervention groups showed significant improvement on most outcomes at 1-month follow-up compared to their respective wait-list control groups; some primary outcomes (eg, insomnia, pain, dysregulated eating indicators) and secondary outcomes (eg, depression, anxiety symptoms) were sustained at 3-month follow-up. Medium-to-large effect sizes were found at postassessments in most outcomes in all studies. In the intervention for insomnia, mediation analyses showed that dysfunctional beliefs and attitudes about sleep mediated the effect of the intervention on all primary outcomes and most secondary outcomes at both 1-month and 3-month follow-ups, whereas mindfulness mediated the intervention effect on presleep arousal at 1-month and 3-month follow-ups. In the intervention for pain, pain catastrophizing mediated the effect of intervention on pain intensity and functioning at both 1-month and 3-month follow-ups, whereas mindfulness only mediated the effect of intervention on anxiety and depressive symptoms. In the intervention for dysregulated eating, power of food mediated the effect of intervention on both uncontrolled and emotional eating at both 1-month and 3-month follow-ups and mindfulness was found to mediate the effect on depressive symptoms at both 1-month and 3-month follow-ups.

Conclusions

These 3 studies converged and provided empirical evidence that mindfulness-based interventions delivered through text messaging are effective in improving distress related to sleep, pain, and dysregulated eating. Text messaging has the potential to be a core intervention modality to improve various common health outcomes for people living a fast-paced lifestyle.

Trial Registration

Clinical Research and Biostatistics Clinical Trials Registry CUHK_CCRB00559; https://tinyurl.com/24rkwarz

Engagement, Predictors, and Outcomes of a Trauma Recovery Digital Mental Health Intervention: Longitudinal Study

BACKGROUND

Worldwide, exposure to potentially traumatic events is extremely common, and many individuals develop posttraumatic stress disorder (PTSD) along with other disorders. Unfortunately, considerable barriers to treatment exist. A promising approach to overcoming treatment barriers is a digital mental health intervention (DMHI). However, engagement with DMHIs is a concern, and theoretically based research in this area is sparse and often inconclusive.

OBJECTIVE

The focus of this study is on the complex issue of DMHI engagement. On the basis of the social cognitive theory framework, the conceptualization of engagement and a theoretically based model of predictors and outcomes were investigated using a DMHI for trauma recovery.

METHODS

A 6-week longitudinal study with a national sample of survivors of trauma was conducted to measure engagement, predictors of engagement, and mediational pathways to symptom reduction while using a trauma recovery DMHI (time 1: N=915; time 2: N=350; time 3: N=168; and time 4: N=101).

RESULTS

Confirmatory factor analysis of the engagement latent constructs of duration, frequency, interest, attention, and affect produced an acceptable model fit (χ²₂=8.3; P=.02; comparative fit index 0.973; root mean square error of approximation 0.059; 90% CI 0.022-0.103). Using the latent construct, the longitudinal theoretical model demonstrated adequate model fit (comparative fit index 0.929; root mean square error of approximation 0.052; 90% CI 0.040-0.064), indicating that engagement self-efficacy (β=.35; P<.001) and outcome expectations (β=.37; P<.001) were significant predictors of engagement (R²=39%). The overall indirect effect between engagement and PTSD symptom reduction was significant (β=-.065; P<.001; 90% CI -0.071 to -0.058). This relationship was serially mediated by both skill activation self-efficacy (β=.80; P<.001) and trauma coping self-efficacy (β=.40; P<.001), which predicted a reduction in PTSD symptoms (β=-.20; P=.02).

CONCLUSIONS

The results of this study may provide a solid foundation for formalizing the nascent science of engagement. Engagement conceptualization comprised general measures of attention, interest, affect, and use that could be applied to other applications. The longitudinal research model supported 2 theoretically based predictors of engagement: engagement self-efficacy and outcome expectancies. A total of 2 task-specific self-efficacies-skill activation and trauma coping-proved to be significant mediators between engagement and symptom reduction. Taken together, this model can be applied to other DMHIs to understand engagement, as well as predictors and mechanisms of action. Ultimately, this could help improve the design and development of engaging and effective trauma recovery DMHIs.

The Stop-tabac smartphone application for smoking cessation: a randomized controlled trial

AIMS

To test whether the Stop-tabac smartphone application (app) increased smoking cessation rates.

DESIGN

A two-arm, parallel-group, individually randomized, double-blind, controlled trial.

SETTING AND PARTICIPANTS

A total of 5293 daily smokers (Stop-tabac = 2639, control = 2654) enrolled on app stores and on the internet in 2019-20, who lived in France or Switzerland.

INTERVENTION AND COMPARATOR

The Stop-tabac application includes immediate feedback during episodes of craving and withdrawal; individually tailored counseling messages with notifications sent during 6 months; a discussion forum; fact sheets; modules on nicotine replacement therapy and e-cigarettes; and calculators of cigarettes not smoked, money saved and days of life gained since quitting. The control application included five brief pages and calculators as above.

MEASUREMENTS

Primary outcome: self-reported smoking cessation after 6 months (no puff of tobacco in the past 4 weeks), with non-responders counted as smokers.

SECONDARY OUTCOME

self-reported use of nicotine medications.

FINDINGS

Participants were aged 36 years on average; 66% were women who smoked 15 cigarettes/day, and 64% screened positive for depression. Stop-tabac participants used the app over a longer period than control participants (23 versus 11 days, P < 0.001). Smoking cessation rates after 6 months were 9.9% in the Stop-tabac group versus 10.3% in the control group (odds ratio = 0.96, 95% confidence interval = 0.80-1.45, P = 0.63). Rates of use of nicotine medications after entry in the study were 38 versus 30% after 6 months (χ²  = 8.3, P = 0.004) in the Stop-tabac and control groups. After 6 months, 26% of participants in the Stop-tabac group and 8% in the control group said that the app helped them 'a lot' or 'enormously' to quit smoking (χ²  =  113, P < 0.001).

CONCLUSIONS

In smokers enrolled on the app stores and the internet, allocation to the Stop-tabac smoking cessation app did not increase smoking cessation rates, but increased rates of use of nicotine medications.

Evaluation Methods Applied to Digital Health Interventions: What Is Being Used beyond Randomised Controlled Trials?-A Scoping Review

Despite the potential of digital health interventions (DHIs), evaluations of their effectiveness face challenges. DHIs are complex interventions and currently established evaluation methods, e.g., the randomised controlled trial (RCT), are limited in their application. This study aimed at identifying alternatives to RCTs as potentially more appropriate evaluation approaches. A scoping review was conducted to provide an overview of existing evaluation methods of DHIs beyond the RCT. Cochrane Central Register of Controlled Trials, MEDLINE, Web of Science, and EMBASE were screened in May 2021 to identify relevant publications, while using defined inclusion and exclusion criteria. Eight studies were extracted for a synthesis comprising four alternative evaluation designs. Factorial designs were mostly used to evaluate DHIs followed by stepped-wedge designs, sequential multiple assignment randomised trials (SMARTs), and micro randomised trials (MRTs). Some of these methods allow for the adaptation of interventions (e.g., SMART or MRT) and the evaluation of specific components of interventions (e.g., factorial designs). Thus, they are appropriate for addressing some specific needs in the evaluation of DHIs. However, it remains unsolved how to establish these alternative evaluation designs in research practice and how to deal with the limitations of the designs.

Applying Collective Intelligence in Health Recommender Systems for Smoking Cessation: A Comparison Trial

Background: Health recommender systems (HRSs) are intelligent systems that can be used to tailor digital health interventions. We compared two HRSs to assess their impact providing smoking cessation support messages. Methods: Smokers who downloaded a mobile app to support smoking abstinence were randomly assigned to two interventions. They received personalized, ratable motivational messages on the app. The first intervention had a knowledge-based HRS (n = 181): it selected random messages from a subset matching the users’ demographics and smoking habits. The second intervention had a hybrid HRS using collective intelligence (n = 190): it selected messages applying the knowledge-based filter first, and then chose the ones with higher ratings provided by other similar users in the system. Both interventions were compared on: (a) message appreciation, (b) engagement with the system, and (c) one’s own self-reported smoking cessation status, as indicated by the last seven-day point prevalence report in different time intervals during a period of six months. Results: Both interventions had similar message appreciation, number of rated messages, and abstinence results. The knowledge-based HRS achieved a significantly higher number of active days, number of abstinence reports, and better abstinence results. The hybrid algorithm led to more quitting attempts in participants who completed their user profiles.

Predicting Uptake of the COVID Coach App Among US Military Veterans: Funnel Analysis Using a Probability-Based Panel

BACKGROUND

Although the COVID-19 pandemic has not led to a uniform increase of mental health concerns among older adults, there is evidence to suggest that some older veterans did experience an exacerbation of preexisting mental health conditions, and that mental health difficulties were associated with a lack of social support and increasing numbers of pandemic-related stressors. Mobile mental health apps are scalable, may be a helpful resource for managing stress during the pandemic and beyond, and could potentially provide services that are not accessible due to the pandemic. However, overall comfort with mobile devices and factors influencing the uptake and usage of mobile apps during the pandemic among older veterans are not well known. COVID Coach is a free, evidence-informed mobile app designed for pandemic-related stress. Public usage data have been evaluated; however, the uptake and usage of the app among older veterans have not been explored.

OBJECTIVE

The purpose of this study was to characterize smartphone ownership rates among US veterans, identify veteran characteristics associated with downloading and use of COVID Coach, and characterize key content usage within the app.

METHODS

Data were analyzed from the 2019-2020 National Health and Resilience in Veterans Study (NHRVS), which surveyed a nationally representative, prospective cohort of 3078 US military veterans before and 1 year into the pandemic. The NHRVS sample was drawn from KnowledgePanel, a research panel of more than 50,000 households maintained by Ipsos, Inc. The median time to complete the survey was nearly 32 minutes. The research version of COVID Coach was offered to all veterans who completed the peripandemic follow-up assessment on a mobile device (n=814; weighted 34.2% of total sample). App usage data from all respondents who downloaded the app (n=34; weighted 3.3% of the mobile completers sample) were collected between November 14, 2020, and November 7, 2021.

RESULTS

We found that most US veterans (81.5%) own smartphones, and that veterans with higher education, greater number of adverse childhood experiences, higher extraversion, and greater severity of pandemic-related posttraumatic stress disorder symptoms were more likely to download COVID Coach. Although uptake and usage of COVID Coach were relatively low (3.3% of eligible participants, n=34), 50% of the participants returned to the app for more than 1 day of use. The interactive tools for managing stress were used most frequently.

CONCLUSIONS

The COVID-19 pandemic has increased the need for and creation of digital mental health tools. However, these resources may require tailoring for older veteran populations. Future research is needed to better understand how to optimize digital mental health tools such as apps to ensure uptake and usage among older adults, particularly those who have experienced traumas across the lifespan.

Process and Outcome Evaluations of Smartphone Apps for Bipolar Disorder: Scoping Review

Background

Mental health apps (MHAs) provide opportunities for accessible, immediate, and innovative approaches to better understand and support the treatment of mental health disorders, especially those with a high burden, such as bipolar disorder (BD). Many MHAs have been developed, but few have had their effectiveness evaluated.

Objective

This systematic scoping review explores current process and outcome measures of MHAs for BD with the aim to provide a comprehensive overview of current research. This will identify the best practice for evaluating MHAs for BD and inform future studies.

Methods

A systematic literature search of the health science databases PsycINFO, MEDLINE, Embase, EBSCO, Scopus, and Web of Science was undertaken up to January 2021 (with no start date) to narratively assess how studies had evaluated MHAs for BD.

Results

Of 4051 original search results, 12 articles were included. These 12 studies included 435 participants, and of these, 343 had BD type I or II. Moreover, 11 of the 12 studies provided the ages (mean 37 years) of the participants. One study did not report age data. The male to female ratio of the 343 participants was 137:206. The most widely employed validated outcome measure was the Young Mania Rating Scale, being used 8 times. The Hamilton Depression Rating Scale-17/Hamilton Depression Rating Scale was used thrice; the Altman Self-Rating Mania Scale, Quick Inventory of Depressive Symptomatology, and Functional Assessment Staging Test were used twice; and the Coping Inventory for Stressful Situations, EuroQoL 5-Dimension Health Questionnaire, Generalized Anxiety Disorder Scale-7, Inventory of Depressive Symptomatology, Mindfulness Attention Awareness Scale, Major Depression Index, Morisky-Green 8-item, Perceived Stress Scale, and World Health Organization Quality of Life-BREF were used once. Self-report measures were captured in 9 different studies, 6 of which used MONARCA. Mood and energy levels were the most commonly used self-report measures, being used 4 times each. Furthermore, 11 of the 12 studies discussed the various confounding factors and barriers to the use of MHAs for BD.

Conclusions

Reported low adherence rates, usability challenges, and privacy concerns act as barriers to the use of MHAs for BD. Moreover, as MHA evaluation is itself developing, guidance for clinicians in how to aid patient choices in mobile health needs to develop. These obstacles could be ameliorated by incorporating co-production and co-design using participatory patient approaches during the development and evaluation stages of MHAs for BD. Further, including qualitative aspects in trials that examine patient experience of both mental ill health and the MHA itself could result in a more patient-friendly fit-for-purpose MHA for BD.

Improving Access to Behavioral Strategies to Improve Mental Well-being With an Entertaining Breakfast Show App: Feasibility Evaluation Study

Background

Although mental ill-health is more prevalent among people from lower socioeconomic groups, digital mental well-being innovations are often developed for people from higher socioeconomic groups, who already have resources to maintain good mental and physical health. To decrease health inequalities and ensure that available solutions are appealing and accessible to people with fewer resources, new approaches should be explored. We developed the app Wakey!, which focused on creating engaging mental health content that is accessible, particularly among lower socioeconomic groups in the United Kingdom.

Objective

The aim of this study is to assess engagement with the app, investigate initial effectiveness data for 6 well-being outcomes, and explore participants’ subjective experiences of using Wakey!

Methods

The app Wakey! was publicly launched on January 20, 2020, and was free to download from Apple Store and Google Play. The app provided its users with entertaining and educational content related to mental well-being. Concurrently, a single-arm mixed methods feasibility trial was carried out from January to April 2020 among people who had downloaded the app and created an account. The primary outcome was engagement, which was collected passively from data logs. Secondary outcome measures were 6 well-being outcomes collected from self-report questionnaires. Individual interviews with 19 app users were carried out in April 2020.

Results

In total, 5413 people fit the inclusion criteria and were included in the final sample—65.62% (3520/5364) women, 61.07% (3286/5381) aged between 25 and 44 years, 61.61% (2902/4710) in employment, 8.92% (420/4710) belonging to the lower socioeconomic group, and 8.09% (438/5413) were engaged users. There was no evidence of a difference in engagement regarding sociodemographic and socioeconomic characteristics. There was evidence that users with a higher average daily sleep score, who joined the study more recently, who had higher baseline self-report of sleep quality, and who found episodes more entertaining were more likely to be engaged users. Among 230 users who provided follow-up data, there was evidence of improvements on four of the six well-being outcomes: life satisfaction (P<.001), feeling that life is worthwhile (P=.01), ease of getting up in the morning (P<.001), and self-efficacy (P=.04). The app and its content were well received by those who were interviewed, and several people perceived a positive change in their mental well-being.

Conclusions

This study shows that the app Wakey! could potentially be engaging across different socioeconomic groups, and there is an indication that it could positively impact the mental well-being of those engaged with the app. However, this study was a pragmatic trial with a limited sample, and the selection bias was present in the qualitative and quantitative study. Further work is needed to make any generalizable conclusions.

Trial Registration

ClinicalTrials.gov NCT04287296; https://clinicaltrials.gov/ct2/show/NCT04287296

Understanding client engagement in digital mental health interventions: An investigation of the eTherapy Attitudes and Process Questionnaire

Aims

Digital mental health services may increase the accessibility and affordability of mental health treatments. However, client dropout a low use is often reported. The purpose of the current study was to investigate the structural validity of the e‐Therapy Attitudes and Process (eTAP) questionnaire, as a theoretically based (theory of planned behavior) tool for understanding ongoing client engagement intentions with digital mental health treatments. The possible role of eHealth literacy in predicting behavioral intentions to use digital mental health treatments was also examined.

Methods

Participants were 244 Australian‐based adults aged between 18 and 56 years, who were currently using a digital mental health tool. Data were collected via online survey.

Results

Confirmatory Factor Analysis was conducted, with good model fit obtained following two theoretically supported modifications. Moderated hierarchical regression supported the utility of the theory of planned behavior in predicting behavioral intentions, with attitudes emerging as a strong and consistent individual predictor. No support was found for the moderating role or individual significance of eHealth literacy.

Conclusions

These findings support the clinical and research use of the eTAP as a theory‐based measure to understand client engagement in digital mental health interventions. The study also highlights the need for interventions to target attitudes to improve clients' ongoing engagement in digital mental health.

Willingness, perceived barriers and motivators in adopting mobile applications for health-related interventions among older adults: a scoping review

OBJECTIVES

This scoping review aims to identify the level of willingness, the existing barriers, and motivators among older adults in using mobile applications to monitor and manage their health conditions. The secondary aim of this paper is to categorise these willingness, barriers and motivators using the Theoretical Domains Framework (TDF).

DESIGN

Scoping review.

DATA SOURCE

PubMed, Embase, CINAHL, Cochrane Library, Google Scholar and Science Direct (January 2009-December 2020).

STUDY SELECTION

Studies that describe older adults' perspectives with regard to their willingness, barriers or motivators towards the use of mobile applications in monitoring and managing their health condition were included.

DATA EXTRACTION

Titles and abstracts were initially screened by two reviewers. Articles agreed by both reviewers were proceeded to full-text screening. One reviewer extracted the data, which were verified by a second reviewer. Findings were further classified according to the 14 TDF domains by two researchers.

RESULTS

Six studies were included in the final scoping review. Barriers to adopting mobile applications for health-related interventions among older adults were the most common topic identified in the included studies. Barriers included being unaware of the existence of mobile health applications, lack of technological skills, lack of perceived ability and time, absence of professional involvements, and violation of trust and privacy. With regard to willingness, older adults are willing to use mobile applications if the apps incorporated features from a trusted source and have valid credentials. Motivators included continuous improvements of mobile applications' design interface and personalised features tailored to older adults' needs.

CONCLUSIONS

With the constant research for more diversified technology, the development of mobile applications to help older adults to manage and monitor health is seen as feasible, but barriers have to be addressed. The most prominent barriers linked to TDF domains were: (1) technological skills, (2) belief about consequences, and (3) memory, attention and decision process. Future interventions should use behaviour change techniques that target these three TDF domains in order to improve the ability to engage older adults with mobile technology.

PROTOCOL: Mobile apps to reduce depressive symptoms and alcohol use in youth: A systematic review and meta-analysis

Background

Depressive symptoms and alcohol use in youth doubled in the first year of the COVID-19 pandemic. The COVID-19 pandemic has created sustained disruption in society, schools, and universities, including increasing poverty and discrimination. Public health restrictions have caused isolation and reduced social and emotional support. Together, these factors make depressive symptoms and alcohol use in youth a global public health emergency. Mobile applications (apps) have emerged as potentially scalable intervention to reduce depressive symptoms and alcohol use in youth that could meet increased demands for mental health resources. Mobile apps may potentially reduce psychological distress with accessible technology-based mental health resources.

Objectives

This systematic review and meta-analysis aims to assess the effect of mobile apps on depressive symptoms and alcohol use in youth.

Search Methods

We will develop a systematic search strategy in collaboration with an experienced librarian. We will search a series of databases (MEDLINE, Embase, PsycINFO, CINAHL, CENTRAL) from January 2008 to July 2021.

Selection Criteria

Following the PRISMA reporting guidelines for systematic reviews, two independent reviewers will identify eligible studies: randomized controlled trials on mobile apps for the management of depressive disorders (depression and anxiety) and alcohol use in youth aged 15-24 years of age.

Data Collection and Analysis

Eligible studies will be assessed for risk of bias, and outcomes pooled, when appropriate, for meta-analysis. Heterogeneity, if present, will be examined for gender. ethnicity, and socioeconomic status contributions. A narrative synthesis will highlight similarities and differences between the included studies. We will report GRADE summary of finding tables.

Participatory Design of a Mobile App to Safeguard Mental Resilience in the Context of Drug Use in Young Adults: Multi-Method Study

Background

Existing mental health apps are largely not aimed at generally healthy young people who may be experimenting with addictive substances and mind-altering experiences.

Objective

The aim of this study is to examine the interest and expectations of young people regarding a proposed smartphone app designed to help protect and promote mental health and resilience in the face of risks associated with substance use.

Methods

The study was based on agile system development and had 3 empirical substudies. Our feasibility study (study 1) included an anonymous questionnaire that examined the potential interest of young people in this type of app. It was answered by 339 Israelis aged 18-30 years. The second part of the feasibility study was a pilot study with 1.2% (4/339) of the people who answered the questionnaire and expressed interest in participating in a focus group. They tested and refined the elements planned for the focus groups. Study 2 was a participatory design study involving 7 focus groups of 5 to 7 participants each (young people aged 18-35 years, n=38). Persona development, open discussion, and a Technology Acceptance Model questionnaire were used to elicit user expectations and requirements for the app and to understand the perceived usefulness and usability of the proposed features. Study 3 comprised in-depth interviews with experts in the field of youth mental health and drug use to enlist their professional opinion regarding the value of such an app and recommendations about the features it should include.

Results

The mock-up for the proposed app had five key features: personalized assessment of risk for a drug-associated mental crisis, support for self-monitoring, useful information (eg, warning signs and first-aid guidelines), resilience-building exercises, and a support center. Participants rated highly the usefulness of all 5 main features and 96% (24/25) of the specific features we proposed within those main categories. The participants also suggested additional features as well as a new user persona we had not considered: the parents or family members of the young person. The focus groups rated highly the perceived usability of the app. Most of the experts saw value in all the main features and suggested specific knowledge sources for the app’s content. Finally, participants of both the feasibility study and the participatory design study expressed moderate to high interest in using the app for self-help and high interest in using the app to help friends.

Conclusions

The findings provide preliminary encouraging support for the 5 main features suggested by the research team and reinforce recommendations for mobile health apps found in the literature. The findings emphasize the insight that this kind of app should be designed primarily for use by individuals seeking to help others.

A Systematic and Comparative Review of Behavior Change Strategies in Stress Management Apps: Opportunities for Improvement

Stress is one of the significant triggers of several physiological and psychological illnesses. Mobile health apps have been used to deliver various stress management interventions and coping strategies over the years. However, little work exists on persuasive strategies employed in stress management apps to promote behavior change. To address this gap, we review 150 stress management apps on both Google Play and Apple's App Store in three stages. First, we deconstruct and compare the persuasive/behavior change strategies operationalized in the apps using the Persuasive Systems Design (PSD) framework and Cialdini's Principles of Persuasion. Our results show that the most frequently employed strategies are personalization, followed by self-monitoring, and trustworthiness, while social support strategies such as competition, cooperation and social comparison are the least employed. Second, we compare our findings within the stress management domain with those from other mental health domains to uncover further insights. Finally, we reflect on our findings and offer eight design recommendations to improve the effectiveness of stress management apps and foster future research.

Human-Computer Interaction in Digital Mental Health

Human-computer interaction (HCI) has contributed to the design and development of some efficient, user-friendly, cost-effective, and adaptable digital mental health solutions. But HCI has not been well-combined into technological developments resulting in quality and safety concerns. Digital platforms and artificial intelligence (AI) have a good potential to improve prediction, identification, coordination, and treatment by mental health care and suicide prevention services. AI is driving web-based and smartphone apps; mostly it is used for self-help and guided cognitive behavioral therapy (CBT) for anxiety and depression. Interactive AI may help real-time screening and treatment in outdated, strained or lacking mental healthcare systems. The barriers for using AI in mental healthcare include accessibility, efficacy, reliability, usability, safety, security, ethics, suitable education and training, and socio-cultural adaptability. Apps, real-time machine learning algorithms, immersive technologies, and digital phenotyping are notable prospects. Generally, there is a need for faster and better human factors in combination with machine interaction and automation, higher levels of effectiveness evaluation and the application of blended, hybrid or stepped care in an adjunct approach. HCI modeling may assist in the design and development of usable applications, and to effectively recognize, acknowledge, and address the inequities of mental health care and suicide prevention and assist in the digital therapeutic alliance.

Digital Companion Choice to Support Teachers' Stress Self-management: Systematic Approach Through Taxonomy Creation

BACKGROUND

There are thousands of digital companions designed for emotional well-being and stress, including websites, wearables, and smartphone apps. Although public evaluation frameworks and ratings exist, they do not facilitate digital companion choice based on contextual or individual information, such as occupation or personal management strategies.

OBJECTIVE

The aim of this study is to establish a process for creating a taxonomy to support systematic choice of digital companions for teachers' stress self-management.

METHODS

We used a 4-step study design. In step 1, we identified the dimension of stress self-management and strategic classifications. In step 2, we identified the dimension of the digital techniques and conceptual descriptions. In step 3, we created 6 criteria for the inclusion of digital companions. In step 4, we used the taxonomy framework created by steps 1 and 2 and populated it with digital companions for stress self-management, as identified in step 3.

RESULTS

First, in the dimension of stress self-management, we identified four classes of strategies: educational, physiological, cognitive, and social. Second, in the digital techniques dimension, we derived four conceptual descriptions for the digital companions' mechanisms of action: fostering reflection, suggesting treatment, peer-to-peer support, and entertainment. Third, we created six criteria for digital companion inclusion in the taxonomy: suitability, availability, evaluation, security, validity, and cost. Using the taxonomy framework and criteria, we populated it with digital companions for stress management ahead of presentation to teachers in a stress study workshop.

CONCLUSIONS

The elements of our approach can be generalized as principles for the creation of taxonomies for other occupations or conditions. Taxonomies such as this could be a valuable resource for individuals to understand which digital companion could be of help in their personal context.

A self-guided and monitored digital problem-solving intervention for patients with symptoms of depression or anxiety on the waiting list for treatment in routine psychiatric care: feasibility study

BACKGROUND

There is often a waiting period for people who seek psychiatric treatment for depression or anxiety. As this delay risks worsening symptoms, an alternative could be to provide an intervention that requires minimal resources during the waiting period.

AIMS

The aim was to investigate if a digital problem-solving intervention delivered in a self-guided format with automated features is feasible to provide for patients on the waiting list in routine psychiatric care.

METHOD

A total of 12 patients with symptoms of depression or anxiety on the waiting list for treatment in routine psychiatric care were given access to a self-guided and monitored digital problem-solving intervention over 4 weeks. Primary outcome measures were treatment credibility and usability. Secondary outcome measures were behavioural engagement, symptoms of depression and anxiety, and negative effects.

RESULTS

A majority of participants rated the intervention as both credible and usable. The intervention was used at least once by nine out of 12 individuals, with an average of 11 logins. The participants did, on average, initiate 2.8 problem-solving attempts and 10.1 solutions. A few participants reached a clinically relevant symptom improvement of depression and anxiety. No serious negative effects were reported.

CONCLUSIONS

The credibility and usability of the intervention was perceived as good, and the behavioural engagement with the intervention was deemed sufficient compared with similar self-guided interventions. A self-guided and monitored digital problem-solving intervention may be a beneficial option for patients waiting for or receiving treatment in routine psychiatric care, and should be further evaluated.

Characteristics of Mobile Health Platforms for Depression and Anxiety: Content Analysis Through a Systematic Review of the Literature and Systematic Search of Two App Stores

Background

Mobile health (mHealth) platforms show promise in the management of mental health conditions such as anxiety and depression. This has resulted in an abundance of mHealth platforms available for research or commercial use.

Objective

The objective of this review is to characterize the current state of mHealth platforms designed for anxiety or depression that are available for research, commercial use, or both.

Methods

A systematic review was conducted using a two-pronged approach: searching relevant literature with prespecified search terms to identify platforms in published research and simultaneously searching 2 major app stores—Google Play Store and Apple App Store—to identify commercially available platforms. Key characteristics of the mHealth platforms were synthesized, such as platform name, targeted condition, targeted group, purpose, technology type, intervention type, commercial availability, and regulatory information.

Results

The literature and app store searches yielded 169 and 179 mHealth platforms, respectively. Most platforms developed for research purposes were designed for depression (116/169, 68.6%), whereas the app store search reported a higher number of platforms developed for anxiety (Android: 58/179, 32.4%; iOS: 27/179, 15.1%). The most common purpose of platforms in both searches was treatment (literature search: 122/169, 72.2%; app store search: 129/179, 72.1%). With regard to the types of intervention, cognitive behavioral therapy and referral to care or counseling emerged as the most popular options offered by the platforms identified in the literature and app store searches, respectively. Most platforms from both searches did not have a specific target age group. In addition, most platforms found in app stores lacked clinical and real-world evidence, and a small number of platforms found in the published research were available commercially.

Conclusions

A considerable number of mHealth platforms designed for anxiety or depression are available for research, commercial use, or both. The characteristics of these mHealth platforms greatly vary. Future efforts should focus on assessing the quality—utility, safety, and effectiveness—of the existing platforms and providing developers, from both commercial and research sectors, a reporting guideline for their platform description and a regulatory framework to facilitate the development, validation, and deployment of effective mHealth platforms.

Real-world Implementation of a Smartphone-Based Psychoeducation Program for Bipolar Disorder: Observational Ecological Study

BACKGROUND

SIMPLe is an internet-delivered self-management mobile app for bipolar disorder (BD) designed to combine technology with evidence-based interventions and facilitate access to psychoeducational content. The SIMPLe app was launched to the real world to make it available worldwide within the context of BD treatment.

OBJECTIVE

The main aims of this study are as follows: to describe app use, engagement, and retention rates based on server data; to identify patterns of user retention over the first 6-month follow-up of use; and to explore potential factors contributing to discontinuation of app use.

METHODS

This was an observational ecological study in which we pooled available data from a real-world implementation of the SIMPLe app. Participation was open on the project website, and the data-collection sources were a web-based questionnaire on clinical data and treatment history administered at inclusion and at 6 months, subjective data gathered through continuous app use, and the use patterns captured by the app server. Characteristics and engagement of regular users, occasional users, and no users were compared using 2-tailed t tests or analysis of variance or their nonparametric equivalent. Survival analysis and risk functions were applied to regular users' data to examine and compare use and user retention. In addition, a user evaluation analysis was performed based on satisfaction, perceived usefulness, and reasons to discontinue app use.

RESULTS

We included 503 participants with data collected between 2016 and 2018, of whom 77.5% (n=390) used the app. Among the app users, 44.4% (173/390) completed the follow-up assessment, and data from these participants were used in our analyses. Engagement declined gradually over the first 6 months of use. The probability of retention of the regular users after 1 month of app use was 67.4% (263/390; 95% CI 62.7%-72.4%). Age (P=.002), time passed since illness onset (P<.001), and years since diagnosis of BD (P=.048) correlate with retention duration. In addition, participants who had been diagnosed with BD for longer used the app on more days (mean 97.73, SD 69.15 days; P=.002) than those who had had a more recent onset (mean 66.49, SD 66.18 days; P=.002) or those who had been diagnosed more recently (mean 73.45, SD 66 days; P=.01).

CONCLUSIONS

The user retention rate of the app decreased rapidly after each month until reaching only one-third of the users at 6 months. There exists a strong association between age and app engagement of individuals with BD. Other variables such as years lived with BD, diagnosis of an anxiety disorder, and taking antipsychotics seem relevant as well. Understanding these associations can help in the definition of the most suitable user profiles for predicting trends of engagement, optimization of app prescription, and management.

An overview of and recommendations for more accessible digital mental health services

Mental health concerns are common, and various evidence-based interventions for mental health conditions have been developed. However, many people have difficulty accessing appropriate mental health care and this has been exacerbated by the COVID-19 pandemic. Digital mental health services, such as those delivered by mobile phone or web-based platforms, offer the possibility of expanding the reach and accessibility of mental health care. To achieve this goal, digital mental health interventions and plans for their implementation must be designed with the end users in mind. In this Review, we describe the evidence base for digital mental health interventions across various diagnoses and treatment targets. Then, we explain the different formats for digital mental health intervention delivery, and offer considerations for their use across key age groups. We discuss the role that the COVID-19 pandemic has played in emphasizing the value of these interventions, and offer considerations for ensuring equity in access to digital mental health interventions among diverse populations. As healthcare providers continue to embrace the role that technology can play in broadening access to care, the design and implementation of digital mental healthcare solutions must be carefully considered to maximize their effectiveness and accessibility.

Designing and scaling up integrated youth mental health care

Mental ill-health represents the main threat to the health, survival and future potential of young people around the world. There are indications that this is a rising tide of vulnerability and need for care, a trend that has been augmented by the COVID-19 pandemic. It represents a global public health crisis, which not only demands a deep and sophisticated understanding of possible targets for prevention, but also urgent reform and investment in the provision of developmentally appropriate clinical care. Despite having the greatest level of need, and potential to benefit, adolescents and emerging adults have the worst access to timely and quality mental health care. How is this global crisis to be addressed? Since the start of the century, a range of co-designed youth mental health strategies and innovations have emerged. These range from digital platforms, through to new models of primary care to new services for potentially severe mental illness, which must be locally adapted according to the availability of resources, workforce, cultural factors and health financing patterns. The fulcrum of this progress is the advent of broad-spectrum, integrated primary youth mental health care services. They represent a blueprint and beach-head for an overdue global system reform. While resources will vary across settings, the mental health needs of young people are largely universal, and underpin a set of fundamental principles and design features. These include establishing an accessible, "soft entry" youth primary care platform with digital support, where young people are valued and essential partners in the design, operation, management and evaluation of the service. Global progress achieved to date in implementing integrated youth mental health care has highlighted that these services are being accessed by young people with genuine and substantial mental health needs, that they are benefiting from them, and that both these young people and their families are highly satisfied with the services they receive. However, we are still at base camp and these primary care platforms need to be scaled up across the globe, complemented by prevention, digital platforms and, crucially, more specialized care for complex and persistent conditions, aligned to this transitional age range (from approximately 12 to 25 years). The rising tide of mental ill-health in young people globally demands that this focus be elevated to a top priority in global health.