The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review

Feasibility and Engagement of a Mobile App Preparation Program (Kwit) for Smoking Cessation in an Ecological Context: Quantitative Study

BACKGROUND

Mobile health apps can facilitate access to effective treatment and therapeutic information services. However, the real-world effectiveness of mobile apps for smoking cessation and their potential impact in everyday settings remain unclear.

OBJECTIVE

In an ecological context, this study aimed to estimate the engagement rate of a mobile app-based smoking cessation preparation program and its potential impact on users' willingness, ability, and readiness to quit smoking.

METHODS

A total of 2331 "organic users" (ie, users who discover and install a mobile app on their own, without any prompts) chose 1 of 2 program versions of the mobile app (Kwit): the basic version or the premium version. Both versions were identical in design, with 4 more evidence-based content items and strategies in the premium version. Outcomes were analyzed based on automated data registered in the app (engagement rate, motivation to quit, motivation type, motivation levels, and satisfaction level). Mann-Whitney and χ2 tests were used to compare the results of both groups.

RESULTS

As expected, in the ecological context, a high dropout rate was observed at different moments. A significant difference was observed between the 2 versions (n=2331; χ21=5.4; P=.02), with a proportionally higher engagement rate in the premium version (premium=4.7% vs basic=2%). Likewise, differences were also observed between the 2 groups in terms of reasons to quit (n=2331; χ24=19; P≤.001; V=0.08), motivation type (n=2331; χ27=14.7; P=.04), and motivation level. Users of the app's premium version more frequently reported "well-being" (23.3% vs 17.9%) and "planning a pregnancy" (7.4% vs 4.4%) as their primary reasons for quitting smoking compared to those with the basic version. Moreover, they reported being more likely to be driven in the smoking cessation process by intrinsic motivation (premium=28% vs basic=20.4%), as well as feeling significantly more willing (z score=156,055; P≤.001; Cohen d=0.15), able (z score=172,905; P=.04; Cohen d=0.09), and ready (z score=166,390; P=.005; Cohen d=0.12) to stop smoking than users who had the basic version before completion of the preparation program. Among participants who finished each version of the program (premium: 9/189, 4.8%; basic: 47/2142, 2.19%), significant improvements in motivation levels were observed in both groups, although in different areas for each group (willingness levels for the premium group and ability for the basic group).

CONCLUSIONS

These results suggest that even in ecological contexts where engagement rates are meager, the Kwit preparation program can address ambivalence by increasing willingness to change, self-confidence, and readiness to quit among its users, especially those who feel less able to do so. Further development and evaluations are needed to better understand determinants for regular mobile health apps.

Behavior Change Techniques Within Digital Interventions for the Treatment of Eating Disorders: Systematic Review and Meta-Analysis

BACKGROUND

Previous systematic reviews of digital eating disorder interventions have demonstrated effectiveness at improving symptoms of eating disorders; however, our understanding of how these interventions work and what contributes to their effectiveness is limited. Understanding the behavior change techniques (BCTs) that are most commonly included within effective interventions may provide valuable information for researchers and developers. Establishing whether these techniques have been informed by theory will identify whether they target those mechanisms of action that have been identified as core to changing eating disorder behaviors. It will also evaluate the importance of a theoretical approach to digital intervention design.

OBJECTIVE

This study aims to define the BCTs within digital self-management interventions or minimally guided self-help interventions for adults with eating disorders that have been evaluated within randomized controlled trials. It also assessed which of the digital interventions were grounded in theory and the range of modes of delivery included.

METHODS

A literature search identified randomized controlled trials of digital intervention for the treatment of adults with eating disorders with minimal therapist support. Each digital intervention was coded for BCTs using the established BCT Taxonomy v1; for the application of theory using an adapted version of the theory coding scheme (TCS); and for modes of delivery using the Mode of Delivery Ontology. A meta-analysis evaluated the evidence that any individual BCT moderated effect size or that other potential factors such as the application of theory or number of modes of delivery had an effect on eating disorder outcomes.

RESULTS

Digital interventions included an average of 14 (SD 2.6; range 9-18) BCTs. Self-monitoring of behavior was included in all effective interventions, with Problem-solving, Information about antecedents, Feedback on behavior, Self-monitoring of outcomes of behavior, and Action planning identified in >75% (13/17) of effective interventions. Social support and Information about health consequences were more evident in effective interventions at follow-up compared with postintervention measurement. The mean number of modes of delivery was 4 (SD 1.6; range 2-7) out of 12 possible modes, with most interventions (15/17, 88%) being web based. Digital interventions that had a higher score on the TCS had a greater effect size than those with a lower TCS score (subgroup differences: χ21=9.7; P=.002; I²=89.7%) within the meta-analysis. No other subgroup analyses had statistically significant results.

CONCLUSIONS

There was a high level of consistency in terms of the most common BCTs within effective interventions; however, there was no evidence that any specific BCT contributed to intervention efficacy. The interventions that were more strongly informed by theory demonstrated greater improvements in eating disorder outcomes compared to waitlist or treatment-as-usual controls. These results can be used to inform the development of future digital eating disorder interventions.

TRIAL REGISTRATION

PROSPERO CRD42023410060; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=410060.

Design of Digital Mental Health Platforms for Family Member Cocompletion: Scoping Review

BACKGROUND

The COVID-19 pandemic placed an additional mental health burden on individuals and families, resulting in widespread service access problems. Digital mental health interventions suggest promise for improved accessibility. Recent reviews have shown emerging evidence for individual use and early evidence for multiusers. However, attrition rates remain high for digital mental health interventions, and additional complexities exist when engaging multiple family members together.

OBJECTIVE

As such, this scoping review aims to detail the reported evidence for digital mental health interventions designed for family use with a focus on the build and design characteristics that promote accessibility and engagement and enable cocompletion by families.

METHODS

A systematic literature search of MEDLINE, Embase, PsycINFO, Web of Science, and CINAHL databases was conducted for articles published in the English language from January 2002 to March 2024. Eligible records included empirical studies of digital platforms containing some elements designed for cocompletion by related people as well as some components intended to be completed without therapist engagement. Platforms were included in cases in which clinical evidence had been documented.

RESULTS

Of the 9527 papers reviewed, 85 (0.89%) met the eligibility criteria. A total of 24 unique platforms designed for co-use by related parties were identified. Relationships between participants included couples, parent-child dyads, family caregiver-care recipient dyads, and families. Common platform features included the delivery of content via structured interventions with no to minimal tailoring or personalization offered. Some interventions provided live contact with therapists. User engagement indicators and findings varied and included user experience, satisfaction, completion rates, and feasibility. Our findings are more remarkable for what was absent in the literature than what was present. Contrary to expectations, few studies reported any design and build characteristics that enabled coparticipation. No studies reported on platform features for enabling cocompletion or considerations for ensuring individual privacy and safety. None examined platform build or design characteristics as moderators of intervention effect, and none offered a formative evaluation of the platform itself.

CONCLUSIONS

In this early era of digital mental health platform design, this novel review demonstrates a striking absence of information about design elements associated with the successful engagement of multiple related users in any aspect of a therapeutic process. There remains a large gap in the literature detailing and evaluating platform design, highlighting a significant opportunity for future cross-disciplinary research. This review details the incentive for undertaking such research; suggests design considerations when building digital mental health platforms for use by families; and offers recommendations for future development, including platform co-design and formative evaluation.

Using Monte Carlo Simulation to Forecast the Scientific Utility of Psychological App Studies: A Tutorial

Mobile applications offer a wide range of opportunities for psychological data collection, such as increased ecological validity and greater acceptance by participants compared to traditional laboratory studies. However, app-based psychological data also pose data-analytic challenges because of the complexities introduced by missingness and interdependence of observations. Consequently, researchers must weigh the advantages and disadvantages of app-based data collection to decide on the scientific utility of their proposed app study. For instance, some studies might only be worthwhile if they provide adequate statistical power. However, the complexity of app data forestalls the use of simple analytic formulas to estimate properties such as power. In this paper, we demonstrate how Monte Carlo simulations can be used to investigate the impact of app usage behavior on the utility of app-based psychological data. We introduce a set of questions to guide simulation implementation and showcase how we answered them for the simulation in the context of the guessing game app Who Knows (Rau et al., 2023). Finally, we give a brief overview of the simulation results and the conclusions we have drawn from them for real-world data generation. Our results can serve as an example of how to use a simulation approach for planning real-world app-based data collection.

Theory-based interventions aimed at promoting physical activity in pregnant women: A systematic review and meta-analysis of randomized controlled trials

OBJECTIVES

The objectives were to assess (i) the quality of theory implementation, (ii) the application of behavior change techniques, and (iii) the effectiveness of theory-based interventions in promoting physical activity in pregnant women and improving maternal and neonatal outcomes.

METHODS

A systematic search was conducted across 8 databases (Cumulative Index to Nursing and Allied Health Literature, the Cochrane Library, EMBASE, MEDLINE, APA PsycINFO, PubMed, SPORTDiscus, and Web of Science) to identify randomized controlled trials published from database inception to 8 July 2023. The Cochrane risk-of-bias 2.0 tool was used to evaluate the quality of the included studies. The theory coding scheme was used to measure the quality of theory implementation, and behavior change techniques were coded according to behavior change taxonomy (version 1). The meta-analysis was performed using RevMan 5.3. The Grading of Recommendations, Assessment, Development, and Evaluation Approach was used to assess the certainty of evidence.

RESULTS

Eleven studies met the study criteria. Nine studies were based on one theory, while two studies were based on a combination of two theories. The quality of theory implementation was generally moderate. A total of 24 unique behavior change techniques were extracted. The most commonly used types of behavior change techniques were 'instruction on how to perform the behavior' (n = 9), 'goal setting' (behavior) (n = 8), 'action planning' (n = 7), and 'information about health consequences' (n = 7). Theory-based interventions significantly improved moderate-to-vigorous physical activity (standardized mean difference (SMD) = 0.17, 95 % confidence interval (CI) [0.04, 0.30], P = 0.01; moderate certainty of evidence), reduced the average gestational weight gain per week (mean difference (MD) = -0.06, 95 % CI [-0.11, -0.01], P = 0.02; moderate certainty of evidence), and decreased the incidence of gestational diabetes mellitus (risk ratio (RR) = 0.64, 95 % CI [0.46, 0.89], P = 0.008; high certainty of evidence). However, the effects of theory-based interventions on total physical activity, total gestational weight gain and the incidence of gestational hypertension and preterm delivery were unclear (P > 0.05).

CONCLUSIONS

(i) Most of the studies exhibited a moderate level of theory implementation quality. (ii) The use of theories varies, but common behavior change techniques were found across studies. (iii) Theory-based interventions can improve physical activity and maternal and neonatal outcomes and appear to be safe. Appropriate health behavior theories and behavior change techniques should be fully utilized in future interventions.

REGISTRATION

PROSPERO: CRD42023440886.

TWEETABLE ABSTRACT

Theory-based interventions can improve physical activity and maternal and neonatal outcomes and appear to be safe. Appropriate health behavior theories and behavior change techniques should be fully utilized in the development of future interventions.

Long-Term Emotional Impact of the COVID-19 Pandemic and Barriers and Facilitators to Digital Mental Health Tools in Long-Term Care Workers: Qualitative Study

BACKGROUND

The overall pandemic created enormous pressure on long-term care workers (LTCWs), making them particularly vulnerable to mental disorders. Despite this, most of the available evidence on professional well-being during COVID-19 has exclusively focused on frontline health care workers.

OBJECTIVE

This study aimed to identify the long-term psychological needs of LTCWs derived from the COVID-19 pandemic and to explore barriers and facilitators related to digital mental health tools. This is part of a project that seeks to develop a digital mental health intervention to reduce psychological distress in this population group.

METHODS

We performed a qualitative study with a rapid research approach. Participants were LTCWs of the autonomous community of Catalonia. We conducted 30 semistructured interviews between April and September 2022. We used a qualitative content analysis method with an inductive-deductive approach.

RESULTS

The period of the pandemic with the highest mental health burden was the COVID-19 outbreak, with almost all workers having experienced some form of emotional distress. Emotional distress persisted over time in more than half of the participants, with fatigue and nervousness being the main emotions expressed at the time of the interview. High workload, the feeling that pandemic times are not over, and poor working conditions that have remained since then have been the most frequently expressed determinants of such emotions. Potential barriers and facilitators to engagement with digital tools were also identified in terms of previous experience and beliefs of the target population, possibilities for the integration of a digital tool into daily life, preferences regarding the level of guidance, the possibility of social connectedness through the tool, and privacy and confidentiality. The identified factors may become especially relevant in the context of the pandemic remission phase.

CONCLUSIONS

More than 2 years after the pandemic outbreak, emotional distress is still relevant. The persistent burden of psychological distress points to a need for institutions to take action to improve working conditions and promote employees' well-being. Considering factors that act as barriers and facilitators for the use of digital mental health tools, it is important to develop tailored tools that could offer valuable support to this population during and after a pandemic.

A Systematic Narrative Review of Recent Obesity Interventions with Black Women in the United States

OBJECTIVES

This study is to comprehensively review recent obesity interventions for Black women in the United States.

METHODS

We searched PubMed and EBSCOhost for articles published between 2013 and 2022 using a comprehensive search strategy. Two reviewers screened titles, abstracts, and full texts. Data from the included articles were extracted. Qualitative themes related to the intervention designs were identified across studies.

RESULTS

Fifty-two studies were included in the review. Interventions typically aimed to reduce weight by targeting diet and/or physical activity. Intervention activities were delivered virtually and in-person via several formats including didactic content and interactive sessions. Outcomes were assessed through a variety of research designs. Across papers, we identified six key themes of intervention design: integration of technology, centering community and culture, personalization of content, use of social support, skill-building through intervention activities, and addressing comorbid health conditions.

CONCLUSIONS

To address the obesity epidemic, future research can build upon key lessons learned from recent interventions tailored to Black women.

Digital psychosocial interventions for individuals with spinal cord injury: a scoping review

Objective

To provide an overview of the digital mental health care landscape for individuals with spinal cord injury (SCI).

Methods

PubMed, PsycInfo, and PSYNDEX were searched for articles meeting the following criteria: (1) article written in English or German; (2) digital psychosocial intervention; (3) SCI only; (4) treatment of individuals with SCI and not their relatives or caregivers. Records were screened by title and abstract and records meeting the inclusion criteria were obtained for full text screening. The references of identified articles were screened to find further relevant articles. The literature search was updated before submission. Risk of Bias was assessed by using the Cochrane risk-of-bias tool for randomized trials (RoB 2) and a narrative synthesis was conducted.

Results

Ten randomized-controlled trials (RCT) and ten non-randomized-controlled trials were identified and compared in this review, evaluating twelve internet- and mobile-based interventions, five smartphone apps, and three virtual reality applications. The interventions were primarily used as stand-alone aftercare programs. While some were not based on any theory, cognitive behavioral therapy mostly served as the theoretical basis for the online interventions. The extent of human support also varied greatly between the studies. The number of intervention modules ranged between 2 and 72. There were also major differences in outcome variables and effects. A meta-analytical evaluation of the data was not conducted due to heterogeneity of studies.

Conclusion

Digital applications to promote the psychosocial health of individuals with SCI are an emerging field of research with many treatment approaches still to come. First high quality RCT studies report promising results. Unfortunately, not all studies are of high quality or the interventions have been insufficiently adapted to the needs of people with SCI. Therefore, more research is needed to further develop applications, and to generalize and test the effects found in the long term.

The Report of Access and Engagement With Digital Health Interventions Among Children and Young People: Systematic Review

BACKGROUND

Digital health interventions are increasingly used to deliver health-related interventions for children and young people to change health behaviors and improve health outcomes. Digital health interventions have the potential to enhance access to and engagement with children and young people; however, they may also increase the divide between those who can access technology and are supported to engage and those who are not. This review included studies that reported on the access to or engagement with digital health interventions among children and young people.

OBJECTIVE

This review aims to identify and report on access and engagement in studies involving digital health interventions among children and young people.

METHODS

A systematic review following the Joanna Briggs Institute methods for conducting systematic reviews was conducted. An electronic literature search was conducted for all studies published between January 1, 2010, and August 2022, across sources, including MEDLINE, CINAHL, and PsycINFO. Studies were included if they examined any aspect of access or engagement in relation to interventions among children and young people. The quality of the included papers was assessed, and data were extracted. Data were considered for meta-analysis, where possible.

RESULTS

A total of 3292 references were identified using search terms. Following the exclusion of duplicates and review by inclusion criteria, 40 studies were independently appraised for their methodological quality. A total of 16 studies were excluded owing to their low assessed quality and flawed critical elements in the study design. The studies focused on a variety of health conditions; type 1 diabetes, weight management and obesity, mental health issues, and sexual health were the predominant conditions. Most studies were conducted in developed countries, with most of them being conducted in the United States. Two studies reported data related to access and considered ethnicity and social determinants. No studies used strategies to enhance or increase access. All studies included in the review reported on at least 1 aspect of engagement. Engagement with interventions was measured in relation to frequency of engagement, with no reference to the concept of effective engagement.

CONCLUSIONS

Most digital health interventions do not consider the factors that can affect access and engagement. Of those studies that measured either access or engagement or both, few sought to implement strategies to improve access or engagement to address potential disparities between groups. Although the literature to date provides some insight into access and engagement and how these are addressed in digital health interventions, there are major limitations in understanding how both can be enhanced to promote equity. Consideration of both access and engagement is vital to ensure that children and young people have the ability to participate in studies.

TRIAL REGISTRATION

PROSPERO CRD42020170874; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=170874.

Rural disparities impact response to a web-based physical activity self-management intervention in COPD: A secondary analysis

PURPOSE

This secondary exploratory analysis examined rural-urban differences in response to a web-based physical activity self-management intervention for chronic obstructive pulmonary disease (COPD).

METHODS

Participants with COPD (N = 239 US Veterans) were randomized to either a multicomponent web-based intervention (goal setting, iterative feedback of daily step counts, motivational and educational information, and an online community forum) or waitlist-control for 4 months with a 12-month follow-up. General linear modeling estimated the impact of rural/urban status (using Rural-Urban Commuting Area [RUCA] codes) on (1) 4- and 12-month daily step-count change compared to waitlist-control, and (2) intervention engagement (weekly logons and participant feedback).

FINDINGS

Rural (n = 108) and urban (n = 131) participants' mean age was 66.7±8.8 years. Rural/urban status significantly moderated 4-month change in daily step counts between randomization groups (p = 0.041). Specifically, among urban participants, intervention participants improved by 1500 daily steps more than waitlist-control participants (p = 0.001). There was no difference among rural participants. In the intervention group, rural participants engaged less with the step-count graphs on the website than urban participants at 4 months (p = 0.019); this difference dissipated at 12 months. More frequent logons were associated with greater change in daily step counts (p = 0.004); this association was not moderated by rural/urban status.

CONCLUSIONS

The web-based intervention was effective for urban, but not rural, participants at 4 months. Rural participants were also less engaged at 4 months, which may explain differences in effectiveness. Technology-based interventions can help address urban-rural disparities in patients with COPD, but may also contribute to them unless resources are available to support engagement with the technology.

Guided versus non-guided digital psychological interventions for cancer patients: A systematic review and meta-analysis of engagement and efficacy

OBJECTIVE

To evaluate engagement with and efficacy of guided versus non-guided digital interventions targeting psychological symptoms of cancer via a systematic review of current evidence.

METHODS

PubMed, Scopus, PsychINFO, MEDLINE, and CINAHL databases were searched. Eligible publications were randomised controlled trials of guided or non-guided digital psychological interventions used in cancer settings reporting intervention efficacy and/or engagement. Study methodological quality was assessed using the Cochrane risk of bias (RoB) tool. Random effects meta-analyses were performed on outcomes with sufficient data, with sub-group analyses of intervention type and follow-up period.

RESULTS

Forty-three studies were included. Studies varied by level of guidance, type of technology used, duration, and outcomes assessed. Most studies had a high overall RoB. Meta-analysis indicated that guided interventions significantly reduced distress, anxiety, and fatigue, while non-guided did not. For depression and quality of life, both guided and non-guided interventions produced significant improvements. Guided interventions reported higher levels of intervention engagement than non-guided.

CONCLUSIONS

Guided digital psychological interventions were likely to be more effective than non-guided ones for cancer patients, particularly in reducing distress, anxiety, and fatigue. Whilst both types were found to improve depression and life quality, guided interventions were associated with higher patient engagement. These findings suggest digital interventions could supplement traditional cancer care, warranting further research concerning long-term effects and cost-efficiency.

The Effectiveness of Strategies to Improve User Engagement With Digital Health Interventions Targeting Nutrition, Physical Activity, and Overweight and Obesity: Systematic Review and Meta-Analysis

BACKGROUND

Digital health interventions (DHIs) are effective in improving poor nutrition, physical inactivity, overweight and obesity. There is evidence suggesting that the impact of DHIs may be enhanced by improving user engagement. However, little is known about the overall effectiveness of strategies on engagement with DHIs.

OBJECTIVE

This study aims to assess the overall effectiveness of strategies to improve engagement with DHIs targeting nutrition, physical activity, and overweight or obesity and explore associations between strategies and engagement outcomes. The secondary aim was to explore the impact of these strategies on health risk outcomes.

METHODS

The MEDLINE, Embase, PsycINFO, CINAHL, CENTRAL, Scopus, and Academic Source Complete databases were searched up to July 24, 2023. Eligible studies were randomized controlled trials that evaluated strategies to improve engagement with DHIs and reported on outcomes related to DHI engagement (use or user experience). Strategies were classified according to behavior change techniques (BCTs) and design features (eg, supplementary emails). Multiple-variable meta-analyses of the primary outcomes (usage and user experience) were undertaken to assess the overall effectiveness of strategies. Meta-regressions were conducted to assess associations between strategies and use and user experience outcomes. Synthesis of secondary outcomes followed the "Synthesis Without Meta-Analysis" guidelines. The methodological quality and evidence was assessed using the Cochrane risk-of-bias tool, and the Grading of Recommendations Assessment, Development, and Evaluation tool respectively.

RESULTS

Overall, 54 studies (across 62 publications) were included. Pooled analysis found very low-certainty evidence of a small-to-moderate positive effect of the use of strategies to improve DHI use (standardized mean difference=0.33, 95% CI 0.20-0.46; P<.001) and very low-certainty evidence of a small-to-moderate positive effect on user experience (standardized mean difference=0.29, 95% CI 0.07-0.52; P=.01). A significant positive association was found between the BCTs social support (effect size [ES]=0.40, 95% CI 0.14-0.66; P<.001) and shaping knowledge (ES=0.39, 95% CI 0.03-0.74; P=.03) and DHI use. A significant positive association was found among the BCTs social support (ES=0.70, 95% CI 0.18-1.22; P=.01), repetition and substitution (ES=0.29, 95% CI 0.05-0.53; P=.03), and natural consequences (ES=0.29, 95% CI 0.05-0.53; P=.02); the design features email (ES=0.29, 95% CI 0.05-0.53; P=.02) and SMS text messages (ES=0.34, 95% CI 0.11-0.57; P=.01); and DHI user experience. For secondary outcomes, 47% (7/15) of nutrition-related, 73% (24/33) of physical activity-related, and 41% (14/34) of overweight- and obesity-related outcomes reported an improvement in health outcomes.

CONCLUSIONS

Although findings suggest that the use of strategies may improve engagement with DHIs targeting such health outcomes, the true effect is unknown because of the low quality of evidence. Future research exploring whether specific forms of social support, repetition and substitution, natural consequences, emails, and SMS text messages have a greater impact on DHI engagement is warranted.

TRIAL REGISTRATION

PROSPERO CRD42018077333; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=77333.

Usability and Feasibility Testing of an Atrial Fibrillation Educational Website with Patients Referred to an Atrial Fibrillation Specialty Clinic

BACKGROUND

The purpose of this study was to design, usability test, and explore the feasibility of a web-based educational platform/intervention for patients with atrial fibrillation (AF) as part of their virtual AF care.

METHODS

Participants were patients attending a specialized AF clinic. The multiple mixed-methods design included website design, think-aloud usability test, 1-month unstructured pre-testing analysis using Google Analytics, follow-up interviews, and a non-randomized one-group feasibility test using pre/post online surveys and Google Analytics.

RESULTS

Usability testing participants (n = 2) guided adjustments for improving navigation. Pre-testing participants' (n = 9) website activity averaged four sessions (SD = 2.6) at 10 (SD 8) minutes per session during a 1-month study period. In the feasibility test, 30 patients referred to AF specialty clinic care completed the baseline survey, and 20 of these completed the 6-month follow-up survey. A total of 19 patients accessed the website over the 6 months, and all 30 participants were sent email prompts containing information from the website. Health-related quality of life, treatment satisfaction, household activity, and AF knowledge scores were higher at follow-up than baseline. There was an overall downward trend in self-reported healthcare utilization at follow-up.

CONCLUSIONS

Access to a credible education website for patients with AF has great potential to complement virtual and hybrid models of care.

How Notifications Affect Engagement With a Behavior Change App: Results From a Micro-Randomized Trial

BACKGROUND

Drink Less is a behavior change app to help higher-risk drinkers in the United Kingdom reduce their alcohol consumption. The app includes a daily notification asking users to "Please complete your drinks and mood diary," yet we did not understand the causal effect of the notification on engagement nor how to improve this component of Drink Less. We developed a new bank of 30 new messages to increase users' reflective motivation to engage with Drink Less. This study aimed to determine how standard and new notifications affect engagement.

OBJECTIVE

Our objective was to estimate the causal effect of the notification on near-term engagement, to explore whether this effect changed over time, and to create an evidence base to further inform the optimization of the notification policy.

METHODS

We conducted a micro-randomized trial (MRT) with 2 additional parallel arms. Inclusion criteria were Drink Less users who consented to participate in the trial, self-reported a baseline Alcohol Use Disorders Identification Test score of ≥8, resided in the United Kingdom, were aged ≥18 years, and reported interest in drinking less alcohol. Our MRT randomized 350 new users to test whether receiving a notification, compared with receiving no notification, increased the probability of opening the app in the subsequent hour, over the first 30 days since downloading Drink Less. Each day at 8 PM, users were randomized with a 30% probability of receiving the standard message, a 30% probability of receiving a new message, or a 40% probability of receiving no message. We additionally explored time to disengagement, with the allocation of 60% of eligible users randomized to the MRT (n=350) and 40% of eligible users randomized in equal number to the 2 parallel arms, either receiving the no notification policy (n=98) or the standard notification policy (n=121). Ancillary analyses explored effect moderation by recent states of habituation and engagement.

RESULTS

Receiving a notification, compared with not receiving a notification, increased the probability of opening the app in the next hour by 3.5-fold (95% CI 2.91-4.25). Both types of messages were similarly effective. The effect of the notification did not change significantly over time. A user being in a state of already engaged lowered the new notification effect by 0.80 (95% CI 0.55-1.16), although not significantly. Across the 3 arms, time to disengagement was not significantly different.

CONCLUSIONS

We found a strong near-term effect of engagement on the notification, but no overall difference in time to disengagement between users receiving the standard fixed notification, no notification at all, or the random sequence of notifications within the MRT. The strong near-term effect of the notification presents an opportunity to target notifications to increase "in-the-moment" engagement. Further optimization is required to improve the long-term engagement.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/18690.

Understanding What Drives Long-term Engagement in Digital Mental Health Interventions: Secondary Causal Analysis of the Relationship Between Social Networking and Therapy Engagement

BACKGROUND

Low engagement rates with digital mental health interventions are a major challenge in the field. Multicomponent digital interventions aim to improve engagement by adding components such as social networks. Although social networks may be engaging, they may not be sufficient to improve clinical outcomes or lead users to engage with key therapeutic components. Therefore, we need to understand what components drive engagement with digital mental health interventions overall and what drives engagement with key therapeutic components.

OBJECTIVE

Horyzons was an 18-month digital mental health intervention for young people recovering from first-episode psychosis, incorporating therapeutic content and a private social network. However, it is unclear whether use of the social network leads to subsequent use of therapeutic content or vice versa. This study aimed to determine the causal relationship between the social networking and therapeutic components of Horyzons.

METHODS

Participants comprised 82 young people (16-27 years) recovering from first-episode psychosis. Multiple convergent cross mapping was used to test causality, as a secondary analysis of the Horyzons intervention. Multiple convergent cross mapping tested the direction of the relationship between each pair of social and therapeutic system usage variables on Horyzons, using longitudinal usage data.

RESULTS

Results indicated that the social networking aspects of Horyzons were most engaging. Posting on the social network drove engagement with all therapeutic components (r=0.06-0.36). Reacting to social network posts drove engagement with all therapeutic components (r=0.39-0.65). Commenting on social network posts drove engagement with most therapeutic components (r=0.11-0.18). Liking social network posts drove engagement with most therapeutic components (r=0.09-0.17). However, starting a therapy pathway led to commenting on social network posts (r=0.05) and liking social network posts (r=0.06), and completing a therapy action led to commenting on social network posts (r=0.14) and liking social network posts (r=0.15).

CONCLUSIONS

The online social network was a key driver of long-term engagement with the Horyzons intervention and fostered engagement with key therapeutic components and ingredients of the intervention. Online social networks can be further leveraged to engage young people with therapeutic content to ensure treatment effects are maintained and to create virtuous cycles between all intervention components to maintain engagement.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry: ACTRN12614000009617; https://www.australianclinicaltrials.gov.au/anzctr/trial/ACTRN12614000009617.

"I Assumed It Would Be Somebody Who Had a Stroke That Was Doing This": Views of Stroke Survivors, Caregivers, and Health Professionals on Tailoring a Relaxation and Mindfulness Intervention

Stroke survivors and informal caregivers experience high levels of stress and anxiety, linked to heightened risk of secondary stroke in survivors. Relaxation and mindfulness could reduce stress and anxiety; being most effective when tailored to the target populations. Aims of the PPI include to: (1) consult on possible alterations to an existing relaxation and mindfulness intervention, delivered via YouTube/DVD and (2) discuss relevance and preference of prompts and cues designed to facilitate the daily practice of the intervention. Eleven UK PPI contributors were consulted during 2020: four stroke survivors (F = 2, M = 2), three caregivers (F = 1, M = 2), and four HCPs (F = 4) (range = 23-63 years). Contributors watched the existing intervention and provided feedback via online discussions. Transcripts were analysed using thematic analysis. Five themes were identified, highlighting several necessary alterations to the intervention: "Who represents the stroke population?"; "The paradox of age"; "Specifically selected language"; "Visual presentation of the intervention"; and the "Audio qualities". Contributors ranked the prompts and cues in order of preference with setting alarms and email alerts as the most popular. The PPI consultations resulted in several alterations enabling a revised version of the intervention. Including a PPI consultation at an early stage of the research improves the relevance and appropriateness of the research. The revised intervention is more representative of the stroke population thus more likely to be practised by survivors and caregivers, which will enhance the extent of effectiveness, reducing the risk of a secondary stroke.

Promoting engagement with self-guided digital therapeutics for mental health: Insights from a cross-sectional survey of end-users

BACKGROUND

Poor engagement has hindered the dissemination of self-guided digital therapeutics for mental health. Evidence on the efficacy of technology-supported strategies designed for increasing engagement with these interventions is currently inconclusive. Few studies have examined user perceptions of such strategies, which could yield key insights for enhancing their effectiveness.

METHODS

Two hundred and eleven participants completed a cross-sectional online survey. All participants were aged 18 years and above, living in Australia, fluent in English, and self-reported prior use of digital therapeutics for mental health needs. Survey items elicited participants' views on factor(s) contributing to their engagement/disengagement with digital therapeutics, and perceptions of engagement strategies, including: automated electronic reminders, fun facts, quizzes, and social media platforms. χ² tests of independence were used to analyse nominal data. Inductive thematic analysis was used to analyse free-text data.

RESULTS

Factors facilitating engagement included digestible content, assurance of confidentiality, and esthetically appealing design. Factors hindering engagement included lack of time, forgetfulness, and lack of perceived intervention efficacy. Participants had mixed views over the feasibility and acceptability of the strategies explored toward promoting engagement.

CONCLUSIONS

Regardless of strategy type, succinct and easily applicable content was identified as an important feature for promoting engagement. Conversely, content that could trigger psychological distress among intervention users should be avoided. Overall, the diverse range of user perspectives highlighted that engagement strategies for any specific digital intervention should be co-designed with individuals with lived experience of mental health difficulties.

Enhancing Self-care Among Oral Cancer Survivors: Protocol for the Empowered Survivor Trial

BACKGROUND

Survivors of oral cavity and oropharyngeal cancer frequently experience difficulties in swallowing; tasting; speaking; chewing; and maintaining comfortable movements of the head, neck, and shoulder. Engagement in regular self-care can reduce further loss of function and mitigate late effects. Despite the substantial self-care requirements, there are no empirically based interventions to enhance the skills and confidence of these survivors in managing their ongoing care.

OBJECTIVE

The aim of this study is to describe the rationale and methodology for a randomized controlled trial evaluating Empowered Survivor (ES) versus Springboard Beyond Cancer, a general web-based program for cancer survivors, on self-efficacy in managing care, preparedness for managing survivorship, and health-related quality of life (QOL).

METHODS

This study will recruit a total of 600 individuals who were diagnosed with oral cavity or oropharyngeal cancer in the past 3 years and are currently cancer free primarily from state cancer registries; these individuals will be randomly assigned to either the ES or Springboard Beyond Cancer condition. The participants complete measures of self-efficacy in managing care, preparedness for survivorship, health-related QOL, and engagement in oral self-examination and head and neck strengthening and flexibility exercises at baseline and 2 and 6 months after baseline. The primary aim of this study is to evaluate the impact of ES versus Springboard Beyond Cancer on self-efficacy, preparedness, and health-related QOL. The secondary aim is to examine the mediators and moderators of ES's impact on self-efficacy in managing care, preparedness, and health-related QOL at 6 months. The exploratory aim is to conduct a process evaluation of ES to identify potential oncology or community settings for future implementation.

RESULTS

Multilevel modeling will be used to examine whether there are significant differences between the ES and Springboard Beyond Cancer interventions over time. Mediational models will evaluate the indirect effects of ES on outcomes. Quantitative analyses will evaluate the predictors of ES use, and qualitative analyses will evaluate the preferred timing and settings for the implementation of ES.

CONCLUSIONS

This randomized controlled trial evaluates a completely web-based intervention, ES, versus a general web-based program for cancer survivors, Springboard Beyond Cancer, on self-efficacy in managing care, preparedness for managing survivorship, and health-related QOL and identifies the putative mediators and moderators of the intervention's effects. If an effect on the primary outcomes is illustrated, the next step could be an implementation trial to evaluate the intervention's uptake in and impact on an oncology care setting or nonprofit organizations.

TRIAL REGISTRATION

ClincalTrials.gov NCT04713449; https://clinicaltrials.gov/ct2/show/NCT04713449.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/39996.

Increasing Engagement in the Electronic Framingham Heart Study: Factorial Randomized Controlled Trial

BACKGROUND

Smartphone apps and mobile health devices offer innovative ways to collect longitudinal cardiovascular data. Randomized evidence regarding effective strategies to maintain longitudinal engagement is limited.

OBJECTIVE

This study aimed to evaluate smartphone messaging interventions on remote transmission of blood pressure (BP) and heart rate (HR) data.

METHODS

We conducted a 2 × 2 × 2 factorial blinded randomized trial with randomization implemented centrally to ensure allocation concealment. We invited participants from the Electronic Framingham Heart Study (eFHS), an e-cohort embedded in the FHS, and asked participants to measure their BP (Withings digital cuff) weekly and wear their smartwatch daily. We assessed 3 weekly notification strategies to promote adherence: personalized versus standard; weekend versus weekday; and morning versus evening. Personalized notifications included the participant's name and were tailored to whether or not data from the prior week were transmitted to the research team. Intervention notification messages were delivered weekly automatically via the eFHS app. We assessed if participants transmitted at least one BP or HR measurement within 7 days of each notification after randomization. Outcomes were adherence to BP and HR transmission at 3 months (primary) and 6 months (secondary).

RESULTS

Of the 791 FHS participants, 655 (82.8%) were eligible and randomized (mean age 53, SD 9 years; 392/655, 59.8% women; 596/655, 91% White). For the personalized versus standard notifications, 38.9% (126/324) versus 28.8% (94/327) participants sent BP data at 3 months (difference=10.1%, 95% CI 2.9%-17.4%; P=.006), but no significant differences were observed for HR data transmission (212/324, 65.4% vs 209/327, 63.9%; P=.69). Personalized notifications were associated with increased BP and HR data transmission versus standard at 6 months (BP: 107/291, 36.8% vs 66/295, 22.4%; difference=14.4%, 95% CI 7.1- 21.7%; P<.001; HR: 186/281, 66.2% vs 158/281, 56.2%; difference=10%, 95% CI 2%-18%; P=.02). For BP and HR primary or secondary outcomes, there was no evidence of differences in data transmission for notifications sent on weekend versus weekday or morning versus evening.

CONCLUSIONS

Personalized notifications increased longitudinal adherence to BP and HR transmission from mobile and digital devices among eFHS participants. Our results suggest that personalized messaging is a powerful tool to promote adherence to mobile health systems in cardiovascular research.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03516019; https://clinicaltrials.gov/ct2/show/NCT03516019.

User engagement in mobile apps for people with schizophrenia: A scoping review

Over the past decade, there has been an increase in the number of mobile apps designed for mental health proposes and mHealth has been perceived as a promising approach to help people with schizophrenia to manage their condition. However, adoption rates are relatively low and long-term user engagement is a major issue. The aim of this study is to identify and better understand what strategies and factors may influence user engagement and facilitate prolonged use of apps for people with schizophrenia to better manage their illness. A scoping review was conducted in accordance with the Arksey and O'Malley scoping review framework and following PRISMA ScR guidelines. The sources consisted of searching four electronic databases. Rayyan software was used for this study selection process and a narrative approach was used to synthesize the extracted data. A total of 28 studies which met the inclusion criteria were identified. The engagement strategies included push notifications, message prompts, personalization, application customization, goal setting, game-like features, use of different multimedia formats, social connectedness, support (peers and professionals), reliability of content and quality of feedback received. Some demographic factors may influence adherence such as age, gender, education level and socioeconomic status. Other factors also may play a role impacting engagement: health status, data privacy and security, involvement in design process, incentives for participation, app usage fitting in the user routines, initial training, and constant technical support. Included studies present high heterogeneity in outcome measures and thresholds criteria to assess engagement. Understanding what influences engagement and how to measure it is essential to enhance the design of mobile apps and deliver scalable solutions to help people with schizophrenia better manage their illness in their real-world uptake.

Needs assessment in community-dwelling older adults toward digital interventions to promote physical activity: Cross-sectional survey study

Background

Tackling physical inactivity represents a key global public health challenge. Strategies to increase physical activity (PA) are therefore warranted. Despite the rising availability of digital interventions (DIs), which offer tremendous potential for PA promotion, there has been inadequate attention to the special needs of older adults.

Objective

The aim was to investigate community-dwelling older adults' needs, requirements, and preferences toward DIs to promote PA.

Methods

The target population of this cross-sectional study was community-dwelling older adults (≥60 years old) within German-speaking Switzerland. Potential respondents were informed about the study and sent a link to a self-developed and self-administered online survey by our cooperating institutions.

Results

Overall, 922 respondents who completed the online survey were included in the final analysis. The mean age of the sample was 72 years (SD 6.4, range 60-98). The preferred delivery mode of DIs to promote PA was a website (428/922, 46.4%) and 80.3% (740/922) preferred video-based structures. Most respondents expressed the need for personal access, personal goals, personal messages, and a personal contact in case of problems or questions (585/817, 71.6%; 546/811, 67.3%; 536/822, 65.2%; 536/822, 65.2%). Memory training, psychological wellbeing, and nutrition were mainly rated as relevant additional content of DIs to promote PA (690/849, 81.2%; 661/845, 78.2%, 619/849, 72.9%).

Conclusion

Community-dwelling older adults may be willing to use DIs to promote PA in the long term, but this study identified particular needs and requirements in terms of design, technological realization, delivery mode, support, and individualization/personalization among the sample. Our results can inform future developments of DIs to promote PA specifically tailored to older adults. However, caution is warranted in interpreting the findings due to the sample's high PA and education levels.

Digital Health and Community Health Worker Support for Diabetes Management: a Randomized Controlled Trial

OBJECTIVE

The aim of this study was to evaluate the effectiveness of a digital health intervention plus community health worker (CHW) support on self-monitoring of blood glucose and glycosylated hemoglobin (HbA1c) among adult Medicaid beneficiaries with diabetes.

DESIGN

Randomized controlled trial.

SETTING

Urban outpatient clinic.

PARTICIPANTS

Adult Medicaid beneficiaries living with diabetes and treated with insulin and who had a HbA1c ≥ 9%.

INTERVENTION

Participants were randomly assigned to one of three arms. Participants in the usual-care arm received a wireless glucometer if needed. Those in the digital arm received a lottery incentive for daily glucose monitoring. Those in the hybrid arm received the lottery plus support from a CHW if they had low adherence or high blood glucose levels.

MAIN MEASURES

The primary outcome was the difference in adherence to daily glucose self-monitoring at 3 months between the hybrid and usual-care arms. The secondary outcome was difference in HbA1c from baseline at 6 months.

KEY RESULTS

A total of 150 participants were enrolled in the study. A total of 102 participants (68%) completed the study. At 3 months, glucose self-monitoring rates in the hybrid versus usual-care arms were 0.72 vs 0.65, p = 0.23. At 6 months, change in HbA1c in the hybrid versus usual-care arms was - 0.74% vs - 0.49%, p = 0.69.

CONCLUSION

There were no statistically significant differences between the hybrid and usual care in glucose self-monitoring adherence or improvements in HbA1C.

TRIAL REGISTRATION

This trial is registered with clinicaltrials.gov identifier: NCT03939793.

DECENT: A sociotechnical approach for developing mobile health apps in underserved settings

Objective

Despite the fact that user engagement is critical to the efficacy of mobile health (mHealth) interventions in the Global South, many of these interventions lack user engagement features. This is because sociotechnical aspects of such initiatives are frequently ignored during the design, development, and implementation stages. This research highlighted the importance of considering sociotechnical factors when developing mHealth apps. The intended users for the mHealth technologies in this study are care professionals.

Materials and Methods

Five semi-structured interviews and a pilot interview were conducted to identify user engagement facilitators and barriers. The interview data were analysed using NVivo. The Capability, Opportunity, Motivation - Behaviour (COM-B) model is then used to map the facilitators and barriers to mHealth app engagement, allowing researchers to better understand how users engage/disengage with mHealth apps.

Results and Discussion

Capability facilitators included features that assist users in learning more about the app (e.g. a user manual and statistical data) as well as features that assist users in developing a routine. The lack of app skills and cognitive overload limit capability. While social connectedness and offline functionality were identified as facilitators of user engagement, non-user-friendly design and cultural dimensions were identified as barriers. Early user engagement and rewards were identified as motivational facilitators that influence user engagement. Furthermore, perceived non-utility and a lack of encouragement were identified as motivational barriers to engagement.

Conclusion

Several factors were discovered across all COM-B model components that could be used to develop more engaging mHealth apps. Adopting a techno-centric approach that ignores sociotechnical factors can reduce user engagement. The design process engagement enhancement system (DECENT) framework was proposed based on the findings.

A pilot randomized controlled trial of a lay telephone coaching and web-based intervention for postpartum depression and anxiety: The MPOWER study

BACKGROUND

Mental health problems are frequent in the postpartum period, but accessible treatment options are lacking. The MPOWER study investigated whether the use of trained lay coaches could increase the uptake and effectiveness of a web-based intervention (WBI) for women with postpartum depression and/or anxiety.

OBJECTIVES

First, to compare the feasibility and acceptability of a WBI for women with postpartum depression and anxiety, with and without the addition of telephone coaching calls. Second, to estimate the effectiveness of the WBI at decreasing symptoms of depression and anxiety at 6 months, with and without coaching calls.

METHODS

We conducted a pilot randomized controlled trial (RCT) that enrolled women who had recently given birth and had mild to moderate postpartum depression and/or anxiety. Study participants were provided access to the WBI. Women randomized to the intervention group also received up to 7 telephone coaching calls during the 6 months of follow up. We evaluated the feasibility of the intervention through participants' usage of the WBI, as well as the completion and fidelity of planned coach calls. We measured acceptability via two questionnaires on the usability of the WBI and participant satisfaction with the intervention. To determine the potential effectiveness of the intervention, the primary outcomes were defined as symptoms of depression and anxiety at 6 months and adjusted mean differences between groups for these outcomes were estimated using linear regression models.

RESULTS

We recruited 52 participants (25 intervention; 27 control). At 6 months, 88 % (22/25) of participants randomized to the intervention arm and 59 % (16/27) of participants randomized to the control arm remained in the study. The intervention group had an average of 11 (95 % CI: [5, 18]) more website logins than the control group. Intervention group participants completed a mean of 6.2 coaching calls with high fidelity. The estimates of the effect of the intervention on mental health outcomes at 6-months were imprecise but point estimates and confidence intervals were consistent with a moderate beneficial effect of the intervention on both symptoms of depression and anxiety (fully adjusted effects sizes: 0.51 (95 % CI: [-0.14, 1.17]) and 0.56 (95 % CI: [-0.09, 1.22]), respectively).

CONCLUSIONS

WBIs with coaching are feasible, acceptable, and potentially effective treatment options for women with mild to moderate postpartum depression and/or anxiety. The addition of coaching calls markedly increased engagement with the WBI, but a larger RCT is needed to determine the effectiveness of such an intervention.

Dropout Rate in Digital Health Interventions for the Prevention of Skin Cancer: Systematic Review, Meta-analysis, and Metaregression

BACKGROUND

Digital strategies are innovative approaches to the prevention of skin cancer, but the attrition following this kind of intervention needs to be analyzed.

OBJECTIVE

The aim of this paper is to assess the dropouts from studies focused on digital strategies for the prevention of skin cancer.

METHODS

We conducted this systematic review with meta-analyses and metaregression according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statements. Search terms for skin cancer, digital strategies, and prevention were combined to search PubMed, Scopus, Web of Science, CINAHL, and Cochrane Library from inception until July 2022. Randomized clinical trials that reported dropouts of participants and compared digital strategies with other interventions to prevent skin cancer in healthy or disease-free participants were included. Two independent reviewers extracted data for analysis. The Revised Cochrane Collaboration Bias tool was employed. We calculated the pooled dropout rate of participants through a meta-analysis of proportions and examined whether dropout was more or less frequent in digital interventions against comparators via an odds ratio (OR) meta-analysis. Data were pooled using a random-effects model. Subgroup meta-analyses were conducted in a meta-analysis of proportions and OR meta-analysis to assess the dropout events when data were sorted by digital interventions or control comparator. A univariate metaregression based on a random-effects model assessed possible moderators of dropout. Participants' dropout rates as pooled proportions were calculated for all groups combined, and the digital and comparator groups separately. OR>1 indicated higher dropouts for digital-based interventions. Metaregressions were performed for age, sex, length of intervention, and sample size.

RESULTS

A total of 17 studies were included. The overall pooled dropout rate was 9.5% (95% CI 5.0-17.5). The subgroup meta-analysis of proportions revealed a dropout rate of 11.6% for digital strategies (95% CI 6.8-19.0) and 10.0% for comparators (95% CI 5.5-17.7). A trend of higher dropout rates for digital strategies was observed in the overall (OR 1.16, 95% CI 0.98-1.36) and subgroup OR meta-analysis, but no significant differences were found between the groups. None of the covariates moderated the effect size in the univariate metaregression.

CONCLUSIONS

Digital strategies had a higher dropout rate compared to other prevention interventions, but the difference was not significant. Standardization is needed regarding reporting the number of and reasons for dropouts.

TRIAL REGISTRATION

International Prospective Register of Systematic Reviews (PROSPERO) CRD42022329669; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=329669.

Tobacco quitlines: Opportunities for innovation to increase reach and effectiveness

The largest tobacco treatment network in North America, Tobacco Quitlines are an effective population-based approach to increase tobacco cessation; however, overall reach has decreased significantly in the past decade. A new generation of innovations responsive to evolving shifts in communication preferences, supported by research, and focused on increasing the impact of services have the potential to reinvigorate this network. The goal of this narrative review was to identify opportunities for innovation in Quitline service delivery, synthesize evidence for these opportunities, and identify gaps in the research. Innovation was defined as significant shift in current practice by utilizing novel theoretical concepts, approaches, methodologies, or interventions. The Experimental Medicine Approach informed the identification of gaps in the research. The specific domains were selected by reviewing previous reviews, commentaries, calls for action, and a recent report on promising practices. Evidence was garnered primarily from systematic reviews. Opportunities included automated and interactive digital therapeutics, novel health communications for stigma-free media campaigns, methods to increase access to nicotine replacement therapies, novel treatment options and combinations, and methods to promote engagement with digital therapeutics. Research topics that cross multiple domains include the consideration of theoretical frameworks, the identification of therapeutic targets and mechanisms of action, and the development of adapted approaches to address specific challenges and cultural responsivity. Finally, an examination is needed to understand how to improve the speed with which innovations are developed and implemented in this network.

Can behavior change techniques be delivered via short text messages?

Despite significant advancements in behavioral science it is unclear whether behavior change techniques (or BCTs) can be delivered to large numbers of people in a cost-effective and reliable way. The current study investigated whether it is possible to reliably deliver BCTs using short text messages. Short text messages were designed to deliver each of the 93 BCTs specified in the BCT taxonomy v1. Following initial coding and refinement by the team, a Delphi study with a panel of 15 experts coded which BCT each short text message was designed to deliver and also rated whether they were likely to be understood by recipients and easily converted to target different behaviors. After two iterations, the experts correctly assigned 66 of the 93 messages to the BCT that they were designed to deliver and indicated that these messages were likely to be easy to apply to a range of behaviors and understood by recipients. Experts were not able to identify which BCT 27 of the messages were designed to deliver and it was notable that some clusters of BCTs (e.g., "Goals and planning") were easier to deliver via short text messages than other clusters (e.g., "Scheduled consequences"). The findings suggest that short text messages can be a reliable way to deliver many, but not all, BCTs. The implications of the current study are discussed with respect to the delivery of specific BCTs and clusters of the taxonomy, as well as the need to test the acceptability of interventions delivered via short messages and the impact of messages on behavior.

The Effect of Periodic Email Prompts on Participant Engagement with a Behavior Change mHealth App: Longitudinal Study (Preprint)

BACKGROUND

Following the need for the prevention of noncommunicable diseases, mobile health (mHealth) apps are increasingly used for promoting lifestyle behavior changes. Although mHealth apps have the potential to reach all population segments, providing accessible and personalized services, their effectiveness is often limited by low participant engagement and high attrition rates.

OBJECTIVE

This study concerns a large-scale, open-access mHealth app, based in the Netherlands, focused on improving the lifestyle behaviors of its participants. The study examines whether periodic email prompts increased participant engagement with the mHealth app and how this effect evolved over time. Points gained from the activities in the app were used as an objective measure of participant engagement with the program. The activities considered were physical workouts tracked through the mHealth app and interactions with the web-based coach.

METHODS

The data analyzed covered 22,797 unique participants over a period of 78 weeks. A hidden Markov model (HMM) was used for disentangling the overtime effects of periodic email prompts on participant engagement with the mHealth app. The HMM accounted for transitions between latent activity states, which generated the observed measure of points received in a week.

RESULTS

The HMM indicated that, on average, 70% (15,958/22,797) of the participants were in the inactivity state, gaining 0 points in total per week; 18% (4103/22,797) of the participants were in the average activity state, gaining 27 points per week; and 12% (2736/22,797) of the participants were in the high activity state, gaining 182 points per week. Receiving and opening a generic email was associated with a 3 percentage point increase in the likelihood of becoming active in that week, compared with the weeks when no email was received. Examining detailed email categories revealed that the participants were more likely to increase their activity level following emails that were in line with the program's goal, such as emails regarding health campaigns, while being resistant to emails that deviated from the program's goal, such as emails regarding special deals.

CONCLUSIONS

Participant engagement with a behavior change mHealth app can be positively influenced by email prompts, albeit to a limited extent. Given the relatively low costs associated with emails and the high population reach that mHealth apps can achieve, such instruments can be a cost-effective means of increasing participant engagement in the stride toward improving program effectiveness.

The Intersection of Persuasive System Design and Personalization in Mobile Health: Statistical Evaluation

Background

Persuasive technology is an umbrella term that encompasses software (eg, mobile apps) or hardware (eg, smartwatches) designed to influence users to perform preferable behavior once or on a long-term basis. Considering the ubiquitous nature of mobile devices across all socioeconomic groups, user behavior modification thrives under the personalized care that persuasive technology can offer. However, there is no guidance for developing personalized persuasive technologies based on the psychological characteristics of users.

Objective

This study examined the role that psychological characteristics play in interpreted mobile health (mHealth) screen perceived persuasiveness. In addition, this study aims to explore how users’ psychological characteristics drive the perceived persuasiveness of digital health technologies in an effort to assist developers and researchers of digital health technologies by creating more engaging solutions.

Methods

An experiment was designed to evaluate how psychological characteristics (self-efficacy, health consciousness, health motivation, and the Big Five personality traits) affect the perceived persuasiveness of digital health technologies, using the persuasive system design framework. Participants (n=262) were recruited by Qualtrics International, Inc, using the web-based survey system of the XM Research Service. This experiment involved a survey-based design with a series of 25 mHealth app screens that featured the use of persuasive principles, with a focus on physical activity. Exploratory factor analysis and linear regression were used to evaluate the multifaceted needs of digital health users based on their psychological characteristics.

Results

The results imply that an individual user’s psychological characteristics (self-efficacy, health consciousness, health motivation, and extraversion) affect interpreted mHealth screen perceived persuasiveness, and combinations of persuasive principles and psychological characteristics lead to greater perceived persuasiveness. The F test (ie, ANOVA) for model 1 was significant (F9,6540=191.806; P<.001), with an adjusted R2 of 0.208, indicating that the demographic variables explained 20.8% of the variance in perceived persuasiveness. Gender was a significant predictor, with women having higher perceived persuasiveness (P=.008) relative to men. Age was a significant predictor of perceived persuasiveness with individuals aged 40 to 59 years (P<.001) and ≥60 years (P<.001). Model 2 was significant (F13,6536=341.035; P<.001), with an adjusted R2 of 0.403, indicating that the demographic variables self-efficacy, health consciousness, health motivation, and extraversion together explained 40.3% of the variance in perceived persuasiveness.

Conclusions

This study evaluates the role that psychological characteristics play in interpreted mHealth screen perceived persuasiveness. Findings indicate that self-efficacy, health consciousness, health motivation, extraversion, gender, age, and education significantly influence the perceived persuasiveness of digital health technologies. Moreover, this study showed that varying combinations of psychological characteristics and demographic variables affected the perceived persuasiveness of the primary persuasive technology category.

Building Emotional Awareness and Mental Health (BEAM): study protocol for a phase III randomized controlled trial of the BEAM app-based program for mothers of children 18-36 months

BACKGROUND

The prevalence of maternal depression and anxiety has increased during the COVID-19 pandemic, and pregnant individuals are experiencing concerningly elevated levels of mental health symptoms worldwide. Many individuals may now be at heightened risk of postpartum mental health disorders. There are significant concerns that a cohort of children may be at-risk for impaired self-regulation and mental illness due to elevated exposure to perinatal mental illness. With both an increased prevalence of depression and limited availability of services due to the pandemic, there is an urgent need for accessible eHealth interventions for mothers of young children. The aims of this trial are to evaluate the efficacy of the Building Emotion Awareness and Mental Health (BEAM) app-based program for reducing maternal depression symptoms (primary outcome) and improve anxiety symptoms, parenting stress, family relationships, and mother and child functioning (secondary outcomes) compared to treatment as usual (TAU).

METHODS

A two-arm randomized controlled trial (RCT) with repeated measures will be used to evaluate the efficacy of the BEAM intervention compared to TAU among a sample of 140 mothers with children aged 18 to 36 months, who self-report moderate-to-severe symptoms of depression and/or anxiety. Individuals will be recruited online, and those randomized to the treatment group will participate in 10 weeks of psychoeducation modules, an online social support forum, and weekly group teletherapy sessions. Assessments will occur at 18-36 months postpartum (pre-test, T1), immediately after the last week of the BEAM intervention (post-test, T2), and at 3 months after the intervention (follow-up, T3).

DISCUSSION

eHealth interventions have the potential to address elevated maternal mental health symptoms, parenting stress, and child functioning concerns during and after the COVID-19 pandemic and to provide accessible programming to mothers who are in need of support. This RCT will build on an open pilot trial of the BEAM program and provide further evaluation of this evidence-based intervention. Findings will increase our understanding of depression in mothers with young children and reveal the potential for long-term improvements in maternal and child health and family well-being.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05306626 . Registered on April 1, 2022.

Smoking Cessation Smartphone App Use Over Time: Predicting 12-Month Cessation Outcomes in a 2-Arm Randomized Trial

BACKGROUND

Little is known about how individuals engage over time with smartphone app interventions and whether this engagement predicts health outcomes.

OBJECTIVE

In the context of a randomized trial comparing 2 smartphone apps for smoking cessation, this study aimed to determine distinct groups of smartphone app log-in trajectories over a 6-month period, their association with smoking cessation outcomes at 12 months, and baseline user characteristics that predict data-driven trajectory group membership.

METHODS

Functional clustering of 182 consecutive days of smoothed log-in data from both arms of a large (N=2415) randomized trial of 2 smartphone apps for smoking cessation (iCanQuit and QuitGuide) was used to identify distinct trajectory groups. Logistic regression was used to determine the association of group membership with the primary outcome of 30-day point prevalence of smoking abstinence at 12 months. Finally, the baseline characteristics associated with group membership were examined using logistic and multinomial logistic regression. The analyses were conducted separately for each app.

RESULTS

For iCanQuit, participants were clustered into 3 groups: "1-week users" (610/1069, 57.06%), "4-week users" (303/1069, 28.34%), and "26-week users" (156/1069, 14.59%). For smoking cessation rates at the 12-month follow-up, compared with 1-week users, 4-week users had 50% higher odds of cessation (30% vs 23%; odds ratio [OR] 1.50, 95% CI 1.05-2.14; P=.03), whereas 26-week users had 397% higher odds (56% vs 23%; OR 4.97, 95% CI 3.31-7.52; P<.001). For QuitGuide, participants were clustered into 2 groups: "1-week users" (695/1064, 65.32%) and "3-week users" (369/1064, 34.68%). The difference in the odds of being abstinent at 12 months for 3-week users versus 1-week users was minimal (23% vs 21%; OR 1.16, 95% CI 0.84-1.62; P=.37). Different baseline characteristics predicted the trajectory group membership for each app.

CONCLUSIONS

Patterns of 1-, 3-, and 4-week smartphone app use for smoking cessation may be common in how people engage in digital health interventions. There were significantly higher odds of quitting smoking among 4-week users and especially among 26-week users of the iCanQuit app. To improve study outcomes, strategies for detecting users who disengage early from these interventions (1-week users) and proactively offering them a more intensive intervention could be fruitful.

Mindfulness and Relaxation Techniques for Stroke Survivors with Aphasia: A Feasibility and Acceptability Study

Stroke survivors with aphasia (SsWA) tend to experience high levels of anxiety and stress, leading to an increased risk of recurrent strokes. Mindfulness and/or relaxation that does not require language outputs could reduce psychosocial stress; however, these approaches work best if they consist of a range of techniques and are modified to suit the needs of SsWA. Using a mixed-methods approach, we examined the feasibility and acceptability of a set of tailored mindfulness and relaxation techniques for SsWA. Nine SsWA were recruited (six men and three women, median age = 51 years). Four relaxation and mindfulness techniques which had been tailored for SsWA were filmed into a DVD/YouTube video and were given to participants together with a practice diary for home practice once daily for 5 weeks. The participants joined focus group discussions and completed a feasibility scale 5 weeks later. The participants perceived these techniques as easy, user-friendly and acceptable for SsWA in general. Although practised less often than instructed, many participants reported benefits of regular practice. The perceived relevance of these techniques to the participants' own situations and the intention to continue varied. Future research could encourage the regular practice of self-help interventions by incorporating behavioural change techniques such as using prompts and cues.

Exploring an Artificial Intelligence–Based, Gamified Phone App Prototype to Track and Improve Food Choices of Adolescent Girls in Vietnam: Acceptability, Usability, and Likeability Study

Background

Adolescents’ consumption of healthy foods is suboptimal in low- and middle-income countries. Adolescents’ fondness for games and social media and the increasing access to smartphones make apps suitable for collecting dietary data and influencing their food choices. Little is known about how adolescents use phones to track and shape their food choices.

Objective

This study aimed to examine the acceptability, usability, and likability of a mobile phone app prototype developed to collect dietary data using artificial intelligence–based image recognition of foods, provide feedback, and motivate users to make healthier food choices. The findings were used to improve the design of the app.

Methods

A total of 4 focus group discussions (n=32 girls, aged 15-17 years) were conducted in Vietnam. Qualitative data were collected and analyzed by grouping ideas into common themes based on content analysis and ground theory.

Results

Adolescents accepted most of the individual- and team-based dietary goals presented in the app prototype to help them make healthier food choices. They deemed the overall app wireframes, interface, and graphic design as acceptable, likable, and usable but suggested the following modifications: tailored feedback based on users’ medical history, anthropometric characteristics, and fitness goals; new language on dietary goals; provision of information about each of the food group dietary goals; wider camera frame to fit the whole family food tray, as meals are shared in Vietnam; possibility of digitally separating food consumption on shared meals; and more appealing graphic design, including unique badge designs for each food group. Participants also liked the app’s feedback on food choices in the form of badges, notifications, and statistics. A new version of the app was designed incorporating adolescent’s feedback to improve its acceptability, usability, and likability.

Conclusions

A phone app prototype designed to track food choice and help adolescent girls from low- and middle-income countries make healthier food choices was found to be acceptable, likable, and usable. Further research is needed to examine the feasibility of using this technology at scale.

Theory-Based Self-Management Interventions for Community-Dwelling Stroke Survivors: A Systematic Review and Meta-Analysis

IMPORTANCE

Self-management is a critical component of stroke rehabilitation. A better understanding of the use of theory and behavior change techniques (BCTs) informs the development of more effective stroke self-management interventions.

OBJECTIVE

To examine what theories and BCTs have been applied in stroke self-management interventions; investigate the extent to which these interventions encourage implementation of behavior changes; and appraise their effectiveness to enhance self-efficacy, quality of life, and functional independence.

DATA SOURCES

Ovid MEDLINE, Embase, Scopus, CINAHL, Cochrane Library, and ClinicalTrials.gov were searched from inception to May 26, 2020.

STUDY SELECTION AND DATA COLLECTION

Randomized controlled trials (RCTs) in six databases were reviewed for inclusion and analysis. We included trials that involved community-dwelling adult stroke survivors, assessed the effectiveness of self-management interventions, and explicitly mentioned the use of theory in the development of the intervention. We assessed use of theory and BCTs using the Theory Coding Scheme and BCT taxonomy v1, respectively.

FINDINGS

A total of 3,049 studies were screened, and 13 RCTs were included. The predominant theory and BCT categories were Social Cognitive Theory (7 studies) and goals and planning (12 studies), respectively. Significant and small effect sizes were found for self-efficacy (0.27) and functional independence (0.19).

CONCLUSIONS AND RELEVANCE

Theory-based self-management interventions have the potential to enhance stroke outcomes. Systematic reporting on the use of theory and BCTs is recommended to enhance clarity and facilitate evaluations of future interventions. What This Article Adds: This review supports and guides occupational therapy practitioners to use theory-based self-management intervention as a routine part of stroke rehabilitation to improve stroke survivors' experience in the community.

An Intervention to Connect Patients With Psychosis and Volunteers via Smartphone (the Phone Pal): Development Study

BACKGROUND

Intervention development is a critical stage. However, evidence indicates that the substandard reporting of intervention details is widespread.

OBJECTIVE

This study aimed to provide an overview of the guiding frameworks, methodology, and stages for the design and construction of a new complex intervention-the Phone Pal.

METHODS

The intervention development process followed the Medical Research Council framework for developing complex interventions as well as the person-based approach. The intervention was developed following the evidence synthesis of a literature review, a focus group study, and a survey after consultation and input from advisory groups with a range of stakeholders, including patients, volunteers, clinicians, and academics.

RESULTS

The developed logic model outlines the contextual factors, intervention, mechanisms of change, and short- and long-term outcomes. The operationalized intervention required matching 1 patient with 1 volunteer to communicate with each other through a smartphone via SMS text messages, WhatsApp messages or email, and audio or video calls. Each participant was encouraged to communicate with their match at least once per week for a 12-week period using informal conversation.

CONCLUSIONS

The systematic process and theoretically sound strategy through which this intervention was developed can provide insights to future researchers on the reality of developing and preparing the operationalization of a digital intervention using multiple components.

Three-arm randomised controlled trial of an m-health app and digital engagement strategy for improving treatment adherence and reducing suicidal ideation in young people: study protocol

INTRODUCTION

Youth suicidal ideation and behaviour is concerning due to its widespread prevalence, morbidity and potentially fatal consequences. Digital mental health interventions have been found to improve access to low-cost and high-quality support for a range of mental health issues, yet there are few digital interventions available for suicide prevention in young people. In addition, no studies have examined how digital engagement strategies may impact the engagement and efficacy of digital interventions in suicide prevention. The current protocol describes a three-arm parallel randomised controlled trial. A therapeutic smartphone application ('LifeBuoy'; intervention condition) will be tested against a condition that consists of the LifeBuoy application plus access to a digital engagement strategy ('LifeBuoy+engagement'; intervention condition) to determine whether the addition of the digital strategy improves app engagement metrics. To establish the efficacy of the LifeBuoy application, both of these intervention conditions will be tested against an attention-matched control condition (a placebo app).

METHODS AND ANALYSIS

669 young Australians aged 17-24 years who have experienced suicidal ideation in the past 30 days will be recruited by Facebook advertisement. The primary outcomes will be suicidal ideation severity and level of app engagement. Primary analyses will use an intention-to-treat approach and compare changes from baseline to 30-day, 60-day and 120-day follow-up time points relative to the control group using mixed-effect modelling. A subset of participants in the intervention groups will be interviewed on their experience with the app and engagement strategy. Qualitative data will be analysed using an inductive approach, independent of a theoretical confirmative method to identify the group themes.

ETHICS AND DISSEMINATION

The study has been approved by the University of New South Wales Human Research Ethics Committee (HC210400). The results of the trial will be disseminated via peer-reviewed publications in scientific journals and conferences.

TRIAL REGISTRATION NUMBER

ACTRN12621001247864.

Delivering Mindfulness-Based Interventions for Insomnia, Pain, and Dysfunctional Eating Through a Text Messaging App: Three Randomized Controlled Trials Investigating the Effectiveness and Mediating Mechanisms

Background

Although text messaging has the potential to be the core intervention modality, it is often used as an adjunct only. To improve health and alleviate the distress related to insomnia, pain, and dysregulated eating of people living in urban areas, text messaging–based mindfulness-based interventions were designed and evaluated in 3 randomized controlled trials.

Objective

This study investigated the effectiveness and mediating mechanisms of text messaging–based mindfulness-based interventions for people with distress related to insomnia, pain, or dysregulated eating.

Methods

In these trials, 333, 235, and 351 participants were recruited online and randomized to intervention and wait-list control conditions for insomnia, pain, and dysregulated eating, respectively. Participants experienced 21 days of intervention through WhatsApp Messenger. Participants completed pre-, post-, 1-month follow-up, and 3-month follow-up self-report questionnaires online. The retention rates at postmeasurements were 83.2% (139/167), 77.1% (91/118), and 72.9% (129/177) for intervention groups of insomnia, pain, and dysregulated eating, respectively. Participants’ queries were answered by a study technician. Primary outcomes included insomnia severity, presleep arousal, pain intensity, pain acceptance, and eating behaviors. Secondary outcomes included mindfulness, depression, anxiety, mental well-being, and functional impairments. Mindfulness, dysfunctional beliefs and attitudes about sleep, pain catastrophizing, and reactivity to food cues were hypothesized to mediate the relationship between the intervention and outcomes.

Results

For all 3 studies, the intervention groups showed significant improvement on most outcomes at 1-month follow-up compared to their respective wait-list control groups; some primary outcomes (eg, insomnia, pain, dysregulated eating indicators) and secondary outcomes (eg, depression, anxiety symptoms) were sustained at 3-month follow-up. Medium-to-large effect sizes were found at postassessments in most outcomes in all studies. In the intervention for insomnia, mediation analyses showed that dysfunctional beliefs and attitudes about sleep mediated the effect of the intervention on all primary outcomes and most secondary outcomes at both 1-month and 3-month follow-ups, whereas mindfulness mediated the intervention effect on presleep arousal at 1-month and 3-month follow-ups. In the intervention for pain, pain catastrophizing mediated the effect of intervention on pain intensity and functioning at both 1-month and 3-month follow-ups, whereas mindfulness only mediated the effect of intervention on anxiety and depressive symptoms. In the intervention for dysregulated eating, power of food mediated the effect of intervention on both uncontrolled and emotional eating at both 1-month and 3-month follow-ups and mindfulness was found to mediate the effect on depressive symptoms at both 1-month and 3-month follow-ups.

Conclusions

These 3 studies converged and provided empirical evidence that mindfulness-based interventions delivered through text messaging are effective in improving distress related to sleep, pain, and dysregulated eating. Text messaging has the potential to be a core intervention modality to improve various common health outcomes for people living a fast-paced lifestyle.

Trial Registration

Clinical Research and Biostatistics Clinical Trials Registry CUHK_CCRB00559; https://tinyurl.com/24rkwarz

Virtual Laboratories- A historical review and bibliometric analysis of the past three decades

Online and virtual teaching-learning has been a panacea that most educational institutions adopted from the dire need created by COVID-19. We provide a comprehensive bibliometric study of 9523 publications on virtual laboratories in higher education covering the years 1991 to 2021. Influential bibliometrics such as publications and citations, productive countries, contributing institutions, funders, journals, authors, and bibliographic couplings were studied using the Scientific Procedures and Rationales for Systematic Literature Reviews (SPAR-4-SLR) protocol. A new metric to complement citations called Field Weighted Citation Impact was introduced that considers the differences in research behavior across disciplines. Findings show that 72% of the research work was published between 2011-and 2021, most likely due to digitalization, with the highest number of publications in 2020-2021 highlighting the impact of the pandemic. Top contributing institutions were from the developed economies of Spain, Germany, and the United States. The citation impact from publications with international co-authors is the highest, highlighting the importance of co-authoring papers with different countries. For the first time, Altmetrics in the context of virtual labs were studied though a very low correlation was observed between citations and Altmetrics Attention Score. Still, the overall percentage of publications with attention showed linear growth. Our work also highlights that virtual laboratory could play a significant role in achieving the United Nations Sustainable Development Goals, specifically SDG4-Quality Education, which largely remains under-addressed.

Can Personalization Persuade? Study of Notification Adaptation in Mobile Behavior Change Intervention Application

The growing ubiquity of smartphones and the ease of creating and distributing applications render the mobile platform an attractive means for facilitating positive behavior change at scale. Within the smartphone as a behavior change support system, mobile notifications play a critical role as they enable timely and relevant information distribution. In this paper we describe our preliminary investigation of the persuasiveness of mobile notifications delivered within a real-world behavior change intervention mobile app, which enabled users to set goals and define tasks related to those goals. The application aimed to motivate the users with notifications belonging to one of two groups—tailored and non-tailored, seeing them as sparks in the Fogg Behavior Model and personalizing them according to the users’ Big Five personality traits. Results indicate that customized messages may work for some individuals while working poorly for others. When analyzing users as a single group, no significant differences were observed, but when proceeding with the analysis on the individual level we found seven users whose personality traits notifications interact with in interesting ways. Our results offer two general insights: (1) Using personality-tailored messaging in a dynamic mobile domain as opposed to a static domain leads to different outcomes, and it seems that there is no one-to-one mapping between domains; (2) A major reason for most of our hypotheses being false may be that messages that are deemed as persuasive on their own are not what persuades people to perform an action. Unlike the clear-cut findings observed in other domains, we discover a rather nuanced relationship between the personalization and persuasiveness that calls for further exploration at the individual participant level.

Effectiveness of an optimized text message and Internet intervention for smoking cessation: A randomized controlled trial

AIMS

To evaluate the effectiveness of a combined internet and text message intervention for smoking cessation compared with an internet intervention alone. The text message intervention was optimized for engagement in an earlier multiphase optimization (MOST) screening phase.

DESIGN

A parallel, two-group, individually randomized clinical trial (RCT) was conducted in a MOST confirming phase. Recruitment spanned December 2018 to March 2019. Follow-up was conducted at 3 and 9 months, beginning March 2019 and ending January 2020.

SETTING

United States: a digital study conducted among new registrants on a free tobacco cessation website.

PARTICIPANTS

Eligible individuals were 618 adult current smokers in the United States, age 18 years or older who signed up for text messages during website registration (67.2% female, 70.4% white).

INTERVENTIONS

The treatment arm (WEB+TXT; n = 311) received access to the website and text messaging. The control arm (WEB; n = 307) received access to the website alone.

MEASUREMENTS

The primary outcome was self-reported 30-day point prevalence abstinence (ppa) at 9 months post-randomization analyzed under intent to treat (ITT), counting non-responders as smoking. Secondary outcomes included 3-month measures of 30-day ppa, intervention engagement and intervention satisfaction.

FINDINGS

Abstinence rates at 9 months were 23.1% among WEB+TXT and 23.2% among WEB (OR = 1.00, 95% CI = 0.69-1.45; P = 0.99). WEB+TXT increased engagement with 5 of 6 interactive features (standardized mean difference (SMD) = 0.26-0.47, all P < 0.001) and repeat website visits (48.7% vs 38.9%, SMD = 0.14, P = 0.02). Satisfaction metrics favored WEB+TXT (satisfied: 96.3% vs 90.5%, SMD = 0.17, P = 0.008; recommend to friend: 95.9% vs 90.1%, SMD = 0.16, P = 0.028).

CONCLUSIONS

A randomized controlled trial found no evidence that a combined internet and text message intervention for smoking cessation compared with an internet intervention alone increased 9-month abstinence rates among adult current smokers in the United States, despite evidence of higher levels of intervention engagement and satisfaction at 3 months.

Digital Prompts to Increase Engagement With the Headspace App and for Stress Regulation Among Parents: Feasibility Study

Background

Given the interrelated health of children and parents, strategies to promote stress regulation are critically important in the family context. However, the uptake of preventive mental health is limited among parents owing to competing family demands.

Objective

In this study, we aim to determine whether it is feasible and acceptable to randomize digital prompts designed to engage parents in real-time brief mindfulness activities guided by a commercially available app.

Methods

We conducted a 30-day pilot microrandomized trial among a sample of parents who used Android smartphones. Each day during a parent-specified time frame, participants had a 50% probability of receiving a prompt with a message encouraging them to engage in a mindfulness activity using a commercial app, Headspace. In the 24 hours following randomization, ecological momentary assessments and passively collected smartphone data were used to assess proximal engagement (yes or no) with the app and any mindfulness activity (with or without the app). These data were combined with baseline and exit surveys to determine feasibility and acceptability.

Results

Over 4 months, 83 interested parents were screened, 48 were eligible, 16 were enrolled, and 10 were successfully onboarded. Reasons for nonparticipation included technology barriers, privacy concerns, time constraints, or change of mind. In total, 80% (8/10) of parents who onboarded successfully completed all aspects of the intervention. While it is feasible to randomize prompt delivery, only 60% (6/10) of parents reported that the timing of prompts was helpful despite having control over the delivery window. Across the study period, we observed higher self-reported engagement with Headspace on days with prompts (31/62, 50% of days), as opposed to days without prompts (33/103, 32% of days). This pattern was consistent for most participants in this study (7/8, 87%). The time spent using the app on days with prompts (mean 566, SD 378 seconds) was descriptively higher than on days without prompts (mean 225, SD 276 seconds). App usage was highest during the first week and declined over each of the remaining 3 weeks. However, self-reported engagement in mindfulness activities without the app increased over time. Self-reported engagement with any mindfulness activity was similar on days with (40/62, 65% of days) and without (65/103, 63% of days) prompts. Participants found the Headspace app helpful (10/10, 100%) and would recommend the program to others (9/10, 90%).

Conclusions

Preliminary findings suggest that parents are receptive to using mindfulness apps to support stress management, and prompts are likely to increase engagement with the app. However, we identified several implementation challenges in the current trial, specifically a need to optimize prompt timing and frequency as a strategy to engage users in preventive digital mental health.

A Tailored App for the Self-management of Musculoskeletal Conditions: Evidencing a Logic Model of Behavior Change

Background

Musculoskeletal conditions such as joint pain are a growing problem, affecting 18.8 million people in the United Kingdom. Digital health interventions (DHIs) are a potentially effective way of delivering information and supporting self-management. It is vital that the development of such interventions is transparent and can illustrate how individual components work, how they link back to the theoretical constructs they are attempting to change, and how this might influence outcomes. getUBetter is a DHI developed to address the lack of personalized, supported self-management tools available to patients with musculoskeletal conditions by providing knowledge, skills, and confidence to navigate through a self-management journey.

Objective

The aim of this study was to map a logic model of behavior change for getUBetter to illustrate how the content and functionality of the DHI are aligned with recognized behavioral theory, effective behavior change techniques, and clinical guidelines.

Methods

A range of behavior change models and frameworks were used, including the behavior change wheel and persuasive systems design framework, to map the logic model of behavior change underpinning getUBetter. The three main stages included understanding the behavior the intervention is attempting to change, identifying which elements of the intervention might bring about the desired change in behavior, and describing intervention content and how this can be optimally implemented.

Results

The content was mapped to 25 behavior change techniques, including information about health consequences, instruction on how to perform a behavior, reducing negative emotions, and verbal persuasion about capability. Mapping to the persuasive system design framework illustrated the use of a number of persuasive design principles, including tailoring, personalization, simulation, and reminders.

Conclusions

This process enabled the proposed mechanisms of action and theoretical foundations of getUBetter to be comprehensively described, highlighting the key techniques used to support patients to self-manage their condition. These findings provide guidance for the ongoing evaluation of the effectiveness (including quality of engagement) of the intervention and highlight areas that might be strengthened in future iterations.

Design of a randomized controlled trial of digital health and community health worker support for diabetes management among low-income patients

BACKGROUND

Insulin-dependent diabetes is a challenging disease to manage and involves complex behaviors, such as self-monitoring of blood glucose. This can be especially challenging in the face of socioeconomic barriers and in the wake of the COVID-19 pandemic. Digital health self-monitoring interventions and community health worker support are promising and complementary best practices for improving diabetes-related health behaviors and outcomes. Yet, these strategies have not been tested in combination. This protocol paper describes the rationale and design of a trial that measures the combined effect of digital health and community health worker support on glucose self-monitoring and glycosylated hemoglobin.

METHODS

The study population was uninsured or publicly insured; lived in high-poverty, urban neighborhoods; and had poorly controlled diabetes mellitus with insulin dependence. The study consisted of three arms: usual diabetes care; digital health self-monitoring; or combined digital health and community health worker support. The primary outcome was adherence to blood glucose self-monitoring. The exploratory outcome was change in glycosylated hemoglobin.

CONCLUSION

The design of this trial was grounded in social justice and community engagement. The study protocols were designed in collaboration with frontline community health workers, the study aim was explicit about furthering knowledge useful for advancing health equity, and the population was focused on low-income people. This trial will advance knowledge of whether combining digital health and community health worker interventions can improve glucose self-monitoring and diabetes-related outcomes in a high-risk population.

Impact of a Digital Intervention for Literacy in Depression among Portuguese University Students: A Randomized Controlled Trial

Digital interventions are important tools to promote mental health literacy among university students. “Depression in Portuguese University Students” (Depressão em Estudantes Universitários Portugueses, DEEP) is an audiovisual intervention describing how symptoms can be identified and what possible treatments can be applied. The aim of this study was to evaluate the impact of this intervention. A random sample of 98 students, aged 20–38 years old, participated in a 12-week study. Participants were recruited through social media by the academic services and institutional emails of two Portuguese universities. Participants were contacted and distributed into four study groups (G1, G2, G3 and G4): G1 received the DEEP intervention in audiovisual format; G2 was given the DEEP in text format; G3 received four news articles on depression; G4 was the control group. A questionnaire was shared to collect socio-demographic and depression knowledge data as a pre-intervention method; content was then distributed to each group following a set schedule; the depression knowledge questionnaire was then administered to compare pre-intervention, post-intervention and follow-up literacy levels. Using the Scheffé and Least Significant Difference (LSD) multiple comparisons test, it was found that G1, which received the DEEP audiovisual intervention, differed significantly from the other groups, with higher depression knowledge scores in post-intervention stages. The DEEP audiovisual intervention, compared to the other formats used (narrative text format; news format), proved to be an effective tool for increasing depression knowledge in university students.

Web-Based Structured Education for Type 2 Diabetes: Interdisciplinary User-Centered Design Approach

BACKGROUND

Digital health research encompasses methods from human-computer interaction and health research.

OBJECTIVE

This paper aims to describe how these methods were combined to develop HeLP-Diabetes: Starting Out, a web-based structured education program for people newly diagnosed with type 2 diabetes.

METHODS

The development process consisted of three phases: initial design for effectiveness, optimization for usability, and in the wild testing in the National Health Service with people newly diagnosed with type 2 diabetes, and further revisions. We adopted an iterative user-centered approach and followed steps from the human-computer interaction design life cycle and the Medical Research Council guidelines on developing and evaluating complex interventions.

RESULTS

The initial design process resulted in an 8-session program containing information and behavior change techniques targeting weight loss, being more active, and taking medication. The usability testing was highlighted at an early stage, where changes needed to be made to the language and layout of the program. The in the wild testing provided data on uptake of and barriers to use. The study suggested low uptake and completion of the program, but those who used it seemed to benefit from it. The qualitative findings suggested that barriers to use included an expectation that the program would take too long. This informed refinements to the program.

CONCLUSIONS

The use of interdisciplinary methods resulted in an iterative development process and refinements to the program that were based on user needs and data on uptake. The final intervention was more suitable for a definitive evaluation than the initial version. The description of our approach informs other digital health researchers on how to make interventions more sensitive to user needs.

Technology-supported strategies for promoting user engagement with digital mental health interventions: A systematic review

Background

Although digital mental health interventions (DMHIs) offer a potential solution for increasing access to mental health treatment, their integration into real-world settings has been slow. A key reason for this is poor user engagement. A growing number of studies evaluating strategies for promoting engagement with DMHIs means that a review of the literature is now warranted. This systematic review is the first to synthesise evidence on technology-supported strategies for promoting engagement with DMHIs.

Methods

MEDLINE, EmbASE, PsycINFO and PubMed databases were searched from 1 January 1995 to 1 October 2021. Experimental or quasi-experimental studies examining the effect of technology-supported engagement strategies deployed alongside DMHIs were included, as were secondary analyses of such studies. Title and abstract screening, full-text coding and quality assessment were performed independently by two authors. Narrative synthesis was used to summarise findings from the included studies.

Results

24 studies (10,266 participants) were included. Engagement strategies ranged from reminders, coaching, personalised information and peer support. Most strategies were disseminated once a week, usually via email or telephone. There was some empirical support for the efficacy of technology-based strategies towards promoting engagement. However, findings were mixed regardless of strategy type or study aim.

Conclusions

Technology-supported strategies appear to increase engagement with DMHIs; however, their efficacy varies widely by strategy type. Future research should involve end-users in the development and evaluation of these strategies to develop a more cohesive set of strategies that are acceptable and effective for target audiences, and explore the mechanism(s) through which such strategies promote engagement.

Development of a computer-aided text message platform for user engagement with a digital Diabetes Prevention Program: a case study

Digital Diabetes Prevention Programs (dDPP) are novel mHealth applications that leverage digital features such as tracking and messaging to support behavior change for diabetes prevention. Despite their clinical effectiveness, long-term engagement to these programs remains a challenge, creating barriers to adherence and meaningful health outcomes. We partnered with a dDPP vendor to develop a personalized automatic message system (PAMS) to promote user engagement to the dDPP platform by sending messages on behalf of their primary care provider. PAMS innovates by integrating into clinical workflows. User-centered design (UCD) methodologies in the form of iterative cycles of focus groups, user interviews, design workshops, and other core UCD activities were utilized to defined PAMS requirements. PAMS uses computational tools to deliver theory-based, automated, tailored messages, and content to support patient use of dDPP. In this article, we discuss the design and development of our system, including key requirements and features, the technical architecture and build, and preliminary user testing.

Estimating the impact of engagement with digital health interventions on patient outcomes in randomized trials

OBJECTIVE

Guidance is needed on studying engagement and treatment effects in digital health interventions, including levels required for benefit. We evaluated multiple analytic approaches for understanding the association between engagement and clinical outcomes.

MATERIALS AND METHODS

We defined engagement as intervention participants' response rate to interactive text messages, and considered moderation, standard regression, mediation, and a modified instrumental variable (IV) analysis to investigate the relationship between engagement and clinical outcomes. We applied each approach to two randomized controlled trials featuring text message content in the intervention: REACH (Rapid Encouragement/Education and Communications for Health), which targeted diabetes, and VERB (Vanderbilt Emergency Room Bundle), which targeted hypertension.

RESULTS

In REACH, the treatment effect on hemoglobin A1c was estimated to be -0.73% (95% CI: [-1.29, -0.21]; P = 0.008), and in VERB, the treatment effect on systolic blood pressure was estimated to be -10.1 mmHg (95% CI: [-17.7, -2.8]; P = 0.007). Only the IV analyses suggested an effect of engagement on outcomes; the difference in treatment effects between engagers and non-engagers was -0.29% to -0.51% in the REACH study and -1.08 to -3.25 mmHg in the VERB study.

DISCUSSION

Standard regression and mediation have less power than a modified IV analysis, but the IV approach requires specification of assumptions. This is the first review of the strengths and limitations of various approaches to evaluating the impact of engagement on outcomes.

CONCLUSIONS

Understanding the role of engagement in digital health interventions can help reveal when and how these interventions achieve desired outcomes.

A review of the quality and content of mobile apps to support lifestyle modifications following a transient ischaemic attack or 'minor' stroke

Objective

Secondary prevention is recommended to reduce cardiovascular risk after transient ischaemic attack (TIA) or ‘minor’ stroke. Mobile health interventions can provide accessible, cost-effective approaches to address modifiable risk factors, such as physical inactivity, hypertension and being overweight. The objective of this study was to evaluate the quality of apps for supporting lifestyle change following a TIA or ‘minor’ stroke.

Methods

Systematic searches of Google Play and the Apple Store were carried out to identify mobile apps released between 1 November 2019 and 1 October 2021. Keywords were used including stroke, TIA, lifestyle, prevention and recovery. Quality was assessed using the Mobile Application Rating Scale (MARS). Common components were identified with the Behaviour Change Technique (BCT) Taxonomy. Descriptive statistics were used to summarize the performance results for each app.

Results

Searches identified 2545 potential apps. Thirty remained after removing duplicates and screening titles and descriptions. Six were eligible after full review of their content. All apps included at least one BCT (range: 1–16 BCTs). The most frequent BCTs included ‘information about health consequences’ (n = 5/6), ‘verbal or visual communication from a credible source’ (n = 4/6) and ‘action planning’ (n = 4/6). The mean MARS score was 2.57/5 (SD: 0.51; range: 1.78–3.36). No apps were of ‘good’ overall quality (scoring more than 4/5).

Conclusions

This is the first review of mobile health interventions for this population. Only a small number of apps were available. None were targeted specifically at people with a TIA or ‘minor’ stroke. Overall quality was low. Further work is needed to develop and test accessible, user designed, and evidence-informed digital interventions in this population.

Identifying behaviour change techniques within randomized trials of interventions promoting deceased organ donation registration

OBJECTIVE

Increasing deceased organ donation registration may increase the number of available organs for transplant to help save lives. This study aimed to identify which behaviour change techniques (BCTs; or 'active ingredients') are reported within randomized trials of interventions promoting deceased organ donation registration and of those, which are associated with a larger intervention effect.

METHODS

We conducted a secondary analysis of 45 trials included in a Cochrane systematic review of deceased organ donation registration interventions. Two researchers used the BCT Taxonomy v1 to independently code intervention content in all trial groups. Outcome data were pooled and we used meta-regression to explore associations between individual and combinations of recurring BCTs and effect on registration intention and/or registration behaviour.

RESULTS

A total of 27 different BCTs (mean = 3.7, range = 1-9) were identified in intervention groups across the 45 trials. The five most common BCTs were: 'Information about health consequences' (71%); 'Instruction on how to perform the behaviour' (47%); 'Salience of consequences' (40%); 'Adding objects to the environment' (28%); and 'Credible source' (27%). Comparator groups in 20/45 trials also included identifiable BCTs (n = 12, mean = 3.1, range = 1-7). Meta-regression revealed that a combination of the three most common BCTs was associated with a larger intervention effect size for registration behaviour (k = 8, β = .19, p = .02).

CONCLUSIONS

Trials of deceased organ donation registration interventions focus predominantly on providing information, instruction, and a means to register. While potentially effective, a much wider set of possible BCTs could be leveraged to address known barriers to registration.