Engagement features judged by excessive drinkers as most important to include in smartphone applications for alcohol reduction: A mixed-methods study

Engagement with mHealth Alcohol Interventions: User Perspectives on an App or Chatbot-Delivered Program to Reduce Drinking

Research suggests participant engagement is a key mediator of mHealth alcohol interventions' effectiveness in reducing alcohol consumption among users. Understanding the features that promote engagement is critical to maximizing the effectiveness of mHealth-delivered alcohol interventions. The purpose of this study was to identify facilitators and barriers to mHealth alcohol intervention utilization among hazardous-drinking participants who were randomized to use either an app (Step Away) or Artificial Intelligence (AI) chatbot-based intervention for reducing drinking (the Step Away chatbot). We conducted semi-structured interviews from December 2019 to January 2020 with 20 participants who used the app or chatbot for three months, identifying common facilitators and barriers to use. Participants of both interventions reported that tracking their drinking, receiving feedback about their drinking, feeling held accountable, notifications about high-risk drinking times, and reminders to track their drinking promoted continued engagement. Positivity, personalization, gaining insight into their drinking, and daily tips were stronger facilitator themes among bot users, indicating these may be strengths of the AI chatbot-based intervention when compared to a user-directed app. While tracking drinking was a theme among both groups, it was more salient among app users, potentially due to the option to quickly track drinks in the app that was not present with the conversational chatbot. Notification glitches, technology glitches, and difficulty with tracking drinking data were usage barriers for both groups. Lengthy setup processes were a stronger barrier for app users. Repetitiveness of the bot conversation, receipt of non-tailored daily tips, and inability to self-navigate to desired content were reported as barriers by bot users. To maximize engagement with AI interventions, future developers should include tracking to reinforce behavior change self-monitoring and be mindful of repetitive conversations, lengthy setup, and pathways that limit self-directed navigation.

Keeping Track of My Drinking - Patient Perceptions of Using Smartphone Applications as a Treatment Complement for Alcohol Dependence

BACKGROUND

Alcohol dependence is common, yet highly undertreated. Smartphone applications (apps) have potential to enhance treatment accessibility and effectiveness, however evidence is limited, especially studies focussing on user experiences. The aim was to describe patient perceptions on the usability and acceptability of self-monitoring apps provided as treatment complement for alcohol dependence.

METHODS

Individual semi-structured interviews were conducted through video or phone calls with 21 participants, recruited from a randomized controlled trial at a dependency clinic in Stockholm. The participants had used two specific apps for self-monitoring consumption ("Glasklart" and "iBAC") during 12 wk prior to the interviews. Data was analyzed using Qualitative Content Analysis.

RESULTS

Two domains were identified: 1) Smartphone applications as facilitators to treatment, and 2) Barriers to smartphone application use. Using apps within the treatment context was believed to increase the accuracy of the reported consumption. Participants became more aware of their alcohol problem and described the apps as reinforcers that could increase both the motivation to change and the focus on the problem and commitment to treatment. The apps were further described as helpful to control alcohol consumption. However, app usage was constrained by technical problems, unfit app-specific features and procedures, and alcohol-related shame and stigma.

DISCUSSION AND CONCLUSIONS

Self-monitoring alcohol apps have several beneficial features that can help assess, track, and control alcohol consumption, and improve communication with clinicians. The results indicate they can be useful complements to treatment for patients with alcohol dependence, but their use can be limited by different, foremost technical, issues.

Testing a Digital Health App for Patients With Alcohol-Associated Liver Disease: Mixed Methods Usability Study

BACKGROUND

Alcohol-associated liver disease (ALD) is increasingly common and associated with serious and costly health consequences. Cessation of drinking can improve ALD morbidity and mortality; however, support for cessation is not routinely offered to those diagnosed with ALD, and continued drinking or resumption of drinking after diagnosis is common. Mobile health (mHealth) has the potential to offer convenient and scalable support for alcohol cessation to those diagnosed with ALD, but mHealth interventions for alcohol cessation have not been designed for or evaluated in a population with ALD.

OBJECTIVE

This study aims to understand how individuals with ALD would perceive and use an mHealth tool for alcohol cessation and to gather their perspectives on potential refinements to the tool that would allow it to better meet their needs.

METHODS

We interviewed 11 individuals who attended clinic visits related to their ALD to elicit their needs related to support for alcohol cessation and views on how mHealth could be applied. After completing initial interviews (pre), participants were provided with access to an mHealth app designed for alcohol cessation, which they used for 1 month. Afterward, they were interviewed again (post) to give feedback on their experiences, including aspects of the app that met their needs and potential refinements. We applied a mixed methods approach, including a qualitative analysis to identify major themes from the interview transcripts and descriptive analyses of use of the app over 1 month.

RESULTS

First, we found that a diagnosis of ALD is perceived as a motivator to quit drinking but that patients had difficulty processing the overwhelming amount of information about ALD they received and finding resources for cessation of alcohol use. Second, we found that the app was perceived as usable and useful for supporting drinking recovery, with patients responding favorably to the self-tracking and motivational components of the app. Finally, patients identified areas in which the app could be adapted to meet the needs of patients with ALD, such as providing information on the medical implications of an ALD diagnosis and how to care for their liver as well as connecting individuals with ALD to one another via a peer-to-peer support forum. Rates of app use were high and sustained across the entire study, with participants using the app a little more than half the days during the study on average and with 100% (11/11) of participants logging in each week.

CONCLUSIONS

Our results highlight the need for convenient access to resources for alcohol cessation after ALD diagnosis and support the potential of an mHealth approach to integrate recovery support into care for ALD. Our findings also highlight the ways the alcohol cessation app should be modified to address ALD-specific concerns.

Examining engagement with and acceptability and usability of REAL Parenting: A brief online parent-based intervention to reduce alcohol use and consequences among high school students

This study is a formative assessment of REAL Parenting (RP): a brief, digital intervention for parents of high school students that encourages parent-teen communication about alcohol and, in turn, aims to prevent teen alcohol use. The aims of this study were to describe engagement with, and acceptability and usability of RP; and to explore the relationship of these measures with each other and with short-term outcomes. Participants were 160 parents randomly assigned to the treatment group who received RP as part of a randomized pilot trial (M_age = 45.43[SD = 7.26], 59.3% female, 56% White, 19% Hispanic). App-based program analytics captured real-time engagement with RP. Parents completed self-report measures of acceptability, usability, perceived communication effectiveness, perceived self-efficacy to communicate, and frequency of communication post-intervention. Descriptive statistics were calculated to describe engagement, acceptability and usability, and zero-order correlations were calculated to examine associations between these and self-report variables. About 75% (n = 118) of parents accessed the intervention and two-thirds (n = 110) accessed at least one module. Self-report ratings of acceptability and usability were neutral to positive, and mothers liked RP more than fathers. Self-report, but not program analytic indicators were associated with short-term outcomes. Findings suggest that, with little incentive, most parents will access an app focused on parent-teen communication about alcohol. While parent feedback was positive, it also highlighted areas for improvement with app content and design. Correlations suggest that analytic metrics of engagement are useful to discern who is and is not using interventions, and self-report measures are important for understanding pathways by which interventions are associated with short-term outcomes.

Promoting Hand Hygiene During the COVID-19 Pandemic: Parallel Randomized Trial for the Optimization of the Soapp App

BACKGROUND

Hand hygiene is an effective behavior for preventing the spread of the respiratory disease COVID-19 and was included in public health guidelines worldwide. Behavior change interventions addressing hand hygiene have the potential to support the adherence to public health recommendations and, thereby, prevent the spread of COVID-19. However, randomized trials are largely absent during a pandemic; therefore, there is little knowledge about the most effective strategies to promote hand hygiene during an ongoing pandemic. This study addresses this gap by presenting the results of the optimization phase of a Multiphase Optimization Strategy of Soapp, a smartphone app for promoting hand hygiene in the context of the COVID-19 pandemic.

OBJECTIVE

This study aimed to identify the most effective combination and sequence of 3 theory- and evidence-based intervention modules (habit, motivation, and social norms) for promoting hand hygiene. To this end, 9 versions of Soapp were developed (conditions), and 2 optimization criteria were defined: the condition with the largest increase in hand hygiene at follow-up and condition with the highest engagement, usability, and satisfaction based on quantitative and qualitative analyses.

METHODS

This study was a parallel randomized trial with 9 intervention conditions defined by the combination of 2 intervention modules and their sequence. The trial was conducted from March to August 2021 with interested participants from the Swiss general population (N=232; randomized). Randomization was performed using Qualtrics (Qualtrics International Inc), and blinding was ensured. The duration of the intervention was 34 days. The primary outcome was self-reported hand hygiene at follow-up, which was assessed using an electronic diary. The secondary outcomes were user engagement, usability, and satisfaction assessed at follow-up. Nine participants were further invited to participate in semistructured exit interviews. A set of ANOVAs was performed to test the main hypotheses, whereas a thematic analysis was performed to analyze the qualitative data.

RESULTS

The results showed a significant increase in hand hygiene over time across all conditions. There was no interaction effect between time and intervention condition. Similarly, no between-group differences in engagement, usability, and satisfaction emerged. Seven themes (eg, "variety and timeliness of the task load" and "social interaction") were found in the thematic analysis.

CONCLUSIONS

The effectiveness of Soapp in promoting hand hygiene laid the foundation for the next evaluation phase of the app. More generally, the study supported the value of digital interventions in pandemic contexts. The findings showed no differential effect of intervention conditions involving different combinations and sequences of the habit, motivation, and social norms modules on hand hygiene, engagement, usability, and satisfaction. In the absence of quantitative differences, we relied on the results from the thematic analysis to select the best version of Soapp for the evaluation phase.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04830761; https://clinicaltrials.gov/ct2/show/NCT04830761.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2021-055971.

Smartphone-based alcohol interventions: A systematic review on the role of notifications in changing behaviors toward alcohol

Background: Smartphone-based interventions are increasingly being used to facilitate positive behavior change, including reducing alcohol consumption. However, less is known about the effects of notifications to support this change, including intervention engagement and adherence. The aim of this review was to assess the role of notifications in smartphone-based interventions designed to support, manage, or reduce alcohol consumption. Methods: Five electronic databases were searched to identify studies meeting inclusion criteria: (1) studies using a smartphone-based alcohol intervention, (2) the intervention used notifications, and (3) published between 1st January 2007 and 30th April 2021 in English. PROSPERO was searched to identify any completed, ongoing, or planned systematic reviews and meta-analyses of relevance. The reference lists of all included studies were searched. Results: Overall, 14 papers were identified, reporting on 10 different interventions. The strength of the evidence regarding the role and utility of notifications in changing behavior toward alcohol of the reviewed interventions was inconclusive. Only one study drew distinct conclusions about the relationships between notifications and app engagement, and notifications and behavior change. Conclusions: Although there are many smartphone-based interventions to support alcohol reduction, this review highlights a lack of evidence to support the use of notifications (such as push notifications, alerts, prompts, and nudges) used within smartphone interventions for alcohol management aiming to promote positive behavior change. Included studies were limited due to small sample sizes and insufficient follow-up. Evidence for the benefits of smartphone-based alcohol interventions remains promising, but the efficacy of using notifications, especially personalized notifications, within these interventions remain unproven.

Perceptions of Factors Influencing Engagement With Health and Well-being Apps in the United Kingdom: Qualitative Interview Study

BACKGROUND

Digital health devices, such as health and well-being smartphone apps, could offer an accessible and cost-effective way to deliver health and well-being interventions. A key component of the effectiveness of health and well-being apps is user engagement. However, engagement with health and well-being apps is typically poor. Previous studies have identified a list of factors that could influence engagement; however, most of these studies were conducted on a particular population or for an app targeting a particular behavior. An understanding of the factors that influence engagement with a wide range of health and well-being apps can inform the design and the development of more engaging apps in general.

OBJECTIVE

The aim of this study is to explore user experiences of and reasons for engaging and not engaging with a wide range of health and well-being apps.

METHODS

A sample of adults in the United Kingdom (N=17) interested in using a health or well-being app participated in a semistructured interview to explore experiences of engaging and not engaging with these apps. Participants were recruited via social media platforms. Data were analyzed with the framework approach, informed by the Capability, Opportunity, Motivation-Behaviour (COM-B) model and the Theoretical Domains Framework, which are 2 widely used frameworks that incorporate a comprehensive set of behavioral influences.

RESULTS

Factors that influence the capability of participants included available user guidance, statistical and health information, reduced cognitive load, well-designed reminders, self-monitoring features, features that help establish a routine, features that offer a safety net, and stepping-stone app characteristics. Tailoring, peer support, and embedded professional support were identified as important factors that enhance user opportunities for engagement with health and well-being apps. Feedback, rewards, encouragement, goal setting, action planning, self-confidence, and commitment were judged to be the motivation factors that affect engagement with health and well-being apps.

CONCLUSIONS

Multiple factors were identified across all components of the COM-B model that may be valuable for the development of more engaging health and well-being apps. Engagement appears to be influenced primarily by features that provide user guidance, promote minimal cognitive load, support self-monitoring (capability), provide embedded social support (opportunity), and provide goal setting with action planning (motivation). This research provides recommendations for policy makers, industry, health care providers, and app developers for increasing effective engagement.

Design Features for Improving Mobile Health Intervention User Engagement: Systematic Review and Thematic Analysis

Background

Well-designed mobile health (mHealth) interventions support a positive user experience; however, a high rate of disengagement has been reported as a common concern regarding mHealth interventions. To address this issue, it is necessary to summarize the design features that improve user engagement based on research over the past 10 years, during which time the popularity of mHealth interventions has rapidly increased due to the use of smartphones.

Objective

The aim of this review was to answer the question “Which design features improve user engagement with mHealth interventions?” by summarizing published literature with the purpose of guiding the design of future mHealth interventions.

Methods

This review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. Databases, namely, PubMed, Web of Science, Cochrane Library, Ovid EMBASE, and Ovid PsycINFO, were searched for English and Chinese language papers published from January 2009 to June 2019. Thematic analysis was undertaken to assess the design features in eligible studies. The Mixed Methods Appraisal Tool was used to assess study quality.

Results

A total of 35 articles were included. The investigated mHealth interventions were mainly used in unhealthy lifestyle (n=17) and chronic disease (n=10) prevention programs. Mobile phone apps (n=24) were the most common delivery method. Qualitative (n=22) and mixed methods (n=9) designs were widely represented. We identified the following 7 themes that influenced user engagement: personalization (n=29), reinforcement (n=23), communication (n=20), navigation (n=17), credibility (n=16), message presentation (n=16), and interface aesthetics (n=7). A checklist was developed that contained these 7 design features and 29 corresponding specific implementations derived from the studies.

Conclusions

This systematic review and thematic synthesis identified useful design features that make an mHealth intervention more user friendly. We generated a checklist with evidence-based items to enable developers to use our findings easily. Future evaluations should use more robust quantitative approaches to elucidate the relationships between design features and user engagement.

Engagement With a Web-Based Intervention to Reduce Harmful Drinking: Secondary Analysis of a Randomized Controlled Trial

Background

Engagement with digital behavior change interventions (DBCIs) is considered a prerequisite for intervention efficacy. However, in many trials on DBCIs, participants use the intervention either only little or not at all.

Objective

To analyze engagement with a web-based intervention to reduce harmful drinking, we explored (1) whether engagement with a web-based alcohol intervention is related to drinking outcomes, (2) which user characteristics are associated with measures of engagement, and (3) whether reported outcomes are associated with data captured by voluntary intervention questionnaires.

Methods

We analyzed data of the intervention arm of a randomized controlled trial on a DBCI to reduce risky alcohol consumption. Data were collected at baseline (T0), after 90 days (T1), and at the end of the 180-day usage period (T2). Engagement with the intervention was measured via system usage data as well as self-reported usage. Drinking behavior was measured as average daily alcohol consumption as well as the number of binge drinking days. User characteristics included demographics, baseline drinking behavior, readiness to change, alcohol-related outcome expectancies, and alcohol abstinence self-efficacy. Following a bivariate approach, we performed two-tailed Welch’s t tests and Wilcoxon signed rank/Mann-Whitney U tests or calculated correlation coefficients.

Results

The data of 306 users were analyzed. Time spent engaging with the intervention as measured by system usage did not match self-reported usage. Higher self-reported usage was associated with higher reductions in average daily alcohol consumption (T1: ρ=0.39, P<.001; T2: ρ=0.29, P=.015) and in binge drinking days (T1: ρ=0.62, P<.001; T2: ρ=0.3, P=.006). Higher usage was reported from users who were single (T1: P<.001; T2: P<.001), users without children (T1: P<.001; T2: P<.001), users who did not start or finish secondary education (T1: P<.001; T2: P<.001), users without academic education (T1: P<.001; T2: P<.001), and those who worked (T1: P=.001; T2: P=.004). Relationships between self-reported usage and clinical or psychological baseline characteristics were complex. For system usage, the findings were mixed. Reductions in drinking captured by intervention questionnaires were associated with reported outcomes.

Conclusions

Though self-reported usage could be consistently linked to better outcomes and multiple user characteristics, our findings add to the overall inconclusive evidence that can be found throughout the literature. Our findings indicate potential benefits of self-reports as measures of engagement and intervention questionnaires as a basis for tailoring of intervention content. Future studies should adopt a theory-driven approach to engagement research utilizing psychometrically sound self-report questionnaires and include short ecological momentary assessments within the DBCIs.

Trial Registration

German Clinical Trials Register DRKS00006104; https://tinyurl.com/y22oc5jo

Designing m-Health interventions for precision mental health support

Mobile health (m-Health) resources are emerging as a significant tool to overcome mental health support access barriers due to their ability to rapidly reach and provide support to individuals in need of mental health support. m-Health provides an approach to adapt and initiate mental health support at precise moments, when they are most likely to be effective for the individual. However, poor adoption of mental health apps in the real world suggests that new approaches to optimising the quality of m-Health interventions are critically needed in order to realise the potential translational benefits for mental health support. The micro-randomised trial is an experimental approach for optimising and adapting m-Health resources. This trial design provides data to construct and optimise m-Health interventions. The data can be used to inform when and what type of m-Health interventions should be initiated, and thus serve to integrate interventions into daily routines with precision. Here, we illustrate this approach in a case study, review implementation issues that need to be considered while conducting an MRT, and provide a checklist for mental health m-Health intervention developers.

Influences on the Uptake of and Engagement With Health and Well-Being Smartphone Apps: Systematic Review

BACKGROUND

The public health impact of health and well-being digital interventions is dependent upon sufficient real-world uptake and engagement. Uptake is currently largely dependent on popularity indicators (eg, ranking and user ratings on app stores), which may not correspond with effectiveness, and rapid disengagement is common. Therefore, there is an urgent need to identify factors that influence uptake and engagement with health and well-being apps to inform new approaches that promote the effective use of such tools.

OBJECTIVE

This review aimed to understand what is known about influences on the uptake of and engagement with health and well-being smartphone apps among adults.

METHODS

We conducted a systematic review of quantitative, qualitative, and mixed methods studies. Studies conducted on adults were included if they focused on health and well-being smartphone apps reporting on uptake and engagement behavior. Studies identified through a systematic search in Medical Literature Analysis and Retrieval System Online, or MEDLARS Online (MEDLINE), EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsychINFO, Scopus, Cochrane library databases, DataBase systems and Logic Programming (DBLP), and Association for Computing Machinery (ACM) Digital library were screened, with a proportion screened independently by 2 authors. Data synthesis and interpretation were undertaken using a deductive iterative process. External validity checking was undertaken by an independent researcher. A narrative synthesis of the findings was structured around the components of the capability, opportunity, motivation, behavior change model and the theoretical domains framework (TDF).

RESULTS

Of the 7640 identified studies, 41 were included in the review. Factors related to uptake (U), engagement (E), or both (B) were identified. Under capability, the main factors identified were app literacy skills (B), app awareness (U), available user guidance (B), health information (E), statistical information on progress (E), well-designed reminders (E), features to reduce cognitive load (E), and self-monitoring features (E). Availability at low cost (U), positive tone, and personalization (E) were identified as physical opportunity factors, whereas recommendations for health and well-being apps (U), embedded health professional support (E), and social networking (E) possibilities were social opportunity factors. Finally, the motivation factors included positive feedback (E), available rewards (E), goal setting (E), and the perceived utility of the app (E).

CONCLUSIONS

Across a wide range of populations and behaviors, 26 factors relating to capability, opportunity, and motivation appear to influence the uptake of and engagement with health and well-being smartphone apps. Our recommendations may help app developers, health app portal developers, and policy makers in the optimization of health and well-being apps.

Engagement in a Novel Internet Intervention for Alcohol Reduction: A Qualitative Study of User Motivations and Experiences

Internet interventions are effective in reducing alcohol consumption, but little is known regarding their acceptability. We aimed to inform recruitment and retention strategies by exploring users' motivations and experiences in using a novel, Internet intervention, the Hello Sunday Morning (HSM) program. We conducted one-to-one, telephone-enabled qualitative interviews with 24 adult users of HSM (50 percent female; M_age = 42.42 years), purposively selected to ensure diversity in demographics and drinking levels. Data were analyzed using thematic analysis. Two themes, each with two subthemes were identified: (1a) pathway to HSM: HSM attracted participants seeking help for alcohol-related problems, and those not yet seeking help; (1b) format and framing: the positive, nonthreatening framing and anonymous, convenient format enabled participants to join out of interest, curiosity, or desire for a challenge; (2a) support and normalization: participants gained social support from other users, and their problems with alcohol and desire to seek help were normalized; (2b) goal setting and self-monitoring: setting goals and monitoring progress provided participants with motivation and self-accountability. We conclude that evidence-based behavior change techniques, including social support, normative strategies, goal setting, and self-monitoring, were appealing to users. These aspects could be incorporated into other programs to recruit participants who might otherwise avoid or delay seeking help.

Adults' Preferences for Behavior Change Techniques and Engagement Features in a Mobile App to Promote 24-Hour Movement Behaviors: Cross-Sectional Survey Study

Background

There is a limited understanding of components that should be included in digital interventions for 24-hour movement behaviors (physical activity [PA], sleep, and sedentary behavior [SB]). For intervention effectiveness, user engagement is important. This can be enhanced by a user-centered design to, for example, explore and integrate user preferences for intervention techniques and features.

Objective

This study aimed to examine adult users’ preferences for techniques and features in mobile apps for 24-hour movement behaviors.

Methods

A total of 86 participants (mean age 37.4 years [SD 9.2]; 49/86, 57% female) completed a Web-based survey. Behavior change techniques (BCTs) were based on a validated taxonomy v2 by Abraham and Michie, and engagement features were based on a list extracted from the literature. Behavioral data were collected using Fitbit trackers. Correlations, (repeated measures) analysis of variance, and independent sample t tests were used to examine associations and differences between and within users by the type of health domain and users’ behavioral intention and adoption.

Results

Preferences were generally the highest for information on the health consequences of movement behavior self-monitoring, behavioral feedback, insight into healthy lifestyles, and tips and instructions. Although the same ranking was found for techniques across behaviors, preferences were stronger for all but one BCT for PA in comparison to the other two health behaviors. Although techniques fit user preferences for addressing PA well, supplemental techniques may be able to address preferences for sleep and SB in a better manner. In addition to what is commonly included in apps, sleep apps should consider providing tips for sleep. SB apps may wish to include more self-regulation and goal-setting techniques. Few differences were found by users’ intentions or adoption to change a particular behavior. Apps should provide more self-monitoring (P=.03), information on behavior health outcome (P=.048), and feedback (P=.04) and incorporate social support (P=.048) to help those who are further removed from healthy sleep. A virtual coach (P<.001) and video modeling (P=.004) may provide appreciated support to those who are physically less active. PA self-monitoring appealed more to those with an intention to change PA (P=.03). Social comparison and support features are not high on users’ agenda and may not be needed from an engagement point of view. Engagement features may not be very relevant for user engagement but should be examined in future research with a less reflective method.

Conclusions

The findings of this study provide guidance for the design of digital 24-hour movement behavior interventions. As 24-hour movement guidelines are increasingly being adopted in several countries, our study findings are timely to support the design of interventions to meet these guidelines.

Do Daily Fluctuations in Psychological and App-Related Variables Predict Engagement With an Alcohol Reduction App? A Series of N-Of-1 Studies

BACKGROUND

Previous studies have identified psychological and smartphone app-related predictors of engagement with alcohol reduction apps at a group level. However, strategies to promote engagement need to be effective at the individual level. Evidence as to whether group-level predictors of engagement are also predictive for individuals is lacking.

OBJECTIVE

The aim of this study was to examine whether daily fluctuations in (1) the receipt of a reminder, (2) motivation to reduce alcohol, (3) perceived usefulness of the app, (4) alcohol consumption, and (5) perceived lack of time predicted within-person variability in the frequency and amount of engagement with an alcohol reduction app.

METHODS

We conducted a series of observational N-of-1 studies. The predictor variables were measured twice daily for 28 days via ecological momentary assessments. The outcome variables were measured through automated recordings of the participants' app screen views. A total of nine London-based adults who drank alcohol excessively and were willing to set a reduction goal took part. Each participant's dataset was analyzed separately using generalized additive mixed models to derive incidence rate ratios (IRRs) for the within-person associations of the predictor and outcome variables. Debriefing interviews, analyzed using thematic analysis, were used to contextualize the findings.

RESULTS

Predictors of the frequency and amount of engagement differed between individuals, and for the variables 'perceived usefulness of the app' and 'perceived lack of time', the direction of associations also differed between individuals. The most consistent predictors of within-person variability in the frequency of engagement were the receipt of a daily reminder (IRR=1.80-3.88; P<.05) and perceived usefulness of the app (IRR=0.82-1.42; P<.05). The most consistent predictors of within-person variability in the amount of engagement were motivation to reduce alcohol (IRR=1.67-3.45; P<.05) and perceived usefulness of the app (IRR=0.52-137.32; P<.05).

CONCLUSIONS

The utility of the selected psychological and app-related variables in predicting the frequency and amount of engagement with an alcohol reduction app differed at the individual level. This highlights that key within-person associations may be masked in group-level designs and suggests that different strategies to promote engagement may be required for different individuals.

Development and usability evaluation of an online self-management intervention for fear of cancer recurrence (iConquerFear)

OBJECTIVE

To develop and evaluate the usability of iConquerFear, an online self-management adaptation of an efficacious face-to-face therapist-delivered treatment for fear of cancer recurrence (FCR).

METHODS

iConquerFear development was theory based and person based. Development was guided by Ritterband et al's behaviour change model for internet interventions. iConquerFear end users (cancer survivors) provided iterative feedback in accordance with Yardley et al's person-based approach to maximise engagement and usability. Online focus groups and cognitive interviews were conducted to evaluate the usability of iConquerFear. Discussions were recorded, transcribed verbatim, and thematically analysed.

RESULTS

Five online FCR modules were developed. Twenty-three cancer survivors (47% of those eligible) participated; 11/23 (58%) were breast cancer survivors, and average age was 53 years (SD = 10.8). Thematic saturation was reached after six focus groups (n = 16) and seven individual think-aloud interviews. Thematic analysis produced five overarching themes: easy navigation essential; satisfaction and engagement with content; flexible access is key; normalising and empowering; and a useful first step.

CONCLUSIONS

Online self-management interventions like iConquerFear have the potential to address the unmet supportive care needs reported by burgeoning numbers of cancer survivors. However, that potential may not be realised unless interventions are rigorously developed and user tested, as benefits are constrained by limited engagement. Themes from the usability testing of iConquerFear highlight the importance of developing flexible, tailored, interactive, and contextual online self-management interventions for people with cancer.

Implementation of the goal-setting components in popular physical activity apps: Review and content analysis

OBJECTIVE

Goal setting is an effective strategy to promote physical activity. Commercial apps that tackle physical activity often include goal setting; however, it is unknown whether the implementation of the goal-setting components is congruent with the theory. This study evaluated the quality of goal setting in popular free and paid physical activity apps by assessing the presence of effective goal-setting components.

METHODS

A six-item scale was developed based on the goal-setting literature and used for coding each app for the presence/absence of goal-setting components (i.e. specificity, difficulty, action planning, timeframe, goal evaluation and goal re-evaluation). Cohen's Kappa was used to evaluate inter-rater reliability for each scale item. The number of goal-setting components included in the 40 apps was calculated and the difference between free and paid apps was assessed.

RESULTS

All scale items achieved satisfactory inter-rater reliability except 'goal evaluation'. The most frequently included goal-setting components in popular physical activity apps were 'goal specificity' (95% of the apps) and 'goal timeframe' (67.5%). Conversely, only 47.5% and 25% of the apps implemented 'action planning' and 'goal difficulty', respectively, and none included 'goal re-evaluation'. No differences emerged between free and paid apps.

CONCLUSIONS

The quality of the goal-setting strategy in popular physical activity apps could be improved by introducing components scarcely implemented to date. In particular, tailoring the goal difficulty to the users' ability level and re-evaluating the goals based on achievements should be implemented to increase the quality of goal setting.