User Preferences for Content, Features, and Style for an App to Reduce Harmful Drinking in Young Adults: Analysis of User Feedback in App Stores and Focus Group Interviews

Discovering what young adults want in electronic interventions aimed at reducing alcohol-related consequences

BACKGROUND

Despite intervention efforts, negative alcohol-related consequences continue to impact young adults. Most alcohol interventions focus on reducing alcohol consumption; however, previous research indicates that focusing solely on alcohol use may not decrease consequences. Additionally, many alcohol interventions have diminishing engagement, and few are designed with young adults involved in the development process. Drawing on user-centered design, this study sought to understand young adult perceptions, preferences, and needs for electronic interventions specifically aimed at reducing alcohol consequences.

METHODS

Using semi-structured qualitative interviews, 21 young adult drinkers (ages 18-24; 57.1% female) shared their opinions regarding the need for electronic interventions (i.e., mobile or web-delivered) to reduce alcohol consequences as well as their preferences for content, features, and ways to increase engagement. Interviews were coded and analyzed using a multi-step thematic analysis approach.

RESULTS

As part of our discovery phase of intervention development, content coding revealed four main themes. Participants perceived several benefits of interventions focused on alcohol consequences, such as promoting mindful alcohol use and reducing alcohol-related harms. Participants also discussed perceived limitations of such programs, including believing consequences from drinking are unavoidable, necessary for learning, and associated with peer pressure. Preferences for features included real-time tracking, personalized feedback, and psychoeducation along with preferences for design including non-judgmental framing, interactive content, and a user-friendly platform.

CONCLUSIONS

Engaging end users early in the development process is a valuable approach to increase intervention relevancy with the target population. This can also inform intervention content and design to maximize engagement and satisfaction (e.g., framing, features, and interactivity) while also reducing barriers identified early on (e.g., peer pressure).

Engagement With a Remote Symptom-Tracking Platform Among Participants With Major Depressive Disorder: Randomized Controlled Trial

BACKGROUND

Multiparametric remote measurement technologies (RMTs), which comprise smartphones and wearable devices, have the potential to revolutionize understanding of the etiology and trajectory of major depressive disorder (MDD). Engagement with RMTs in MDD research is of the utmost importance for the validity of predictive analytical methods and long-term use and can be conceptualized as both objective engagement (data availability) and subjective engagement (system usability and experiential factors). Positioning the design of user interfaces within the theoretical framework of the Behavior Change Wheel can help maximize effectiveness. In-app components containing information from credible sources, visual feedback, and access to support provide an opportunity to promote engagement with RMTs while minimizing team resources. Randomized controlled trials are the gold standard in quantifying the effects of in-app components on engagement with RMTs in patients with MDD.

OBJECTIVE

This study aims to evaluate whether a multiparametric RMT system with theoretically informed notifications, visual progress tracking, and access to research team contact details could promote engagement with remote symptom tracking over and above the system as usual. We hypothesized that participants using the adapted app (intervention group) would have higher engagement in symptom monitoring, as measured by objective and subjective engagement.

METHODS

A 2-arm, parallel-group randomized controlled trial (participant-blinded) with 1:1 randomization was conducted with 100 participants with MDD over 12 weeks. Participants in both arms used the RADAR-base system, comprising a smartphone app for weekly symptom assessments and a wearable Fitbit device for continuous passive tracking. Participants in the intervention arm (n=50, 50%) also had access to additional in-app components. The primary outcome was objective engagement, measured as the percentage of weekly questionnaires completed during follow-up. The secondary outcomes measured subjective engagement (system engagement, system usability, and emotional self-awareness).

RESULTS

The levels of completion of the Patient Health Questionnaire-8 (PHQ-8) were similar between the control (67/97, 69%) and intervention (66/97, 68%) arms (P value for the difference between the arms=.83, 95% CI -9.32 to 11.65). The intervention group participants reported slightly higher user engagement (1.93, 95% CI -1.91 to 5.78), emotional self-awareness (1.13, 95% CI -2.93 to 5.19), and system usability (2.29, 95% CI -5.93 to 10.52) scores than the control group participants at follow-up; however, all CIs were wide and included 0. Process evaluation suggested that participants saw the in-app components as helpful in increasing task completion.

CONCLUSIONS

The adapted system did not increase objective or subjective engagement in remote symptom tracking in our research cohort. This study provides an important foundation for understanding engagement with RMTs for research and the methodologies by which this work can be replicated in both community and clinical settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04972474; https://clinicaltrials.gov/ct2/show/NCT04972474.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/32653.

Thematic Analysis on User Reviews for Depression and Anxiety Chatbot Apps: Machine Learning Approach

BACKGROUND

Anxiety and depression are among the most commonly prevalent mental health disorders worldwide. Chatbot apps can play an important role in relieving anxiety and depression. Users' reviews of chatbot apps are considered an important source of data for exploring users' opinions and satisfaction.

OBJECTIVE

This study aims to explore users' opinions, satisfaction, and attitudes toward anxiety and depression chatbot apps by conducting a thematic analysis of users' reviews of 11 anxiety and depression chatbot apps collected from the Google Play Store and Apple App Store. In addition, we propose a workflow to provide a methodological approach for future analysis of app review comments.

METHODS

We analyzed 205,581 user review comments from chatbots designed for users with anxiety and depression symptoms. Using scraper tools and Google Play Scraper and App Store Scraper Python libraries, we extracted the text and metadata. The reviews were divided into positive and negative meta-themes based on users' rating per review. We analyzed the reviews using word frequencies of bigrams and words in pairs. A topic modeling technique, latent Dirichlet allocation, was applied to identify topics in the reviews and analyzed to detect themes and subthemes.

RESULTS

Thematic analysis was conducted on 5 topics for each sentimental set. Reviews were categorized as positive or negative. For positive reviews, the main themes were confidence and affirmation building, adequate analysis, and consultation, caring as a friend, and ease of use. For negative reviews, the results revealed the following themes: usability issues, update issues, privacy, and noncreative conversations.

CONCLUSIONS

Using a machine learning approach, we were able to analyze ≥200,000 comments and categorize them into themes, allowing us to observe users' expectations effectively despite some negative factors. A methodological workflow is provided for the future analysis of review comments.

Smartphone-based alcohol interventions: A systematic review on the role of notifications in changing behaviors toward alcohol

Background: Smartphone-based interventions are increasingly being used to facilitate positive behavior change, including reducing alcohol consumption. However, less is known about the effects of notifications to support this change, including intervention engagement and adherence. The aim of this review was to assess the role of notifications in smartphone-based interventions designed to support, manage, or reduce alcohol consumption. Methods: Five electronic databases were searched to identify studies meeting inclusion criteria: (1) studies using a smartphone-based alcohol intervention, (2) the intervention used notifications, and (3) published between 1st January 2007 and 30th April 2021 in English. PROSPERO was searched to identify any completed, ongoing, or planned systematic reviews and meta-analyses of relevance. The reference lists of all included studies were searched. Results: Overall, 14 papers were identified, reporting on 10 different interventions. The strength of the evidence regarding the role and utility of notifications in changing behavior toward alcohol of the reviewed interventions was inconclusive. Only one study drew distinct conclusions about the relationships between notifications and app engagement, and notifications and behavior change. Conclusions: Although there are many smartphone-based interventions to support alcohol reduction, this review highlights a lack of evidence to support the use of notifications (such as push notifications, alerts, prompts, and nudges) used within smartphone interventions for alcohol management aiming to promote positive behavior change. Included studies were limited due to small sample sizes and insufficient follow-up. Evidence for the benefits of smartphone-based alcohol interventions remains promising, but the efficacy of using notifications, especially personalized notifications, within these interventions remain unproven.

A feature-oriented analysis of developers' descriptions and user reviews of top mHealth applications for diabetes and hypertension

BACKGROUND AND OBJECTIVE

Diabetes and hypertension are two prevalent and related chronic conditions. To inform the design and development of mobile health applications (mHealth apps) for people living with multiple chronic conditions, this paper examines features mentioned in developers' descriptions and user reviews of mHealth apps, along with users' attitudes toward associated features.

MATERIALS AND METHODS

Eleven top apps for diabetes and hypertension were identified from Google Play as of January 2020. Based on a stratified sampling strategy, 1,100 user reviews were selected to form the final dataset. Developers' descriptions were also collected for analysis. Using the grounded theory approach, we developed a feature-oriented coding scheme, which was used to identify three levels of features mentioned in app descriptions and user reviews: feature group (the highest level), feature type (the second level), and individual feature (the lowest level). Users' attitudes toward app features mentioned in user reviews were also analyzed.

RESULTS

Most top-rated apps for diabetes and hypertension under study were multifeatured, incorporating self-management, information sharing, and decision support features. At the feature-group level, most informative user reviews commented on features related to self-management, followed by decision support and information sharing. The four most frequently mentioned feature types were data entry, data export/import, data visualization, and assessment. Users expressed overwhelming positive attitudes toward app features across all feature categories. Based on users' assessments of existing features and requests for additional features, design implications for app development are provided.

CONCLUSIONS

Despite the diversity of app features provided by mHealth apps and users' primarily positive attitudes toward existing app features, more comprehensive and personalized features are expected by app users to satisfy their health needs. Beyond identifying app features in user reviews, future research may seek more in-depth feedback from real-life patients for app development and design using methods like interviews and focus groups, to further enhance the overall quality of relevant mHealth apps to better support users.

Consumer Perspectives on Maternal and Infant Health Apps: Qualitative Content Analysis

BACKGROUND

Despite the popularity of maternal and infant health mobile apps, ongoing consumer engagement and sustained app use remain barriers. Few studies have examined user experiences or perceived benefits of maternal and infant health app use from consumer perspectives.

OBJECTIVE

This study aims to assess users' self-reported experiences with maternal and infant health apps, perceived benefits, and general feedback by analyzing publicly available user reviews on two popular app stores-Apple App Store and Google Play Store.

METHODS

We conducted a qualitative assessment of publicly available user reviews (N=2422) sampled from 75 maternal and infant health apps designed to provide health education or decision-making support to pregnant women or parents and caregivers of infants. The reviews were coded and analyzed using a general inductive qualitative content analysis approach.

RESULTS

The three major themes included the following: app functionality, where users discussed app features and functions; technical aspects, where users talked about technology-based aspects of an app; and app content, where users specifically focused on the app content and the information it provides. The six minor themes included the following: patterns of use, where users highlighted the frequency and type of use; social support, where users talked about receiving social support from friends, family and community of other users; app cost, where users talked about the cost of an app within the context of being cost-effective or a potential waste of money; app comparisons, where users compared one app with others available in app stores; assistance in health care, where users specifically highlighted the role of an app in offering clinical assistance; and customer care support, where users specifically talked about their interaction with the app customer care support team.

CONCLUSIONS

Users generally tend to value apps that are of low cost and preferably free, with high-quality content, superior features, enhanced technical aspects, and user-friendly interfaces. Users also find app developer responsiveness to be integral, as it offers them an opportunity to engage in the app development and delivery process. These findings may be beneficial for app developers in designing better apps, as no best practice guidelines currently exist for the app environment.

Brief interventions to prevent excessive alcohol use in adolescents at low-risk presenting to Emergency Departments: Three-arm, randomised trial of effectiveness and cost-effectiveness

BACKGROUND

Alcohol consumption and related harm increase rapidly from the age of 12 years. We evaluated whether alcohol screening and brief intervention is effective and cost-effective in delaying hazardous or harmful drinking amongst low-risk or abstaining adolescents attending Emergency Departments (EDs).

METHODS

This ten-centre, three-arm, parallel-group, single-blind, pragmatic, individually randomised trial screened ED attenders aged between 14 and 17 years for alcohol consumption. We sampled at random one third of those scoring at most 2 on AUDIT-C who had access to the internet and, if aged under 16, were Gillick competent or had informed consent from parent or guardian. We randomised them between: screening only (control intervention); one session of face-to-face Personalised Feedback and Brief Advice (PFBA); and PFBA plus an electronic brief intervention (eBI) on smartphone or web. We conducted follow-up after six and 12 months. The principal outcomes were alcohol consumed over the 3 months before 12-month follow up, measured by AUDIT-C; and quality-adjusted life-years.

FINDINGS

Between October 2014 and May 2015, we approached 5,016 eligible patients of whom 3,326 consented to be screened and participate in the trial; 2,571 of these were low-risk drinkers or abstainers, consuming an average 0.14 units per week. We randomised: 304 to screening only; 285 to PFBA; and 294 to PFBA and eBI. We found no significant difference between groups, notably in weekly alcohol consumption: those receiving screening only drank 0.10 units (95% confidence interval 0.05 to 0.18); PFBA 0.12 (0.06 to 0.21); PFBA and eBI 0.10 (0.05 to 0.19).

INTERPRETATION

While drinking levels remained low in this population, this trial found no evidence that PFBA with or without eBI was more effective than screening alone in reducing or delaying alcohol consumption.

Thematic Analysis on User Reviews for Depression and Anxiety Chatbot Apps: Machine Learning Approach (Preprint).. [DOI: 10.2196/preprints.27654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

BACKGROUND

Anxiety and depression are among the most commonly prevalent mental health disorders worldwide. Chatbot apps can play an important role in relieving anxiety and depression. Users’ reviews of chatbot apps are considered an important source of data for exploring users’ opinions and satisfaction.

OBJECTIVE

This study aims to explore users’ opinions, satisfaction, and attitudes toward anxiety and depression chatbot apps by conducting a thematic analysis of users’ reviews of 11 anxiety and depression chatbot apps collected from the Google Play Store and Apple App Store. In addition, we propose a workflow to provide a methodological approach for future analysis of app review comments.

METHODS

We analyzed 205,581 user review comments from chatbots designed for users with anxiety and depression symptoms. Using scraper tools and Google Play Scraper and App Store Scraper Python libraries, we extracted the text and metadata. The reviews were divided into positive and negative meta-themes based on users’ rating per review. We analyzed the reviews using word frequencies of bigrams and words in pairs. A topic modeling technique, latent Dirichlet allocation, was applied to identify topics in the reviews and analyzed to detect themes and subthemes.

RESULTS

Thematic analysis was conducted on 5 topics for each sentimental set. Reviews were categorized as positive or negative. For positive reviews, the main themes were confidence and affirmation building, adequate analysis, and consultation, caring as a friend, and ease of use. For negative reviews, the results revealed the following themes: usability issues, update issues, privacy, and noncreative conversations.

CONCLUSIONS

Using a machine learning approach, we were able to analyze ≥200,000 comments and categorize them into themes, allowing us to observe users’ expectations effectively despite some negative factors. A methodological workflow is provided for the future analysis of review comments.

Efficacy of a complex smartphone application for reducing hazardous alcohol consumption: Study protocol for a randomized controlled trial with analysis of in-app user behavior in relation to outcome

OBJECTIVE

The efficacy of alcohol reduction applications is variable, and the underlying factors are largely unknown. The aim of this study is threefold: evaluate the relationship between user engagement and intervention efficacy, investigate the efficacy of the different functions applied, and investigate the efficacy of the intervention application compared to control groups.

METHODS

A randomized controlled trial will be conducted to determine the efficacy of a newly developed smartphone application compared to the controls in reducing alcohol consumption at a 30, 60, 90, 120, 150, and 180 days follow-up. Hazardous drinkers, aged 18 years or older, will be recruited through web articles and will be randomized (blinded to their allocation), to receive one of the two versions of the application (educational or control application) for 30 days, or will be allocated to a wait-list control group. Function usage times will be recorded on a single-user level to determine the association between application usage and efficacy.

RESULTS

Data collection will be completed by July 2020, and follow-up will be completed by January 2021.

CONCLUSIONS

The evaluation of intervention efficacy as a function of user behavior will hopefully contribute to the science of developing more efficient alcohol intervention applications in the future.

A peer-led intervention to promote sexual health in secondary schools: the STASH feasibility study

Background

Young people report higher levels of unsafe sex and have higher rates of sexually transmitted infections than any other age group. Schools are well placed to facilitate early intervention, but more effective approaches are required. Peer-led approaches can augment school-based education, but often fail to capitalise on mechanisms of social influence. The potential of using social media in sexual health has not been tested in school settings.

Objectives

Finalise the design of the Sexually Transmitted infections And Sexual Health (STASH) intervention; assess the recruitment and retention of peer supporters, and acceptability to participants and stakeholders; assess the fidelity and reach, in addition to the barriers to and facilitators of, implementation; refine programme theory; understand the potential of social media; determine design parameters for a future randomised controlled trial, including economic evaluation; and establish whether or not progression criteria were met.

Design

This was a feasibility study comprising intervention development and refinement of the STASH pilot and non-randomised feasibility trial in six schools. Control data were provided by students in the year above the intervention group.

Setting

Secondary schools in Scotland.

Participants

Students aged 14–16 years, teachers and intervention delivery partners.

Interventions

The STASH intervention was adapted from A Stop Smoking In Schools Trial (ASSIST) (an effective peer-led smoking intervention). Based on diffusion of innovation theory, the STASH study involves peer nomination to identify the most influential students, with the aim of recruiting and training 15% of the year group as peer supporters. The peer supporters deliver sexual health messages to friends in their year group via conversations and use of Facebook (www.facebook.com; Facebook, Inc., Menlo Park, CA, USA) to share varied content from a curated set of web-based resources. Peer supporters are given support themselves via follow-up sessions and via trainer membership of Facebook groups.

Main outcome measures

The primary outcome was whether or not progression criteria were met in relation to intervention acceptability and feasibility. The study also piloted indicative primary outcomes for a full-scale evaluation.

Data sources

Peer supporter questionnaire; observations of activities; interviews with trainers, teachers, peer supporters and students; monitoring log of peer supporter activities (including on Facebook and meeting attendance); questionnaire to control year group (baseline characteristics, social networks, mediators and sexual health outcomes); baseline and follow-up questionnaire (approximately 6 months later) for intervention year group.

Results

A total of 104 students were trained as peer supporters (just over half of those nominated for the role by their peers). Role retention was very high (97%). Of 611 students completing the follow-up questionnaire, 58% reported exposure to STASH study activities. Intervention acceptability was high among students and stakeholders. Activities were delivered with good fidelity. The peer supporters were active, representative of their year group and well connected within their social network. Carefully managed social media use by peer supporters augmented conversations. A primary outcome of ‘always safer sex’ was identified, measured as no sex or always condom use for vaginal or anal sex in the last 6 months. The intervention cost £42 per student. Six progression criteria were met. A seventh criterion (regarding uptake of role by peer supporters) was not.

Limitations

Small feasibility study that cannot comment on effectiveness.

Conclusions

The STASH intervention is feasible and acceptable within the context of Scottish secondary schools. The results support continuation to a full-scale evaluation.

Future work

Small-scale improvements to the intervention, refinement to programme theory and funding sought for full-scale evaluation.

Trial registration

Current Controlled Trials ISRCTN97369178.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 8, No. 15. See the NIHR Journals Library website for further project information.

Apps for pain self-management of older people's arthritic pain, one size doesn't fit all: A qualitative study

Introduction Arthritic pain is a major cause of illness and disability among older people. People living with arthritic pain carry out self-management activities to adequately manage their pain. As the trend of smartphone uptake continues to rise among older people, there are opportunities to explore the role of these devices in helping older people better manage their pain. Aim: To explore the attitudes and experiences of older people with chronic arthritic pain towards using an app for their pain selfmanagement. Methods A qualitative design using semi-structured interviews with community-dwelling older Australians living with arthritic pain (n = 16). Data was analyzed using thematic analysis. Results Four themes emerged from the data: (1) Apps are valuable self-management tool, but they do have the potential for harm; (2) A pain self-management app needs to strictly align with the user's needs; (3) Clinician's involvement is crucial when integrating an app into older people's pain selfmanagement regime; and (4) pain self-management app must be designed with enduser in mind. In addition, suggestions on how to make an app more useful and userfriendly were offered by the participants. Discussion While pain self-management apps have the potential to assist older people in their pain self-management process, this modality is not of interest to all older people. Adaptable apps that offer clinician input may be best placed to offer individual level relevance to older users. Future pain selfmanagement app development endeavors should adopt a co-design approach where older people are involved through all stages of design and development.

Proposal for the User-Centered Design Approach for Health Apps Based on Successful Experiences: Integrative Review

Background

Different strategies encompassed within mHealth have shown themselves to be effective for maintaining good health or controlling certain diseases. However, there is usually a very high rate of abandonment of health apps. Therefore, it would seem obvious that there is a need for involving the end users (whether they are health professionals, patients, or both) in the design process from the early stages in order to enable their needs and characteristics to be identified. In this sense, it is common knowledge that focusing on the user permits the consideration of valuable details aimed at making the correct adjustment between the patient, the technology, and the organization of attention.

Objective

The goal of the research was to propose a methodology based on the review of previous successful user experiences in setting up health apps by using qualitative techniques (focus groups and discussion groups) that includes the participation of information technology and health professionals and the patients themselves.

Methods

An integrative review was made of studies in which a qualitative methodology was employed mainly through focus and/or discussion groups for the design and development of health apps, consulting diverse databases (PubMed, Scopus, and Proquest) with the following search strategy: “mHealth AND apps AND focus group OR discussion group.” A total of 69 papers were included in the review.

Results

A proposal structured in 4 sessions of variable duration was made in which information technology and health professionals and patients take part: composing, preparing, and organizing contents (session 1); testing structure and usability (session 2); does the app fit the needs of end users? (session 3); and last testing—keep on improving (session 4). Throughout the sessions, we propose studying aspects like previous user experiences in mHealth, barriers to the adoption of mHealth, interface contents, management and browsability, usability, perceived quality, security and privacy, capacity to self-manage disease with the app, ergonomics, and glanceability, etc. Specific tools that have proved useful in previous research for measuring these aspects are presented.

Conclusions

These work sessions would be based on predominantly qualitative methodologies although, as they evolve, validated questionnaires permitting the assessment of the objectivity of certain technical aspects could be incorporated. With this proposal, a project centered on end users could be effected, responding to their needs. However, this requires validation that will be made via implementation in the development of health apps, with the subsequent measurement of results in terms of adherence and improvement in the clinical variables of the end users.

Patient preferences for visualization of longitudinal patient-reported outcomes data

OBJECTIVE

The study sought to design symptom reports of longitudinal patient-reported outcomes data that are understandable and meaningful to end users.

MATERIALS AND METHODS

We completed a 2-phase iterative design and evaluation process. In phase I, we developed symptom reports and refined them according to expert input. End users then completed a survey containing demographics, a measure of health literacy, and items to assess visualization preferences and comprehension of reports. We then collected participants' perspectives on reports through semistructured interviews and modified them accordingly. In phase II, refined reports were evaluated in a survey that included demographics, validated measures of health and graph literacy, and items to assess preferences and comprehension of reports. Surveys were administered using a think-aloud protocol.

RESULTS

Fifty-five English- and Spanish-speaking end users, 89.1% of whom had limited health literacy, participated. In phase I, experts recommended improvements and 20 end users evaluated reports. From the feedback received, we added emojis, changed date and font formats, and simplified the y-axis scale of reports. In phase II, 35 end users evaluated refined designs, of whom 94.3% preferred reports with emojis, the favorite being a bar graph combined with emojis, which also promoted comprehension. In both phases, participants literally interpreted reports and provided suggestions for future visualizations.

CONCLUSIONS

A bar graph combined with emojis was participants' preferred format and the one that promoted comprehension. Target end users must be included in visualization design to identify literal interpretations of images and ensure final products are meaningful.

Effectiveness of a Theory-Based mHealth Intervention for High-Risk Drinking in College Students

Background: College students are among the most vulnerable groups to problems associated with high-risk drinking consequences such as illness, injury, sexual abuse, and death. Promising mobile health (mHealth) approaches, such as smartphone (SP) apps, can be used in interventions to address or prevent excessive drinking. Method: The aim of the investigation was to examine the efficacy of a theoretically based mHealth SP app for alcohol intervention in two independent samples (N = 379): Mandated participants (Study 1) and voluntary participants (Study 2). Study 1 included a controlled trial with Mandated participants randomized into either an in-person Brief Motivational Interviewing BMI (n = 70) or BMI + SP app intervention (n = 71). Study 2 included Voluntary participants who participated in either a Control group (n = 157) or the BMI + SP app intervention (n = 81). Participants in both studies completed baseline and 6-week assessments. Results: In Study 1, peak Blood Alcohol Concentration (BAC) of participants in the in-person BMI group had increased slightly at six weeks, while it had decreased for the app-based BMI + SP group. Study 2 participants using the BMI + SP app reported significant reductions in drinking and consequences; there were no changes in the (AO) Control group. Conclusions: The BMI + SP app was effective with both Mandated and Voluntary participants. Future testing with the BMI + SP app is needed to assess whether reach, adoptability, portability, and sustainability are greater with the mHealth smartphone app for alcohol intervention than in-person approaches.

Screening and brief interventions for adolescent alcohol use disorders presenting through emergency departments: a research programme including two RCTs

Background

Alcohol consumption and related harm increase steeply from the ages of 12–20 years. Adolescents in the UK are among the heaviest drinkers in Europe. Excessive drinking in adolescents is associated with increased risk of accidents, injuries, self-harm, unprotected or regretted sex, violence and disorder, poisoning and accidental death. However, there is lack of clear evidence for the most clinically effective and cost-effective screening and brief interventions for reducing or preventing alcohol consumption in adolescents attending emergency departments (EDs).

Objectives

To estimate the distribution of alcohol consumption, alcohol-related problems and alcohol use disorders in adolescents attending EDs; to develop age-appropriate alcohol screening and brief intervention tools; and to evaluate the clinical effectiveness and cost-effectiveness of these interventions.

Design

The research has been conducted in three linked stages: (1) a prevalence study, (2) intervention development and (3) two linked randomised controlled trials (RCTs).

Setting

Twelve EDs in England (London, North East, and Yorkshire and The Humber).

Participants

A total of 5376 participants in the prevalence study [mean age 13.0 years, standard deviation (SD) 2.0 years; 46.2% female] and 1640 participants in the two linked RCTs (mean age 15.6 years, SD 1.0 years; 50.7% female).

Interventions

Personalised feedback and brief advice (PFBA) and personalised feedback plus electronic brief intervention (eBI), compared with alcohol screening alone. These age-appropriate alcohol interventions were developed in collaboration with the target audience through a series of focus groups and evaluations during stage 2 of the research programme and following two literature reviews.

Main outcome measures

Total alcohol consumed in standard UK units (1 unit = 8 g of ethanol) over the previous 3 months at 12-month follow-up, assessed using the Alcohol Use Disorders Identification Test, Consumption (3 items) (AUDIT-C).

Results

In the prevalence study, 2112 participants (39.5%) reported having had a drink of alcohol that was more than a sip in their lifetime, with prevalence increasing steadily with age and reaching 89.5% at the age of 17 years. The prevalence of at-risk alcohol consumption was 15% [95% confidence interval (CI) 14% to 16%] and the optimum cut-off point of the AUDIT-C in identifying at-risk drinking was ≥ 3. Associations of alcohol consumption and early onset of drinking with poorer health and social functioning were also found. In the RCT, the analysis of the primary outcome (average weekly alcohol consumption at month 12) identified no significant differences in effect between the three groups in both trials. In the high-risk drinking trial, the mean difference compared with control was 0.57 (95% CI –0.36 to 1.70) for PFBA and 0.19 (95% CI –0.71 to 1.30) for eBI. In the low-risk drinking trial, the mean difference compared with control was 0.03 (95% CI –0.07 to 0.13) for PFBA and 0.01 (95% CI –0.10 to 0.11) for eBI. The health economic analysis showed that eBI and PFBA were not more cost-effective than screening alone.

Conclusions

The ED can offer an opportunity for the identification of at-risk alcohol use in adolescents. A simple, short, self-completed screening instrument, the AUDIT-C, is an effective tool for identifying adolescents who are at risk of alcohol-related problems. Associations of alcohol consumption and earlier onset of drinking with poorer health and social functioning were observed in the prevalence study. The trials were feasible to implement and exceeded the recruitment target and minimum follow-up rates. However, PFBA and eBI were not found to be more effective than screening alone in reducing or preventing alcohol consumption in 14- to 17-year-olds attending EDs.

Limitations and future work

Only one-third of participants engaged with the application program; this is likely to have limited the effect of the intervention. We recommend that future research should focus on methods to maximise engagement with digital interventions and evaluate the effect of such engagement on clinical outcomes.

Trial registration

Current Controlled Trials ISRCTN45300218.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 8, No. 2. See the NIHR Journals Library website for further project information.

Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

Background

Patient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually.

Main aim

To improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience.

Secondary aims

(1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability.

Design

A scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice.

Key outcomes

A taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods.

Results

(1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support.

Limitations

Small participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use.

Conclusions

Using a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application.

Future work

Further exploration is needed of implementation into practice, transferable uses and technology development co-design approaches.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

mHealth Interventions to Reduce Alcohol Use in Young People: A Systematic Review of the Literature

Harmful use of alcohol has serious effects on public health and is considered a significant risk factor for poor health. mHealth technology promotes health behavior change and enhances health through increased social opportunities for encouragement and support. It remains unknown whether these types of applications directly influence the health status of young people in reducing harmful levels of alcohol consumption. The purpose of this systematic review is to examine current evidence on the effectiveness of mHealth technology use in positively influencing alcohol-related behaviors of young people without known alcohol addiction. Relevant articles published from 2005 to January 2017 were identified through electronic searches of eight databases. Studies with interventions delivered by mHealth (social networking sites, SMS and mobile phone applications) to young people aged 12-26 years were included. Outcome measures were alcohol use, reduction in alcohol consumption or behavior change. Eighteen studies met the inclusion criteria. Interventions varied in design, participant characteristics, settings, length and outcome measures. Ten studies reported some effectiveness related to interventions with nine reporting a reduction in alcohol consumption. Use of mHealth, particularly text messaging (documented as SMS), was found to be an acceptable, affordable and effective way to deliver messages about reducing alcohol consumption to young people. Further research using adequately powered sample sizes in varied settings, with adequate periods of intervention and follow-up, underpinned by theoretical perspectives incorporating behavior change in young people's use of alcohol, is needed.

Exploring User Needs and Preferences for Mobile Apps for Sleep Disturbance: Mixed Methods Study

BACKGROUND

Mobile health (mHealth) apps demonstrate promise for improving sleep at scale. End-user engagement is a prerequisite for sustained use and effectiveness.

OBJECTIVE

We assessed the needs and preferences of those with poor sleep and insomnia to inform the development of an engaging sleep app.

METHODS

We triangulated results from qualitative (focus groups and app reviews) and quantitative (online survey) approaches. A total of 2 focus groups were conducted (N=9). An online survey tested themes identified from the focus groups against a larger population (N=167). In addition, we analyzed 434 user reviews of 6 mobile apps available on app stores.

RESULTS

Common focus group themes included the need to account for diverse sleep phenotypes with an adaptive and tailored program, key app features (alarms and sleep diaries), the complex yet condescending nature of existing resources, providing rationale for information requested, and cost as a motivator. Most survey participants (156/167, 93%) would try an evidence-based sleep app. The most important app features reported were sleep diaries (148/167, 88%), sharing sleep data with a doctor (116/167, 70%), and lifestyle tracking (107/167, 64%). App reviews highlighted the alarm as the most salient app feature (43/122, 35%) and data synchronization with a wearable device (WD) as the most commonly mentioned functionality (40/135, 30%).

CONCLUSIONS

This co-design process involving end users through 3 methods consistently highlighted sleep tracking (through a diary and WD), alarms, and personalization as vital for engagement, although their implementation was commonly criticized in review. Engagement is negatively affected by poorly designed features, bugs, and didactic information which must be addressed. Other needs depend upon the type of user, for example, those with severe insomnia.

A randomised trial of the effect of appearance versus health-framed messages on engagement with an online brief screening and alcohol reduction intervention

Objectives: To compare the impact of appearance versus health-framed messages on engagement in a brief web-based risk screening and alcohol reduction intervention. Design: Randomised trial delivered via Drinkaware's website. Visitors were exposed to appearance (n = 51,588) or health-framed messages (n = 52,639) directing them towards an AUDIT-C risk screening questionnaire. Users completing this questionnaire were given feedback on their risk level and extended frame-congruent information. Outcomes: The primary outcome is completion of the AUDIT-C questionnaire. The secondary outcome is whether the participant accessed any of four further resources. Results: The appearance-framed message led to a small but significant increase in the number of users completing the AUDIT-C compared to the health-framed message (n = 3,537, 6.86% versus n = 3,355, 6.37%, p < 0.01). Conversely, following subsequent risk feedback, users exposed to extended health-framed information were more likely to access further resources (n = 1,146, 2.17% versus n = 942, 1.83%, p < 0.01). Conclusions: Physical appearance-framed messages increased the likelihood of engagement with an online alcohol screening and brief intervention tool, whereas health-framed messages increased the likelihood of accessing further resources. This highlights the potential for the use of multi-level approaches in alcohol reduction interventions.

The development of Drink Less: an alcohol reduction smartphone app for excessive drinkers

Excessive alcohol consumption poses a serious problem for public health. Digital behavior change interventions have the potential to help users reduce their drinking. In accordance with Open Science principles, this paper describes the development of a smartphone app to help individuals who drink excessively to reduce their alcohol consumption. Following the UK Medical Research Council's guidance and the Multiphase Optimization Strategy, development consisted of two phases: (i) selection of intervention components and (ii) design and development work to implement the chosen components into modules to be evaluated further for inclusion in the app. Phase 1 involved a scoping literature review, expert consensus study and content analysis of existing alcohol apps. Findings were integrated within a broad model of behavior change (Capability, Opportunity, Motivation-Behavior). Phase 2 involved a highly iterative process and used the "Person-Based" approach to promote engagement. From Phase 1, five intervention components were selected: (i) Normative Feedback, (ii) Cognitive Bias Re-training, (iii) Self-monitoring and Feedback, (iv) Action Planning, and (v) Identity Change. Phase 2 indicated that each of these components presented different challenges for implementation as app modules; all required multiple iterations and design changes to arrive at versions that would be suitable for inclusion in a subsequent evaluation study. The development of the Drink Less app involved a thorough process of component identification with a scoping literature review, expert consensus, and review of other apps. Translation of the components into app modules required a highly iterative process involving user testing and design modification.

Developing Typologies of User Engagement With the BRANCH Alcohol-Harm Reduction Smartphone App: Qualitative Study

BACKGROUND

Understanding how users engage with electronic screening and brief intervention (eSBI) is a critical research objective to improve effectiveness of app-based interventions to reduce harmful alcohol consumption. Although quantitative measures of engagement provide a strong indicator of how the user engages with an app at the group level, they do not elucidate finer-grained details of how apps function from an individual, experiential perspective and why, or how, users engage with an intervention in a particular manner.

OBJECTIVE

The aim of this study was to (1) understand why and how participants engaged with the BRANCH app, (2) explore facilitators and barriers to engagement with app features, (3) explore how the BRANCH app impacted drinking behavior, (4) use these data to identify typologies of users of the BRANCH app in terms of engagement behaviors, and (5) identify future eSBI app design implications.

METHODS

In total, 20 one-to-one semistructured telephone interviews were conducted with participants recruited from a randomized controlled trial, which evaluated the effectiveness of engagement-promoting strategies in the BRANCH app targeting harmful drinking in young adults (aged 18-30 years). The topic guide explored users' current engagement levels with existing health promotion apps, their views toward the effectiveness of such apps, and what they liked and disliked about BRANCH, specifically focusing on how they engaged with the app. Framework analysis was used to develop typologies of user engagement.

RESULTS

The study identified 3 typologies of engagers. Trackers were defined by their motivations to use health-tracking apps to monitor and understand quantified self-data. They did not have intentions necessarily to cut down and predominantly used only the drinking diary. Cut-downers were motivated to use the app because they wanted to reduce their alcohol consumption Unlike Trackers, they did not use a range of different health apps daily, but saw the BRANCH app as an opportunity to test out a different method of trying to cut down their alcohol use. This typology used more features than Trackers, such as the goal setting function. Noncommitters were characterized as a group of users who were initially enthusiastic about using the app; however, this enthusiasm quickly waned and they gained no benefit from it.

CONCLUSIONS

This was the first study to identify typologies of user engagement with eSBI apps. Although in need of replication, it provides a first step in understanding independent categories of eSBI users, who may benefit from apps tailored to a user's typology or motivation. It also provides new evidence to suggest that apps may be used more effectively as a tool to raise awareness of drinking, instead of reducing alcohol use, and be a step in the care pathway, identifying at-risk individuals and signposting them to more intensive treatment.

TRIAL REGISTRATION

International Standard Randomised Controlled Trial Number ISRCTN70980706; http://www.isrctn.com /ISRCTN70980706 (Archived by WebCite at http://www.webcitation.org/73vfDXYEZ).

Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies

Engagement in electronic health (eHealth) and mobile health (mHealth) behavior change interventions is thought to be important for intervention effectiveness, though what constitutes engagement and how it enhances efficacy has been somewhat unclear in the literature. Recently published detailed definitions and conceptual models of engagement have helped to build consensus around a definition of engagement and improve our understanding of how engagement may influence effectiveness. This work has helped to establish a clearer research agenda. However, to test the hypotheses generated by the conceptual modules, we need to know how to measure engagement in a valid and reliable way. The aim of this viewpoint is to provide an overview of engagement measurement options that can be employed in eHealth and mHealth behavior change intervention evaluations, discuss methodological considerations, and provide direction for future research. To identify measures, we used snowball sampling, starting from systematic reviews of engagement research as well as those utilized in studies known to the authors. A wide range of methods to measure engagement were identified, including qualitative measures, self-report questionnaires, ecological momentary assessments, system usage data, sensor data, social media data, and psychophysiological measures. Each measurement method is appraised and examples are provided to illustrate possible use in eHealth and mHealth behavior change research. Recommendations for future research are provided, based on the limitations of current methods and the heavy reliance on system usage data as the sole assessment of engagement. The validation and adoption of a wider range of engagement measurements and their thoughtful application to the study of engagement are encouraged.

A Mobile Phone-Based Healthy Lifestyle Monitoring Tool for People With Mental Health Problems (MyHealthPA): Development and Pilot Testing

Background

People with mental health disorders live, on average, 20 years less than those without, often because of poor physical health including cardiovascular disease (CVD). Evidence-based interventions are required to reduce this lifespan gap.

Objective

This study aimed to develop, test, and evaluate a mobile phone–based lifestyle program (MyHealthPA) to help people with mental health problems improve key health risk behaviors and reduce their risk of CVD.

Methods

The development of MyHealthPA occurred in 3 stages: (1) scoping of the literature, (2) a survey (n=251) among people with and without the experience of mental health problems, and (3) program development informed by stages 1 and 2. A small pilot trial among young people with and without mental health disorders was also conducted. Participants completed a baseline assessment and were given access to the MyHealthPA program for a period of 8 weeks. They were then asked to complete an end-of-treatment assessment and a follow-up assessment 1 month later.

Results

In the study, 28 young people aged 19 to 25 years were recruited to the pilot trial. Of these, 12 (12/28, 43%) had been previously diagnosed with a mental illness. Overall, 12 participants (12/28, 43%) completed the end-of-treatment assessment and 6 (6/28, 21%) completed the follow-up assessment. Small improvements in fruit and vegetable consumption, level of physical activity, alcohol use, and mood were found between baseline and end of treatment and follow-up, particularly among people with experience of mental health issues. Most participants (history of mental illness: 4/7, 57%; no history of mental illness: 3/5, 60%) reported the program had above average usability; however, only 29% (2/7, no history of mental illness) to 40% (2/5, history of mental illness) of participants reported that they would like to use the program frequently and would recommend it to other young people. Participants also identified a number of ways in which the program could be improved.

Conclusions

This study describes the formative research and process of planning that formed the development of MyHealthPA and the evidence base underpinning the approach. The MyHealthPA program represents an innovative approach to CVD risk reduction among people with mental health problems. MyHealthPA appears to be an acceptable, easy-to-use, and potentially effective mHealth intervention to assist young people with mental illness to monitor risk factors for CVD. However, ways in which the program could be improved for future testing and dissemination were identified and discussed.

Mobile App Tools for Identifying and Managing Mental Health Disorders in Primary Care

PURPOSE OF REVIEW

Mental health apps are intriguing yet challenging tools for addressing barriers to treatment in primary care. In the current review, we seek to assist primary care professionals with evaluating and integrating mental health apps into practice. We briefly summarize two leading frameworks for evaluating mental health apps and conduct a systematic review of mental health apps across a variety of areas commonly encountered in primary care.

RECENT FINDINGS

Existing frameworks can guide professionals and patients through the process of identifying apps and evaluating dimensions such as privacy and security, credibility, and user experience. For specific apps, several problem areas appear to have relatively more scientific evaluation in the current app landscape, including PTSD, smoking, and alcohol use. Other areas such as eating disorders not only lack evaluation, but contain a significant subset of apps providing potentially harmful advice.

SUMMARY

Overall, individuals seeking mental health apps will likely encounter strengths such as symptom tracking and psychoeducational components, while encountering common weaknesses such as insufficient privacy settings and little integration of empirically-supported techniques. While mental health apps may have more promise than ever, significant barriers to finding functional, usable, effective apps remain for health professionals and patients alike.

Engagement features judged by excessive drinkers as most important to include in smartphone applications for alcohol reduction: A mixed-methods study

Objective

Engagement with smartphone applications (apps) for alcohol reduction is necessary for their effectiveness. This study explored (1) the features that are ranked as most important for engagement by excessive drinkers and (2) why particular features are judged to be more important for engagement than others.

Methods

Two studies were conducted in parallel. The first was a focus group study with adult excessive drinkers, interested in reducing alcohol consumption using an app (n_groups = 3). Participants individually ranked their top 10 features from a pre-specified list and subsequently discussed their rankings. The second was an online study with a new sample (n = 132). Rankings were analysed using the intraclass correlation coefficient (ICC) to assess the level of agreement between raters for each study. Qualitative data were analysed using inductive thematic analysis.

Results

There was low agreement between participants in their rankings, both in the focus groups (ICC = 0.15, 95% confidence interval (CI) = 0.03–0.38) and the online sample (ICC = 0.11, 95% CI = 0.06–0.23). ‘Personalisation’, ‘control features’ and ‘interactive features’ were most highly ranked in the focus groups. These were expected to elicit a sense of benefit and usefulness, adaptability, provide motivational support or spark users’ interest. Results from the online study partly corroborated these findings.

Conclusion

There was little agreement between participants, but on average, the features judged to be most important for inclusion in smartphone apps for alcohol reduction were personalisation, interactive features and control features. Tailoring on users’ underlying psychological needs may promote engagement with alcohol reduction apps.

Identifying Medication Management Smartphone App Features Suitable for Young Adults With Developmental Disabilities: Delphi Consensus Study

BACKGROUND

Smartphone apps can be a tool to facilitate independent medication management among persons with developmental disabilities. At present, multiple medication management apps exist in the market, but only 1 has been specifically designed for persons with developmental disabilities. Before initiating further app development targeting this population, input from stakeholders including persons with developmental disabilities, caregivers, and professionals regarding the most preferred features should be obtained.

OBJECTIVE

The aim of this study was to identify medication management app features that are suitable to promote independence in the medication management process by young adults with developmental disabilities using a Delphi consensus method.

METHODS

A compilation of medication management app features was performed by searching the iTunes App Store, United States, in February 2016, using the following terms: adherence, medication, medication management, medication list, and medication reminder. After identifying features within the retrieved apps, a final list of 42 features grouped into 4 modules (medication list, medication reminder, medication administration record, and additional features) was included in a questionnaire for expert consensus rating. A total of 52 experts in developmental disabilities, including persons with developmental disabilities, caregivers, and professionals, were invited to participate in a 3-round Delphi technique. The purpose was to obtain consensus on features that are preferred and suitable to promote independence in the medication management process among persons with developmental disabilities. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively.

RESULTS

A total of 75 responses were received over the 3 Delphi rounds-30 in the first round, 24 in the second round, and 21 in the third round. At the end of the third round, cumulative consensus was achieved for 60% (12/20) items in the medication list module, 100% (3/3) in the medication reminder module, 67% (2/3) in the medication administration record module, and 63% (10/16) in the additional features module. In addition to the medication list, medication reminder, and medication administration record features, experts selected the following top 3 most important additional features: automatic refills through pharmacies; ability to share medication information from the app with providers; and ability to share medication information from the app with family, friends, and caregivers. The top 3 least important features included a link to an official drug information source, privacy settings and password protection, and prescription refill reminders.

CONCLUSIONS

Although several mobile apps for medication management exist, few are specifically designed to support persons with developmental disabilities in the complex medication management process. Of the 42 different features assessed, 64% (27/42) achieved consensus for inclusion in a future medication management app. This study provides information on the features of a medication management app that are most important to persons with developmental disabilities, caregivers, and professionals.

Mobile Phone Apps for Behavioral Interventions for At-Risk Drinkers in Australia: Literature Review

Background

The mobile technology era has ushered in the use of mobile phone apps for behavioral intervention for at-risk drinkers.

Objective

Our objective was to review recent research relevant to mobile phone apps that can be used for behavioral intervention for at-risk drinkers in Australia.

Methods

The inclusion criteria for this review were articles published in peer-reviewed journals from 2001 to 2017 with use of the search terms “smartphone application,” “alcohol,” “substance,” “behavioural intervention,” “electronic health,” and “mobile health.”

Results

In total, we identified 103 abstracts, screened 90 articles, and assessed 50 full-text articles that fit the inclusion criteria for eligibility. We included 19 articles in this review.

Conclusions

This review highlighted the paucity of evidence-based and empirically validated research into effective mobile phone apps that can be used for behavioral interventions with at-risk drinkers in Australia.

What makes online substance-use interventions engaging? A systematic review and narrative synthesis

Background

Online substance-use interventions are effective in producing reductions in harmful-use. However, low user engagement rates with online interventions reduces overall effectiveness of interventions. Identifying optimal strategies with which to engage users with online substance-use interventions may improve usage rates and subsequent effectiveness.

Objectives

(1) To identify the most prevalent engagement promoting strategies utilised to increase use of online substance-use interventions. (2) To determine whether the identified engagement promoting strategies increased said use of online substance-use interventions.

Review methods

The reviewed followed Cochrane methodology. Databases were searched for online substance-use interventions and engagement promoting strategies limited by study type (randomised controlled trial). Due to heterogeneity between engagement promoting strategies and engagement outcomes, meta-analytic techniques were not possible. Narrative synthesis methods were used.

Results

Fifteen studies were included. Five different engagement promoting strategies were identified: (1) tailoring; (2) delivery strategies; (3) incentives; (4) reminders; (5) social support. The most frequently reported engagement promoting strategies was tailoring (47% of studies), followed by reminders and social support (40% of studies) and delivery strategies (33% of studies). The narrative synthesis demonstrated that tailoring, multimedia delivery of content and reminders are potential techniques for promoting engagement. The evidence for social support was inconclusive and negative for incentives.

Conclusions

This review was the first to examine engagement promoting strategies in solely online substance-use interventions. Three strategies were identified that may be integral in promoting engagement with online substance-use interventions. However, the small number of eligible extracted studies, inconsistent reporting of engagement outcomes and diversity of engagement features prevent firmer conclusions. More high-quality trials examining engagement are required.

User characteristics of a smartphone app to reduce alcohol consumption

Digital interventions are available to help people reduce their alcohol consumption, but it is not known who uses these interventions and how this treatment-seeking group compares with the general population of drinkers. The study objective was to compare the socio-demographic and drinking characteristics of users of the 'Drinks Meter' smartphone app with the general population of drinkers in England and website users of the same intervention. Data were used from the Drinks Meter app and website, and a nationally representative cross-sectional survey in England (Alcohol Toolkit Study). Participants were drinkers aged 16+ in England. Data were collected on participants' age, gender, region, sexual orientation, social grade and AUDIT score. Regression analyses were conducted to assess differences in socio-demographic and drinking characteristics between samples. Drinks Meter app users, compared with drinkers of the general population, were younger, more likely to be from the South, not heterosexual, less likely to be of a lower social grade and had a higher mean AUDIT score. Drinks Meter app users were younger than website users and reported greater alcohol consumption and related harms. Drinkers using the Drinks Meter app are more likely to be younger and report greater alcohol consumption and related harms compared with the general population of drinkers in England and website users of the same intervention. Apps that provide feedback on drinking appear to be reaching those who report greater alcohol consumption and related harms.

There is an app for that - Or is there? A content analysis of publicly available smartphone apps for managing alcohol use

INTRODUCTION

Smartphone apps are emerging as a promising tool to support recovery from and prevention of problematic alcohol use, yet it is unclear what type of apps are currently available in the public domain, and to what degree these apps use interactive tailoring or other dynamic features to meet users' specific needs.

METHODS

We conducted a content analysis of Android apps for managing drinking available on Google Play (n=266), downloaded between November 21, 2014 and June 25, 2015. We recorded app popularity (>10,000 downloads) and user-rated quality (number of stars) from Google Play, and coded the apps on three domains (basic descriptors, functionality, use of dynamic features).

RESULTS

In total, the reviewed 266 apps were downloaded at least 2,793,567 times altogether. The most common types of app were BAC calculators (37%), information provision apps (37%), tracking calendars (24%), and motivational tools (21%). Most apps were free (65%) or low in cost (mean=$3.76; SD=$5.80). Many apps provided at least some level of tailored feedback (60%), but the extent of tailoring was limited. Use of other dynamic features (i.e., push notifications, passive data collection) was largely absent. Univariate models predicting app popularity (i.e., >10,000 downloads vs. not) and user-rated quality (i.e., star rating) indicated that tailoring was positively related to popularity (OR=2.41 [1.30-4.46]), and the existence of time-based tailoring (e.g., tracking) was related to quality (b=0.48 [0.19-0.77]).

CONCLUSIONS

These apps have a wide public health reach with >2.7 million total combined downloads to date. A wide variety of apps exist, allowing persons interested in using apps to help them manage their drinking to choose from numerous types of supports. Tailoring, while related favorably to an app's popularity and user-rated quality, is limited in publicly available apps.

Interest in using mobile technology to help self-manage alcohol use among persons living with the human immunodeficiency virus: A Florida Cohort cross-sectional study

BACKGROUND

Alcohol consumption at hazardous levels is more prevalent and associated with poor health outcomes among persons living with the human immunodeficiency virus (HIV; PLWH). Although PLWH are receptive to using technology to manage health issues, it is unknown whether a cell phone app to self-manage alcohol use would be acceptable among PLWH who drink. The objectives of this study were to determine factors associated with interest in an app to self-manage drinking and to identify differences in baseline mobile technology use among PLWH by drinking level.

METHODS

The study population included 757 PLWH recruited from 2014 to 2016 into the Florida Cohort, an ongoing cohort study investigating the utilization of health services and HIV care outcomes among PLWH. Participants completed a questionnaire examining demographics, substance use, mobile technology use, and other health behaviors. Multivariable logistic regression was used to identify factors significantly associated with interest in an app to self-manage drinking. We also determined whether mobile technology use varied by drinking level.

RESULTS

Of the sample, 40% of persons who drink at hazardous levels, 34% of persons who drink at nonhazardous levels, and 19% of persons who do not drink were interested in a self-management app for alcohol use. Multivariable logistic regression analysis indicated that nonhazardous drinking (adjusted odds ratio [AOR] = 1.78; confidence interval [CI 95%]: 1.10-2.88) and hazardous drinking (AOR = 2.58; CI: 1.60-4.16) were associated with interest, controlling for age, gender, education, and drug use. Regarding mobile technology use, most of the sample reported smartphone ownership (56%), text messaging (89%), and at least one cell phone app (69%).

CONCLUSIONS

Regardless of drinking level, overall mobile technology use among PLWH was moderate, whereas PLWH who consumed alcohol expressed greater interest in a cell phone app to self-manage alcohol use. This indicates that many PLWH who drink would be interested in and prepared for a mobile technology-based intervention to reduce alcohol consumption.

Usability Testing of the BRANCH Smartphone App Designed to Reduce Harmful Drinking in Young Adults

Background

Electronic screening and brief intervention (eSBI) apps demonstrate potential to reduce harmful drinking. However, low user engagement rates with eSBI reduce overall effectiveness of interventions. As “Digital Natives,” young adults have high expectations of app quality. Ensuring that the design, content, and functionality of an eSBI app are acceptable to young adults is an integral stage to the development process.

Objective

The objective of this study was to identify usability barriers and enablers for an app, BRANCH, targeting harmful drinking in young adults.

Methods

The BRANCH app contains a drinking diary, alcohol reduction goal setting functions, normative drinking feedback, and information on risks and advice for cutting down. The app includes a social feature personalized to motivate cutting down and to promote engagement with a point-based system for usage. Three focus groups were conducted with 20 users who had tested the app for 1 week. A detailed thematic analysis was undertaken.

Results

The first theme, “Functionality” referred to how users wanted an easy-to-use interface, with minimum required user-input. Poor functionality was considered a major usability barrier. The second theme, “Design” described how an aesthetic with minimum text, clearly distinguishable tabs and buttons and appealing infographics was integral to the level of usability. The final theme, “Content” described how participants wanted all aspects of the app to be automatically personalized to them, as well as providing them with opportunities to personalize the app themselves, with increased options for social connectivity.

Conclusions

There are high demands for apps such as BRANCH that target skilled technology users including young adults. Key areas to optimize eSBI app development that emerged from testing BRANCH with representative users include high-quality functionality, appealing aesthetics, and improved personalization.

Moving on From Representativeness: Testing the Utility of the Global Drug Survey

A decline in response rates in traditional household surveys, combined with increased internet coverage and decreased research budgets, has resulted in increased attractiveness of web survey research designs based on purposive and voluntary opt-in sampling strategies. In the study of hidden or stigmatised behaviours, such as cannabis use, web survey methods are increasingly common. However, opt-in web surveys are often heavily criticised due to their lack of sampling frame and unknown representativeness. In this article, we outline the current state of the debate about the relevance of pursuing representativeness, the state of probability sampling methods, and the utility of non-probability, web survey methods especially for accessing hidden or minority populations. Our article has two aims: (1) to present a comprehensive description of the methodology we use at Global Drug Survey (GDS), an annual cross-sectional web survey and (2) to compare the age and sex distributions of cannabis users who voluntarily completed (a) a household survey or (b) a large web-based purposive survey (GDS), across three countries: Australia, the United States, and Switzerland. We find that within each set of country comparisons, the demographic distributions among recent cannabis users are broadly similar, demonstrating that the age and sex distributions of those who volunteer to be surveyed are not vastly different between these non-probability and probability methods. We conclude that opt-in web surveys of hard-to-reach populations are an efficient way of gaining in-depth understanding of stigmatised behaviours and are appropriate, as long as they are not used to estimate drug use prevalence of the general population.

Binge drinking: Health impact, prevalence, correlates and interventions

OBJECTIVE

Binge drinking (also called heavy episodic drinking, risky single-occasion drinking etc.) is a major public health problem. This paper provides an overview of recently published evidence concerning the definition and measurement, prevalence rates, health impact, demographic and psychosocial correlates of, and interventions for, binge drinking.

DESIGN

Narrative review.

RESULTS

Mostly occurring among young people at weekends, binge drinking increases the risk of both acute (e.g. injuries) and long-term negative consequences (e.g. alcohol disorders). Binge drinkers tend to be extrovert, impulsive and sensation-seeking. Stress, anxiety, traumatic events and depression are also related to binge drinking. Both alcohol-related behaviour of parents and general parenting (e.g. parenting styles, monitoring) are also important. Other major risk factors for binge drinking are frequently spending time with friends who drink, and the drinking norms observed in the wider social environment (e.g. school, community, culture). Emergency departments, birthday parties, fraternities and the workplace serve as settings for interventions; these are increasingly delivered via digital and mobile technology. There is evidence of small-sized effects across approaches (brief interventions, personalised normative feedback, protective behavioural strategies etc.) and populations.

CONCLUSION

A more consistent terminology, investigating multi-level influences and identifying the most effective intervention components are challenges for future research.

Using a mobile health application to reduce alcohol consumption: a mixed-methods evaluation of the drinkaware track & calculate units application

Background

Smartphone applications (“apps”) offer promise as tools to help people monitor and reduce their alcohol consumption. To date, few evaluations of alcohol reduction apps exist, with even fewer considering apps already available to the public. The aim of this study was to evaluate an existing publically available app, designed by Drinkaware, a UK-based alcohol awareness charity.

Methods

We adopted a mixed-methods design, analysing routinely collected app usage data to explore user characteristics and patterns of usage. Following this, in-depth interviews were conducted with a sub-sample of app users to examine perceptions of acceptability, usability and perceived effectiveness, as well as to provide recommendations on how to improve the app.

Results

One hundred nineteen thousand seven hundred thirteen people downloaded and entered data into the app over a 13-month period. High attrition was observed after 1 week. Users who engaged with the app tended to be “high risk” drinkers and to report being motivated “to reduce drinking” at the point of first download. In those who consistently engaged with the app over time, self-reported alcohol consumption levels reduced, with most change occurring in the first week of usage. Our qualitative findings indicate satisfaction with the usability of the app, but mixed feedback was given regarding individual features. Users expressed conflicting views concerning the type of feedback and notifications that the app currently provides. A common preference was expressed for more personalised content.

Conclusions

The Drinkaware app is a useful tool to support behaviour change in individuals who are already motivated and committed to reducing their alcohol consumption. The Drinkaware app would benefit from greater personalisation and tailoring to promote longer term use. This evaluation provides insight into the usability and acceptability of various app features and contains a number of recommendations for improving user satisfaction and the potential effectiveness of apps designed to encourage reductions in alcohol consumption.

Electronic supplementary material

The online version of this article (doi:10.1186/s12889-017-4358-9) contains supplementary material, which is available to authorized users.

A Digital Tool to Promote Alcohol and Drug Use Screening, Brief Intervention, and Referral to Treatment Skill Translation: A Mobile App Development and Randomized Controlled Trial Protocol

BACKGROUND

Translation of knowledge and skills from classroom settings to clinical practice is a major challenge in healthcare training, especially for behavioral interventions. For example, screening, brief intervention, and referral to treatment (SBIRT) is a highly-promoted approach to identifying and treating individuals at risk for alcohol or drug problems, yet effective, routine use of SBIRT has lagged.

OBJECTIVE

The objective of this paper is to describe the development, pilot testing, and trial protocol of a mobile app based on the theory of planned behavior (TPB) to promote SBIRT skill translation and application.

METHODS

Intended for use after classroom training occurs, the mobile app has three primary functions designed to increase behavioral intent to deliver SBIRT: (1) review skills (ie, address knowledge and beliefs about SBIRT), (2) apply skills with patients (ie, build confidence and perceived behavioral control), and (3) report performance data (ie, increase accountability and social norms and/or influence). The app includes depression and anxiety screening tools due to high comorbidity with substance use. A randomized controlled trial (RCT) is in progress among health and social service learners (N=200) recruited from 3 universities and 6 different training programs in nursing, social work, internal medicine, psychiatry, and psychology. Participants are randomized to SBIRT classroom instruction alone or classroom instruction plus app access prior to beginning their field placement rotations. TPB-based data are collected via Qualtrics or via the mobile app pre-post and SBIRT utilization, weekly for 10 weeks. Key outcomes include the frequency of and self-reported confidence in delivery of SBIRT.

RESULTS

Beta testing with advanced practice nursing students (N=22) indicated that the app and its associated assessment tools were acceptable and useful. The system usability scale (SUS) mean was 65.8 (n=19), which indicated that the SBIRT app was acceptable but could benefit from improvement. Indeed, modifications were implemented prior to starting the trial. Enrollment of trial participants began in September 2016. Results are expected by December 2017.

CONCLUSIONS

This report describes the process of TPB-based app development and testing, and the protocol for a RCT to determine the effectiveness of the app in enhancing skill translation. If effective, this approach could improve SBIRT implementation, fidelity, and clinical outcomes.

The Reviews Are in: A Qualitative Content Analysis of Consumer Perspectives on Apps for Bipolar Disorder

Background

The delivery of mobile health (mHealth) services is acceptable to mental health consumers. However, despite the benefits of accessibility, cost-effectiveness, anonymity, and ability to tailor content to individual needs, consumer engagement remains a hurdle for uptake and continued use. This may be unsurprising as few studies have examined app content from the consumer perspective or assessed consumer preferences for the content of apps for mental health management. An opportunity to examine consumer perspectives exists in using naturally generated data that is publically available in the Google Play and Apple app stores. Whereas commercial developers routinely use this data, to date there has been no in-depth evaluation within scientific research.

Objective

The aim of our study was to explore what consumers consider useful content for mental health management apps, identify unmet needs, and understand user expectations of mental health apps within the context of apps for bipolar disorder.

Methods

Publically available English language consumer reviews of 48 apps for bipolar disorder were used as data, providing a total of 2173 reviews. Review text was coded and analyzed using a team approach to qualitative content analysis. Results were presented in 2 forms: (1) a quantitative summary of the 9 major and minor themes and (2) a qualitative synthesis of key thematic findings.

Results

The majority of reviews were for symptom monitoring apps (87.94%, 1911/2173). The qualitative content analysis revealed 5 main themes: (1) laudatory talk, comments regarding the app’s benefits including helpfulness and successful design features (74.00% of reviews, 1608/2173); (2) unfavorable feedback, negative reviews largely concerning unmet needs, privacy and technical issues, and potential dangers of app use (25.54%, 555/2173); (3) conceptions of community, referring to both communities of users with mental ill-health accessed via the app and a community created among app users and developers (24.25%, 527/2173); (4) wishlist features, app features requested by users (17.53%, 381/2173); and (5) apps and therapy, app use within clinical care (10.58%, 230/2173). Four minor themes were also identified: (1) app cost, (2) privacy and data security, (3) comparisons with traditional monitoring, and (4) evidence-based mHealth.

Conclusions

Although mostly positive, the proportion of reviews containing wishlist requests indicates consumer needs are not adequately addressed by currently available disorder management apps. Consumers value content that is helpful, supportive, and easy to use, and they are integrating apps into their health management and clinical care without necessarily considering the evidence-base or clinical effectiveness of the tool. User expectations regarding developer responsiveness to their needs has implications for community-based participatory research and integrated knowledge translation. However, this expectation is incompatible with current mHealth funding structures.

Factors Influencing Usability of a Smartphone App to Reduce Excessive Alcohol Consumption: Think Aloud and Interview Studies

BACKGROUND

Interventions delivered by smartphone apps have the potential to help drinkers reduce their consumption of alcohol. To optimize engagement and reduce the high rates of attrition associated with the use of digital interventions, it is necessary to ensure that an app's design and functionality is appropriate for its intended purposes and target population.

AIMS

To understand the usability of an app to help people reduce their alcohol consumption.

METHOD

The app, Drink Less, contains a core module focusing on goal setting, supplemented by five additional modules: self-monitoring and feedback, identity change, cognitive bias re-training, action planning, and social comparison. Two studies were conducted, a "think aloud" study performed with people using the app for the first time and a semistructured interview study performed after users had had access to the app for at least 2 weeks. A thematic analysis of the "think aloud" and interview transcripts was conducted by one coder and verified by a second.

RESULTS

Twenty-four participants, half of whom were women and half from disadvantaged groups, took part in the two studies. Three main themes identified in the data were "Feeling lost and unsure of what to do next," "Make the app easy to use," and "Make the app beneficial and rewarding to use." These themes reflected participants' need for (i) guidance, particularly when first using the app or when entering data; (ii) the data entry process to be simple and the navigation intuitive; (iii) neither the amount of text nor range of options to be overwhelming; (iv) the app to reward them for effort and progress; and (v) it to be clear how the app could help alcohol reduction goals be reached.

CONCLUSION

First-time and experienced users want an alcohol reduction app to be easy, rewarding, and beneficial to use. An easy-to-use app would reduce user burden, offer ongoing help, and be esthetically pleasing. A rewarding and beneficial app would provide positive reinforcement, give feedback about progress, and demonstrate credibility. Users need help when first using the app, and they need a compelling reason to continue using it.