Applicability of the User Engagement Scale to Mobile Health: A Survey-Based Quantitative Study

Midwifery student engagement with digital interactive books: A cross sectional survey

AIM

To explore the benefit and engagement of undergraduate students' use of H5P interactive books for student learning.

DESIGN

An evaluation study of technology enabled learning for first year undergraduate Bachelor of Midwifery students in Australia.

METHODS

Students were invited to complete an online evaluation survey of their use and engagement with H5P interactive books. The survey included the long form User Engagement Scale which has four subscales of focused attention, aesthetic appeal, reward factor and perceived usability scored on a 5-point Likert scale. Content analysis was used to analyse the text comments given to five open text questions.

RESULTS

There were 21 students who completed the survey. There was a high overall User Engagement Scale score of 73.1 % with aesthetic appeal and reward factor being the highest scoring subscales. The content analysis showed students found the interactive books engaging and easy to navigate. Areas for improvement identified were not including a large amount of content and providing downloadable content.

CONCLUSIONS

This study demonstrates the valuable and engaging use of H5P Interactive Books for undergraduate students in higher education. Students who used H5P Interactive Books identified their ease of use, organised layout and engaging format.

Engagement With a Remote Symptom-Tracking Platform Among Participants With Major Depressive Disorder: Randomized Controlled Trial

BACKGROUND

Multiparametric remote measurement technologies (RMTs), which comprise smartphones and wearable devices, have the potential to revolutionize understanding of the etiology and trajectory of major depressive disorder (MDD). Engagement with RMTs in MDD research is of the utmost importance for the validity of predictive analytical methods and long-term use and can be conceptualized as both objective engagement (data availability) and subjective engagement (system usability and experiential factors). Positioning the design of user interfaces within the theoretical framework of the Behavior Change Wheel can help maximize effectiveness. In-app components containing information from credible sources, visual feedback, and access to support provide an opportunity to promote engagement with RMTs while minimizing team resources. Randomized controlled trials are the gold standard in quantifying the effects of in-app components on engagement with RMTs in patients with MDD.

OBJECTIVE

This study aims to evaluate whether a multiparametric RMT system with theoretically informed notifications, visual progress tracking, and access to research team contact details could promote engagement with remote symptom tracking over and above the system as usual. We hypothesized that participants using the adapted app (intervention group) would have higher engagement in symptom monitoring, as measured by objective and subjective engagement.

METHODS

A 2-arm, parallel-group randomized controlled trial (participant-blinded) with 1:1 randomization was conducted with 100 participants with MDD over 12 weeks. Participants in both arms used the RADAR-base system, comprising a smartphone app for weekly symptom assessments and a wearable Fitbit device for continuous passive tracking. Participants in the intervention arm (n=50, 50%) also had access to additional in-app components. The primary outcome was objective engagement, measured as the percentage of weekly questionnaires completed during follow-up. The secondary outcomes measured subjective engagement (system engagement, system usability, and emotional self-awareness).

RESULTS

The levels of completion of the Patient Health Questionnaire-8 (PHQ-8) were similar between the control (67/97, 69%) and intervention (66/97, 68%) arms (P value for the difference between the arms=.83, 95% CI -9.32 to 11.65). The intervention group participants reported slightly higher user engagement (1.93, 95% CI -1.91 to 5.78), emotional self-awareness (1.13, 95% CI -2.93 to 5.19), and system usability (2.29, 95% CI -5.93 to 10.52) scores than the control group participants at follow-up; however, all CIs were wide and included 0. Process evaluation suggested that participants saw the in-app components as helpful in increasing task completion.

CONCLUSIONS

The adapted system did not increase objective or subjective engagement in remote symptom tracking in our research cohort. This study provides an important foundation for understanding engagement with RMTs for research and the methodologies by which this work can be replicated in both community and clinical settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04972474; https://clinicaltrials.gov/ct2/show/NCT04972474.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/32653.

How Can Digital Mental Health Enhance Psychiatry?

The use of digital technologies is constantly growing around the world. The wider-spread adoption of digital technologies and solutions in the daily clinical practice in psychiatry seems to be a question of when, not if. We propose a synthesis of the scientific literature on digital technologies in psychiatry and discuss the main aspects of its possible uses and interests in psychiatry according to three domains of influence that appeared to us: 1) assist and improve current care: digital psychiatry allows for more people to have access to care by simply being more accessible but also by being less stigmatized and more convenient; 2) develop new treatments: digital psychiatry allows for new treatments to be distributed via apps, and practical guidelines can reduce ethical challenges and increase the efficacy of digital tools; and 3) produce scientific and medical knowledge: digital technologies offer larger and more objective data collection, allowing for more detection and prevention of symptoms. Finally, ethical and efficacy issues remain, and some guidelines have been put forth on how to safely use these solutions and prepare for the future.

The Intersection of Persuasive System Design and Personalization in Mobile Health: Statistical Evaluation

Background

Persuasive technology is an umbrella term that encompasses software (eg, mobile apps) or hardware (eg, smartwatches) designed to influence users to perform preferable behavior once or on a long-term basis. Considering the ubiquitous nature of mobile devices across all socioeconomic groups, user behavior modification thrives under the personalized care that persuasive technology can offer. However, there is no guidance for developing personalized persuasive technologies based on the psychological characteristics of users.

Objective

This study examined the role that psychological characteristics play in interpreted mobile health (mHealth) screen perceived persuasiveness. In addition, this study aims to explore how users’ psychological characteristics drive the perceived persuasiveness of digital health technologies in an effort to assist developers and researchers of digital health technologies by creating more engaging solutions.

Methods

An experiment was designed to evaluate how psychological characteristics (self-efficacy, health consciousness, health motivation, and the Big Five personality traits) affect the perceived persuasiveness of digital health technologies, using the persuasive system design framework. Participants (n=262) were recruited by Qualtrics International, Inc, using the web-based survey system of the XM Research Service. This experiment involved a survey-based design with a series of 25 mHealth app screens that featured the use of persuasive principles, with a focus on physical activity. Exploratory factor analysis and linear regression were used to evaluate the multifaceted needs of digital health users based on their psychological characteristics.

Results

The results imply that an individual user’s psychological characteristics (self-efficacy, health consciousness, health motivation, and extraversion) affect interpreted mHealth screen perceived persuasiveness, and combinations of persuasive principles and psychological characteristics lead to greater perceived persuasiveness. The F test (ie, ANOVA) for model 1 was significant (F9,6540=191.806; P<.001), with an adjusted R2 of 0.208, indicating that the demographic variables explained 20.8% of the variance in perceived persuasiveness. Gender was a significant predictor, with women having higher perceived persuasiveness (P=.008) relative to men. Age was a significant predictor of perceived persuasiveness with individuals aged 40 to 59 years (P<.001) and ≥60 years (P<.001). Model 2 was significant (F13,6536=341.035; P<.001), with an adjusted R2 of 0.403, indicating that the demographic variables self-efficacy, health consciousness, health motivation, and extraversion together explained 40.3% of the variance in perceived persuasiveness.

Conclusions

This study evaluates the role that psychological characteristics play in interpreted mHealth screen perceived persuasiveness. Findings indicate that self-efficacy, health consciousness, health motivation, extraversion, gender, age, and education significantly influence the perceived persuasiveness of digital health technologies. Moreover, this study showed that varying combinations of psychological characteristics and demographic variables affected the perceived persuasiveness of the primary persuasive technology category.

Role of Social and App-Related Factors in Behavioral Engagement With mHealth for Improved Well-being Among Chronically Ill Patients: Scenario-Based Survey Study

Background

The last decade has seen a considerable increase in the number of mobile health (mHealth) apps in everyday life. These mHealth apps have the potential to significantly improve the well-being of chronically ill patients. However, behavioral engagement with mHealth apps remains low.

Objective

The aim of this study was to describe the behavioral engagement of chronically ill patients with mHealth apps by investigating (1) how it is affected by social factors (ie, physician recommendation) and app-related factors (ie, app integration) and (2) how it affects patient well-being. This study also considers the moderating effect of attachment to traditional health care and the mobile app experience among patients.

Methods

We carried out a scenario-based survey study of chronically ill patients (N=521). A Bayesian structural equation modeling with mediation and moderation analysis was conducted in MPlus.

Results

Both physician recommendations for mHealth app use and app integration have positive effects on the behavioral engagement of chronically ill patients with mHealth apps. Higher behavioral engagement positively affects the hedonic well-being (extent of pleasure) and the eudaemonic well-being (extent of self-efficacy) of chronically ill patients. Mobile app experience, however, positively moderates the relationship between app integration and behavioral engagement, whereas patient attachment to traditional care does not moderate the relationship between physician recommendation and behavioral engagement. Taken together, the proportion of variance explained (R²) equals 21% for behavioral engagement and 52.8% and 62.2% for hedonic and eudaemonic well-being, respectively, thereby providing support for the strong influence of app integration and physician recommendation via the mediation of the patients’ behavioral engagement on both patients’ hedonic and eudaemonic well-being.

Conclusions

Physician recommendation and app integration enable behavioral engagement and promote well-being among chronically ill patients. It is thus important to take social and app-related factors into consideration during and after the development of mHealth apps.

Digital phenotype of mood disorders: A conceptual and critical review

BACKGROUND

Mood disorders are commonly diagnosed and staged using clinical features that rely merely on subjective data. The concept of digital phenotyping is based on the idea that collecting real-time markers of human behavior allows us to determine the digital signature of a pathology. This strategy assumes that behaviors are quantifiable from data extracted and analyzed through digital sensors, wearable devices, or smartphones. That concept could bring a shift in the diagnosis of mood disorders, introducing for the first time additional examinations on psychiatric routine care.

OBJECTIVE

The main objective of this review was to propose a conceptual and critical review of the literature regarding the theoretical and technical principles of the digital phenotypes applied to mood disorders.

METHODS

We conducted a review of the literature by updating a previous article and querying the PubMed database between February 2017 and November 2021 on titles with relevant keywords regarding digital phenotyping, mood disorders and artificial intelligence.

RESULTS

Out of 884 articles included for evaluation, 45 articles were taken into account and classified by data source (multimodal, actigraphy, ECG, smartphone use, voice analysis, or body temperature). For depressive episodes, the main finding is a decrease in terms of functional and biological parameters [decrease in activities and walking, decrease in the number of calls and SMS messages, decrease in temperature and heart rate variability (HRV)], while the manic phase produces the reverse phenomenon (increase in activities, number of calls and HRV).

CONCLUSION

The various studies presented support the potential interest in digital phenotyping to computerize the clinical characteristics of mood disorders.

Correlation between Acylcarnitine and Peripheral Neuropathy in Type 2 Diabetes Mellitus

OBJECTIVE

In patients with type 2 diabetes mellitus (T2DM), it is unknown whether acylcarnitine changes in the patient's plasma as diabetic peripheral neuropathy (DPN) occurs. The purpose of the present study was to investigate the correlation between acylcarnitines and DPN in Chinese patients with T2DM.

METHODS

A total of 508 patients admitted to the First Affiliated Hospital of Jinzhou Medical University were included in this study, and all of whom were hospitalized for T2DM from January 2018 to December 2020. The diagnostic criteria for DPN were based on the 2017 Chinese Guidelines for the Prevention of Type 2 Diabetes. The contents of 25 acylcarnitine metabolites in fasting blood were determined by mass spectrometry. The measured acylcarnitines were classified by factor analysis, and the factors were extracted. To determine the correlation between acylcarnitines and DPN, binary logistic regression analysis was applied.

RESULTS

Among the 508 T2DM patients, 270 had DPN. Six factors were extracted from 25 acylcarnitines, and the cumulative contribution rate of variance was 61.02%. After the adjustment for other potential confounding factors, such as other carnitines and conventional risk factors, Factor 2 was positively associated with an increased risk of DPN (OR: 1.38, 95% CI: 1.13-1.69). Factor 2 contained acetylcarnitine (C2), propionylcarnitine (C3), butylcarnitine (C4), and isovalerylcarnitine (C5).

CONCLUSIONS

Plasma levels of short-chain acylcarnitines (C2, C3, C4, and C5) were positively associated with DPN risk.

Exploring the Effects of In-App Components on Engagement With a Symptom-Tracking Platform Among Participants With Major Depressive Disorder (RADAR-Engage): Protocol for a 2-Armed Randomized Controlled Trial

BACKGROUND

Multi-parametric remote measurement technologies (RMTs) comprise smartphone apps and wearable devices for both active and passive symptom tracking. They hold potential for understanding current depression status and predicting future depression status. However, the promise of using RMTs for relapse prediction is heavily dependent on user engagement, which is defined as both a behavioral and experiential construct. A better understanding of how to promote engagement in RMT research through various in-app components will aid in providing scalable solutions for future remote research, higher quality results, and applications for implementation in clinical practice.

OBJECTIVE

The aim of this study is to provide the rationale and protocol for a 2-armed randomized controlled trial to investigate the effect of insightful notifications, progress visualization, and researcher contact details on behavioral and experiential engagement with a multi-parametric mobile health data collection platform, Remote Assessment of Disease and Relapse (RADAR)-base.

METHODS

We aim to recruit 140 participants upon completion of their participation in the RADAR Major Depressive Disorder study in the London site. Data will be collected using 3 weekly tasks through an active smartphone app, a passive (background) data collection app, and a Fitbit device. Participants will be randomly allocated at a 1:1 ratio to receive either an adapted version of the active app that incorporates insightful notifications, progress visualization, and access to researcher contact details or the active app as usual. Statistical tests will be used to assess the hypotheses that participants using the adapted app will complete a higher percentage of weekly tasks (behavioral engagement: primary outcome) and score higher on self-awareness measures (experiential engagement).

RESULTS

Recruitment commenced in April 2021. Data collection was completed in September 2021. The results of this study will be communicated via publication in 2022.

CONCLUSIONS

This study aims to understand how best to promote engagement with RMTs in depression research. The findings will help determine the most effective techniques for implementation in both future rounds of the RADAR Major Depressive Disorder study and, in the long term, clinical practice.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04972474; http://clinicaltrials.gov/ct2/show/NCT04972474.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/32653.

Preconception and Diabetes Information (PADI) App for Women with Pregestational Diabetes: a Feasibility and Acceptability Study

Diabetes mellitus increases the risk of adverse maternal and fetal outcomes. Preconception care is vital to minimise complications; however, preconception care service provision is hindered by inadequate knowledge, resources and care fragmentation. Mobile health technology, particularly smartphone apps, could improve preconception care and pregnancy outcomes for women with diabetes. The aim of this study is to co-create a preconception and diabetes information app with healthcare professionals and women with diabetes and explore the feasibility, acceptability and preliminary effects of the app. A mixed-methods study design employing questionnaires and semi-structured interviews was used to assess preliminary outcome estimates (preconception care knowledge, attitudes and behaviours), and user acceptability. Data analysis included thematic analysis, descriptive statistics and non-parametric tests. Improvements were recorded in knowledge and attitudes to preconception care and patient activation measure following the 3-month app usage. Participants found the app acceptable (satisfaction rating was 72%), useful and informative. The app's usability and usefulness facilitated usage while manual data input and competing priorities were barriers which participants felt could be overcome via personalisation, automation and use of daily reminders. This is the first study to explore the acceptability and feasibility of a preconception and diabetes information app for women with diabetes. Triangulated data suggest that the app has potential to improve preconception care knowledge, attitudes and behaviours. However, in order for women with DM to realise the full potential of the app intervention, particularly improved maternal and fetal outcomes, further development and evaluation is required.

In Search of Digital Dopamine: How Apps Can Motivate Depressed Patients, a Review and Conceptual Analysis

INTRODUCTION

Depression is highly prevalent and causes considerable suffering and disease burden despite the existence of wide-ranging treatment options. Momentary assessment is a promising tool in the management of psychiatric disorders, and particularly depression. It allows for a real-time evaluation of symptoms and an earlier detection of relapse or treatment efficacy. Treating the motivational and hedonic aspects of depression is a key target reported in the literature, but it is time-consuming in terms of human resources. Digital Applications offer a major opportunity to indirectly regulate impaired motivational circuits through dopaminergic pathways.

OBJECTIVE

The main objective of this review was twofold: (1) propose a conceptual and critical review of the literature regarding the theoretical and technical principles of digital applications focused on motivation in depression, activating dopamine, and (2) suggest recommendations on the relevance of using these tools and their potential place in the treatment of depression.

MATERIAL AND METHODS

A search for words related to "dopamine", "depression", "smartphone apps", "digital phenotype" has been conducted on PubMed.

RESULTS

Ecological momentary interventions (EMIs) differ from traditional treatments by providing relevant, useful intervention strategies in the context of people's daily lives. EMIs triggered by ecological momentary assessment (EMA) are called "Smart-EMI". Smart-EMIs can mimic the "dopamine reward system" if the intervention is tailored for motivation or hedonic enhancement, and it has been shown that a simple reward (such as a digital badge) can increase motivation.

DISCUSSION

The various studies presented support the potential interest of digital health in effectively motivating depressed patients to adopt therapeutic activation behaviors. Finding effective ways to integrate EMIs with human-provided therapeutic support may ultimately yield the most efficient and effective intervention method. This approach could be a helpful tool to increase adherence and motivation.

CONCLUSION

Smartphone apps can motivate depressed patients by enhancing dopamine, offering the opportunity to enhance motivation and behavioral changes, although longer term studies are still needed.

ABC Epatite Web App: raising health awareness in a mobile world

BACKGROUND

This paper presents the case study of a health campaign for mobile devices launched in Italy in 2019 aimed at raising viral hepatitis awareness. The research project "ABC epatite. Sviluppo di una app per la prevenzione delle epatiti virali e per la consapevolezza dei comportamenti a rischio", winner of the 2018 Digital Health Program of Gilead Italia, was carried out by the Italian National Research Council.

METHODS

The project entailed the development of a free Italian language Progressive Web App (PWA) providing current and scientifically validated information on viral hepatitis (A, B and C).

RESULTS

A mobile first PWA health awareness app was implemented (https://epatite.web.app) together with an Android app version. Diversified landing pages cater to two target audiences: general public and schools. An initial campaign was directed toward engaging schools in nine Italian regions.

CONCLUSIONS

Preliminary results based on the campaign directed toward Italian schools in just under half of its regions have shown promise on the feasibility of reaching large audiences and encouraging engagement on viral hepatitis prevention. A mobile first approach to health communication is a cost-effective way to help reaching the goal of eradicating viral hepatitis by reducing infections and deaths.

Characteristics of Acute Childhood Illness Apps for Parents: Environmental Scan

Background

Providing parents with resources that aid in the identification and management of acute childhood illnesses helps those parents feel better equipped to assess their children’s health and significantly changes parental health-seeking behaviors. Some of these resources are limited by accessibility and scalability. Remote locations and staffing limitations create challenges for parents aiming to access their child’s health information. Mobile health apps offer a scalable, accessible solution for improving health literacy by enabling access to health information through mobile devices. 

Objective

The aim of our study is to create an inventory of acute childhood illness apps that are available to North American parents and caregivers, assess their quality, and identify the areas in which future apps can be improved.

Methods

We conducted an environmental scan to identify and summarize app information for parents and digital health researchers. The Google and Apple app marketplaces were used as search platforms. We built a list of search terms and searched the platforms for apps targeted at parents and related to acute pediatric illnesses in the United States and Canada. We assessed apps meeting the inclusion criteria using the Mobile App Rating Scale (MARS), a validated tool for assessing the quality of health apps. The MARS examines apps on 5 subscales: engagement, functionality, aesthetics, information quality, and subjective quality. Data were analyzed by MARS subscale averages and individual item scores.

Results

Overall, 650 unique apps were screened, and 53 (8.2%) were included. On a scale of 1-5, apps had an average engagement score of 2.82/5 (SD 0.86), functionality score of 3.98/5 (SD 0.72), aesthetics score of 3.09/5 (SD 0.87), information quality score of 2.73/5 (SD 1.32), and subjective quality score of 2.20/5 (SD 0.79). On the same scale of 1-5, app scores ranged from 2.2/5 to 4.5/5 (mean 3.2, SD 0.6). The top 3 MARS-scored apps were Baby and Child First Aid (4.5/5), Ada (4.5/5), and HANDi Paediatric (4.2/5). Taken together, the top 3 apps covered topics of emergency pediatric first aid, identification of (and appropriate response to) common childhood illnesses, a means of checking symptoms, and a means of responding to emergency situations. There was a lack of Canadian-based app content available to parents in both marketplaces; this space was filled with content originating primarily in the United Kingdom and the United States. In addition, published evidence of the impact of the included apps was poor: of 53 apps, only 5 (9%) had an evidence base showing that the app had been trialed for usability or efficacy.

Conclusions

There is a need for evidence-based acute childhood illness apps of Canadian origin. This environmental scan offers a comprehensive picture of the health app landscape by examining trends in acute childhood illness apps that are readily available to parents and by identifying gaps in app design.

Des repères pour la conception des apps ?

Objectif Proposer quelques repères pour faciliter le processus de création d’applications pour téléphones intelligents (apps) en santé mentale.

Méthode Présentation brève de l’intérêt potentiel des apps et proposition argumentée d’étapes clés pour la création des apps. L’article se base sur une revue narrative, un retour d’expérience et des discussions de groupes d’experts.

Résultats Les apps ont des caractéristiques ubiquitaires particulièrement intéressantes pour le domaine de la santé mentale. Potentiellement connectées à de multiples technologies, mobiles et disponibles en tout temps, elles permettent une grande flexibilité de conception. Afin d’augmenter les chances d’efficacité et de bonne dissémination d’une app donnée, certains principes pourraient guider de manière utile le travail de conception des apps : 9 repères sont proposés, en particulier une bonne intégration des utilisateurs finaux autour d’objectifs cibles bien définis durant tout le processus de création de tels outils.

Conclusion Les repères proposés pourraient faciliter le processus de création d’apps pour la santé mentale.

Mobile App for Parental Empowerment for Caregivers of Children With Autism Spectrum Disorders: Prospective Open Trial

BACKGROUND

Conflicting data emerge from literature regarding the actual use of smartphone apps in medicine; some considered the introduction of smartphone apps in medicine to be a breakthrough, while others suggested that, in real-life, the use of smartphone apps in medicine is disappointingly low. Yet, digital tools become more present in medicine daily. To empower parents of a child with autism spectrum disorder, we developed the Smartautism smartphone app, which asks questions and provides feedback, using a screen with simple curves.

OBJECTIVE

The purpose of this study was to evaluate usage of the app by caregivers of individuals with autism spectrum disorders.

METHODS

We conducted a prospective longitudinal exploratory open study with families that have a child with autism spectrum disorder. Data were recorded over a period of 6 months, and the outcome criteria were (1) overall response rates for a feedback screen and qualitative questionnaires, and (2) response rates by degree of completion and by user interest, based on attrition.

RESULTS

Participants (n=65) had a very high intent to use the app during the 6-month period (3698/3900 instances, 94.8%); however, secondary analysis showed that only 46% of participants (30/65) had constant response rates over 50%. Interestingly, these users were characterized by higher use and satisfaction with the feedback screen when compared to low (P<.001) and moderate (P=.007) users.

CONCLUSIONS

We found that real or perceived utility is an important incentive for parents who use empowerment smartphone apps.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2016-012135.

A Therapeutic Relational Agent for Reducing Problematic Substance Use (Woebot): Development and Usability Study

Background

Misuse of substances is common, can be serious and costly to society, and often goes untreated due to barriers to accessing care. Woebot is a mental health digital solution informed by cognitive behavioral therapy and built upon an artificial intelligence–driven platform to deliver tailored content to users. In a previous 2-week randomized controlled trial, Woebot alleviated depressive symptoms.

Objective

This study aims to adapt Woebot for the treatment of substance use disorders (W-SUDs) and examine its feasibility, acceptability, and preliminary efficacy.

Methods

American adults (aged 18-65 years) who screened positive for substance misuse without major health contraindications were recruited from online sources and flyers and enrolled between March 27 and May 6, 2020. In a single-group pre/postdesign, all participants received W-SUDs for 8 weeks. W-SUDs provided mood, craving, and pain tracking and modules (psychoeducational lessons and psychotherapeutic tools) using elements of dialectical behavior therapy and motivational interviewing. Paired samples t tests and McNemar nonparametric tests were used to examine within-subject changes from pre- to posttreatment on measures of substance use, confidence, cravings, mood, and pain.

Results

The sample (N=101) had a mean age of 36.8 years (SD 10.0), and 75.2% (76/101) of the participants were female, 78.2% (79/101) were non-Hispanic White, and 72.3% (73/101) were employed. Participants’ W-SUDs use averaged 15.7 (SD 14.2) days, 12.1 (SD 8.3) modules, and 600.7 (SD 556.5) sent messages. About 94% (562/598) of all completed psychoeducational lessons were rated positively. From treatment start to end, in-app craving ratings were reduced by half (87/101, 86.1% reporting cravings in the app; odds ratio 0.48, 95% CI 0.32-0.73). Posttreatment assessment completion was 50.5% (51/101), with better retention among those who initially screened higher on substance misuse. From pre- to posttreatment, confidence to resist urges to use substances significantly increased (mean score change +16.9, SD 21.4; P<.001), whereas past month substance use occasions (mean change −9.3, SD 14.1; P<.001) and scores on the Alcohol Use Disorders Identification Test-Concise (mean change −1.3, SD 2.6; P<.001), 10-item Drug Abuse Screening Test (mean change −1.2, SD 2.0; P<.001), Patient Health Questionnaire-8 item (mean change 2.1, SD 5.2; P=.005), Generalized Anxiety Disorder-7 (mean change −2.3, SD 4.7; P=.001), and cravings scale (68.6% vs 47.1% moderate to extreme; P=.01) significantly decreased. Most participants would recommend W-SUDs to a friend (39/51, 76%) and reported receiving the service they desired (41/51, 80%). Fewer felt W-SUDs met most or all of their needs (22/51, 43%).

Conclusions

W-SUDs was feasible to deliver, engaging, and acceptable and was associated with significant improvements in substance use, confidence, cravings, depression, and anxiety. Study attrition was high. Future research will evaluate W-SUDs in a randomized controlled trial with a more diverse sample and with the use of greater study retention strategies.

Trial Registration

ClinicalTrials.gov NCT04096001; http://clinicaltrials.gov/ct2/show/NCT04096001.

A Smartphone App With a Digital Care Pathway for Patients Undergoing Spine Surgery: Development and Feasibility Study

BACKGROUND

There is a great unmet clinical need to provide patients undergoing spinal surgery and their caregivers with ongoing, high-quality care before and after surgery in an efficiency-focused health care environment.

OBJECTIVE

The objective of this study is to design, develop, and evaluate the acceptability and feasibility of a novel planning-, outcomes-, and analytics-based smartphone app called ManageMySurgery (MMS) in patients undergoing elective spine surgery (MMS-Spine).

METHODS

The development process of the MMS app was conducted over 2 sequential stages: (1) an evidence-based intervention design with refinement from surgeon and patient feedback and (2) feasibility testing in a clinical pilot study. We developed a novel, mobile-based, Health Insurance Portability and Accountability Act-compliant platform for interventional and surgical procedures. It is a patient-centric mobile health app that streamlines patients' interactions with their care team. MMS divides the patient journey into phases, making it feasible to provide customized care pathways that meet patients' unique needs. Patient-reported outcomes are easily collected and conform to the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) standard.

RESULTS

We tested the feasibility of the MMS-Spine app with patients undergoing elective spine surgery at a large academic health system. A total of 47 patients undergoing elective spine surgery (26 cervical spine and 21 lumbar spine surgeries) downloaded and used MMS-Spine to navigate their surgical journey, quantify their baseline characteristics and postoperative outcomes, and provide feedback on the utility of the app in preparing for and recovering from their spinal surgery. The median age was 59.0 (range 33-77) years, 22 of the 47 patients (47%) were women, and 26 patients (55%) had commercial insurance. Of the 47 patients, a total of 33 (70%) logged in on an iOS device, 11 (23%) on an Android device, and 3 (6%) on a computer or tablet. A total of 17 of the 47 patients (36%) added a caregiver, of which 7 (41%) logged in. The median number of sign-ins was 2. A total of 38 of 47 patients (81%) completed their baseline preoperative PROMIS-29 outcomes, and 14 patients (30%) completed at least one PROMIS-29 survey during the postoperative period. Of the 24 patients who completed the MMS survey, 21 (88%) said it was helpful during preparation for their procedure, 16 (67%) said it was helpful during the postoperative period, and 23 (96%) said that they would recommend MMS to a friend or family member.

CONCLUSIONS

We used a patient-centered approach based on proven behavior change techniques to develop a comprehensive smartphone app for patients undergoing elective spine surgery. The optimized version of the app is ready for formal testing in a larger randomized clinical study to establish its cost-effectiveness and effect on patients' self-management skills and long-term outcomes.

Patients' Utilization and Perception of an Artificial Intelligence-Based Symptom Assessment and Advice Technology in a British Primary Care Waiting Room: Exploratory Pilot Study

BACKGROUND

When someone needs to know whether and when to seek medical attention, there are a range of options to consider. Each will have consequences for the individual (primarily considering trust, convenience, usefulness, and opportunity costs) and for the wider health system (affecting clinical throughput, cost, and system efficiency). Digital symptom assessment technologies that leverage artificial intelligence may help patients navigate to the right type of care with the correct degree of urgency. However, a recent review highlighted a gap in the literature on the real-world usability of these technologies.

OBJECTIVE

We sought to explore the usability, acceptability, and utility of one such symptom assessment technology, Ada, in a primary care setting.

METHODS

Patients with a new complaint attending a primary care clinic in South London were invited to use a custom version of the Ada symptom assessment mobile app. This exploratory pilot study was conducted between November 2017 and January 2018 in a practice with 20,000 registered patients. Participants were asked to complete an Ada self-assessment about their presenting complaint on a study smartphone, with assistance provided if required. Perceptions on the app and its utility were collected through a self-completed study questionnaire following completion of the Ada self-assessment.

RESULTS

Over a 3-month period, 523 patients participated. Most were female (n=325, 62.1%), mean age 39.79 years (SD 17.7 years), with a larger proportion (413/506, 81.6%) of working-age individuals (aged 15-64) than the general population (66.0%). Participants rated Ada's ease of use highly, with most (511/522, 97.8%) reporting it was very or quite easy. Most would use Ada again (443/503, 88.1%) and agreed they would recommend it to a friend or relative (444/520, 85.3%). We identified a number of age-related trends among respondents, with a directional trend for more young respondents to report Ada had provided helpful advice (50/54, 93%, 18-24-year olds reported helpful) than older respondents (19/32, 59%, adults aged 70+ reported helpful). We found no sex differences on any of the usability questions fielded. While most respondents reported that using the symptom checker would not have made a difference in their care-seeking behavior (425/494, 86.0%), a sizable minority (63/494, 12.8%) reported they would have used lower-intensity care such as self-care, pharmacy, or delaying their appointment. The proportion was higher for patients aged 18-24 (11/50, 22%) than aged 70+ (0/28, 0%).

CONCLUSIONS

In this exploratory pilot study, the digital symptom checker was rated as highly usable and acceptable by patients in a primary care setting. Further research is needed to confirm whether the app might appropriately direct patients to timely care, and understand how this might save resources for the health system. More work is also needed to ensure the benefits accrue equally to older age groups.

A Smartphone App With a Digital Care Pathway for Patients Undergoing Spine Surgery: Development and Feasibility Study (Preprint).. [DOI: 10.2196/preprints.21138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

BACKGROUND

There is a great unmet clinical need to provide patients undergoing spinal surgery and their caregivers with ongoing, high-quality care before and after surgery in an efficiency-focused health care environment.

OBJECTIVE

The objective of this study is to design, develop, and evaluate the acceptability and feasibility of a novel planning-, outcomes-, and analytics-based smartphone app called ManageMySurgery (MMS) in patients undergoing elective spine surgery (MMS-Spine).

METHODS

The development process of the MMS app was conducted over 2 sequential stages: (1) an evidence-based intervention design with refinement from surgeon and patient feedback and (2) feasibility testing in a clinical pilot study. We developed a novel, mobile-based, Health Insurance Portability and Accountability Act–compliant platform for interventional and surgical procedures. It is a patient-centric mobile health app that streamlines patients’ interactions with their care team. MMS divides the patient journey into phases, making it feasible to provide customized care pathways that meet patients’ unique needs. Patient-reported outcomes are easily collected and conform to the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) standard.

RESULTS

We tested the feasibility of the MMS-Spine app with patients undergoing elective spine surgery at a large academic health system. A total of 47 patients undergoing elective spine surgery (26 cervical spine and 21 lumbar spine surgeries) downloaded and used MMS-Spine to navigate their surgical journey, quantify their baseline characteristics and postoperative outcomes, and provide feedback on the utility of the app in preparing for and recovering from their spinal surgery. The median age was 59.0 (range 33-77) years, 22 of the 47 patients (47%) were women, and 26 patients (55%) had commercial insurance. Of the 47 patients, a total of 33 (70%) logged in on an iOS device, 11 (23%) on an Android device, and 3 (6%) on a computer or tablet. A total of 17 of the 47 patients (36%) added a caregiver, of which 7 (41%) logged in. The median number of sign-ins was 2. A total of 38 of 47 patients (81%) completed their baseline preoperative PROMIS-29 outcomes, and 14 patients (30%) completed at least one PROMIS-29 survey during the postoperative period. Of the 24 patients who completed the MMS survey, 21 (88%) said it was helpful during preparation for their procedure, 16 (67%) said it was helpful during the postoperative period, and 23 (96%) said that they would recommend MMS to a friend or family member.

CONCLUSIONS

We used a patient-centered approach based on proven behavior change techniques to develop a comprehensive smartphone app for patients undergoing elective spine surgery. The optimized version of the app is ready for formal testing in a larger randomized clinical study to establish its cost-effectiveness and effect on patients’ self-management skills and long-term outcomes.