Identifying Behavior Change Techniques in an Artificial Intelligence-Based Fitness App: A Content Analysis

In the field of artificial intelligence-based fitness apps, the effective integration of behavior change techniques (BCTs) is critical for promoting physical activity and improving health outcomes. However, the specific BCTs employed by apps and their impact on user engagement and behavior change are not explored sufficiently. This study investigates the Freeletics fitness app through a mixed-methods approach to evaluate the use of BCTs. In the quantitative analysis, fifteen unique BCTs were identified based on the Behavior Change Technique Taxonomy (V1). In the qualitative analysis, user reviews (n=400) were examined to understand perspectives on the app's effectiveness in promoting behavior change. Goal setting, action planning, self-monitoring of behavior, and social support were among the most prevalent BCTs identified in the Freeletics app, and their effectiveness in enhancing user engagement and promoting behavior change was also highlighted by user reviews. Among the areas of improvement identified in the study were the need for simplifying personalization options and addressing user concerns regarding the specificity of feedback. The study underscores the importance of integrating BCTs effectively within AI-based fitness apps to drive user engagement and facilitate behavior change. It contributes valuable insights into the design and implementation of BCTs in fitness apps and offers recommendations for developers, emphasizing the significance of goal setting, feedback mechanisms, self-monitoring, and social support. By understanding the impact of specific BCTs on user behavior and addressing user concerns, developers can create more effective fitness apps, ultimately promoting healthier lifestyles and positive behavior change.

Design of Digital Mental Health Platforms for Family Member Cocompletion: Scoping Review

BACKGROUND

The COVID-19 pandemic placed an additional mental health burden on individuals and families, resulting in widespread service access problems. Digital mental health interventions suggest promise for improved accessibility. Recent reviews have shown emerging evidence for individual use and early evidence for multiusers. However, attrition rates remain high for digital mental health interventions, and additional complexities exist when engaging multiple family members together.

OBJECTIVE

As such, this scoping review aims to detail the reported evidence for digital mental health interventions designed for family use with a focus on the build and design characteristics that promote accessibility and engagement and enable cocompletion by families.

METHODS

A systematic literature search of MEDLINE, Embase, PsycINFO, Web of Science, and CINAHL databases was conducted for articles published in the English language from January 2002 to March 2024. Eligible records included empirical studies of digital platforms containing some elements designed for cocompletion by related people as well as some components intended to be completed without therapist engagement. Platforms were included in cases in which clinical evidence had been documented.

RESULTS

Of the 9527 papers reviewed, 85 (0.89%) met the eligibility criteria. A total of 24 unique platforms designed for co-use by related parties were identified. Relationships between participants included couples, parent-child dyads, family caregiver-care recipient dyads, and families. Common platform features included the delivery of content via structured interventions with no to minimal tailoring or personalization offered. Some interventions provided live contact with therapists. User engagement indicators and findings varied and included user experience, satisfaction, completion rates, and feasibility. Our findings are more remarkable for what was absent in the literature than what was present. Contrary to expectations, few studies reported any design and build characteristics that enabled coparticipation. No studies reported on platform features for enabling cocompletion or considerations for ensuring individual privacy and safety. None examined platform build or design characteristics as moderators of intervention effect, and none offered a formative evaluation of the platform itself.

CONCLUSIONS

In this early era of digital mental health platform design, this novel review demonstrates a striking absence of information about design elements associated with the successful engagement of multiple related users in any aspect of a therapeutic process. There remains a large gap in the literature detailing and evaluating platform design, highlighting a significant opportunity for future cross-disciplinary research. This review details the incentive for undertaking such research; suggests design considerations when building digital mental health platforms for use by families; and offers recommendations for future development, including platform co-design and formative evaluation.

Behavioral Engagement and Activation Model Study (BEAMS): A latent class analysis of adopters and non-adopters of digital health technologies among people with Type 2 diabetes

Many people with Type 2 diabetes (T2D) who could benefit from digital health technologies (DHTs) are either not using DHTs or do use them, but not for long enough to reach their behavioral or metabolic goals. We aimed to identify subgroups within DHT adopters and non-adopters and describe their unique profiles to better understand the type of tailored support needed to promote effective and sustained DHT use across a diverse T2D population. We conducted latent class analysis of a sample of adults with T2D who responded to an internet survey between December 2021 and March 2022. We describe the clinical and psychological characteristics of DHT adopters and non-adopters, and their attitudes toward DHTs. A total of 633 individuals were characterized as either DHT "Adopters" (n = 376 reporting any use of DHT) or "Non-Adopters" (n = 257 reporting never using any DHT). Within Adopters, three subgroups were identified: 21% (79/376) were "Self-managing Adopters," who reported high health activation and self-efficacy for diabetes management, 42% (158/376) were "Activated Adopters with dropout risk," and 37% (139/376) were "Non-Activated Adopters with dropout risk." The latter two subgroups reported barriers to using DHTs and lower rates of intended future use. Within Non-Adopters, two subgroups were identified: 31% (79/257) were "Activated Non-Adopters," and 69% (178/257) were "Non-Adopters with barriers," and were similarly distinguished by health activation and barriers to using DHTs. Beyond demographic characteristics, psychological, and clinical factors may help identify different subgroups of Adopters and Non-Adopters.

A Comprehensive Architecture for Federated Learning-Based Smart Advertising

This paper introduces a cutting-edge data architecture designed for a smart advertising context, prioritizing efficient data flow and performance, robust security, while guaranteeing data privacy and integrity. At the core of this study lies the application of federated learning (FL) as the primary methodology, which emphasizes the authenticity and privacy of data while promptly discarding irrelevant or fraudulent information. Our innovative data model employs a semi-random role assignment strategy based on a variety of criteria to efficiently collect and amalgamate data. The architecture is composed of model nodes, data nodes, and validator nodes, where the role of each node is determined by factors such as computational capability, interconnection quality, and historical performance records. A key feature of our proposed system is the selective engagement of a subset of nodes for modeling and validation, optimizing resource use and minimizing data loss. The AROUND social network platform serves as a real-world case study, illustrating the efficacy of our data architecture in a practical setting. Both simulated and real implementations of our architecture showcase its potential to dramatically curtail network traffic and average CPU usage, while preserving the accuracy of the FL model. Remarkably, the system is capable of achieving over a 50% reduction in both network traffic and average CPU usage even when the user count escalates by twenty-fold. The click rate, user engagement, and other parameters have also been evaluated, proving that the proposed architecture's advantages do not affect the smart advertising accuracy. These findings highlight the proposed architecture's capacity to scale efficiently and maintain high performance in smart advertising environments, making it a valuable contribution to the evolving landscape of digital marketing and FL.

"Intelligent tutoring effects on induced emotions and cognitive load of learning-disabled learners"

PURPOSE

This study addresses the learning requirements of learners with learning difficulties by monitoring their learning experience in an Intelligent Tutoring System. Intelligent Tutoring Systems were developed to enrich the teaching-learning process.

MATERIALS AND METHODS

In the present work, the interface is designed and developed utilizing the potential of Artificial Intelligence to meet their individual needs. Designing an online learning platform for a learners with learning difficulties requires consideration of their learning problems and preferences. The interface was developed focusing on all the requirements of the LD learners. The objective of the present study is to monitor the learning experience in the form of induced emotions and cognitive load of the learners to determine the impact of learning.

RESULTS

83 learners were observed during various stage of learning. The results obtained through the Support Vector machine (SVM) classification technique showed the positive attitude towards intelligent tutoring. The analysis revealed that a total of 0.23% of learners were positively induced. Their learning experience was positive and effective. The cognition load on learners was minimum with single-mode instruction and least disturbed.

CONCLUSIONS

The system was improved based on preference feedback on design features. This helps in improving content design and creating device independent and responsive visual design. The fatigue effect analysis on cognitive load implied that multiple modes of instruction increased drowsiness. Single mode of instruction have a positive impact on the learning process and it reduces the cognitive load of the learners.Implications for RehabilitationThe user interface designed and developed for learners with Dyslexia, Dysgraphia and Dyscalculia has learning disabled-friendly features. These can be used to create a device-independent and responsive design.Learning experience is monitored along with the impact on cognitive load of the learners.The research helps in understanding the stimulation and response of learners with learning disability for different learning conditions.Most existing learning systems are limited to non-learning-disabled learners. The ITS developed during research presents a Universal learning design helpful for all learners with and without learning disability.

Designing mHealth Apps to Incorporate Evidence-Based Techniques for Prolonging User Engagement

Maintaining user engagement with mobile health (mHealth) apps can be a challenge. Previously, we developed a conceptual model to optimize patient engagement in mHealth apps by incorporating multiple evidence-based methods, including increasing health literacy, enhancing technical competence, and improving feelings about participation in clinical trials. This viewpoint aims to report on a series of exploratory mini-experiments demonstrating the feasibility of testing our previously published engagement conceptual model. We collected data from 6 participants using an app that showed a series of educational videos and obtained additional data via questionnaires to illustrate and pilot the approach. The videos addressed 3 elements shown to relate to engagement in health care app use: increasing health literacy, enhancing technical competence, and improving positive feelings about participation in clinical trials. We measured changes in participants' knowledge and feelings, collected feedback on the videos and content, made revisions based on this feedback, and conducted participant reassessments. The findings support the feasibility of an iterative approach to creating and refining engagement enhancements in mHealth apps. Systematically identifying the key evidence-based elements intended to be included in an app's design and then systematically testing the implantation of each element separately until a satisfactory level of positive impact is achieved is feasible and should be incorporated into standard app design. While mHealth apps have shown promise, participants are more likely to drop out than to be retained. This viewpoint highlights the potential for mHealth researchers to test and refine mHealth apps using approaches to better engage users.

Validating the efficacy and value proposition of mental fitness vocal biomarkers in a psychiatric population: prospective cohort study

Background

The utility of vocal biomarkers for mental health assessment has gained increasing attention. This study aims to further this line of research by introducing a novel vocal scoring system designed to provide mental fitness tracking insights to users in real-world settings.

Methods

A prospective cohort study with 104 outpatient psychiatric participants was conducted to validate the "Mental Fitness Vocal Biomarker" (MFVB) score. The MFVB score was derived from eight vocal features, selected based on literature review. Participants' mental health symptom severity was assessed using the M3 Checklist, which serves as a transdiagnostic tool for measuring depression, anxiety, post-traumatic stress disorder, and bipolar symptoms.

Results

The MFVB demonstrated an ability to stratify individuals by their risk of elevated mental health symptom severity. Continuous observation enhanced the MFVB's efficacy, with risk ratios improving from 1.53 (1.09-2.14, p=0.0138) for single 30-second voice samples to 2.00 (1.21-3.30, p=0.0068) for data aggregated over two weeks. A higher risk ratio of 8.50 (2.31-31.25, p=0.0013) was observed in participants who used the MFVB 5-6 times per week, underscoring the utility of frequent and continuous observation. Participant feedback confirmed the user-friendliness of the application and its perceived benefits.

Conclusions

The MFVB is a promising tool for objective mental health tracking in real-world conditions, with potential to be a cost-effective, scalable, and privacy-preserving adjunct to traditional psychiatric assessments. User feedback suggests that vocal biomarkers can offer personalized insights and support clinical therapy and other beneficial activities that are associated with improved mental health risks and outcomes.

Leveraging Machine Learning to Develop Digital Engagement Phenotypes of Users in a Digital Diabetes Prevention Program: Evaluation Study

BACKGROUND

Digital diabetes prevention programs (dDPPs) are effective "digital prescriptions" but have high attrition rates and program noncompletion. To address this, we developed a personalized automatic messaging system (PAMS) that leverages SMS text messaging and data integration into clinical workflows to increase dDPP engagement via enhanced patient-provider communication. Preliminary data showed positive results. However, further investigation is needed to determine how to optimize the tailoring of support technology such as PAMS based on a user's preferences to boost their dDPP engagement.

OBJECTIVE

This study evaluates leveraging machine learning (ML) to develop digital engagement phenotypes of dDPP users and assess ML's accuracy in predicting engagement with dDPP activities. This research will be used in a PAMS optimization process to improve PAMS personalization by incorporating engagement prediction and digital phenotyping. This study aims (1) to prove the feasibility of using dDPP user-collected data to build an ML model that predicts engagement and contributes to identifying digital engagement phenotypes, (2) to describe methods for developing ML models with dDPP data sets and present preliminary results, and (3) to present preliminary data on user profiling based on ML model outputs.

METHODS

Using the gradient-boosted forest model, we predicted engagement in 4 dDPP individual activities (physical activity, lessons, social activity, and weigh-ins) and general activity (engagement in any activity) based on previous short- and long-term activity in the app. The area under the receiver operating characteristic curve, the area under the precision-recall curve, and the Brier score metrics determined the performance of the model. Shapley values reflected the feature importance of the models and determined what variables informed user profiling through latent profile analysis.

RESULTS

We developed 2 models using weekly and daily DPP data sets (328,821 and 704,242 records, respectively), which yielded predictive accuracies above 90%. Although both models were highly accurate, the daily model better fitted our research plan because it predicted daily changes in individual activities, which was crucial for creating the "digital phenotypes." To better understand the variables contributing to the model predictor, we calculated the Shapley values for both models to identify the features with the highest contribution to model fit; engagement with any activity in the dDPP in the last 7 days had the most predictive power. We profiled users with latent profile analysis after 2 weeks of engagement (Bayesian information criterion=-3222.46) with the dDPP and identified 6 profiles of users, including those with high engagement, minimal engagement, and attrition.

CONCLUSIONS

Preliminary results demonstrate that applying ML methods with predicting power is an acceptable mechanism to tailor and optimize messaging interventions to support patient engagement and adherence to digital prescriptions. The results enable future optimization of our existing messaging platform and expansion of this methodology to other clinical domains.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04773834; https://www.clinicaltrials.gov/ct2/show/NCT04773834.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/26750.

Deep breathing in your hands: designing and assessing a DTx mobile app

Digital Therapeutics (DTx) are experiencing rapid advancements within mobile and mental healthcare sectors, with their ubiquity and enhanced accessibility setting them apart as uniquely effective solutions. In this evolving context, our research focuses on deep breathing, a vital technique in mental health management, aiming to optimize its application in DTx mobile platforms. Based on well-founded theories, we introduced a gamified and affordance-driven design, facilitating intuitive breath control. To enhance user engagement, we deployed the Mel Frequency Cepstral Coefficient (MFCC)-driven personalized machine learning method for accurate biofeedback visualization. To assess our design, we enlisted 70 participants, segregating them into a control and an intervention group. We evaluated Heart Rate Variability (HRV) metrics and collated user experience feedback. A key finding of our research is the stabilization of the Standard Deviation of the NN Interval (SDNN) within Heart Rate Variability (HRV), which is critical for stress reduction and overall health improvement. Our intervention group observed a pronounced stabilization in SDNN, indicating significant stress alleviation compared to the control group. This finding underscores the practical impact of our DTx solution in managing stress and promoting mental health. Furthermore, in the assessment of our intervention cohort, we observed a significant increase in perceived enjoyment, with a notable 22% higher score and 10.69% increase in positive attitudes toward the application compared to the control group. These metrics underscore our DTx solution's effectiveness in improving user engagement and fostering a positive disposition toward digital therapeutic efficacy. Although current technology poses challenges in seamlessly incorporating machine learning into mobile platforms, our model demonstrated superior effectiveness and user experience compared to existing solutions. We believe this result demonstrates the potential of our user-centric machine learning techniques, such as gamified and affordance-based approaches with MFCC, which could contribute significantly to the field of mobile mental healthcare.

Predictors of Use and Drop Out From a Web-Based Cognitive Behavioral Therapy Program and Health Community for Depression and Anxiety in Primary Care Patients: Secondary Analysis of a Randomized Controlled Trial

BACKGROUND

A previously reported study examined the treatment of primary care patients with at least moderate severity depressive or anxiety symptoms via an evidence-based computerized cognitive behavioral therapy (CCBT) program (Beating the Blues) and an online health community (OHC) that included a moderated internet support group. The 2 treatment arms proved to be equally successful at 6-month follow-up.

OBJECTIVE

Although highly promising, e-mental health treatment programs have encountered high rates of noninitiation, poor adherence, and discontinuation. Identifying ways to counter these tendencies is critical for their success. To further explore these issues, this study identified the primary care patient characteristics that increased the chances patients would not initiate the use of an intervention, (ie, not try it even once), initiate use, and go on to discontinue or continue to use an intervention.

METHODS

The study had 3 arms: one received access to CCBT (n=301); another received CCBT plus OHC (n=302), which included a moderated internet support group; and the third received usual care (n=101). Participants in the 2 active intervention arms of the study were grouped together for analyses of CCBT use (n=603) because both arms had access to CCBT, and there were no differences in outcomes between the 2 arms. Analyses of OHC use were based on 302 participants who were randomized to that arm.

RESULTS

Several baseline patient characteristics were associated with failure to initiate the use of CCBT, including having worse physical health (measured by the Short Form Health Survey Physical Components Score, P=.01), more interference from pain (by the Patient-Reported Outcomes Measurement Information System Pain Interference score, P=.048), less formal education (P=.02), and being African American or another US minority group (P=.006). Characteristics associated with failure to initiate use of the OHC were better mental health (by the Short Form Health Survey Mental Components Score, P=.04), lower use of the internet (P=.005), and less formal education (P=.001). Those who initiated the use of the CCBT program but went on to complete less of the program had less formal education (P=.01) and lower severity of anxiety symptoms (P=.03).

CONCLUSIONS

This study found that several patient characteristics predicted whether a patient was likely to not initiate use or discontinue the use of CCBT or OHC. These findings have clear implications for actionable areas that can be targeted during initial and ongoing engagement activities designed to increase patient buy-in, as well as increase subsequent use and the resulting success of eHealth programs.

TRIAL REGISTRATION

ClinicalTrials.gov NCT01482806; https://clinicaltrials.gov/study/NCT01482806.

Users' views on the use of a smartwatch app to collect daily symptom data in individuals with multiple long-term conditions (Multimorbidity): A qualitative study

Introduction

Long-term conditions are a major burden on health systems. One way to facilitate more research and better clinical care among patients with long-term conditions is to collect accurate data on their daily symptoms (patient-generated health data) using wearable technologies. Whilst evidence is growing for the use of wearable technologies in single conditions, there is less evidence of the utility of frequent symptom tracking in those who have more than one condition.

Aims

To explore patient views of the acceptability of collecting daily patient-generated health data for three months using a smartwatch app.

Methods

Watch Your Steps was a longitudinal study which recruited 53 patients to track over 20 symptoms per day for a 90-day period using a study app on smartwatches. Semi-structured interviews were conducted with a sub-sample of 20 participants to explore their experience of engaging with the app.

Results

In a population of older people with multimorbidity, patients were willing and able to engage with a patient-generated health data app on a smartwatch. It was suggested that to maintain engagement over a longer period, more 'real-time' feedback from the app should be available. Participants did not seem to consider the management of more than one condition to be a factor in either engagement or use of the app, but the presence of severe or chronic pain was at times a barrier.

Conclusion

This study has provided preliminary evidence that multimorbidity was not a major barrier to engagement with patient-generated health data via a smartwatch symptom tracking app.

An Active Model of Research Translation for the General Public: Content Analysis of a YouTube-Based Health Podcast

BACKGROUND

Online health information seeking is changing the way people engage with health care and the health system. Recent changes in practices related to seeking, accessing, and disseminating scientific research, and in particular health information, have enabled a high level of user engagement.

OBJECTIVE

This study aims to examine an innovative model of research translation, The Huberman Lab Podcast (HLP), developed by Andrew Huberman, Professor of Neurobiology and Ophthalmology at the Stanford School of Medicine. The HLP leverages social media to deliver health information translated into specific, actionable practices and health strategies directly to the general public. This research characterizes the HLP as an Active Model of Research Translation and assesses its potential as a framework for replicability and wider adoption.

METHODS

We applied conventional content analysis of the YouTube transcript data and directed content analysis of viewers' YouTube comments to 23 HLP episodes released from January to October 2021, reflecting the time of data analysis. We selected 7 episodes and a welcome video, to describe and identify key characteristics of the HLP model. We analyzed viewer comments for 18 episodes to determine whether viewers found the HLP content valuable, accessible, and easy to implement.

RESULTS

The key HLP features are direct-to-the-consumer, zero-cost, bilingual, and actionable content. We identified 3 main organizing categories and 10 subcategories as the key elements of the HLP: (1) Why: Educate and Empower and Bring Zero Cost to Consumer Information to the General Public; (2) What: Tools and Protocols; Underlying Mechanisms; and Grounded in Science; (3) How: Linear and Iterative Knowledge Building Process; Lecture-Style Sessions; Interactive and Consumer Informed; Easily Accessible; and Building the Community. Analysis of viewers' comments found strong consumer support for the key HLP model elements.

CONCLUSIONS

This Active Model of Research Translation offers a way to synthesize scientific evidence and deliver it directly to end users in the form of actionable tools and education. Timely evidence translation using effective consumer engagement and education techniques appears to improve access and confidence related to health information use and reduces challenges to understanding and applying health information received from health providers. Framing complex content in an approachable manner, engaging the target audience, encouraging participation, and ensuring open access to the content meet current recommendations on innovative practices for leveraging social media or other digital platforms for disseminating science and research findings to the general public, and are likely key contributors to HLP impact and potential for success. The model offers a replicable framework for translating and disseminating scientific evidence. Similar active models of research translation can have implications for accessing health information and implementing health strategies for improved outcomes. Areas for further investigation are specific and measurable impacts on health, usability, and relevance of the model for reaching marginalized and high-risk populations.

Invoking and identifying task-oriented interlocutor confusion in human-robot interaction

Successful conversational interaction with a social robot requires not only an assessment of a user's contribution to an interaction, but also awareness of their emotional and attitudinal states as the interaction unfolds. To this end, our research aims to systematically trigger, but then interpret human behaviors to track different states of potential user confusion in interaction so that systems can be primed to adjust their policies in light of users entering confusion states. In this paper, we present a detailed human-robot interaction study to prompt, investigate, and eventually detect confusion states in users. The study itself employs a Wizard-of-Oz (WoZ) style design with a Pepper robot to prompt confusion states for task-oriented dialogues in a well-defined manner. The data collected from 81 participants includes audio and visual data, from both the robot's perspective and the environment, as well as participant survey data. From these data, we evaluated the correlations of induced confusion conditions with multimodal data, including eye gaze estimation, head pose estimation, facial emotion detection, silence duration time, and user speech analysis-including emotion and pitch analysis. Analysis shows significant differences of participants' behaviors in states of confusion based on these signals, as well as a strong correlation between confusion conditions and participants own self-reported confusion scores. The paper establishes strong correlations between confusion levels and these observable features, and lays the ground or a more complete social and affect oriented strategy for task-oriented human-robot interaction. The contributions of this paper include the methodology applied, dataset, and our systematic analysis.

User Engagement Clusters of an 8-Week Digital Mental Health Intervention Guided by a Relational Agent (Woebot): Exploratory Study

BACKGROUND

With the proliferation of digital mental health interventions (DMHIs) guided by relational agents, little is known about the behavioral, cognitive, and affective engagement components associated with symptom improvement over time. Obtaining a better understanding could lend clues about recommended use for particular subgroups of the population, the potency of different intervention components, and the mechanisms underlying the intervention's success.

OBJECTIVE

This exploratory study applied clustering techniques to a range of engagement indicators, which were mapped to the intervention's active components and the connect, attend, participate, and enact (CAPE) model, to examine the prevalence and characterization of each identified cluster among users of a relational agent-guided DMHI.

METHODS

We invited adults aged 18 years or older who were interested in using digital support to help with mood management or stress reduction through social media to participate in an 8-week DMHI guided by a natural language processing-supported relational agent, Woebot. Users completed assessments of affective and cognitive engagement, working alliance as measured by goal and task working alliance subscale scores, and enactment (ie, application of therapeutic recommendations in real-world settings). The app passively collected data on behavioral engagement (ie, utilization). We applied agglomerative hierarchical clustering analysis to the engagement indicators to identify the number of clusters that provided the best fit to the data collected, characterized the clusters, and then examined associations with baseline demographic and clinical characteristics as well as mental health outcomes at week 8.

RESULTS

Exploratory analyses (n=202) supported 3 clusters: (1) "typical utilizers" (n=81, 40%), who had intermediate levels of behavioral engagement; (2) "early utilizers" (n=58, 29%), who had the nominally highest levels of behavioral engagement in week 1; and (3) "efficient engagers" (n=63, 31%), who had significantly higher levels of affective and cognitive engagement but the lowest level of behavioral engagement. With respect to mental health baseline and outcome measures, efficient engagers had significantly higher levels of baseline resilience (P<.001) and greater declines in depressive symptoms (P=.01) and stress (P=.01) from baseline to week 8 compared to typical utilizers. Significant differences across clusters were found by age, gender identity, race and ethnicity, sexual orientation, education, and insurance coverage. The main analytic findings remained robust in sensitivity analyses.

CONCLUSIONS

There were 3 distinct engagement clusters found, each with distinct baseline demographic and clinical traits and mental health outcomes. Additional research is needed to inform fine-grained recommendations regarding optimal engagement and to determine the best sequence of particular intervention components with known potency. The findings represent an important first step in disentangling the complex interplay between different affective, cognitive, and behavioral engagement indicators and outcomes associated with use of a DMHI incorporating a natural language processing-supported relational agent.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05672745; https://classic.clinicaltrials.gov/ct2/show/NCT05672745.

Examining Engagement and Usability in an Online Discussion Platform for Older Adults: Findings From Pilot Studies

Social media may facilitate older adults' ability to engage socially and explore health information, but it can present difficulties for older adults. Therefore, it is important to explore older adults' experience of usability and user engagement. We conducted two rounds of pilot studies where we used Facebook to engage older adults. We performed a mixed-methods evaluation of user engagement and usability. A directed content analysis of qualitative data from the pilot studies was used to explore engagement and perceived usability, and the Mann-Whitney U test was used to examine differences in feature usage and engagement. We analyzed qualitative data from 13 participants. Qualitative data analysis yielded themes pertaining to three main domains: user engagement , usability , and usability related to aging-related changes . In terms of user engagement and usability, participants in both pilot studies reported positive feedback on felt involvement and endurability, and the second pilot group reported more positive comments regarding perceived usefulness compared with the first pilot group. There was no statistically significant difference in usage over the two studies. The findings of this study suggest opportunities to improve older adults' experience of online discussion platforms. Considering changes that improve perceived aesthetic appeal and focused attention will be helpful.

Seeing eye to eye: trustworthy embodiment for task-based conversational agents

Smart speakers and conversational agents have been accepted into our homes for a number of tasks such as playing music, interfacing with the internet of things, and more recently, general chit-chat. However, they have been less readily accepted in our workplaces. This may be due to data privacy and security concerns that exist with commercially available smart speakers. However, one of the reasons for this may be that a smart speaker is simply too abstract and does not portray the social cues associated with a trustworthy work colleague. Here, we present an in-depth mixed method study, in which we investigate this question of embodiment in a serious task-based work scenario of a first responder team. We explore the concepts of trust, engagement, cognitive load, and human performance using a humanoid head style robot, a commercially available smart speaker, and a specially developed dialogue manager. Studying the effect of embodiment on trust, being a highly subjective and multi-faceted phenomena, is clearly challenging, and our results indicate that potentially, the robot, with its anthropomorphic facial features, expressions, and eye gaze, was trusted more than the smart speaker. In addition, we found that embodying a conversational agent helped increase task engagement and performance compared to the smart speaker. This study indicates that embodiment could potentially be useful for transitioning conversational agents into the workplace, and further in situ, "in the wild" experiments with domain workers could be conducted to confirm this.

Developing A Mobile App With a Human-Centered Design Lens to Improve Access to Mental Health Care (Mentallys Project): Protocol for an Initial Co-Design Process

BACKGROUND

Co-design is one of the human-centered design approaches that allows end users to significantly and positively impact the design of mental health technologies. It is a promising approach to foster user acceptance and engagement in digital mental health solutions. Surprisingly, there is a lack of understanding of what co-design is in this field. In this paper, co-design is approached as a cocreation process involving persons with a lived experience of mental health problems, health professionals, and design experts who lead and facilitate the overall creative process.

OBJECTIVE

This paper describes an initial co-design research protocol for the development of a mobile app that aims to improve access to mental health care. It highlights the characteristics of a co-design approach in e-mental health rooted in human-centered design and led by design experts alongside health experts. The paper focuses on the first steps (phase 1) of the co-design process of the ongoing Mentallys project.

METHODS

This Mentallys project will be located in Montréal (Quebec, Canada). The method approach will be based on the "method stories," depicting the "making of" this project and reflecting adjustments needed to the protocol throughout the project in specific situations. Phase 1 of the process will focus on the desirability of the app. Targeted participants will include people with a lived experience of mental health problems, peer support workers and clinicians, and 3 facilitators (all design experts or researchers). Web-based sessions will be organized because of the COVID-19 pandemic, using Miro (RealtimeBoard Inc) and Zoom (Zoom Video Communications, Inc). Data collection will be based on the comments, thoughts, and new ideas of participants around the imaginary prototypes. Thematic analysis will be carried out after each session to inform a new version of the prototype.

RESULTS

We conducted 2 stages in phase 1 of the process. During stage 1, we explored ideas through group co-design workshops (divergent thinking). Six co-design workshops were held: 2 with only clinicians (n=7), 2 with peer support workers (n=5) and people with a lived experience of mental health problems (n=2), and 2 with all of them (n=14). A total of 6 facilitators participated in conducting activities in subgroups. During stage 2, ideas were refined through 10 dyad co-design sessions (convergent thinking). Stage 2 involved 3 participants (n=3) and 1 facilitator. Thematic analysis was performed after stage 1, while analytic questioning is being performed for stage 2. Both stages allowed several iterations of the prototypes.

CONCLUSIONS

The design of the co-design process, the leadership of the design expertise throughout the process, and the different forms of co-design activities are key elements in this project. We highly recommend that health researchers partner with professional designers or design researchers who are familiar with co-design.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/47220.

Users' Concerns About Endometriosis on Social Media: Sentiment Analysis and Topic Modeling Study

BACKGROUND

Endometriosis is a debilitating and difficult-to-diagnose gynecological disease. Owing to limited information and awareness, women often rely on social media platforms as a support system to engage in discussions regarding their disease-related concerns.

OBJECTIVE

This study aimed to apply computational techniques to social media posts to identify discussion topics about endometriosis and to identify themes that require more attention from health care professionals and researchers. We also aimed to explore whether, amid the challenging nature of the disease, there are themes within the endometriosis community that gather posts with positive sentiments.

METHODS

We retrospectively extracted posts from the subreddits r/Endo and r/endometriosis from January 2011 to April 2022. We analyzed 45,693 Reddit posts using sentiment analysis and topic modeling-based methods in machine learning.

RESULTS

Since 2011, the number of posts and comments has increased steadily. The posts were categorized into 11 categories, and the highest number of posts were related to either asking for information (Question); sharing the experiences (Rant/Vent); or diagnosing and treating endometriosis, especially surgery (Surgery related). Sentiment analysis revealed that 92.09% (42,077/45,693) of posts were associated with negative sentiments, only 2.3% (1053/45,693) expressed positive feelings, and there were no categories with more positive than negative posts. Topic modeling revealed 27 major topics, and the most popular topics were Surgery, Questions/Advice, Diagnosis, and Pain. The Survey/Research topic, which brought together most research-related posts, was the last in terms of posts.

CONCLUSIONS

Our study shows that posts on social media platforms can provide insights into the concerns of women with endometriosis symptoms. The analysis of the posts confirmed that women with endometriosis have to face negative emotions and pain daily. The large number of posts related to asking questions shows that women do not receive sufficient information from physicians and need community support to cope with the disease. Health care professionals should pay more attention to the symptoms and diagnosis of endometriosis, discuss these topics with patients to reduce their dissatisfaction with doctors, and contribute more to the overall well-being of women with endometriosis. Researchers should also become more involved in social media and share new science-based knowledge regarding endometriosis.

Data-to-music sonification and user engagement

The process of transforming data into sounds for auditory display provides unique user experiences and new perspectives for analyzing and interpreting data. A research study for data transformation to sounds based on musical elements, called data-to-music sonification, reveals how musical characteristics can serve analytical purposes with enhanced user engagement. An existing user engagement scale has been applied to measure engagement levels in three conditions within melodic, rhythmic, and chordal contexts. This article reports findings from a user engagement study with musical traits and states the benefits and challenges of using musical characteristics in sonifications. The results can guide the design of future sonifications of multivariable data.

Workload, Usability, and Engagement with a Mobile App Supporting Video Observation of Methadone Take-Home Dosing: Usability Study

BACKGROUND

Methadone, a cornerstone of opioid use disorder treatments for many decades, is an essential tool for combatting the opioid epidemic. However, requirements for observing methadone dosing in person through direct observed therapy (DOT) impose significant barriers for many patients. Digital technology can facilitate remote DOT, which could reduce barriers to methadone treatment. Currently, there are limited data on the usability of such technology among patients and counselors in methadone treatment settings.

OBJECTIVE

The primary objective of this study was to assess the workload, usability, and engagement of a video-based DOT mobile app for patients with opioid use disorder receiving methadone treatment. The secondary objective was to assess the workload, usability, and engagement of the provider-facing app portal used by counselors.

METHODS

Patients (n=12) and counselors (n=3) who previously tried video DOT for methadone through a smartphone app in an opioid treatment program participated in usability testing sessions. Participants completed essential tasks for video DOT, then provided ratings of workload (NASA Task Load Index), usability (modified System Usability Scale), and engagement (modified Engagement Scale) with the core features of the video DOT program.

RESULTS

Patients and counselors reported low mental, physical, and temporal demands, successful performance, low effort, and low frustration associated with activities. Patients reported high usability (mean 85, SD 9.5) and engagement (mean 3.8, SD 1.1); counselors reported moderate usability (mean 43.3, SD 17.7) and engagement (mean 2.81, SD 0.63).

CONCLUSIONS

A mobile health app that facilitates video-based DOT for methadone required a low workload for patients and counselors and was highly usable for patients in an opioid treatment program; however, there are opportunities to improve usability and engagement for the counselor-facing portal.

Human-to-Computer Interactivity Features Incorporated Into Behavioral Health mHealth Apps: Systematic Search

BACKGROUND

While there are thousands of behavioral health apps available to consumers, users often quickly discontinue their use, which limits their therapeutic value. By varying the types and number of ways that users can interact with behavioral health mobile health apps, developers may be able to support greater therapeutic engagement and increase app stickiness.

OBJECTIVE

The main objective of this analysis was to systematically characterize the types of user interactions that are available in behavioral health apps and then examine if greater interactivity was associated with greater user satisfaction, as measured by app metrics.

METHODS

Using a modified PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) methodology, we searched several different app clearinghouse websites and identified 76 behavioral health apps that included some type of interactivity. We then filtered the results to ensure we were examining behavioral health apps and further refined our search to include apps that identified one or more of the following terms: peer or therapist forum, discussion, feedback, professional, licensed, buddy, friend, artificial intelligence, chatbot, counselor, therapist, provider, mentor, bot, coach, message, comment, chat room, community, games, care team, connect, share, and support in the app descriptions. In the final group of 34 apps, we examined the presence of 6 types of human-machine interactivities: human-to-human with peers, human-to-human with providers, human-to-artificial intelligence, human-to-algorithms, human-to-data, and novel interactive smartphone modalities. We also downloaded information on app user ratings and visibility, as well as reviewed other key app features.

RESULTS

We found that on average, the 34 apps reviewed included 2.53 (SD 1.05; range 1-5) features of interactivity. The most common types of interactivities were human-to-data (n=34, 100%), followed by human-to-algorithm (n=15, 44.2%). The least common type of interactivity was human-artificial intelligence (n=7, 20.5%). There were no significant associations between the total number of app interactivity features and user ratings or app visibility. We found that a full range of therapeutic interactivity features were not used in behavioral health apps.

CONCLUSIONS

Ideally, app developers would do well to include more interactivity features in behavioral health apps in order to fully use the capabilities of smartphone technologies and increase app stickiness. Theoretically, increased user engagement would occur by using multiple types of user interactivity, thereby maximizing the benefits that a person would receive when using a mobile health app.

Avatar and virtual agent-assisted telecare for patients in their homes: A scoping review

INTRODUCTION

Telecare can be an effective way to deliver healthcare to patients' homes. Avatar or virtual agent-equipped technologies have the potential to increase user engagement and adherence to telecare. This study aimed to identify telecare interventions assisted by avatars/virtual agents, reflect the concepts of telecare and give an overview on its outcomes.

METHODS

A scoping review guided by the PRISMA-ScR checklist was conducted. MEDLINE, CINAHL, PsycINFO and grey literature were searched through 12 July 2022. Studies were included if patients were remotely cared for by healthcare professionals and received telecare interventions assisted by avatars/virtual agents in their homes. Studies underwent quality appraisal, and were synthesized along the dimensions 'study characteristics', 'intervention' and 'outcomes'.

RESULTS

Out of 535 records screened, 14 studies were included, reporting the effects of avatar/virtual agent-assisted telecare interventions, tailored to specific patient groups. Telecare interventions mainly focused on teletherapy and telemonitoring. Telecare services were rehabilitative, preventive, palliative, promotive and curative. Modes of communication were asynchronous, synchronous or a mix of both. Tasks of the implemented avatars/virtual agents comprised delivering health interventions, monitoring, assessment, guidance and strengthening agency. Telecare interventions led to improved clinical outcomes and higher adherence. Most studies reported sufficient system usability and high satisfaction among participants.

CONCLUSIONS

Telecare interventions were overall target group related and integrated in a service model. This combined with the use of avatars and virtual agents leads to improved adherence to telecare in the home setting. Further studies could account for relatives' experiences with telecare.

Minimal Effect of Messaging on Engagement in a Digital Anxiety Intervention

This study evaluated the effectiveness of different recruitment messages for encouraging enrollment in a digital mental health intervention (DMHI) for anxiety among 1,600 anxious patients in a large healthcare system. Patients were randomly assigned to receive a standard message, or one of five messages designed to encourage enrollment: Three messages offered varying financial incentives, one message offered coaching, and one message provided consumer testimonials. Patients could then click a link in the message to visit the DMHI website, enroll, and start the first session. We examined the effects of message features and message length (short vs. long) on rates of site clicks, enrollment, and starting the first session. We also tested whether demographic and clinical factors derived from patients' electronic health records were associated with rates of enrollment and starting the first session to understand the characteristics of patients most likely to use DMHIs in this setting. Across messages, 19.4% of patients clicked a link to visit the DMHI website, but none of the messages were significantly associated with rates of site clicks, enrollment, or starting the first session. Females (vs. males) had a greater probability of enrollment. No other demographic or clinical variables were significantly associated with enrollment or starting the first session. Findings provide guidance for resource allocation decisions in larger scale DMHI implementations in healthcare settings.

Situating Meditation Apps Within the Ecosystem of Meditation Practice: Population-Based Survey Study

BACKGROUND

Meditation apps have the potential to increase access to evidence-based strategies to promote mental health. However, it is currently unclear how meditation apps are situated within the broader landscape of meditation practice and what factors may influence engagement with them.

OBJECTIVE

This study aimed to clarify the prevalence and correlates of meditation app use in a population-based sample of individuals with lifetime exposure to meditation in the United States. In addition, we sought to identify the concerns and desired features of meditation apps among those with lifetime exposure to meditation.

METHODS

A total of 953 participants completed an initial screening survey. Of these 953 participants, 434 (45.5%) reported lifetime exposure to meditation and completed a follow-up survey (434/470, 92.3% response rate) assessing their meditation app use, anxiety, depression, loneliness, initial motivation for meditation, and concerns about and desired features of meditation apps.

RESULTS

Almost half (434/953, 45.5%) of the participants who completed the screening survey reported lifetime exposure to meditation. Among those with lifetime exposure to meditation (ie, meditators), more than half (255/434, 58.8%) had used meditation apps at least once in their lives, and 21.7% (94/434) used meditation apps weekly or daily (ie, active users). Younger age, higher anxiety, and a mental health motivation for practicing meditation were associated with lifetime exposure to meditation apps. Among meditators, those with lifetime exposure to meditation apps were more likely to report concerns about apps, including concerns regarding the cost and effectiveness of apps, time required for use, technical issues with apps, and app user-friendliness. Meditators who used meditation apps weekly or daily (ie, active users) were younger, less likely to be men and non-Latinx White individuals and have lower income, and more likely to have an initial spiritual motivation for meditation. Active users reported more concerns regarding usability and technical problems and were less likely to report disinterest in apps. Headspace and Calm were the most frequently used apps. Tips and reminders for practice, encouragement of "mini" practices, and mental health content were the most desired features. Participants were less interested in social features (eg, the ability to communicate with other users or teachers).

CONCLUSIONS

Meditation apps are commonly used by meditators in the United States, with a higher use among certain demographic groups. Future studies may increase user engagement in meditation apps by addressing concerns (eg, cost and effectiveness) and incorporating desired features (eg, tips and reminders for practice).