Development of a Management App for Postviral Fibromyalgia-Like Symptoms: Patient Preference-Guided Approach

BACKGROUND

Persistent fibromyalgia-like symptoms have been increasingly reported following viral infections, including SARS-CoV-2. About 30% of patients with post-COVID-19 syndrome fulfill the fibromyalgia criteria. This complex condition presents significant challenges in terms of self-management. Digital health interventions offer a viable means to assist patients in managing their health conditions. However, the challenge of ensuring their widespread adoption and adherence persists. This study responds to this need by developing a patient-centered digital health management app, incorporating patient preferences to enhance usability and effectiveness, ultimately aiming to improve patient outcomes and quality of life.

OBJECTIVE

This research aims to develop a digital health self-management app specifically for patients experiencing postviral fibromyalgia-like symptoms. By prioritizing patient preferences and engagement through the app's design and functionality, the study intends to facilitate better self-management practices and improve adherence.

METHODS

Using an exploratory study design, the research used patient preference surveys and usability testing as primary tools to inform the development process of the digital health solution. We gathered and analyzed patients' expectations regarding design features, content, and usability to steer the iterative app development.

RESULTS

The study uncovered crucial insights from patient surveys and usability testing, which influenced the app's design and functionality. Key findings included a preference for a symptom list over an automated chatbot, a desire to report on a moderate range of symptoms and activities, and the importance of an intuitive onboarding process. While usability testing identified some challenges in the onboarding process, it also confirmed the importance of aligning the app with patient needs to enhance engagement and satisfaction.

CONCLUSIONS

Incorporating patient feedback has been a significant factor in the development of the digital health app. Challenges encountered with user onboarding during usability testing have highlighted the importance of this process for user adoption. The study acknowledges the role of patient input in developing digital health technologies and suggests further research to improve onboarding procedures, aiming to enhance patient engagement and their ability to manage digital health resources effectively.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/32193.

Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone App-Led Cognitive Behavioral Therapy for Depression Under Therapist Supervision: Open Trial

BACKGROUND

Major depressive disorder affects approximately 1 in 5 adults during their lifetime and is the leading cause of disability worldwide. Yet, a minority receive adequate treatment due to person-level (eg, geographical distance to providers) and systems-level (eg, shortage of trained providers) barriers. Digital tools could improve this treatment gap by reducing the time and frequency of therapy sessions needed for effective treatment through the provision of flexible, automated support.

OBJECTIVE

This study aimed to examine the feasibility, acceptability, and preliminary clinical effect of Mindset for Depression, a deployment-ready 8-week smartphone-based cognitive behavioral therapy (CBT) supported by brief teletherapy appointments with a therapist.

METHODS

This 8-week, single-arm open trial tested the Mindset for Depression app when combined with 8 brief (16-25 minutes) video conferencing visits with a licensed doctoral-level CBT therapist (n=28 participants). The app offers flexible, accessible psychoeducation, CBT skills practice, and support to patients as well as clinician guidance to promote sustained engagement, monitor safety, and tailor treatment to individual patient needs. To increase accessibility and thus generalizability, all study procedures were conducted remotely. Feasibility and acceptability were assessed via attrition, patient expectations and feedback, and treatment utilization. The primary clinical outcome measure was the clinician-rated Hamilton Depression Rating Scale, administered at pretreatment, midpoint, and posttreatment. Secondary measures of functional impairment and quality of life as well as maintenance of gains (3-month follow-up) were also collected.

RESULTS

Treatment credibility (week 4), expectancy (week 4), and satisfaction (week 8) were moderate to high, and attrition was low (n=2, 7%). Participants self-reported using the app or practicing (either on or off the app) the CBT skills taught in the app for a median of 50 (IQR 30-60; week 4) or 60 (IQR 30-90; week 8) minutes per week; participants accessed the app on an average 36.8 (SD 10.0) days and completed a median of 7 of 8 (IQR 6-8) steps by the week 8 assessment. The app was rated positively across domains of engagement, functionality, aesthetics, and information. Participants' depression severity scores decreased from an average Hamilton Depression Rating Scale score indicating moderate depression (mean 19.1, SD 5.0) at baseline to a week 8 mean score indicating mild depression (mean 10.8, SD 6.1; d=1.47; P<.001). Improvement was also observed for functional impairment and quality of life. Gains were maintained at 3-month follow-up.

CONCLUSIONS

The results show that Mindset for Depression is a feasible and acceptable treatment option for individuals with major depressive disorder. This smartphone-led treatment holds promise to be an efficacious, scalable, and cost-effective treatment option. The next steps include testing Mindset for Depression in a fully powered randomized controlled trial and real-world clinical settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05386329; https://clinicaltrials.gov/study/NCT05386329?term=NCT05386329.

Evaluating the User Experience of a Smartphone-Delivered Sexual Health Promotion Program for Older Adults in the Netherlands: Single-Arm Pilot Study

BACKGROUND

Sexual health is an important component of quality of life in older adults. However, older adults often face barriers to attaining a fulfilling sexual life because of issues such as stigma, lack of information, or difficult access to adequate support.

OBJECTIVE

We aimed to evaluate the user experience of a self-guided, smartphone-delivered program to promote sexual health among older adults.

METHODS

The mobile app was made available to community-dwelling older adults in the Netherlands, who freely used the app for 8 weeks. User experience and its respective components were assessed using self-developed questionnaires, the System Usability Scale, and semistructured interviews. Quantitative and qualitative data were descriptively and thematically analyzed, respectively.

RESULTS

In total, 15 participants (mean age 71.7, SD 9.5 years) completed the trial. Participants showed a neutral to positive stance regarding the mobile app's usefulness and ease of use. Usability was assessed as "Ok/Fair." The participants felt confident about using the mobile app. To increase user experience, participants offered suggestions to improve content and interaction, including access to specialized sexual health services.

CONCLUSIONS

The sexual health promotion program delivered through a smartphone in a self-guided mode was usable. Participants' perception is that improvements to user experience, namely in content and interaction, as well as connection to external services, will likely improve usefulness and acceptance.

User experience of wearing comfort of reusable versus disposable surgical gowns and environmental perspectives: A cross-sectional survey

OBJECTIVE

To determine the user experience of wearing comfort of reusable sterile surgical gowns and compare these gowns with conventional disposable surgical gowns.

DESIGN

Cross-sectional survey.

SETTING

An academic hospital in the Netherlands.

POPULATION

Gynaecologists, surgeons, residents and operating room assistants (n=80).

METHODS

Quantitative and qualitative data were obtained via a written questionnaire. Participants provided subjective comments and scored the reusable gown on each individual topic with a score from 1 to 5 (1 = unsatisfactory, 2 = moderate, 3 = good, 4 = very good, 5 = excellent) and compared the reusable gown with the conventional disposable alternative (better, equal or worse).

MAIN OUTCOME MEASURES

Wearing comfort: ventilation and temperature regulation, fit and length, functionality, barrier function and ease of use.

RESULTS

The results of the overall scores of the reusable gown are scored as 'very good' (mean 4.3, SD ± 0.5) by its users. Regarding comparison of the gowns, more than 79% (lowest score 79%, highest score 95%) of the participants scored the reusable gown equal or higher on six of seven topics. The topic 'ease of use' was scored equal or higher by 59% of the participants. Subjective comments provided information on possible improvements.

CONCLUSIONS

The findings of this study demonstrate that there is professional acceptance regarding the utilisation of reusable surgical gowns. To facilitate broader adoption, it is imperative to foster collaboration among suppliers and healthcare institutions. The reusable surgical gown is an environmentally sustainable, safe and comfortable alternative in the operating room.

Leveraging Natural Language Processing to Evaluate Young Adults' User Experiences with a Digital Sleep Intervention for Alcohol Use

Evaluating user experiences with digital interventions is critical to increase uptake and adherence, but traditional methods have limitations. We incorporated natural language processing (NLP) with convergent mixed methods to evaluate a personalized feedback and coaching digital sleep intervention for alcohol risk reduction: 'Call it a Night' (CIAN; N = 120). In this randomized clinical trial with young adults with heavy drinking, control conditions were A + SM: web-based advice + active and passive monitoring; and A: advice + passive monitoring. Findings converged to show that the CIAN treatment condition group found feedback and coaching most helpful, whereas participants across conditions generally found advice helpful. Further, most participants across groups were interested in varied whole-health sleep-related factors besides alcohol use (e.g., physical activity), and many appreciated increased awareness through monitoring with digital tools. All groups had high adherence, satisfaction, and reported feasibility, but participants in CIAN and A + SM reported significantly higher effectiveness than those in A. NLP corroborated positive sentiments across groups and added critical insight that sleep, not alcohol use, was a main participant motivator. Digital sleep interventions are an acceptable, novel alcohol treatment strategy, and improving sleep and overall wellness may be important motivations for young adults. Further, NLP provides an efficient convergent method for evaluating experiences with digital interventions.

Designing mHealth Apps to Incorporate Evidence-Based Techniques for Prolonging User Engagement

Maintaining user engagement with mobile health (mHealth) apps can be a challenge. Previously, we developed a conceptual model to optimize patient engagement in mHealth apps by incorporating multiple evidence-based methods, including increasing health literacy, enhancing technical competence, and improving feelings about participation in clinical trials. This viewpoint aims to report on a series of exploratory mini-experiments demonstrating the feasibility of testing our previously published engagement conceptual model. We collected data from 6 participants using an app that showed a series of educational videos and obtained additional data via questionnaires to illustrate and pilot the approach. The videos addressed 3 elements shown to relate to engagement in health care app use: increasing health literacy, enhancing technical competence, and improving positive feelings about participation in clinical trials. We measured changes in participants' knowledge and feelings, collected feedback on the videos and content, made revisions based on this feedback, and conducted participant reassessments. The findings support the feasibility of an iterative approach to creating and refining engagement enhancements in mHealth apps. Systematically identifying the key evidence-based elements intended to be included in an app's design and then systematically testing the implantation of each element separately until a satisfactory level of positive impact is achieved is feasible and should be incorporated into standard app design. While mHealth apps have shown promise, participants are more likely to drop out than to be retained. This viewpoint highlights the potential for mHealth researchers to test and refine mHealth apps using approaches to better engage users.

Effectiveness of a Web-based and Mobile Therapy Chatbot on Anxiety and Depressive Symptoms in Subclinical Young Adults: Randomized Controlled Trial

BACKGROUND

There has been an increased need to provide specialized help for people with depressive and anxiety symptoms, particularly teenagers and young adults. There is evidence from a 2-week intervention that chatbots (eg, Woebot) are effective in reducing depression and anxiety, an effect that was not detected in the control group that was provided self-help materials. Although chatbots are a promising solution, there is limited scientific evidence for the efficacy of agent-guided cognitive behavioral therapy (CBT) outside the English language, especially for highly inflected languages.

OBJECTIVE

This study aimed to measure the efficacy of Fido, a therapy chatbot that uses the Polish language. It targets depressive and anxiety symptoms using CBT techniques. We hypothesized that participants using Fido would show a greater reduction in anxiety and depressive symptoms than the control group.

METHODS

We conducted a 2-arm, open-label, randomized controlled trial with 81 participants with subclinical depression or anxiety who were recruited via social media. Participants were divided into experimental (interacted with a fully automated Fido chatbot) and control (received a self-help book) groups. Both intervention methods addressed topics such as general psychoeducation and cognitive distortion identification and modification via Socratic questioning. The chatbot also featured suicidal ideation identification and redirection to suicide hotlines. We used self-assessment scales to measure primary outcomes, including the levels of depression, anxiety, worry tendencies, satisfaction with life, and loneliness at baseline, after the 2-week intervention and at the 1-month follow-up. We also controlled for secondary outcomes, including engagement and frequency of use.

RESULTS

There were no differences in anxiety and depressive symptoms between the groups at enrollment and baseline. After the intervention, depressive and anxiety symptoms were reduced in both groups (chatbot: n=36; control: n=38), which remained stable at the 1-month follow-up. Loneliness was not significantly different between the groups after the intervention, but an exploratory analysis showed a decline in loneliness among participants who used Fido more frequently. Both groups used their intervention technique with similar frequency; however, the control group spent more time (mean 117.57, SD 72.40 minutes) on the intervention than the Fido group (mean 79.44, SD 42.96 minutes).

CONCLUSIONS

We did not replicate the findings from previous (eg, Woebot) studies, as both arms yielded therapeutic effects. However, such results are in line with other research of Internet interventions. Nevertheless, Fido provided sufficient help to reduce anxiety and depressive symptoms and decreased perceived loneliness among high-frequency users, which is one of the first pieces of evidence of chatbot efficacy with agents that use a highly inflected language. Further research is needed to determine the long-term, real-world effectiveness of Fido and its efficacy in a clinical sample.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05762939; https://clinicaltrials.gov/study/NCT05762939; Open Science Foundation Registry 2cqt3; https://osf.io/2cqt3.

Impact of a Nationwide Medication History Sharing Program on the Care Process and End-User Experience in a Tertiary Teaching Hospital: Cohort Study and Cross-Sectional Study

Background

Timely and comprehensive collection of a patient's medication history in the emergency department (ED) is crucial for optimizing health care delivery. The implementation of a medication history sharing program, titled "Patient's In-home Medications at a Glance," in a tertiary teaching hospital aimed to efficiently collect and display nationwide medication histories for patients' initial hospital visits.

Objective

As an evaluation was necessary to provide a balanced picture of the program, we aimed to evaluate both care process outcomes and humanistic outcomes encompassing end-user experience of physicians and pharmacists.

Methods

We conducted a cohort study and a cross-sectional study to evaluate both outcomes. To evaluate the care process, we measured the time from the first ED assessment to urgent percutaneous coronary intervention (PCI) initiation from electronic health records. To assess end-user experience, we developed a 22-item questionnaire using a 5-point Likert scale, including 5 domains: information quality, system quality, service quality, user satisfaction, and intention to reuse. This questionnaire was validated and distributed to physicians and pharmacists. The Mann-Whiteny U test was used to analyze the PCI initiation time, and structural equation modeling was used to assess factors affecting end-user experience.

Results

The time from the first ED assessment to urgent PCI initiation at the ED was significantly decreased using the patient medication history program (mean rank 42.14 min vs 28.72 min; Mann-Whitney U=346; P=.03). A total of 112 physicians and pharmacists participated in the survey. Among the 5 domains, "intention to reuse" received the highest score (mean 4.77, SD 0.37), followed by "user satisfaction" (mean 4.56, SD 0.49), while "service quality" received the lowest score (mean 3.87, SD 0.79). "User satisfaction" was significantly associated with "information quality" and "intention to reuse."

Conclusions

Timely and complete retrieval using a medication history-sharing program led to an improved care process by expediting critical decision-making in the ED, thereby contributing to value-based health care delivery in a real-world setting. The experiences of end users, including physicians and pharmacists, indicated satisfaction with the program regarding information quality and their intention to reuse.

Parents' User Experience Accessing and Using a Web-Based Map of COVID-19 Recommendations for Health Decision-Making: Qualitative Descriptive Study

BACKGROUND

The eCOVID19 Recommendations Map & Gateway to Contextualization (RecMap) website was developed to identify all COVID-19 guidelines, assess the credibility and trustworthiness of the guidelines, and make recommendations understandable to various stakeholder groups. To date, little has been done to understand and explore parents' experiences when accessing and using the RecMap website for COVID-19 health decision-making.

OBJECTIVE

To explore (1) where parents look for COVID-19 health information and why, (2) parents' user experience when accessing and using the RecMap website to make health decisions, and (3) what knowledge mobilization activities are needed to increase parents' awareness, use, and engagement with the RecMap website.

METHODS

We conducted a qualitative descriptive study using semistructured interviews and a think-aloud activity with parents of children aged 18 years or younger living in Canada. Participants were asked to provide feedback on the RecMap website and to "think aloud" as they navigated the website to find relevant COVID-19 health recommendations. Demographic information was collected using a web-based questionnaire. A hybrid deductive and inductive thematic approach guided analysis and data synthesis.

RESULTS

A total of 21 participants (13/21, 62% mothers) were interviewed and participated in a think-aloud activity. The data were categorized into four sections, representative of key elements that deductively and inductively emerged from the data: (1) parent information seeking behaviors and preferences for COVID-19, (2) RecMap website usability, (3) perceived usefulness of the RecMap website, and (4) knowledge mobilization strategies to increase awareness, use, and engagement of the RecMap website. Parents primarily used the internet to find COVID-19 information and focused on sources that they determined to be credible, trustworthy, simple, and engaging. As the pandemic evolved, participants' information-seeking behaviors changed, specifically their topics of interest and search frequency. Most parents were not aware of the RecMap website before this study but found satisfaction with its concept and layout and expressed intentions to use and share it with others. Parents experienced some barriers to using the RecMap website and suggested key areas for improvement to facilitate its usability and perceived usefulness. Recommendations included a more user-friendly home page for lay audiences (separate public-facing user interface), improving the search and filter options, quicker navigation, clearer titles, more family-friendly graphics, and improving mobile-friendly access. Several strategies to disseminate the RecMap website were also expressed, including a mix of traditional and nontraditional methods (handouts and social media) in credible and high-traffic locations that parents frequent often.

CONCLUSIONS

Overall, parents liked the concept of the RecMap website but had some suggestions to improve its usability (language, navigation, and website interface). These findings can be used to improve the RecMap website for parents and offer insight for the development and dissemination of effective web-based health information tools and resources for the general public.

LovesCompany: evaluating the safety and feasibility of a mental health-focused online community for adolescents

Background: Adolescents are at risk for mental health (MH) disorders but are unlikely to seek services and may be reluctant to talk about their MH. An anonymous, online MH-focused community could help reduce suffering. However, online forums can also promote negative behaviours such as cyberbullying. This study aimed to evaluate the safety and feasibility of an online community - LovesCompany - to improve MH outcomes for adolescents.Methods: American adolescents (14-17 years) were recruited through social media. Eligible participants were randomised to LovesCompany or a placebo MH resource site. Outcomes were assessed every other week for six months, and at twelve months. Multilevel models assessed group differences in depression, anxiety, and suicidal ideation. A subgroup of participants participated in qualitative interviews.Results: Participants (N = 202) were mostly female (70%), White non-Hispanic (69%), and cisgender (80%). There were no instances of inappropriate behaviour such as bullying or posting explicit content. Symptoms for both groups improved over time. Participants appreciated hearing others' experiences and valued the opportunity to offer support.Conclusion: Although adolescents are often resistant to MH treatment, they appear to be interested in anonymous, online, MH-focused conversation, and can benefit from giving and seeking support. Finding a balance between an appealing user experience, ethical considerations, and resource needs is challenging.

User-Friendly Chatbot to Mitigate the Psychological Stress of Older Adults During the COVID-19 Pandemic: Development and Usability Study

BACKGROUND

To safeguard the most vulnerable individuals during the COVID-19 pandemic, numerous governments enforced measures such as stay-at-home orders, social distancing, and self-isolation. These social restrictions had a particularly negative effect on older adults, as they are more vulnerable and experience increased loneliness, which has various adverse effects, including increasing the risk of mental health problems and mortality. Chatbots can potentially reduce loneliness and provide companionship during a pandemic. However, existing chatbots do not cater to the specific needs of older adult populations.

OBJECTIVE

We aimed to develop a user-friendly chatbot tailored to the specific needs of older adults with anxiety or depressive disorders during the COVID-19 pandemic and to examine their perspectives on mental health chatbot use. The primary research objective was to investigate whether chatbots can mitigate the psychological stress of older adults during COVID-19.

METHODS

Participants were older adults belonging to two age groups (≥65 years and <65 years) from a psychiatric outpatient department who had been diagnosed with depressive or anxiety disorders by certified psychiatrists according to the Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition) (DSM-5) criteria. The participants were required to use mobile phones, have internet access, and possess literacy skills. The chatbot's content includes monitoring and tracking health data and providing health information. Participants had access to the chatbot for at least 4 weeks. Self-report questionnaires for loneliness, depression, and anxiety were administered before and after chatbot use. The participants also rated their attitudes toward the chatbot.

RESULTS

A total of 35 participants (mean age 65.21, SD 7.51 years) were enrolled in the trial, comprising 74% (n=26) female and 26% (n=9) male participants. The participants demonstrated a high utilization rate during the intervention, with over 82% engaging with the chatbot daily. Loneliness significantly improved in the older group ≥65 years. This group also responded positively to the chatbot, as evidenced by changes in University of California Los Angeles Loneliness Scale scores, suggesting that this demographic can derive benefits from chatbot interaction. Conversely, the younger group, <65 years, exhibited no significant changes in loneliness after the intervention. Both the older and younger age groups provided good scores in relation to chatbot design with respect to usability (mean scores of 6.33 and 6.05, respectively) and satisfaction (mean scores of 5.33 and 5.15, respectively), rated on a 7-point Likert scale.

CONCLUSIONS

The chatbot interface was found to be user-friendly and demonstrated promising results among participants 65 years and older who were receiving care at psychiatric outpatient clinics and experiencing relatively stable symptoms of depression and anxiety. The chatbot not only provided caring companionship but also showed the potential to alleviate loneliness during the challenging circumstances of a pandemic.

On the relationship between mind perception and social support of chatbots

The social support provided by chatbots is typically designed to mimic the way humans support others. However, individuals have more conflicting attitudes toward chatbots providing emotional support (e.g., empathy and encouragement) compared to informational support (e.g., useful information and advice). This difference may be related to whether individuals associate a certain type of support with the realm of the human mind and whether they attribute human-like minds to chatbots. In the present study, we investigated whether perceiving human-like minds in chatbots affects users' acceptance of various support provided by the chatbot. In the experiment, the chatbot posed questions about participants' interpersonal stress events, prompting them to write down their stressful experiences. Depending on the experimental condition, the chatbot provided two kinds of social support: informational support or emotional support. Our results showed that when participants explicitly perceived a human-like mind in the chatbot, they considered the support to be more helpful in resolving stressful events. The relationship between implicit mind perception and perceived message effectiveness differed depending on the type of support. More specifically, if participants did not implicitly attribute a human-like mind to the chatbot, emotional support undermined the effectiveness of the message, whereas informational support did not. The present findings suggest that users' mind perception is essential for understanding the user experience of chatbot social support. Our findings imply that informational support can be trusted when building social support chatbots. In contrast, the effectiveness of emotional support depends on the users implicitly giving the chatbot a human-like mind.

Evaluating the delivery of physical activity for people with developmental disabilities using an online knowledge translation approach: part 1 - web accessibility

Background: Knowledge-to-action gap exists in delivering physical activity (PA) to people with developmental disabilities via online platforms. Although web-based platforms have great potential in facilitating the delivery of PA for this target group, the lack of knowledge regarding web accessibility poses a challenge in accessing PA-related information online.Objective: This study evaluates the delivery of PA in terms of web accessibility. It also aims to identify barriers and facilitators in delivering PA knowledge to people with developmental disabilities online to improve web accessibility for the target user group.Methods: The study employs a concurrent nested design incorporating both quantitative (web usability questionnaire) and qualitative data (in-depth interviews). Fifteen pairs of individuals consisting of a person with developmental disabilities and a primary caregiver participated in the study, and three web-based platforms were selected for web accessibility tests and in-depth interviews.Results: The nested analysis provides a quantitative comparison of web accessibility and identifies barriers and facilitators of delivering PA for the target user group from the web accessibility perspective. Conclusion: The study findings could inform the development of accessible online platforms that distribute health-related knowledge to populations with developmental disabilities. Additionally, they could help enhance the design of other platforms intended for these populations.

Mixed-method usability investigation of ARROWS: augmented reality for roadway work zone safety

This article explores the usability and user experience challenges of ARROWS, a novel augmented reality (AR) and wearable technology (WT) safety system for roadway work zones, an area with limited existing usability research. We utilized a mixed-method approach with two complementary experiments in indoor and outdoor settings, using the Wizard of Oz methodology and a high-fidelity prototype. We focused on identifying usability challenges, factors contributing to user experience and the distinct needs of highway workers, documenting results using the system usability scale (SUS), the rating scale mental effort (RSME) and a trust score. Participants rated the usability of ARROWS above average in both settings, while making a reasonable level of mental effort. The findings also indicate a significant correlation between perceived trust and usability, highlighting the importance of trust in user experience.

Evidence for Shifting Cognitive Strategies when Icons Appear in Unexpected Locations

OBJECTIVE

The present study examines the cognitive effects of placing icons in unexpected spatial locations within websites.

BACKGROUND

Prior research has revealed evidence for cognitive conflict when web icons occur in unexpected locations (e.g., cart, top left), generally consistent with a dynamical systems models. Here, we compare the relative strength of evidence for both dual and dynamical systems models.

METHODS

Participants clicked on icons located in either expected (e.g., cart, top right) or unexpected (e.g., cart, top left) locations while mouse trajectories were continuously recorded. Trajectories were classified according to prototypes associated with each cognitive model. The dynamical systems model predicts curved trajectories, while the dual-systems model predicts straight and change of mind trajectories.

RESULTS

Trajectory classification revealed that curved trajectories increased (+11%), while straight and change of mind trajectories decreased (-12%) when target icons occurred in unexpected locations (p < .001).

CONCLUSION

Rather than employing a single cognitive strategy, users shift from a primarily dual-systems to dynamical systems strategy when icons occur in unexpected locations.

APPLICATION

Potential applications of this work include the assessment of cognitive impacts such as mental workload and cognitive conflict during real-time interaction with websites and other screen-based interfaces, personalization and adaptive interfaces based on an individual's cognitive strategy, and data-driven A/B testing of alternative interface designs.

The Dual Importance of Virtual Reality Usability in Rehabilitation: A Focus on Therapists and Patients

Virtual reality (VR) has advanced in medical education and rehabilitation from basic graphical applications due to its ability to generate a virtual three-dimensional (3D) environment. This environment is mostly used to practice professional skills, plan surgery procedures, simulate surgeries, display 3D anatomy, and rehabilitate various disorders. VR has transformed the field of rehabilitation therapy by providing immersive and engaging experiences that go beyond traditional bounds, significantly improving patient care and therapeutic results. Considering the direct impact of VR on the efficacy of the treatment for both therapists and patients, its dual significance for usability and user experience cannot be overstated. The purpose of this article is to determine the synergistic association between VR accessibility and the rehabilitation process, highlighting the significance of VR technology in designing the future of rehabilitation therapy and demonstrating how advancing VR technology can improve therapeutic outcomes despite overcoming obstacles encountered during VR usage. In conclusion, VR offers a personalized, efficient, interesting, and engaging rehabilitative environment for patients, while also assisting therapists in cultivating empathy and efficiency and encouraging innovative approaches in treatment procedures.

A Risk Assessment and Planning Tool to Prevent Sudden Unexpected Death in Infancy: Development and Evaluation of The Baby Sleep Planner

BACKGROUND

Successful national safer sleep campaigns in the United Kingdom have lowered the death rates from sudden unexpected death in infancy (SUDI) over the past 3 decades, but deaths persist in socioeconomically deprived families. The circumstances of current deaths suggest that improvements in support for some families to follow safer sleep advice more consistently could save lives.

OBJECTIVE

This study aimed to develop and evaluate a risk assessment and planning tool designed to improve the uptake of safer sleep advice in families with infants at increased risk of SUDI.

METHODS

A co-design approach was used to develop the prototype interface of a web-based tool with 2 parts: an individual SUDI risk assessment at birth and a downloadable plan for safety during times of disruption. The advice contained within the tool is concordant with national guidance from the Lullaby Trust, the United Nations International Children's Emergency Fund (UNICEF), and the National Institute for Health and Care Excellence. User testing of the prototype tool was conducted by inviting health visitors, midwives, and family nurses to use it with families eligible for additional support. Qualitative interviews with health professionals and families allowed for iterative changes to the tool and for insights into its function and influence on parental behavior.

RESULTS

A total of 22 health professionals were enrolled in the study, of whom 20 (91%) were interviewed. They reported appreciating the functionality of the tool, which allowed them to identify at-risk families for further support. They felt that the tool improved how they communicated about risks with families. They suggested expanding its use to include relevance in the antenatal period and having versions available in languages other than English. They reported using the tool with 58 families; 20 parents gave consent to be interviewed by the research team about their experiences with the tool. Families were positive about the tool, appreciated the trustworthy information, and felt that it was useful and appropriate and that the plans for specific infant sleeps would be of benefit to them and other family members.

CONCLUSIONS

Our tool combines risk assessment and safety planning, both of which have the potential to improve the uptake of lifesaving advice. Refinements to the tool based on these findings have ensured that the tool is ready for further evaluation in a larger study before being rolled out to families with infants at increased risk.

Towards a Regulatory Framework for Electronic Medical Record Data Visualization

Physicians struggle to retrieve data from electronic medical records. We evaluated a digital tool that enhances physician efficiency in retrieving and analyzing patient information for treatment decision-making. Our use case is the care of diabetic patients. Evaluation results showed that healthcare providers who used the i4C (Insights for Care) dashboard experienced greater time efficiency than those who used traditional EMR information retrieval methods. A comprehensive evaluation of the i4C Dashboard confirms its effectiveness in facilitating diabetic care data management, as well as its potential application to a wide range of healthcare scenarios. In order to further maximize its effectiveness on clinical efficiency and patient care, future research should focus on improving its usability and scalability.

Participants' experiences of attending a structured education course (DAFNEplus) informed by behavioural science

AIMS

As part of a broader process evaluation, we explored participants' experiences of, and engagement with, the DAFNEplus programme's group-based structured education course. This course, which was informed by behavioural science, provided participants with education and instruction to use flexible intensive insulin therapy (FIIT) together with techniques to identify and address unhelpful cognitive and emotional influences on their type 1 diabetes self-management.

METHODS

We interviewed n = 28 DAFNEplus participants. Data were analysed thematically and took account of previous work exploring individuals' experiences of standard DAFNE courses.

RESULTS

As well as benefitting from the DAFNEplus course's skills-based training and educational curriculum, participants' accounts suggested they had experienced cognitive and emotional changes that had positively influenced their confidence and motivation to adopt and sustain the use of FIIT. These benefits were most keenly felt by those who reported negative emotional states and mind-sets pre-course which had made their diabetes self-management challenging. Participants' cognitive and emotional changes were enabled through techniques used during the course to normalise setbacks and imperfect diabetes self-management, capitalise upon group synergies and encourage the use of social support, including from healthcare professionals. Participants also highlighted motivational gains arising from being reassured that diabetes complications are not common or inevitable if a FIIT regimen is followed.

CONCLUSIONS

Our findings suggest that offering training in FIIT, in conjunction with behaviour change techniques that target unhelpful mindsets and emotional resilience, may be more effective in promoting diabetes self-management than offering education and skills training alone.

Evaluating Users' Experiences of a Child Multimodal Wearable Device: Mixed Methods Approach

BACKGROUND

Wearable devices permit the continuous, unobtrusive collection of data from children in their natural environments and can transform our understanding of child development. Although the use of wearable devices has begun to emerge in research involving children, few studies have considered families' experiences and perspectives of participating in research of this kind.

OBJECTIVE

Through a mixed methods approach, we assessed parents' and children's experiences of using a new wearable device in the home environment. The wearable device was designed specifically for use with infants and young children, and it integrates audio, electrocardiogram, and motion sensors.

METHODS

In study 1, semistructured phone interviews were conducted with 42 parents of children aged 1 month to 9.5 years who completed 2 day-long recordings using the device, which the children wore on a specially designed shirt. In study 2, a total of 110 parents of children aged 2 months to 5.5 years responded to a questionnaire assessing their experience of completing 3 day-long device recordings in the home. Guided by the Digital Health Checklist, we assessed parental responses from both studies in relation to the following three key domains: (1) access and usability, (2) privacy, and (3) risks and benefits.

RESULTS

In study 1, most parents viewed the device as easy to use and safe and remote visits as convenient. Parents' views on privacy related to the audio recordings were more varied. The use of machine learning algorithms (vs human annotators) in the analysis of the audio data, the ability to stop recordings at any time, and the view that the recordings reflected ordinary family life were some reasons cited by parents who expressed minimal, if any, privacy concerns. Varied risks and benefits were also reported, including perceived child comfort or discomfort, the need to adjust routines to accommodate the study, the understanding gained from the study procedures, and the parent's and child's enjoyment of study participation. In study 2, parents' ratings on 5 close-ended items yielded a similar pattern of findings. Compared with a "neutral" rating, parents were significantly more likely to agree that (1) device instructions were helpful and clear (t109=-45.98; P<.001), (2) they felt comfortable putting the device on their child (t109=-22.22; P<.001), and (3) they felt their child was safe while wearing the device (t109=-34.48; P<.001). They were also less likely to worry about the audio recordings gathered by the device (t108=6.14; P<.001), whereas parents' rating of the burden of the study procedures did not differ significantly from a "neutral" rating (t109=-0.16; P=.87).

CONCLUSIONS

On the basis of parents' feedback, several concrete changes can be implemented to improve this new wearable platform and, ultimately, parents' and children's experiences of using child wearable devices in the home setting.

Effectiveness and User Experience of Virtual Reality for Social Anxiety Disorder: Systematic Review

BACKGROUND

Social anxiety disorder (SAD) is a debilitating psychiatric disorder that affects occupational and social functioning. Virtual reality (VR) therapies can provide effective treatment for people with SAD. However, with rapid innovations in immersive VR technology, more contemporary research is required to examine the effectiveness and concomitant user experience outcomes (ie, safety, usability, acceptability, and attrition) of emerging VR interventions for SAD.

OBJECTIVE

The aim of this systematic review was to examine the effectiveness and user experience of contemporary VR interventions among people with SAD.

METHODS

The Cochrane Library, Emcare, PsycINFO, PubMed, ScienceDirect, Scopus, and Web of Science databases were searched between January 1, 2012, and April 26, 2022. Deduplicated search results were screened based on title and abstract information. Full-text examination was conducted on 71 articles. Studies of all designs and comparator groups were included if they appraised the effectiveness and user experience outcomes of any immersive VR intervention among people with SAD. A standardized coding sheet was used to extract data on key participant, intervention, comparator, outcome, and study design items.

RESULTS

The findings were tabulated and discussed using a narrative synthesis. A total of 18 studies met the inclusion criteria.

CONCLUSIONS

The findings showed that VR exposure therapy-based interventions can generally provide effective, safe, usable, and acceptable treatments for adults with SAD. The average attrition rate from VR treatment was low (11.36%) despite some reported user experience difficulties, including potential simulator sickness, exposure-based emotional distress, and problems with managing treatment delivered in a synchronous group setting. This review also revealed several research gaps, including a lack of VR treatment studies on children and adolescents with SAD as well as a paucity of standardized assessments of VR user experience interactions. More studies are required to address these issues.

TRIAL REGISTRATION

PROSPERO CRD42022353891; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=353891.

Remote Self-Administration of Cognitive Screeners for Older Adults Prior to a Primary Care Visit: Pilot Cross-Sectional Study of the Reliability and Usability of the MyCog Mobile Screening App

BACKGROUND

Routine cognitive screening is essential in the early detection of dementia, but time constraints in primary care settings often limit clinicians' ability to conduct screenings. MyCog Mobile is a newly developed cognitive screening system that patients can self-administer on their smartphones before a primary care visit, which can help save clinics' time, encourage broader screening practices, and increase early detection of cognitive decline.

OBJECTIVE

The goal of this pilot study was to examine the feasibility, acceptability, and initial psychometric properties of MyCog Mobile. Research questions included (1) Can older adults complete MyCog Mobile remotely without staff support? (2) Are the internal consistency and test-retest reliability of the measures acceptable? and (3) How do participants rate the user experience of MyCog Mobile?

METHODS

A sample of adults aged 65 years and older (N=51) self-administered the MyCog Mobile measures remotely on their smartphones twice within a 2- to 3-week interval. The pilot version of MyCog Mobile includes 4 activities: MyFaces measures facial memory, MySorting measures executive functioning, MySequences measures working memory, and MyPictures measures episodic memory. After their first administration, participants also completed a modified version of the Simplified System Usability Scale (S-SUS) and 2 custom survey items.

RESULTS

All participants in the sample passed the practice items and completed each measure. Findings indicate that the Mobile Toolbox assessments measure the constructs well (internal consistency 0.73 to 0.91) and are stable over an approximately 2-week delay (test-retest reliability 0.61 to 0.71). Participants' rating of the user experience (mean S-SUS score 73.17, SD 19.27) indicated that older adults found the usability of MyCog Mobile to be above average. On free-response feedback items, most participants provided positive feedback or no feedback at all, but some indicated a need for clarity in certain task instructions, concerns about participants' abilities, desire to be able to contact a support person or use in-app technical support, and desire for additional practice items.

CONCLUSIONS

Pilot evidence suggests that the MyCog Mobile cognitive screener can be reliably self-administered by older adults on their smartphones. Participants in our study generally provided positive feedback about the MyCog Mobile experience and rated the usability of the app highly. Based on participant feedback, we will conduct further usability research to improve support functionality, optimize task instructions and practice opportunities, and ensure that patients feel comfortable using MyCog Mobile. The next steps include a clinical validation study that compares MyCog Mobile to gold-standard assessments and tests the sensitivity and specificity of the measures for identifying dementia.

Timing, Indicators, and Approaches to Digital Patient Experience Evaluation: Umbrella Systematic Review

BACKGROUND

The increasing prevalence of DH applications has outpaced research and practice in digital health (DH) evaluations. Patient experience (PEx) was reported as one of the challenges facing the health system by the World Health Organization. To generate evidence on DH and promote the appropriate integration and use of technologies, a standard evaluation of PEx in DH is required.

OBJECTIVE

This study aims to systematically identify evaluation timing considerations (ie, when to measure), evaluation indicators (ie, what to measure), and evaluation approaches (ie, how to measure) with regard to digital PEx. The overall aim of this study is to generate an evaluation guide for further improving digital PEx evaluation.

METHODS

This is a 2-phase study parallel to our previous study. In phase 1, literature reviews related to PEx in DH were systematically searched from Scopus, PubMed, and Web of Science databases. Two independent raters conducted 2 rounds of paper screening, including title and abstract screening and full-text screening, and assessed the interrater reliability for 20% (round 1: 23/115 and round 2: 12/58) random samples using the Fleiss-Cohen coefficient (round 1: k1=0.88 and round 2: k2=0.80). When reaching interrater reliability (k>0.60), TW conducted the rest of the screening process, leaving any uncertainties for group discussions. Overall, 38% (45/119) of the articles were considered eligible for further thematic analysis. In phase 2, to check if there were any meaningful novel insights that would change our conclusions, we performed an updated literature search in which we collected 294 newly published reviews, of which 102 (34.7%) were identified as eligible articles. We considered them to have no important changes to our original results on the research objectives. Therefore, they were not integrated into the synthesis of this review and were used as supplementary materials.

RESULTS

Our review highlights 5 typical evaluation objectives that serve 5 stakeholder groups separately. We identified a set of key evaluation timing considerations and classified them into 3 categories: intervention maturity stages, timing of the evaluation, and timing of data collection. Information on evaluation indicators of digital PEx was identified and summarized into 3 categories (intervention outputs, patient outcomes, and health care system impact), 9 themes, and 22 subthemes. A set of evaluation theories, common study designs, data collection methods and instruments, and data analysis approaches was captured, which can be used or adapted to evaluate digital PEx.

CONCLUSIONS

Our findings enabled us to generate an evaluation guide to help DH intervention researchers, designers, developers, and program evaluators evaluate digital PEx. Finally, we propose 6 directions for encouraging further digital PEx evaluation research and practice to address the challenge of poor PEx.

Gesture-Based Interactions: Integrating Accelerometer and Gyroscope Sensors in the Use of Mobile Apps

This study investigates the feasibility and functionality of accelerometer and gyroscope sensors for gesture-based interactions in mobile app user experience. The core of this innovative approach lies in introducing a dynamic and intuitive user interaction model with the device sensors. The Android app developed for this purpose has been created for its use in controlled experiments. Methodologically, it was created as a stand-alone tool to both capture quantitative (time, automatically captured) and qualitative (behavior, collected with post-task questionnaires) variables. The app's setting features a set of modules with two levels each (randomized presentation applied, minimizing potential learning effects), allowing users to interact with both sensor-based and traditional touch-based scenarios. Preliminary results with 22 participants reveal that tasks involving sensor-based interactions tend to take longer to complete when compared to the traditional ones. Remarkably, many participants rated sensor-based interactions as a better option than touch-based interactions, as seen in the post-task questionnaires. This apparent discrepancy between objective completion times and subjective user perceptions requires a future in-depth exploration of factors influencing user experiences, including potential learning curves, cognitive load, and task complexity. This study contributes to the evolving landscape of mobile app user experience, emphasizing the benefits of considering the integration of device sensors (and gesture-based interactions) in common mobile usage.

An Evaluation of the User Experience and Privacy Concerns of Individuals Misusing Opioids Using a Location Tracking Mobile Application

Opioid use disorder is a growing public health concern in the United States, causing economic burden and hindered by stigma. New forms of data, including location data, may improve the effectiveness of interventions for preventing and treating opioid use disorder and/or misuse, increase access to treatment and address racial and ethnic disparities. This qualitative study aimed to identify factors that contribute to users' experience with a publicly available location-tracking mobile app - and investigate their privacy and ethical concerns. The study was conducted through two 15-minute interviews within a 48-h time frame. Participants were recruited from a pool of past research participants, Facebook ads, and referrals, and had to meet certain inclusion criteria related to opioid use disorder and/or misuse. The study had a final sample of 30 participants, 15 male and 15 female. The study suggests that a simple onboarding process and convenient experience can enhance participant adherence to the study app and other similar location-based research apps. However, the study also found that participants had concerns about privacy and transparency about locational privacy when sharing their location data. To improve the app, researchers suggest incorporating user behavior earlier in the app development stage. The study also highlights the importance of addressing ethical and privacy concerns such as limiting the types of collected data, incorporating data encryption and retention strategies, giving access to research staff only, and not sharing the data with third-party companies or law enforcement agencies to increase user satisfaction.

Improving Accessibility of Continuing Professional Development for Oncology Health Professionals Through the EviQ Education App

Oncology clinicians must participate in continuing professional development (CPD) to stay up to date with best practice. The Cancer Institute NSW eviQ Education program produces evidence-based, peer-reviewed eLearning resources for oncology professionals. In response to user feedback, eviQ Education trialled a mobile app, EdApp, to improve accessibility of self-directed CPD materials. Following a pilot, users indicated that the EdApp improved CPD accessibility and user experience. EdApp will continue to be used to support evidence-based practice.

User-Led Learning Preferences to Inform Rapid Learning Online Education Supporting Evidence-Based Best Practice in Oncology

Effective eLearning design takes into account the learning needs and styles of users. eviQ Education, a program of the Cancer Institute NSW, considered evidence from user data to develop a range of clinical education resources in formats informed by user preferences, including mini-modules, videos and webinars. Through the website and mobile app, content is available on-demand, supporting health professionals to learn anytime, anywhere, on any device.

Virtual Exercise in Medicine: A Proof of Concept in a Healthy Population

BACKGROUND

Science is beginning to establish the benefits of the use of virtual reality (VR) in health care. This therapeutic approach may be an appropriate complementary treatment for some mental illnesses. It could prevent high levels of morbidity and improve the physical health of patients. For many years, the literature has shown the health benefits of physical exercise. Physical exercise in a VR environment may improve the management of mild to moderate mental health conditions. In this context, we developed a virtual environment combined with an ergocycle (the augmented physical training for isolated and confined environments [APTICE] system).

OBJECTIVE

This study aims to investigate the impact of physical exercise in a VR environment.

METHODS

A total of 14 healthy participants (11 men and 3 women; mean age 43.28, SD 10.60 years) undertook 15 minutes of immersive physical exercise using the system. Measures included mindfulness and immersion disposition, subjective perceptions of sensory information, user experience, and VR experience (ie, psychological state, flow, and presence).

RESULTS

First, the APTICE system appears to be a useful tool because the user experience is positive (subscales in the AttrakDiff questionnaire: pragmatic quality=0.99; hedonic quality-stimulation=1.90; hedonic quality-identification=0.67; attractiveness=1.58). Second, the system can induce a positive psychological state (negative emotion, P=.06) and an experience of flow and presence (P values ranging from <.001 to .04). Third, individual immersive and mindful disposition plays a role in the VR experience (P values ranging from <.02 to .04). Finally, our findings suggest that there is a link between the subjective perception of sensory information and the VR experience (P values ranging from <.02 to .04).

CONCLUSIONS

These results indicate that the device is well accepted with positive psychological and exteroceptive outcomes. Overall, the APTICE system could be a proof of concept to explore the benefits of virtual physical exercise in clinical medicine.

Acceptability and Feasibility of a Smartphone-Based Real-Time Assessment of Suicide Among Black Men: Mixed Methods Pilot Study

BACKGROUND

Suicide rates in the United States have increased recently among Black men. To address this public health crisis, smartphone-based ecological momentary assessment (EMA) platforms are a promising way to collect dynamic, real-time data that can help improve suicide prevention efforts. Despite the promise of this methodology, little is known about its suitability in detecting experiences related to suicidal thoughts and behavior (STB) among Black men.

OBJECTIVE

This study aims to clarify the acceptability and feasibility of using smartphone-based EMA through a pilot study that assesses the user experience among Black men.

METHODS

We recruited Black men aged 18 years and older using the MyChart patient portal messaging (the patient-facing side of the Epic electronic medical record system) or outpatient provider referrals. Eligible participants self-identified as Black men with a previous history of STB and ownership of an Android or iOS smartphone. Eligible participants completed a 7-day smartphone-based EMA study. They received a prompt 4 times per day to complete a brief survey detailing their STB, as well as proximal risk factors, such as depression, social isolation, and feeling like a burden to others. At the conclusion of each day, participants also received a daily diary survey detailing their sleep quality and their daily experiences of everyday discrimination. Participants completed a semistructured exit interview of 60-90 minutes at the study's conclusion.

RESULTS

In total, 10 participants completed 166 EMA surveys and 39 daily diary entries. A total of 4 of the 10 participants completed 75% (21/28) or more of the EMA surveys, while 9 (90%) out of 10 completed 25% (7/28) or more. The average completion rate of all surveys was 58% (20.3/35), with a minimum of 17% (6/35) and maximum of 100% (35/35). A total of 4 (40%) out of 10 participants completed daily diary entries for the full pilot study. No safety-related incidents were reported. On average, participants took 2.08 minutes to complete EMA prompts and 2.72 minutes for daily diary surveys. Our qualitative results generally affirm the acceptability and feasibility of the study procedures, but the participants noted difficulties with the technology and the redundancy of the survey questions. Emerging themes also addressed issues such as reduced EMA survey compliance and diminished mood related to deficit-framed questions related to suicide.

CONCLUSIONS

Findings from this study will be used to clarify the suitability of EMA for Black men. Overall, our EMA pilot study demonstrated mixed feasibility and acceptability when delivered through smartphone-based apps to Black men. Specific recommendations are provided for managing safety within these study designs and for refinements in future intervention and implementation science research.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/31241.

Designing a Web-Based Navigation Tool to Support Access to Youth Mental Health Services: Qualitative Study

BACKGROUND

Many young people with mental health problems do not readily seek help or receive treatment and support. One way to address low help-seeking behavior is to improve access to information on mental health services and how to navigate the mental health system via a web-based tool. Seeking input from the end users (young people and parents or caregivers) on key features of the tool is imperative to ensure that it is relevant, engaging, and likely to meet their needs and expectations.

OBJECTIVE

This study aims to investigate young person and parent or caregiver views on the design, content, functioning, and user experience of a web-based mental health navigation tool to support connection to mental health services for children and young people aged up to 25 years.

METHODS

A total of 4 online focus groups were conducted: 2 with young people aged 16 years and older (total n=15) and 2 with parents or caregivers (total n=13). Focus groups were structured around a series of guiding questions to explore participants' views on content, features, user experience, and design of a mental health navigation website. Focus groups were audio recorded with detailed notes taken. In addition, 53 young people aged 16-25 years and 97 parents or caregivers completed an online survey, comprising closed- and open-ended questions; open-ended responses were included with the focus group data in the qualitative analysis. All qualitative data were analyzed using thematic analysis.

RESULTS

A total of 2 topic areas and 7 themes were developed. The first topic area covered the types of information needs of young people and parents. Identified themes concerned the scope of the navigation website, as well as the provision of up-to-date and practical information on how to navigate the whole help-seeking process. The second topic area covered website features that would be beneficial and included the consideration of the website design; search engines; supported navigation; and forums, reviews, and user accounts.

CONCLUSIONS

This study provides important insights into the navigation needs of young people and parents or caregivers in seeking mental health services. Key findings identified through this research have directly informed the development of MindMap, a web-based youth navigation tool providing a searchable database of local services, including a clear description, their location, and potential wait times. The website can be navigated independently or with support.

An Electronic Teen Questionnaire, the eTeenQ, for Risk Behavior Screening During Adolescent Well Visits in an Integrated Health System: Development and Pilot Implementation

Background

Screening for risk behaviors is a routine and essential component of adolescent preventive health visits. Early identification of risks can inform targeted counseling and care. If stored in discrete fields in the electronic health record (EHR), adolescent screening data can also be used to understand risk behaviors across a clinic or health system or to support quality improvement projects.

Objective

Goals of this pilot study were to adapt and implement an existing paper adolescent risk behavior screening tool for use as an electronic data capture tool (the eTeenQ), to evaluate acceptance of the eTeenQ, and to describe the prevalence of the selected risk behaviors reported through the eTeenQ.

Methods

The multidisciplinary project team applied an iterative process to develop the 29-item eTeenQ. Two unique data entry forms were created with attention to (1) user interface and user experience, (2) the need to maintain patient privacy, and (3) the potential to transmit and store data for future use in clinical care and research. Three primary care clinics within a large health system piloted the eTeenQ from August 17, 2020, to August 27, 2021. During preventive health visits for adolescents aged 12 to 18 years, the eTeenQ was completed on tablets and responses were converted to a provider display for teens and providers to review together. Responses to the eTeenQ were stored in a REDCap (Research Electronic Data Capture; Vanderbilt University) database, and for patients who agreed, responses were transferred to an EHR flowsheet. Responses to selected eTeenQ questions are reported for those consenting to research. At the conclusion of the pilot, the study team conducted semistructured interviews with providers and staff regarding their experience using the eTeenQ.

Results

Among 2816 adolescents with well visits, 2098 (74.5%) completed the eTeenQ. Of these, 1811 (86.3%) agreed to store responses in the EHR. Of 1632 adolescents (77.8% of those completing the eTeenQ) who consented for research and remained eligible, 1472 (90.2%) reported having an adult they can really talk to and 1510 (92.5%) reported feeling safe in their community, yet 401 (24.6%) reported someone they lived with had a gun and 172 (10.5%) reported having had a stressful or scary event that still bothered them. In addition, 157 (9.6%) adolescents reported they were or wondered if they were gay, lesbian, bisexual, pansexual, asexual, or other, and 43 (2.6%) reported they were or wondered if they were transgender or gender diverse. Of 11 staff and 7 providers completing interviews, all felt that the eTeenQ improved confidentiality and willingness among adolescents to answer sensitive questions. All 7 providers preferred the eTeenQ over the paper screening tool.

Conclusions

Electronic capture of adolescent risk behaviors is feasible in a busy clinic setting and well accepted among staff and clinicians. Most adolescents agreed for their responses to risk behavior screening to be stored in the EHR.

Sound masking by a low-pitch speech-shaped noise improves a social robot's talk in noisy environments

Introduction: There has been a surge in the use of social robots for providing information, persuasion, and entertainment in noisy public spaces in recent years. Considering the well-documented negative effect of noise on human cognition, masking sounds have been introduced. Masking sounds work, in principle, by making the intrusive background speeches less intelligible, and hence, less distracting. However, this reduced distraction comes with the cost of increasing annoyance and reduced cognitive performance in the users of masking sounds. Methods: In a previous study, it was shown that reducing the fundamental frequency of the speech-shaped noise as a masking sound significantly contributes to its being less annoying and more efficient. In this study, the effectiveness of the proposed masking sound was tested on the performance of subjects listening to a lecture given by a social robot in a noisy cocktail party environment. Results: The results indicate that the presence of the masking sound significantly increased speech comprehension, perceived understandability, acoustic satisfaction, and sound privacy of the individuals listening to the robot in an adverse listening condition. Discussion: To the knowledge of the authors, no previous work has investigated the application of sound masking technology in human-robot interaction designs. The future directions of this trend are discussed.

Exploring the Potential of a Behavior Theory-Informed Digital Intervention for Infant Fall Prevention: Mixed Methods Longitudinal Study

BACKGROUND

Falls are the most common hospitalized injury mechanism in children aged ≤1 years, and currently, there are no targeted prevention interventions. The prevention of falls in children of this age requires changes in the behavior of their caregivers, and theoretically informed digital behavior change interventions (DBCIs) may provide a unique mechanism for achieving effective intervention. However, user acceptance and the ability of DBCIs to effect the required changes in behavior are critical to their likelihood of success.

OBJECTIVE

This study aims to evaluate a behavior theory-informed digital intervention developed following a user-centered approach for user experience, the potential for this intervention to prevent infant falls, and its impact on behavioral drivers underpinning fall risk in young children.

METHODS

Parents of infants aged <1 year were recruited and asked to use the intervention for 3 months. A pre-post longitudinal design was used to examine the change in the potential to reduce the risk of falls after a 3-month exposure to the intervention. Postintervention data on behavioral drivers for fall prevention, user acceptability, and engagement with the app were also collected. Interviews were conducted to explore user experiences and identify areas for further improvement of the intervention.

RESULTS

A total of 62 parents participated in the study. A statistically significant effect on the potential to reduce falls was observed after the intervention. This effect was higher for new parents. Parents agreed that the intervention targeted most of the target behavior drivers. The impact of behavior drivers and intervention on the potential for fall prevention had a positive correlation. The intervention demonstrated good levels of acceptability. Feedback from participants was mostly positive, and the primary area identified for further improvement was widening the scope of the intervention.

CONCLUSIONS

This study demonstrated the promise of a newly developed digital intervention to reduce the risk of infant falls, particularly among new parents. It also showed a positive influence of the DBCI on the drivers of parental behaviors that are important for fall reduction among infants. The acceptability of the app was high, and important insights were gained from users about how to further improve the app.

Designing the Continuous Glucose Monitor Experience: An App Design Process Overview

Users of continuous glucose monitors (CGMs) experience the product in part through software. Smartphone and watch apps empower people affected by diabetes to make real-time treatment decisions based on glucose readings and aggregate data such as medication, nutrition, and activity information. As CGMs evolve and gain greater market adoption, there's opportunity for these apps to play a greater role in users' lives and diabetes management. To do so, designers should follow the best practices established by the broader technology community and apply them to the needs of this community. The process of thorough discovery research, clear problem definition, iterative design, and testing can lower barriers toward broader adoption, and favorably influence the health of users through their mobile apps.

IsletSwipe, a mobile platform for expert opinion exchange on islet graft images

We previously developed a deep learning-based web service (IsletNet) for an automated counting of isolated pancreatic islets. The neural network training is limited by the absent consensus on the ground truth annotations. Here, we present a platform (IsletSwipe) for an exchange of graphical opinions among experts to facilitate the consensus formation. The platform consists of a web interface and a mobile application. In a small pilot study, we demonstrate the functionalities and the use case scenarios of the platform. Nine experts from three centers validated the drawing tools, tested precision and consistency of the expert contour drawing, and evaluated user experience. Eight experts from two centers proceeded to evaluate additional images to demonstrate the following two use case scenarios. The Validation scenario involves an automated selection of images and islets for the expert scrutiny. It is scalable (more experts, images, and islets may readily be added) and can be applied to independent validation of islet contours from various sources. The Inquiry scenario serves the ground truth generating expert in seeking assistance from peers to achieve consensus on challenging cases during the preparation for IsletNet training. This scenario is limited to a small number of manually selected images and islets. The experts gained an opportunity to influence IsletNet training and to compare other experts' opinions with their own. The ground truth-generating expert obtained feedback for future IsletNet training. IsletSwipe is a suitable tool for the consensus finding. Experts from additional centers are welcome to participate.

It's not what you think: shaping beliefs about a robot to influence a teleoperator's expectations and behavior

In this paper we present a novel design approach for shaping a teleoperator's expectations and behaviors when teleoperating a robot. Just as how people may drive a car differently based on their expectations of it (e.g., the brakes may be poor), we assert that teleoperators may likewise operate a robot differently based on expectations of robot capability and robustness. We present 3 novel interaction designs that proactively shape teleoperator perceptions, and the results from formal studies that demonstrate that these techniques do indeed shape operator perceptions, and in some cases, measures of driving behavior such as changes in collisions. Our methods shape operator perceptions of a robot's speed, weight, or overall safety, designed to encourage them to drive more safely. This approach shows promise as an avenue for improving teleoperator effectiveness without requiring changes to a robot, novel sensors, algorithms, or other functionality.

Holistic Human-Serving Digitization of Health Care Needs Integrated Automated System-Level Assessment Tools

Digital health tools, platforms, and artificial intelligence- or machine learning-based clinical decision support systems are increasingly part of health delivery approaches, with an ever-greater degree of system interaction. Critical to the successful deployment of these tools is their functional integration into existing clinical routines and workflows. This depends on system interoperability and on intuitive and safe user interface design. The importance of minimizing emergent workflow stress through human factors research and purposeful design for integration cannot be overstated. Usability of tools in practice is as important as algorithm quality. Regulatory and health technology assessment frameworks recognize the importance of these factors to a certain extent, but their focus remains mainly on the individual product rather than on emergent system and workflow effects. The measurement of performance and user experience has so far been performed in ad hoc, nonstandardized ways by individual actors using their own evaluation approaches. We propose that a standard framework for system-level and holistic evaluation could be built into interacting digital systems to enable systematic and standardized system-wide, multiproduct, postmarket surveillance and technology assessment. Such a system could be made available to developers through regulatory or assessment bodies as an application programming interface and could be a requirement for digital tool certification, just as interoperability is. This would enable health systems and tool developers to collect system-level data directly from real device use cases, enabling the controlled and safe delivery of systematic quality assessment or improvement studies suitable for the complexity and interconnectedness of clinical workflows using developing digital health technologies.

Public first aid education model design study based on user experience

Background

Presently, China's first aid penetration rate remains relatively low, leaving ample room for improvement in the existing first aid education model. Given its role as a service for the general public, public first aid education must thoroughly consider the learning needs and experiences of the public when designing the teaching mode.

Methods

Semi-structured interviews were employed to gather detailed insights into participants' experiences in the first aid learning process. Subsequently, NVivo was utilized to analyze the interviews and identify specific design strategies. Additionally, a 7-point scale questionnaire was employed to assess the intervention effects of music familiarity and the simulation of teaching aids on users' willingness and confidence in learning. Building upon the design strategy, a "feedback device + app" approach was proposed. Finally, user satisfaction was evaluated through a scale questionnaire.

Results

The use of familiar music had a significant positive effect on participants' willingness and confidence to learn, while users' fear of teaching aids had no effect on willingness and confidence. The user experience-based first aid education model can better meet the public's learning needs for first aid knowledge and skills.

Conclusion

This study proposes a first aid education model based on user experience design methodology, which optimizes the public's self-learning experience by evoking positive emotions while circumventing negative emotions. The educational model was recognized by users in terms of design concepts and is expected to help increase first aid prevalence in the future.

Development and Formative Evaluation of a Virtual Exercise Platform for a Community Fitness Center Serving Individuals With Physical Disabilities: Mixed Methods Study

BACKGROUND

People with disabilities experience numerous barriers to being physically active, such as transportation issues, a lack of trained exercise professionals who understand disabilities, and facility access. The use of a virtual exercise platform (VEP) may provide an alternative and limit certain barriers.

OBJECTIVE

The aim of this mixed method study was to evaluate user interaction (effectiveness, efficiency, and satisfaction), the strengths and weaknesses of the user interface, and the user experience with a VEP.

METHODS

Participants were recruited from a community fitness facility that offers programs for people with disabilities. Inclusion criteria were being older than 18 years, fluent in English, and availability of internet access. Features of the VEP included articles, prerecorded videos, live Zoom classes, web-based class registration, weekly progress tracking, incentives, and surveys. A one-on-one Zoom session was scheduled with each participant, during which they completed certain tasks: (1) create an account or login, (2) register for class, (3) join class, (4) add to calendar, and (5) complete surveys. As participants completed tasks, quantitative observations (time on task, task success, rate of task completion, and number of errors by users, which determined task difficulty), qualitative observations were made and interviews were conducted at the end of the session. The "concurrent think-aloud" method was encouraged by the moderator to gauge participants' thoughts as they worked through testing. Participants also completed the System Usability Scale (SUS) and Questionnaire for User Interface Satisfaction (QUIS).

RESULTS

A total of 5 people with disabilities (3 male, 2 female), aged 36-78 (mean 54) years, with education levels from high school to PhD, were recruited. Devices used for testing included a laptop (n=3), a Chromebook (n=1), and a desktop (n=1). All participants completed tasks #1 and #2 without errors but could not complete task #4. One participant completed task #5 with difficulty and another completed task #3 with difficulty. The average time to complete each task was: (1) 82 seconds (55-110), (2) 11 seconds (4-21), (3) 9 seconds (5-27), and (4) 921.5 seconds (840-958). The mean SUS score was 86.5/100, and the mean user QUIS score was 8.08 out of 10. Qualitative observations indicated that the system was simple, user-friendly, and accessible.

CONCLUSIONS

People with disabilities reported high usability and user satisfaction with the web-based exercise platform, and the system appears to be an efficient and effective physical activity option.

Developing an Instrument to Evaluate the Quality of Dementia Websites

In today's digital era, health information, especially for conditions like dementia, is crucial. This study aims to develop an instrument, demenTia wEbsite measSurement insTrument (TEST), through four steps: identifying existing instruments, determining criteria, selecting and revising measurement statements, and validating the instrument from March to August 2020. Five health informatics experts used the content validity ratio (CVR) test for validation. Thirteen evaluators compared Fleiss Kappa and intraclass correlation coefficient (ICC) values across four dementia websites using TEST and another tool, DISCERN. TEST consists of seven criteria and 25 measurement statements focusing on content quality (relevance, credibility, currency) and user experience (accessibility, interactivity, attractiveness, privacy). CVR = 1 confirmed all statements as essential. The TEST demonstrated stronger consistency and assessor agreement compared to DISCERN, measured by Fleiss Kappa and ICC. Overall, it is a robust tool for reliable and user-friendly dementia resources, ensuring health holistic information accessibility.

Design and User Experience of VirNE Application: Deep Breathing Exercise in a Virtual Natural Environment to Reduce Treatment Anxiety in Pediatrics

Treatment anxiety is a serious problem among child patients. A few studies have addressed this issue with virtual reality solutions, with promising results; however, the applications used have generally been designed for entertainment instead of this purpose. This article studies the potential of using deep breathing exercises in a virtual natural environment to address this issue, with a focus on design approach and user experience. It presents the VirNE-Virtual Natural Environments relaxation application, which is based on known stress-reduction methods, and a feasibility study conducted with it in a local hospital. The study had a within-subjects design, and it included 21 eight to twelve-year-old child patients, who used the application during an intravenous cannulation procedure related to their treatment. The study found good user acceptance and user experience both among the child patients and pediatricians, with the perceived usefulness of the method being higher among the patients with increased levels of anxiety or needle phobia. In addition, a clear stress-reducing effect was found. This offers proof-of-concept for the multidisciplinary design approach based on existing scientific knowledge regarding the desired effect for pediatric virtual reality applications for this use context.

The Effectiveness of Publicly Available Web-Based Interventions in Promoting Health App Use, Digital Health Literacy, and Media Literacy: Pre-Post Evaluation Study

BACKGROUND

According to the World Health Organization, implementing mobile health (mHealth) technologies can increase access to quality health services worldwide. mHealth apps for smartphones, also known as health apps, are a central component of mHealth, and they are already used in diverse medical contexts. To benefit from health apps, potential users need specific skills that enable them to use such apps in a responsible and constructive manner.

OBJECTIVE

This study aimed to evaluate the effectiveness of the free and widely used web-based intervention, The APPocalypse?. Besides providing knowledge about health apps, the web-based intervention was designed to promote digital health and media literacy by teaching skills that enable users to distinguish between trustworthy and less trustworthy health apps. It was hypothesized that after completing the web-based intervention, participants' knowledge in the domain of health apps, their digital health literacy, and their media literacy would be higher than it was before completing the web-based intervention.

METHODS

The study was divided into 3 parts. During part 1, participants (n=365; 181 female, 181 male, and 3 diverse; mean age 17.74, SD 1.391 years) provided demographic information and answered the pre- and postmeasurements. The measurements included questionnaires about participants' knowledge in the domain of health apps, digital health literacy, and media literacy. During part 2, participants had 1 week to complete the web-based intervention. During part 3, participants answered the pre- and postmeasurements again. Furthermore, they answered educational quality and user experience questionnaires. Bayesian paired samples 2-tailed t tests were conducted to test the hypotheses.

RESULTS

Overall, the results support the hypotheses. After completing the web-based intervention, participants demonstrated more elaborate knowledge in the domain of health apps. Specifically, they displayed higher competencies in the domains of subjective (Bayes factor10 [BF10]=1.475×1079; effect size δ=-1.327) and objective health app knowledge (BF10=8.162×1080; effect size δ=-1.350). Furthermore, participants demonstrated higher digital health literacy. Specifically, they displayed higher competencies in the domains of information appraisal (BF10=3.413×1043; effect size δ=-0.870), information searching (BF10=3.324×1023; effect size δ=-0.604), evaluating reliability (BF10=3.081×1035; effect size δ=-0.766), and determining relevance (BF10=3.451×1024; effect size δ=-0.618). Regarding media literacy, the results were mixed. Participants displayed higher competencies in the domain of technology literacy beliefs (BF10=1.533×1021; effect size δ=-0.570). In the domain of technology control beliefs, their competencies did not seem to improve (BF10=0.109; effect size δ=-0.058). In comparison to relevant benchmarks, the web-based intervention offers exceptional educational quality and a superior user experience.

CONCLUSIONS

The free web-based intervention The APPocalypse? might promote the constructive use of health apps, digital health literacy, and media literacy. Therefore, it may contribute to achieving the health-related United Nations Sustainable Development Goals.

Visual Attention and Emotion Analysis Based on Qualitative Assessment and Eyetracking Metrics-The Perception of a Video Game Trailer

Video game trailers are very useful tools for attracting potential players. This research focuses on analyzing the emotions that arise while viewing video game trailers and the link between these emotions and storytelling and visual attention. The methodology consisted of a three-step task test with potential users: the first step was to identify the perception of indie games; the second step was to use the eyetracking device (gaze plot, heat map, and fixation points) and link them to fixation points (attention), viewing patterns, and non-visible areas; the third step was to interview users to understand impressions and questionnaires of emotions related to the trailer's storytelling and expectations. The results show an effective assessment of visual attention together with visualization patterns, non-visible areas that may affect game expectations, fixation points linked to very specific emotions, and perceived narratives based on the gaze plot. The innovation in the mixed methodological approach has made it possible to obtain relevant data regarding the link between the emotions perceived by the user and the areas of attention collected with the device. The proposed methodology enables developers to understand the strengths and weaknesses of the information being conveyed so that they can tailor the trailer to the expectations of potential players.

Reproductive endocrinology and infertility nurse online orientation program evaluation: a quality improvement initiative

Objective

To evaluate the effectiveness of a novel online orientation program (Nurses in REI Communication, Knowledge, and Skills [NRCKS]) among new and early-career reproductive endocrinology nurses to make recommendations for program quality improvement.

Design

Quality improvement.

Subjects

Reproductive endocrinology nurses.

Exposure

Online orientation program featuring 8 micromodules.

Main Outcome Measures

Knowledge acquisition, confidence, user experience, skills, and abilities.

Results

Nurses demonstrated a statistically significant increase in reproductive knowledge after completion of NRCKS. Most nurse users felt confident applying knowledge in the clinical settings after program completion. Nurse users had an overall positive experience with interactive components and quality of visuals. Most nurse users gained skills and abilities that they will implement into professional practice. Nurses suggested improving navigation, adding more visuals in content expert presentations, and teaching soft skills necessary for the role of reproductive endocrinology nurses.

Conclusions

Nurses in REI Communication, Knowledge, and Skills was well received by nurse participants and emphasized the receptivity and desire for reproductive health and fertility training among novice reproductive endocrinology nurses. Nurses in REI Communication, Knowledge, and Skills increased nursing knowledge, and nurses felt confident applying newly gained knowledge in the clinical setting on completion. Nurse participants provided invaluable feedback for quality improvement to inform the hard launch. The results emphasize the online orientation's strong potential to close the theory-practice gap.

Real-world user experience with seizure detection wearable devices in the home environment

OBJECTIVE

To evaluate direct user experience with wearable seizure detection devices in the home environment.

METHODS

A structured online questionnaire was completed by 242 users (175 caregivers and 67 persons with epilepsy), most of the patients (87.19%) having tonic-clonic seizures.

RESULTS

The vast majority of the users were overall satisfied with the wearable device, considered that using the device was easy, and agreed that the use of the device improved their quality of life (median = 6 on 7-point Likert scale). A high retention rate (84.58%) and a long median usage time (14 months) were reported. In the home environment, most users (75.85%) experienced seizure detection sensitivity similar (≥95%) to what was previously reported in validation studies in epilepsy monitoring units. The experienced false alarm rate was relatively low (0-0.43 per day). Due to the alarms, almost one third of persons with epilepsy (PWEs; 30.00%) experienced decrease in the number of seizure-related injuries, and almost two thirds of PWEs (65.41%) experienced improvement in the accuracy of seizure diaries. Nonvalidated devices had significantly lower retention rate, overall satisfaction, perceived sensitivity, and improvement in quality of life, as compared with validated devices.

SIGNIFICANCE

Our results demonstrate the feasibility and usefulness of automated seizure detection in the home environment.

How do Twitter users feel about telehealth? A mixed-methods analysis of experiences, perceptions and expectations

BACKGROUND

Telehealth use has increased considerably in the last years and evidence suggests an overall positive sentiment towards telehealth. Twitter has a wide userbase and can enrich our understanding of telehealth use by users expressing their personal opinions in an unprompted way. This study aimed to explore Twitter users' experiences, perceptions and expectations about telehealth over the last 5 years.

METHODS

Mixed-methods study with sequential complementary quantitative and qualitative phases was used for analysis stages comprising (1) a quantitative semiautomated analysis and (2) a qualitative research-led thematic analysis. A machine learning model was used to establish the data set with relevant English language tweets from 1 September 2017 to 1 September 2022 relating to telehealth using predefined search words. Results were integrated at the end.

RESULTS

From the initial 237,671 downloaded tweets, 6469 had a relevancy score above 0.8 and were input into Leximancer and 595 were manually analysed. Experiences, perceptions and expectations were categorised into three domains: experience with telehealth consultation, telehealth changes over time and the purpose of the appointment. The most tweeted experience was expectations for telehealth consultation in comparison to in-person consultations. Users mostly mentioned the hope that waiting times for the consultations to start to be less than in-person, more telehealth appointments to be available and telehealth to be cheaper. Perceptions around the use of telehealth in relation to healthcare delivery changes brought about by the COVID-19 pandemic were also expressed. General practitioners were mentioned six times more than other healthcare professionals.

CONCLUSION/IMPLICATIONS

This study found that Twitter users expect telehealth services to be better, more affordable and more available than in-person consultations. Users acknowledged the convenience of not having to travel for appointments and the challenges to adapt to telehealth.

PATIENT OR PUBLIC CONTRIBUTION

An open data set with 237,671 tweets expressing users' opinions in an unprompted way was used as a source for telehealth service users, caregivers and members of the public experiences, perceptions and expectations of telehealth.

Development of a lumbar puncture virtual simulator for medical students training: A preliminary evaluation

BACKGROUND

Lumbar puncture is an essential medical procedure whose objective is to obtain cerebrospinal fluid. Lumbar puncture is considered a complex procedure, mainly for novice residents who suffer from stress and low confidence, which may result in harm to the patient.

METHODS

The LPVirSim, has been developed in four stages: i) requirements analysis through user-centred design; ii) prototyping of the virtual environment and the haptic component; iii) preliminary tests with Ph.D. students and physicians using two haptic devices (Omega.7 and Sigma.7); iv) a user study where physicians evaluated the usability and user experience.

RESULTS

The LPVirSim integrates non-technical skills and the possibility of representing different patients for training. Usability increased from 61.76 to 68.75 in the preliminary tests to 71.43 in the user study.

CONCLUSIONS

All the results showed good usability and demonstrated that the simulator arouses interest and realistically represents a Lumbar puncture, through the force and visual feedback.

Designing a Tangible User Interface (TUI) for the Elderly Based on Their Motivations and Game Elements

The elderly population has grown significantly in recent years, requiring strategies focused on promoting active aging to improve health and well-being. It may be achieved in many ways, including using technology for this population. We propose an interactive system for older adults based on a tangible user interface. A group of 10 experts conducted a heuristic evaluation of a system of this type utilizing a questionnaire and obtaining satisfactory results. This study evaluated the older adult population's fun and pervasive game experience. The results will provide a basis for continuing to build this interactive system to promote active aging in older adults, either at the cognitive or physical level, depending on the applied approach.

How do adolescents experience a newly developed Online Single Session Sleep Intervention? A Think-Aloud Study

BACKGROUND

Sleep problems are common in adolescents and have detrimental impacts on physical and mental health and daily functioning. Evidence-based treatment like cognitive behaviour therapy for insomnia (CBT-I) is often hard to access, and adolescents may not engage in and adhere to longer, clinician-delivered interventions. Brief, self-guided, and accessible sleep interventions are needed.

OBJECTIVE

To explore the user experience of a prototype online self-help single session sleep intervention developed for adolescents.

METHODS

Eleven participants aged 17-19 years (8 females, 3 males) took part in online retrospective think-aloud interviews. Participants first completed the prototype intervention independently and were then shown the intervention page by page and asked to verbalise their thoughts and experiences. Transcripts were analyzed thematically.

RESULTS

Participants found the intervention helpful. Four themes were generated - 'Educative: Learning, but more fun', 'Effortless: Quicker and Easier', 'Personalization: Power of Choice', and 'Positivity: Just Good Vibes'. The theme 'Educative: Learning, but more fun' encompassed two sub-themes 'Opportunity to Learn' and 'Aesthetics and Learning'. These themes reflected participants' views that the intervention was educative, personalised, solution-oriented and easy to use, but could incorporate more graphics and visuals to aid in learning and could be made more effortless and positive through modifications to its design.

CONCLUSIONS

Findings convey the importance of ensuring educative well-designed content, personalization, a positive tone, and ease of use while designing interventions targeting adolescents's sleep and mental health. They also indicate areas for further developing the intervention.

Think Aloud Testing of a Smartphone App for Lifestyle Change Among Persons at Risk of Type 2 Diabetes: Usability Study

BACKGROUND

Type 2 diabetes mellitus (DM2) is a leading cause of morbidity and mortality worldwide and is considered a global epidemic. Despite the growing evidence on the effectiveness of mobile health interventions in the management of DM2, the evidence on the effect of mobile health interventions in prevention of DM2 is sparse. Therefore, we have developed an app aiming to promote initiation of behavioral change and adherence to healthy behavior. Before commencing a small-scale randomized controlled trial to assess the feasibility of using an app for initiation and adherence of healthy behavior in people at risk of DM2, testing the usability of the app in the target population is warranted.

OBJECTIVE

The aim of this study was to assess the usability of an app among people at risk of DM2.

METHODS

A qualitative study with the use of a think aloud (TA) procedure was conducted from April to November 2022. The TA procedure consisted of 10 problem-solving tasks and a semistructured interview which was carried out after the tasks. These interviews served to gain more in-depth knowledge of the users experience of the problem-solving tasks. The TA-sessions and the postactivity interviews were recorded and transcribed verbatim, and the data were coded and analyzed following the principles of thematic analysis.

RESULTS

In total, 7 people at risk of DM2 with a median age of 66 (range 41-75) years participated in this study. The analysis resulted in the following themes: (1) user interface design; and (2) suggestions for improvements of the functionality of the app.

CONCLUSIONS

Overall, the participants were satisfied with the usability of the app. Through the TA-sessions, real time perspective on the appeal, relevance, and utility of the app were gained. Only minor changes to the functionality of the prototype app were reported as necessary to improve the usability of the app. Points of guidance from the participants in this study have been adopted and incorporated into the final design of the app now being assessed for feasibility in a small-scale randomized controlled trial.