Technical Guidance for Clinicians Interested in Partnering With Engineers in Mobile Health Development and Evaluation

A framework for design and usability testing of telerehabilitation system for adults with chronic diseases: A panoramic scoping review

Objective

This scoping review aimed to identify the design and usability testing of a telerehabilitation (TR) system, and its characteristics and functionalities that are best-suited for rehabilitating adults with chronic diseases.

Methods

Searches were conducted in PubMed, EBSCO, Web of Science, and Cochrane library for studies published between January 2017 and December 2022. We followed the Joanna Briggs Institute guidelines and the framework by Arksey and O'Malley. Screening was undertaken by two reviewers, and data extraction was undertaken by the first author. Then, the data were further reviewed and discussed thoroughly with the team members.

Results

A total of 31 results were identified, with the core criteria of developing and testing a telerehabilitation system, including a mobile app for cardiovascular diseases, cancer, diabetes, and chronic respiratory disorders. All developed systems resulted from multidisciplinary teams and employed mixed-methods research. We proposed the "input-process-output" framework that identified phases of both system design and usability testing. Through system design, we reported the use of user-centered design, iterative design, users' needs and characteristics, theory underpinning development, and the expert panel in 64%, 75%, 86%, 82%, and 71% of the studies, respectively. We recorded the application of moderated usability testing, unmoderated testing (1), and unmoderated testing (2) in 74%, 63%, and 15% of the studies, respectively. The identified design and testing activities produced a matured system, a high-fidelity prototype, and a released system in 81.5%, 15%, and 3.5%, respectively.

Conclusion

This review provides a framework for TR system design and testing for a wide range of chronic diseases that require prolonged management through remote monitoring using a mobile app. The identified "input-process-output" framework highlights the inputs, design, development, and improvement as components of the system design. It also identifies the "moderated-unmoderated" model for conducting usability testing. This review illustrates characteristics and functionalities of the TR systems and healthcare professional roles.

A Transdiagnostic Self-management Web-Based App for Sleep Disturbance in Adolescents and Young Adults: Feasibility and Acceptability Study

Background

Sleep disturbance and its daytime sequelae, which comprise complex, transdiagnostic sleep problems, are pervasive problems in adolescents and young adults (AYAs) and are associated with negative outcomes. Effective interventions must be both evidence based and individually tailored. Some AYAs prefer self-management and digital approaches. Leveraging these preferences is helpful, given the dearth of AYA treatment providers trained in behavioral sleep medicine. We involved AYAs in the co-design of a behavioral, self-management, transdiagnostic sleep app called DOZE (Delivering Online Zzz’s with Empirical Support).

Objective

This study tests the feasibility and acceptability of DOZE in a community AYA sample aged 15-24 years. The secondary objective is to evaluate sleep and related outcomes in this nonclinical sample.

Methods

Participants used DOZE for 4 weeks (2 periods of 2 weeks). They completed sleep diaries, received feedback on their sleep, set goals in identified target areas, and accessed tips to help them achieve their goals. Measures of acceptability and credibility were completed at baseline and end point. Google Analytics was used to understand the patterns of app use to assess feasibility. Participants completed questionnaires assessing fatigue, sleepiness, chronotype, depression, anxiety, and quality of life at baseline and end point.

Results

In total, 83 participants created a DOZE account, and 51 completed the study. During the study, 2659 app sessions took place with an average duration of 3:02 minutes. AYAs tracked most days in period 1 (mean 10.52, SD 4.87) and period 2 (mean 9.81, SD 6.65), with a modal time of 9 AM (within 2 hours of waking). DOZE was appraised as highly acceptable (mode≥4) on the items “easy to use,” “easy to understand,” “time commitment,” and “overall satisfaction” and was rated as credible (mode≥4) at baseline and end point across all items (logic, confident it would work, confident recommending it to a friend, willingness to undergo, and perceived success in treating others). The most common goals set were decreasing schedule variability (34/83, 41% of participants), naps (17/83, 20%), and morning lingering in bed (16/83, 19%). AYAs accessed tips on difficulty winding down (24/83, 29% of participants), being a night owl (17/83, 20%), difficulty getting up (13/83, 16%), and fatigue (13/83, 16%). There were significant improvements in morning lingering in bed (P=.03); total wake time (P=.02); sleep efficiency (P=.002); total sleep time (P=.03); and self-reported insomnia severity (P=.001), anxiety (P=.002), depression (P=.004), and energy (P=.01).

Conclusions

Our results support the feasibility, acceptability, credibility, and preliminary efficacy of DOZE. AYAs are able to set and achieve goals based on tailored feedback on their sleep habits, which is consistent with research suggesting that AYAs prefer autonomy in their health care choices and produce good results when given tools that support their autonomy.

Trial Registration

ClinicalTrials.gov NCT03960294; https://clinicaltrials.gov/ct2/show/NCT03960294

Untold Stories in User-Centered Design of Mobile Health: Practical Challenges and Strategies Learned From the Design and Evaluation of an App for Older Adults With Heart Failure

Background

User-centered design (UCD) is a powerful framework for creating useful, easy-to-use, and satisfying mobile health (mHealth) apps. However, the literature seldom reports the practical challenges of implementing UCD, particularly in the field of mHealth.

Objective

This study aims to characterize the practical challenges encountered and propose strategies when implementing UCD for mHealth.

Methods

Our multidisciplinary team implemented a UCD process to design and evaluate a mobile app for older adults with heart failure. During and after this process, we documented the challenges the team encountered and the strategies they used or considered using to address those challenges.

Results

We identified 12 challenges, 3 about UCD as a whole and 9 across the UCD stages of formative research, design, and evaluation. Challenges included the timing of stakeholder involvement, overcoming designers’ assumptions, adapting methods to end users, and managing heterogeneity among stakeholders. To address these challenges, practical recommendations are provided to UCD researchers and practitioners.

Conclusions

UCD is a gold standard approach that is increasingly adopted for mHealth projects. Although UCD methods are well-described and easily accessible, practical challenges and strategies for implementing them are underreported. To improve the implementation of UCD for mHealth, we must tell and learn from these traditionally untold stories.