Usability of Mobile Health Apps for Postoperative Care: Systematic Review

WhatsApp Versus SMS for 2-Way, Text-Based Follow-Up After Voluntary Medical Male Circumcision in South Africa: Exploration of Messaging Platform Choice

BACKGROUND

Telehealth is growing, especially in areas where access to health facilities is difficult. We previously used 2-way texting (2wT) via SMS to improve the quality of postoperative care after voluntary medical male circumcision in South Africa. In this study, we offered males aged 15 years and older WhatsApp or SMS as their message delivery and interaction platform to explore user preferences and behaviors.

OBJECTIVE

The objectives of this process evaluation embedded within a larger 2wT expansion trial were to (1) explore 2wT client preferences, including client satisfaction, with WhatsApp or SMS; (2) examine response rates (participation) by SMS and WhatsApp; and (3) gather feedback from the 2wT implementation team on the WhatsApp approach.

METHODS

Males aged 15 years and older undergoing voluntary medical male circumcision in program sites could choose their follow-up approach, selecting 2wT via SMS or WhatsApp or routine care (in-person postoperative visits). The 2wT system provided 1-way educational messages and an open 2-way communication channel between providers and clients. We analyzed quantitative data from the 2wT database on message delivery platforms (WhatsApp vs SMS), response rates, and user behaviors using chi-square tests, z tests, and t tests. The team conducted short phone calls with WhatsApp and SMS clients about their perceptions of this 2wT platform using a short, structured interview guide. We consider informal reflections from the technical team members on the use of WhatsApp. We applied an implementation science lens using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to focus results on practice and policy improvement.

RESULTS

Over a 2-month period-from August to October, 2023-337 males enrolled in 2wT and were offered WhatsApp or SMS and were included in the analysis. For 2wT reach, 177 (53%) participants chose WhatsApp as their platform (P=.38). Mean client age was 30 years, and 253 (75%) participants chose English for automated messages. From quality assurance calls, almost all respondents (87/89, 98%) were happy with the way they were followed up. For effectiveness, on average for the days on which responses were requested, 58 (33%) WhatsApp clients and 44 (28%) SMS clients responded (P=.50). All 2wT team members believed WhatsApp limited the automated message content, language choices, and inclusivity as compared with the SMS-based 2wT approach.

CONCLUSIONS

When presented with a choice of 2wT communication platform, clients appear evenly split between SMS and WhatsApp. However, WhatsApp requires a smartphone and data plan, potentially reducing reach at scale. Clients using both platforms responded to 2wT interactive prompts, demonstrating similar effectiveness in engaging clients in follow-up. For telehealth interventions, digital health designers should maintain an SMS-based platform and carefully consider adding WhatsApp as an option for clients, using an implementation science approach to present evidence that guides the best implementation approach for their setting.

The first AI-based Chatbot to promote HIV self-management: A mixed methods usability study

BACKGROUND

We developed MARVIN, an artificial intelligence (AI)-based chatbot that provides 24/7 expert-validated information on self-management-related topics for people with HIV. This study assessed (1) the feasibility of using MARVIN, (2) its usability and acceptability, and (3) four usability subconstructs (perceived ease of use, perceived usefulness, attitude towards use, and behavioural intention to use).

METHODS

In a mixed-methods study conducted at the McGill University Health Centre, enrolled participants were asked to have 20 conversations within 3 weeks with MARVIN on predetermined topics and to complete a usability questionnaire. Feasibility, usability, acceptability, and usability subconstructs were examined against predetermined success thresholds. Qualitatively, randomly selected participants were invited to semi-structured focus groups/interviews to discuss their experiences with MARVIN. Barriers and facilitators were identified according to the four usability subconstructs.

RESULTS

From March 2021 to April 2022, 28 participants were surveyed after a 3-week testing period, and nine were interviewed. Study retention was 70% (28/40). Mean usability exceeded the threshold (69.9/68), whereas mean acceptability was very close to target (23.8/24). Ratings of attitude towards MARVIN's use were positive (+14%), with the remaining subconstructs exceeding the target (5/7). Facilitators included MARVIN's reliable and useful real-time information support, its easy accessibility, provision of convivial conversations, confidentiality, and perception as being emotionally safe. However, MARVIN's limited comprehension and the use of Facebook as an implementation platform were identified as barriers, along with the need for more conversation topics and new features (e.g., memorization).

CONCLUSIONS

The study demonstrated MARVIN's global usability. Our findings show its potential for HIV self-management and provide direction for further development.

Co-creation and evaluation of an algorithm for the development of a mobile application for wound care among new graduate nurses: A mixed methods study

Chronic wounds are a growing concern due to aging populations, sedentary lifestyles and increasing rates of obesity and chronic diseases. The impact of such wounds is felt worldwide, posing a considerable clinical, environmental and socioeconomic challenge and impacting the quality of life. The increasing complexity of care requires a holistic approach, along with extensive knowledge and skills. The challenge experienced by health-care professionals is particularly significant for newly graduate nurses, who face a gap between theory and practice. Digital tools, such as mobile applications, can support wound care by facilitating more precise assessments, early treatment, complication prevention and better outcomes. They also aid in clinical decision-making and improve healthcare delivery in remote areas. Several mobile applications have emerged to enhance wound care. However, there are no applications dedicated to newly graduate nurses. The aim of this study was to co-create and evaluate an algorithm for the development of a wound care mobile application supporting clinical decisions for new graduate nurses. The development of this mobile application is envisioned to improve knowledge application and facilitate evidence-based practice. This study is part of a multiphase project that adopted a pragmatic epistemological approach, using the 'Knowledge-to-Action' conceptual model and Duchscher's Stages of Transition Theory. Following a scoping review, an expert consensus, and stakeholder meetings, this study was pursued through a sequential exploratory mixed methods design carried out in two phases. In the initial phase, 21 participants engaged in semi-structured focus groups to explore their needs regarding clinical decision support in wound care, explore their perceptions of the future mobile application's content and identify and categorize essential components. Through descriptive analysis, five overarching themes emerged, serving as guiding principles for conceptual data model development and refinement. These findings confirmed the significance of integrating a comprehensive glossary complemented by photos, ensuring compatibility between the mobile application and existing documentation systems, and providing quick access to information to avoid burdening work routines. Subsequently, the algorithm was created from the qualitative data collected. The second phase involved presenting an online SurveyMonkey® questionnaire to 34 participants who were not part of the initial phase to quantitatively measure the usability of this algorithm among future users. This phase revealed very positive feedback regarding the usability [score of 6.33 (±0.19) on a scale of 1-7], which reinforces its quality. The technology maturation process can now continue with the development of a prototype and subsequent validation in a laboratory setting.

Feasibility of Adjunct Therapy with a Robotic Hand Orthosis after Botulinum Toxin Injections in Persons with Spasticity: A Pilot Study

Upper-limb spasticity, frequent after central nervous system lesions, is typically treated with botulinum neurotoxin type A (BoNT-A) injections to reduce muscle tone and increase range of motion. However, performing adjunct physical therapy post-BoNT-A can be challenging due to residual weakness or spasticity. This study evaluates the feasibility of hand therapy using a robotic hand orthosis (RELab tenoexo) with a mobile phone application as an adjunct to BoNT-A injections. Five chronic spastic patients participated in a two-session pilot study. Functional (Box and Block Test (BBT), Action Research Arm Test (ARAT)), and muscle tone (Modified Ashworth Scale (MAS)) assessments were conducted to assess functional abilities and impairment, along with usability evaluations. In the first session, subjects received BoNT-A injections, and then they performed a simulated unsupervised therapy session with the RELab tenoexo in a second session a month later. Results showed that BoNT-A reduced muscle tone (from 12.2 to 7.4 MAS points). The addition of RELab tenoexo therapy was safe, led to functional improvements in four subjects (two-cube increase in BBT as well as 2.8 points in grasp and 1.3 points in grip on ARAT). Usability results indicate that, with minor improvements, adjunct RELab tenoexo therapy could enhance therapy doses and, potentially, long-term outcomes.

Exploring the digital divide: results of a survey informing mobile application development

Introduction

Mobile health apps risk widening health disparities if they overlook digital inclusion. The digital divide, encompassing access, familiarity, and readiness, poses a significant barrier to medical interventions. Existing literature lacks exploration of the digital divide's contributing factors. Hence, data are needed to comprehend the challenges in developing inclusive health apps.

Methods

We created a survey to gauge internet and smartphone access, smartphone familiarity, and readiness for using mobile health apps among caregivers of pediatric patients in tertiary care. Open-ended questions solicited feedback and suggestions on mobile health applications. Responses were categorized by similarity and compared. Developed with patient partners, the survey underwent cognitive testing and piloting for accuracy.

Results

Data from 209 respondents showed that 23% were affected by the digital divide, mainly due to unfamiliarity with digital skills. Among 49 short text responses about health app concerns, 31 mentioned security and confidentiality, with 7 mentioning the impersonal nature of such apps. Desired features included messaging healthcare providers, scheduling, task reminders, and simplicity.

Conclusions

This study underscores a digital divide among caregivers of pediatric patients, with nearly a quarter affected primarily due to a lack of digital comfort. Respondents emphasized user-friendliness and online security for health apps. Future apps should prioritize digital inclusion by addressing the significant barriers and carefully considering patient and family concerns.

Problems and Opportunities of a Smartphone-Based Care Management Platform: Application of the Wald Principles to a Survey-Based Analysis of Patients' Perception in a Pilot Center

(1) Background: Mobile health (mHealth) solutions can become a means of improving functional recovery and reducing the peri-operative burden and costs associated with arthroplasty procedures. The aim of this study is to explore the objectives, functionalities, and outcomes of a platform designed to provide personalized surgical experiences to qualified patients, along with the associated problems and opportunities. (2) Methods: A survey-based analysis was conducted on patients who were prescribed the use of a specific care management platform and underwent primary robotic total knee arthroplasty (rTKA) between January 2021 and February 2023. (3) Results: Patients registered on the platform who have undergone primary robotic TKA (rTKA) were considered. The mean age of registered patients is 68.6 years. The male (M)/female (F) ratio is 45.1%/54.9%. The patients interviewed were at an average distance of 485 days from the intervention, with a standard deviation of 187.5. The survey highlighted appreciation for the app and its features, but also limitations in its use and in its perception by the patients. All these data were evaluated according to the Wald principles and strategies to improve patient recruitment, enhance adherence, and create a comprehensive patient journey for optimized surgical experiences. (4) Conclusions: This patient care platform may have the potential to impact surgical experiences by increasing patient engagement, facilitating remote monitoring, and providing personalized care. There is a need to emphasize the importance of integrating the recruiting process, improving adherence strategies, and creating a comprehensive patient journey within the platform.

The German version of the mHealth App Usability Questionnaire (GER-MAUQ): Translation and validation study in patients with cardiovascular disease

Objective

In Germany, only a few standardized evaluation tools for assessing the usability of mobile Health apps exist so far. This study aimed to translate and validate the English patient version for standalone apps of the mHealth App Usability Questionnaire (MAUQ) into a German version.

Methods

Following scientific guidelines for translation and cross-cultural adaptation, the patient version for standalone apps was forward and back-translated from English into German by an expert panel. In total, 53 participants who were recruited as part of the beta testing process of the recently developed mHealth app HerzFit, answered the questions of the German version of the MAUQ (GER-MAUQ) and the System Usability Scale. Subsequently, a descriptive as well as a psychometric analysis was performed to test validity and reliability.

Results

After conducting three cognitive interviews, five items were modified. The values for Cronbach alpha for the entire questionnaire and the three subscales (0.966, 0.814, 0.910, and 0.909) indicate strong internal consistency. The correlation analysis revealed that the scores of the GER-MAUQ, the subscales and the SUS were strongly correlated with each other. The correlation coefficient of the SUS and the GER-MAUQ overall score was r = 0.854, P < 0.001 and the coefficients of the subscales and the SUS were r = 0.642, P < 0.001; r = 0.866, P < 0.001 and r = 0.643, P < 0.001.

Conclusions

We have developed a novel German version of the MAUQ and demonstrated it as a reliable and valid measurement tool for assessing the usability of standalone mHealth apps from the patients' perspective. The GER-MAUQ allows a new form of standardized assessment of usability of mHealth apps for patients with cardiovascular disease in Germany. Further research with a larger sample and other samples is recommended.

Usability evaluation of the Agente Escuta application: translational research

PURPOSE

To evaluate the usability and satisfaction of users with the interface of the 'Agente Escuta' application, in addition to identifying problems and possibilities for improvement.

METHODS

Descriptive exploratory translational study, characterized by a usability test with a quantitative and qualitative approach, subdivided into three stages: (I) prior evaluation of usability by 10 judges, including students, primary care professionals, professors and researchers in Information Technology and Speech Therapy; (II) evaluation of the application by the target audience, that is, community health agents from six municipalities in Rio Grande do Norte; (III) evaluation of the satisfaction of the agents who used the application in their work routine. The System Usability Scale and the Net Promoter Score were used, in addition to a qualitative evaluation of the opinions.

RESULTS

Usability was rated as excellent by judges, regardless of category. In the evaluation by community health agents, usability was considered good and there was no effect of the city of origin. It was found that the perception of the judges and the target audience were different, with a lower score for the participants in the second stage. However, most would give positive publicity to the product. The heuristic with the highest score was ease of memorization and participants in the third stage were interested in continuing to use the tool in practice, even after the end of the study.

CONCLUSION

The Agente Escuta prototype showed good usability and satisfaction and aspects that could be improved in future solutions were identified.

The effect of mobile application-based rehabilitation in patients with total knee arthroplasty: A systematic review and meta-analysis

OBJECTIVE

Mobile applications have been used frequently in post-operative orthopedic rehabilitation in recent years. However, no systematic review has emphasized the importance of mobile applications in the rehabilitation process after total knee arthroplasty (TKA). This systematic review and meta-analysis aimed to evaluate the effectiveness of mobile application-based rehabilitation practices in patients with TKA.

MATERIAL AND METHODS

PubMed, Web-of-Science, Scopus, ScienceDirect and Cochrane databases were searched. The Physiotherapy Evidence Database (PEDro) and the Revised Cochrane risk-of-bias tool randomized trials 2 (RoB2) tools were used to demonstrate the methodological quality and risk of bias.

RESULTS

A total of 584 articles were screened. Finally, six papers were included in the systematic review. PEDro scores ranged from 4 to 7 (median: 5.5), indicating fair to good methodological quality. All studies were classified as "some concerns" in RoB2. Mobile application-based rehabilitation demonstrated better scores on pain, range of motion (ROM), objective and subjective function, satisfaction and compliance in general. Meta-analysis proved that mobile application-based telerehabilitation demonstrated better results on subjective function (ES:0.57, 95% CI: 0.11-1.02).

CONCLUSION

Compared to conventional rehabilitation, application-based telerehabilitation provides more effective results in function, pain and ROM. Furthermore, mobile application-based rehabilitation should also be considered regarding patient satisfaction and compliance.

Home to Stay: A Randomized Controlled Trial Evaluating the Effect of a Postdischarge Mobile App to Reduce 30-Day Readmission Following Elective Colorectal Surgery

OBJECTIVE

A randomized controlled trial was conducted to evaluate the effect of a postdischarge app on 30-day readmissions and patient-reported outcomes following colorectal surgery.

BACKGROUND

Patients undergoing colorectal surgery are particularly vulnerable during their transition from hospital-to-home. There has been increasing interest in e-health to provide cost-effective transitional care. An integrated discharge monitoring program using a mobile app platform was developed to support patients after surgery.

METHODS

A 2 arm, superiority randomized control trial was conducted at an academic tertiary care center with patients undergoing elective colorectal surgery. The intervention group received usual postoperative care and postdischarge monitoring with the app. The primary outcome was 30-day readmissions following hospital discharge.

RESULTS

Two hundred eighty-two participants were randomized. The majority were young, had inflammatory bowel disease and underwent laparoscopic surgery. Intention to treat analysis showed no difference between groups for 30-day readmission (14.8% vs 17.6%, P =0.55), ER visits (25.0% vs 28.8%, P =0.49), primary care visits (12.5% vs 8.8%, P =0.34) or unplanned healthcare visits (34.4% vs 35.2%, P =0.89). All patient reported outcomes were significantly improved with median scores higher with the app for satisfaction [9, interquartile range (IQR): 8-10 vs 8, IQR: 7-9, P =0.001], well-being (7, IQR: 6-8 vs 6, IQR: 5-7, P =0.001) and significantly lower for anxiety (3, IQR: 2-5 vs 5, IQR: 3-6, P =0.001).

CONCLUSIONS

Although the app did not show a significant reduction in 30-day readmission or ER visits, it did lead to significant improvements in patient-reported outcomes. The app may be an important tool to support patients following colorectal surgery.

An orthopaedic intelligence application successfully integrates data from a smartphone-based care management platform and a robotic knee system using a commercial database

PURPOSE

To evaluate the feasibility of using a smartphone-based care management platform (sbCMP) and robotic-assisted total knee arthroplasty (raTKA) to collect data throughout the episode-of-care and assess if intra-operative measures of soft tissue laxity in raTKA were associated with post-operative outcomes.

METHODS

A secondary data analysis of 131 patients in a commercial database who underwent raTKA was performed. Pre-operative through six week post-operative step counts and KOOS JR scores were collected and cross-referenced with intra-operative laxity measures. A Kruskal-Wallis test or a Wilcoxon sign-rank was used to assess outcomes.

RESULTS

There were higher step counts at six weeks post-operatively in knees with increased laxity in both the lateral compartment in extension and medial compartment in flexion (p < 0.05). Knees balanced in flexion within < 0.5 mm had higher KOOS JR scores at six weeks post-operative (p = 0.034) compared to knees balanced within 0.5-1.5 mm.

CONCLUSION

A smartphone-based care management platform can be integrated with raTKA to passively collect data throughout the episode-of-care. Associations between intra-operative decisions regarding laxity and post-operative outcomes were identified. However, more robust analysis is needed to evaluate these associations and ensure clinical relevance to guide machine learning algorithms.

Developing and pre-testing a digital decision-tree smartphone application for smoking prevention and cessation among HIV care providers

Objectives

The diagnosis and continuous care of chronic conditions such as HIV infection present potential teachable moments for delivering smoking prevention and cessation interventions for patients. We designed and pre-tested a prototype of a smartphone application(app), Decision-T, specifically designed to assist healthcare providers when providing personalized smoking prevention and cessation services to their patients.

Methods

We developed the Decision-T app based on transtheoretical algorithm for smoking prevention and cessation following the 5-A's model. We employed a mixed-methods approach among 18 HIV-care providers recruited from Houston Metropolitan Area for pre-testing the app. Each provider participated in three mock sessions, and the average time spent at each session was measured. We measured accuracy by comparing the smoking prevention and cessation treatment offered by the HIV-care provider using the app to that chosen by the tobacco specialist who designed the case. The system usability scale (SUS) was used to assess usability quantitatively , while individual interview transcripts were analyzed to determine usability qualitatively. STATA-17/SE and Nvivo-V12 were used for quantitative and qualitative analysis, respectively.

Results

The average time for completing each mock session was 5 min 17 s. The participants achieved an overall average accuracy of 89.9%. The average SUS score achieved was 87.5(±10.26). After analyzing the transcripts, five themes (app's contents are beneficial and straightforward, design is easy to understand, user's experience is uncomplicated, tech is intuitive, and app needs improvements) emerged.

Conclusions

The decision-T app can potentially increase HIV-care providers' engagement in offering smoking prevention and cessation behavioral and pharmacotherapy recommendations to their patients briefly and accurately.

Feasibility and usability of a personalized mHealth app for self-management in the first year following breast cancer surgery

This study investigated the feasibility and usability of a personalized mobile health (mHealth) app for self-management during the year following breast cancer surgery. Twenty-nine participants were instructed to use an app and smart band immediately after discharge. Only 18 completed the study. Their perceived necessity and satisfaction for main domains and app were assessed at 1, 2, 4, 6, 9, and 12 months. A self-reporting questionnaire assessed usability at 12 months. Consequently, retention rate as measures of feasibility showed a mean of 75.8%. Exercise and diet management were the most accessed app domains. Perceived necessity was higher than satisfaction. The mean usability score was 80.2. Most participants found the app useful and effective as a delivery for healthcare. Further, 94% of them were willing to pay for and recommend it. Thus, mHealth app can help breast cancer patients improve their healthy behaviors and healthcare further. This study provides insights for designing long-term randomized controlled trials using mHealth interventions.

A Tailored Gender-Sensitive mHealth Weight Loss Intervention (I-GENDO): Development and Process Evaluation

BACKGROUND

Given the increase in the prevalence of overweight and obesity worldwide, the number of digital weight loss interventions has also risen. However, these interventions often lack theoretical background and data on long-term effectiveness. The consideration of individual and gender differences in weight-related psychological parameters might enhance the efficacy and sustainability of mobile-based weight loss interventions.

OBJECTIVE

This paper presented an introduction to and the process evaluation of a 12-week gender-sensitive mobile health (mHealth) weight loss intervention (I-GENDO) combining computer-based and self-tailoring features.

METHODS

Between August 2020 and August 2021, individuals with overweight (BMI 25.0-29.9 kg/m²), those with obesity class I (BMI 30.0-34.9 kg/m²), and those with obesity class II (BMI 35.0-39.9 kg/m²) were recruited to the I-GENDO project, a multicenter study in Germany. The mHealth intervention aimed at targeting individual psychological factors associated with the development and persistence of overweight and obesity (eg, emotional eating) using computer-based tailoring. Moreover, the intervention took a gender-sensitive approach by implementing self-tailoring of gender-targeted module versions. The computer-based assignment of the main modules, self-selection of gender-targeted module versions, and use patterns were evaluated while considering gender. Moreover, gender differences in the usability assessment were analyzed.

RESULTS

Data from the intervention arm of the study were processed. A total of 116 individuals with overweight and obesity (77/116, 66.4% women; age mean 47.28, SD 11.66 years; BMI mean 33.58, SD 3.79 kg/m2) were included in the analyses. Overall, the compliance (90/109, 82.6%) and satisfaction with the app (mean 86% approval) were high and comparable with those of other mobile weight loss interventions. The usability of the intervention was rated with 71% (5.0/7.0 points) satisfaction. More women obtained the main module that focused on emotion regulation skills. Most men and women selected women-targeted versions of the main modules. Women used the app more frequently and longer than men. However, women and men did not differ in the progress of use patterns throughout the intervention.

CONCLUSIONS

We developed a tailored gender-sensitive mHealth weight loss intervention. The usability of and engagement with the intervention were satisfactory, and the overall satisfaction with the intervention was also high. Gender differences must be considered in the evaluation of the effectiveness and sustainability of the intervention.

Telemedicine Technologies Selection for the Posthospital Patient Care Process after Total Hip Arthroplasty

For many years, the importance of using telematic technologies in medicine has been growing, especially in the period of the coronavirus pandemic, when direct contact and supervision of medical personnel over the patient is difficult. The existing possibilities of modern information and communication technologies (ICTs) are not fully used. The aim of the study is to identify the telemedicine technologies that can be used in future implementation projects of the posthospital patient care process after total hip arthroplasty (THA). The literature search is reported according to PRISMA 2020. The search strategy included databases and gray literature. In total, 28 articles (EMBASE, PubMed, PEDro) and 24 records from gray literature (Google Search and Technology presentations) were included in the research. This multi-source study analyzes the possibilities of using different technologies useful in the patient care process. The conducted research resulted in defining visual and wearable types of telemedicine technologies for the original posthospital patient care process after THA. As the needs of stakeholders in the posthospital patient care process after THA differ, the awareness of appropriate technologies selection, information flow, and its management importance are prerequisites for effective posthospital patient care with the use of telemedicine technologies.

System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis

Background

The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS was not specifically designed to evaluate mobile apps, or in particular digital health apps (DHAs).

Objective

The aim of this study was to examine whether the widely used SUS distribution for benchmarking (mean 68, SD 12.5) can be used to reliably assess the usability of DHAs.

Methods

A search of the literature was performed using the ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. This study included papers that published the SUS scores of the evaluated DHAs from 2011 to 2021 to get a 10-year representation. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language were used to model the DHA SUS distribution, with a 1-sample, 2-tailed t test used to compare this distribution with the standard SUS distribution.

Results

The mean SUS score when all the collected apps were included was 76.64 (SD 15.12); however, this distribution exhibited asymmetrical skewness (–0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for “physical activity” apps was 83.28 (SD 12.39) and drove the skewness. Hence, the mean SUS score for all collected apps excluding “physical activity” apps was 68.05 (SD 14.05). A 1-sample, 2-tailed t test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98).

Conclusions

This study concludes that the SUS and the widely accepted benchmark of a mean SUS score of 68 (SD 12.5) are suitable for evaluating the usability of DHAs. We speculate as to why physical activity apps received higher SUS scores than expected. A template for reporting mean SUS scores to facilitate meta-analysis is proposed, together with future work that could be done to further examine the SUS benchmark scores for DHAs.

Feasibility and patient's experiences of perioperative telemonitoring in major abdominal surgery: an observational pilot study

BACKGROUND

Telemonitoring during the perioperative trajectory may improve patient outcomes and self-management. The aim of this study is to assess the feasibility of and patient's experiences with telemonitoring before and after major abdominal surgery to inform future study design.

METHODS

Patients planned for elective major abdominal surgery wore a sensor and answered well-being questions on a tablet daily for at least 2 weeks preoperatively up to 30-days postoperatively. Feasibility was assessed by participation and completion rate, compliance per day, weekly satisfaction scores, and reasons for nonscheduled contact.

RESULTS

Twenty-three patients were included (participation rate of 54.5%) with a completion rate of 69.6%. Median compliance with the wearable sensor and well-being questions was respectively: 94.7% and 83.3% preoperatively at home; 100% and 66.7% postoperatively in-hospital; and 95.4% and 85.8% postoperatively at home. Median weekly satisfaction scores for both wearing the sensor and well-being questions were 5 (IQR, 4-5). Contact moments were related to absence of sensor data and technological issues (76.0%) or patient discomfort and insecurity (24.0%).

CONCLUSIONS

In this study, telemonitoring showed high satisfaction and compliance during the perioperative trajectory. Future trial design regarding the effectiveness of telemonitoring requires embedding in clinical practice and support for patients, relatives, and healthcare personnel.

Iterative Development and Applicability of a Tablet-Based e-Coach for Older Adults in Rehabilitation Units to Improve Nutrition and Physical Activity: Usability Study

BACKGROUND

Maintaining nutrition and exercise strategies after rehabilitation can be difficult for older people with malnutrition or limited mobility. A technical assistance system such as an e-coach could help to positively influence changes in dietary and exercise behavior and contribute to a sustainable improvement in one's nutrition and mobility status. Most apps do not provide a combination of nutrition and exercise content. In most cases, these apps were evaluated with healthy individuals aged <70 years, making transferability to vulnerable patients, with functional limitations and an assumed lower affinity for technology, in geriatric rehabilitation unlikely.

OBJECTIVE

This study aims to identify the potential for optimization and enhance usability through iterative test phases to develop a nutrition and mobility e-coach suitable for older adults (≥65 years) based on individual health behavior change stages in a rehabilitation setting.

METHODS

Iterative testing was performed with patients aged ≥65 years in a rehabilitation center. During testing, participants used an e-coach prototype with educational elements and active input options on nutrition and mobility as a 1-time application test. The participants performed navigation and comprehension tasks and subsequently provided feedback on the design aspects. Hints were provided by the study team when required, documented, and used for improvements. After testing, the participants were asked to rate the usability of the prototype using the System Usability Scale (SUS).

RESULTS

In all, 3 iterative test phases (T1-T3) were conducted with 49 participants (24/49, 49% female; mean 77.8, SD 6.2 years). Improvements were made after each test phase, such as adding explanatory notes on overview screens or using consistent chart types. The use of the user-centered design in this specific target group facilitated an increase in the average SUS score from 69.3 (SD 16.3; median 65) at T1 to 78.1 (SD 11.8; median 82.5) at T3. Fewer hints were required for navigation tasks (T1: 14.1%; T2: 26.5%; T3: 17.2%) than for comprehension questions (T1: 30.5%; T2: 21.6%; T3: 20%). However, the proportion of unsolved tasks, calculated across all participants in all tasks, was higher for navigation tasks (T1: 0%, T2: 15.2%, T3: 4.3%) than for comprehension tasks (T1: 1.9%, T2: 0%, T3: 2.5%).

CONCLUSIONS

The extensive addition of explanatory sentences and terms, instead of shorter keywords, to make it easier for users to navigate and comprehend the content was a major adjustment. Thus, good usability (SUS: 80th-84th percentile) was achieved using iterative optimizations within the user-centered design. Long-term usability and any possible effects on nutritional and physical activity behavior need to be evaluated in an additional study in which patients should be able to use the e-coach with increasing independence, thereby helping them to gain access to content that could support their long-term behavior change.

Postoperative innovative technology for ambulatory anesthesia and surgery

PURPOSE OF REVIEW

To give an overview of the impact of different forms of telehealth that are currently used in ambulatory anesthesia and surgery. Telehealth is applicable during the early recovery and intermediate recovery period (e.g. monitoring of quality of recovery), and as a tool for postoperative check-up during the late recovery phase.

RECENT FINDINGS

Postoperative follow-up after ambulatory surgery is still crucial to maintain quality of care as pain and postoperative nausea and vomiting remain common adverse events. There is a surge of telehealth applications from procedure-specific commercial smartphone apps (mHealth) to complete digital patient platforms instituted by the government. However, patient and healthcare provider engagement is not universal. Usability of these applications is mandatory as well as identifying and overcoming the barriers to its use.

SUMMARY

Telehealth gives many opportunities for postoperative follow-up of ambulatory surgery patients. Clear evidence on the benefits of telehealth in ambulatory surgery is however still sparse. Future research should focus on telehealth for improving quality and safety of postoperative recovery, convincing policymakers for reimbursement encouraging healthcare providers and patients to engage in telehealth.

Mobile devices and wearable technology for measuring patient outcomes after surgery: a systematic review

Complications following surgery are common and frequently occur the following discharge. Mobile and wearable digital health interventions (DHI) provide an opportunity to monitor and support patients during their postoperative recovery. Lack of high-quality evidence is often cited as a barrier to DHI implementation. This review captures and appraises the current use, evidence base and reporting quality of mobile and wearable DHI following surgery. Keyword searches were performed within Embase, Cochrane Library, Web of Science and WHO Global Index Medicus databases, together with clinical trial registries and Google scholar. Studies involving patients undergoing any surgery requiring skin incision where postoperative outcomes were measured using a DHI following hospital discharge were included, with DHI defined as mobile and wireless technologies for health to improve health system efficiency and health outcomes. Methodological reporting quality was determined using the validated mobile health evidence reporting and assessment (mERA) guidelines. Bias was assessed using the Cochrane Collaboration tool for randomised studies or MINORS depending on study type. Overall, 6969 articles were screened, with 44 articles included. The majority (n = 34) described small prospective study designs, with a high risk of bias demonstrated. Reporting standards were suboptimal across all domains, particularly in relation to data security, prior patient engagement and cost analysis. Despite the potential of DHI to improve postoperative patient care, current progress is severely restricted by limitations in methodological reporting. There is an urgent need to improve reporting for DHI following surgery to identify patient benefit, promote reproducibility and encourage sustainability.

Usability Evaluation of an Offline Electronic Data Capture App in a Prospective Multicenter Dementia Registry (digiDEM Bayern): Mixed Method Study

BACKGROUND

Digital registries have been shown to provide an efficient way of gaining a better understanding of the clinical complexity and long-term progression of diseases. The paperless method of electronic data capture (EDC) during a patient interview saves both time and resources. In the prospective multicenter project "Digital Dementia Registry Bavaria (digiDEM Bayern)," interviews are also performed on site in rural areas with unreliable internet connectivity. It must be ensured that EDC can still be performed in such a context and that there is no need to fall back on paper-based questionnaires. In addition to a web-based data collection solution, the EDC system REDCap (Research Electronic Data Capture) offers the option to collect data offline via an app and to synchronize it afterward.

OBJECTIVE

The aim of this study was to evaluate the usability of the REDCap app as an offline EDC option for a lay user group and to examine the necessary technology acceptance of using mobile devices for data collection. The feasibility of the app-based offline data collection in the digiDEM Bayern dementia registry project was then evaluated before going live.

METHODS

An exploratory mixed method design was employed in the form of an on-site usability test with the "Thinking Aloud" method combined with an online questionnaire including the System Usability Scale (SUS). The acceptance of mobile devices for data collection was surveyed based on five categories of the technology acceptance model.

RESULTS

Using the "Thinking Aloud" method, usability issues were identified and solutions were accordingly derived. Evaluation of the REDCap app resulted in a SUS score of 74, which represents "good" usability. After evaluating the technology acceptance questionnaire, it can be concluded that the lay user group is open to mobile devices as interview tools.

CONCLUSIONS

The usability evaluation results show that a lay user group generally agree that data collecting partners in the digiDEM project can handle the REDCap app well. The usability evaluation provided statements about positive aspects and could also identify usability issues relating to the REDCap app. In addition, the current technology acceptance in the sample showed that heterogeneous groups of different ages with diverse experiences in handling mobile devices are also ready for the use of app-based EDC systems. Based on these results, it can be assumed that the offline use of an app-based EDC system on mobile devices is a viable solution for collecting data in a decentralized registry-based research project.

Development and Usability Testing of a Mobile Application to Monitor Patient-Reported Outcomes after Stress Urinary Incontinence Surgery

OBJECTIVE

To develop and perform a usability testing of a mobile application (app) with representative users of surgeons and female patients undergoing stress urinary incontinence (SUI) surgery.

METHODS

A mobile app was developed with the Medical Device Epidemiology Network (MDEpiNet) High-Performance Integrated Virtual Environment (HIVE) to streamline the collection of patient-reported outcomes following SUI surgery using validated questionnaires. It was designed as a collaborative effort with the Women's Health Initiative (WHI), including patient and surgeon involvement. The app evaluation questions addressed the user's rating on the clarity and length of the questions and the comfort level in using the interface for patients to report post-operative outcomes and surgeons to review them.

RESULTS

A total of twenty patients and 5 surgeons tested the mobile app and reported their experience and level of satisfaction. The average patient experience score was 9 out of ten, with ten being the best. Eleven patients (55%) were interested in replacing in-person follow-up visits with the app. The surgeons reported an average user experience score of 8.6 out of ten. Four surgeons (80%) were interested in replacing in-person visits with the app. The combined experience score between all users was 8.9 out of ten. Fifteen out of twenty-five users (60%) showed interest in replacing in-person visits with the app.

CONCLUSION

The mobile app for SUI captured important patient-reported outcomes with a high satisfaction reporting from patients and surgeons.

Is the quality of mobile health applications for burns being adequately assessed?

High quality mobile health applications (mhealth apps) have the potential to enhance the prevention, diagnosis and treatment of burns. The primary aim of this study was to evaluate whether the quality of mhealth apps for burns care is being adequately assessed. The secondary aim was to determine whether these apps meet regulatory standards in the UK. We searched AMED, BNI, CINAHL, Cochrane library, Embase, Emcare, Medline and PsychInfo to identify studies assessing mhealth app quality for burns. The PRISMA reporting guideline was adhered to. Two independent reviewers screened abstracts to identify relevant studies. The quality of identified studies was assessed according to the framework proposed by Nouri et al, including design, information/content, usability, functionality, ethical issues, security/privacy and user-perceived value. Of the 28 included studies, none assessed all seven domains of quality. Design was assessed in 4/28 studies; information/content in 26/28 studies; usability in 12/28 studies; functionality in 10/28 studies; ethical issues were never assessed in any studies; security/privacy was not assessed; subjective assessment was made in 9/28 studies. 17/28 studies included apps that met the definition of 'medical device' according to MHRA guidance, yet only one app was appropriately certified with the UK Conformity Assessed (UKCA) mark. The quality of mHealth apps for burns are not being adequately assessed. The majority of apps should be considered medical devices according to UK standards, yet only one was appropriately certified. Regulatory bodies should support mhealth app developers, so as to improve quality control whilst simultaneously fostering innovation.