A large scale analysis of mHealth app user reviews

Establishing an Evaluation Indicator System for User Satisfaction With Hypertension Management Apps: Combining User-Generated Content and Analytic Hierarchy Process

BACKGROUND

Hypertension management apps (HMAs) can be effective in controlling blood pressure, but their actual impact is often suboptimal. Establishing a user satisfaction evaluation indicator system for HMAs can assist app developers in enhancing app design and functionality, while also helping users identify apps that best meet their needs. This approach aims to improve the overall effectiveness of app usage.

OBJECTIVE

This study aims to systematically collect data on HMAs and their user reviews in the United States and China. It analyzes app usage patterns and functional characteristics, identifies factors influencing user satisfaction from existing research, and develops a satisfaction evaluation indicator system to provide more accurate recommendations for improving user satisfaction.

METHODS

We conducted a descriptive statistical analysis to assess the development status of HMAs in both countries and applied the task-technology fit model to evaluate whether the app functionalities align with business needs. We separately summarized the factors influencing user satisfaction in both countries from previous research, utilized the analytic hierarchy process to develop an evaluation indicator system for HMA user satisfaction, and calculated satisfaction levels. Based on these findings, we propose improvements to enhance app functionality and user satisfaction.

RESULTS

In terms of current development status, there were fewer HMAs and user reviews in China compared with the United States. Regarding app functional availability, fewer than 5% (4/91) of the apps achieved a demand fulfillment rate exceeding 80% (8/10). Overall, user satisfaction in both countries was low.

CONCLUSIONS

In the United States, user satisfaction was lowest for advertising distribution, data synchronization, and reliability. By contrast, Chinese apps need improvements in cost efficiency and compatibility.

mHealth learning strategies to support behaviour change in individuals using wheelchairs and/or scooters: a systematic review

PURPOSE

The purpose of this systematic review of the literature is to build understanding of the key elements and recommendations for the design of mHealth technology for individuals using wheelchairs and/or scooters and identify key features associated with the use of mHealth to support healthy behaviour changes for this population.

MATERIALS AND METHODS

Eight major electronic databases were systematically searched to identify mobile health (mHealth) interventions, which targeted adult WC/S users. Independent reviewers used Endnote and Covidence to manage articles meeting review criteria and to exclude duplicates. A quality assessment was conducted on each included article.

RESULTS

Nine articles describing studies with diverse study designs met criteria to be included in this review. Several interactive application intervention features, such as participant collaboration and goal setting, and key technical features to support mHealth app development and utilisation were identified. Results found intuitive and simple designs of mHealth apps, with the ability to customise to support learning styles and preferences, support usability and acceptability by participants.

CONCLUSIONS

More research is needed to evaluate best practices to support initial training of end-users, mHealth apps' ability to support long-term behaviour change and maintenance, and the understanding of active ingredients in complex interventions that include mHealth apps. Both interactive mHealth application intervention and technical features support healthy behaviour change among individuals using wheelchairs and scooters.

Evaluating the Usability of mHealth Apps: An Evaluation Model Based on Task Analysis Methods and Eye Movement Data

Advancements in information technology have facilitated the emergence of mHealth apps as crucial tools for health management and chronic disease prevention. This research work focuses on mHealth apps for the management of diabetes by patients on their own. Given that China has the highest number of diabetes patients in the world, with 141 million people and a prevalence rate of 12.8% (mentioned in the Global Overview of Diabetes), the development of a usability research methodology to assess and validate the user-friendliness of apps is necessary. This study describes a usability evaluation model that combines task analysis methods and eye movement data. A blood glucose recording application was designed to be evaluated. The evaluation was designed based on the model, and the feasibility of the model was demonstrated by comparing the usability of the blood glucose logging application before and after a prototype modification based on the improvement suggestions derived from the evaluation. Tests showed that an improvement plan based on error logs and post-task questionnaires for task analysis improves interaction usability by about 24%, in addition to an improvement plan based on eye movement data analysis for hotspot movement acceleration that improves information access usability by about 15%. The results demonstrate that this study presents a usability evaluation model for mHealth apps that enables the effective evaluation of the usability of mHealth apps.

MyTrack+: Human-centered design of an mHealth app to support long-term weight loss maintenance

A growing body of research has focused on the utility of adaptive intervention models for promoting long-term weight loss maintenance; however, evaluation of these interventions often requires customized smartphone applications. Building such an app from scratch can be resource-intensive. To support a novel clinical trial of an adaptive intervention for weight loss maintenance, we developed a companion app, MyTrack+, to pair with a main commercial app, FatSecret (FS), leveraging a user-centered design process for rapid prototyping and reducing software engineering efforts. MyTrack+ seamlessly integrates data from FS and the BodyTrace smart scale, enabling participants to log and self-monitor their health data, while also incorporating customized questionnaires and timestamps to enhance data collection for the trial. We iteratively refined the app by first developing initial mockups and incorporating feedback from a usability study with 17 university students. We further improved the app based on an in-the-wild pilot study with 33 participants in the target population, emphasizing acceptance, simplicity, customization options, and dual app usage. Our work highlights the potential of using an iterative human-centered design process to build a companion app that complements a commercial app for rapid prototyping, reducing costs, and enabling efficient research progress.

Patient-Centered Chronic Wound Care Mobile Apps: Systematic Identification, Analysis, and Assessment

Background

The prevalence of chronic wounds is predicted to increase within the aging populations in industrialized countries. Patients experience significant distress due to pain, wound secretions, and the resulting immobilization. As the number of wounds continues to rise, their adequate care becomes increasingly costly in terms of health care resources worldwide. eHealth support systems are being increasingly integrated into patient care. However, to date, no systematic analysis of such apps for chronic wounds has been published.

Objective

The aims of this study were to systematically identify and subjectively assess publicly available German- or English-language mobile apps for patients with chronic wounds, with quality assessments performed by both patients and physicians.

Methods

Two reviewers independently conducted a systematic search and assessment of German- or English-language mobile apps for patients with chronic wounds that were available in the Google Play Store and Apple App Store from April 2022 to May 2022. In total, 3 apps met the inclusion and exclusion criteria and were reviewed independently by 10 physicians using the German Mobile App Rating Scale (MARS) and the System Usability Scale (SUS). The app with the highest mean MARS score was subsequently reviewed by 11 patients with chronic wounds using the German user version of the MARS (uMARS) and the SUS. Additionally, Affinity for Technology Interaction (ATI) scale scores were collected from both patients and physicians.

Results

This study assessed mobile apps for patients with chronic wounds that were selected from a pool of 118 identified apps. Of the 73 apps available in both app stores, 10 were patient oriented. After excluding apps with advertisements or costs, 3 apps were evaluated by 10 physicians. Mean MARS scores ranged from 2.64 (SD 0.65) to 3.88 (SD 0.65) out of 5, and mean SUS scores ranged from 50.75 (SD 27) to 80.5 (SD 17.7) out of 100. WUND APP received the highest mean MARS score (mean 3.88, SD 0.65 out of 5) among physicians. Hence, it was subsequently assessed by 11 patients and achieved a similar rating (uMARS score: mean 3.89, SD 0.4 out of 5). Technical affinity, as measured with the ATI scale, was slightly lower in patients (score: mean 3.62, SD 1.35 out of 6) compared to physicians (score: mean 3.88, SD 1.03 out 6).

Conclusions

The quality ratings from physicians and patients were comparable and indicated mediocre app quality. Technical affinity, as assessed by using the ATI scale, was slightly lower for patients. Adequate apps for patients with chronic wounds remain limited, emphasizing the need for improved app development to meet patient needs. The ATI scale proved valuable for assessing technical affinity among different user groups.

Exploring Generation Z and Young Millennials' Perspectives of a Spiritual Self-Care App and Their Spiritual Identity (Skylight): Qualitative Semistructured Interview Study

BACKGROUND

Generation Z and young millennials (ages 18-35 years), collectively referred to as GenZennials, are connected to technology and the internet like no other generation before them. This has mental health implications, such as increased rates of anxiety and stress. Recent research has shown that app-based mental health interventions can be useful to address such mental health concerns. However, spirituality is an untapped resource, especially since GenZennials largely identify as spiritual and already integrate spiritual practices into their self-care.

OBJECTIVE

There were four objectives to this study: (1) comprehensively explore reasons why GenZennials use a spiritual self-care app (ie, Skylight; Radiant Foundation), (2) understand how GenZennials identify spiritually, (3) understand the app's relevance to GenZennials, and (4) gather feedback and suggestions to improve the app.

METHODS

Semistructured interviews were conducted with 23 GenZennials (ages 18-35 years; mean 28.7, SD 5.0 years; n=20, 87% female) who used the Skylight app. Interviews were 30 to 60 minutes and conducted on Zoom. Thematic analysis was used to analyze interviews.

RESULTS

Five major categories emerged from the analysis, each encompassing one to several themes: (1) reasons for using the Skylight app, (2) content favorites, (3) defining spiritual identity, (4) relevance to GenZennials, and (5) overall improvement recommendations. Participants used the app for various reasons including to relax, escape, or ground themselves; improve mood; and enhance overall health and wellness. Participants also cited the app's variety of content offerings and its free accessibility as their primary reasons for using it. Most participants identified themselves as solely spiritual (8/23/35%) among the options provided (ie, spiritual or religious or both), and they appreciated the app's inclusive content. Participants felt that the app was relevant to their generation as it offered modern content (eg, spiritual self-care activities and short content). Participants recommended adding more personalization capabilities, content, and representation to the app.

CONCLUSIONS

This is the first study to qualitatively explore GenZennials' perspectives and the use of a spiritual self-care app. Our findings should inform the future creation and improvement of spiritual self-care apps aimed at cultivating GenZennials' spiritual and mental well-being. Future research is warranted to examine the effects of using a spiritual self-care app on GenZennial mental health.

Association Between the Characteristics of mHealth Apps and User Input During Development and Testing: Secondary Analysis of App Assessment Data

BACKGROUND

User involvement is increasingly acknowledged as a central part of health care innovation. However, meaningful user involvement during the development and testing of mobile health apps is often not fully realized.

OBJECTIVE

This study aims to examine in which areas user input is most prevalent and whether there is an association between user inclusion and compliance with best practices for mobile health apps.

METHODS

A secondary analysis was conducted on an assessment data set of 1595 health apps. The data set contained information on whether the apps had been developed or tested with user input and whether they followed best practices across several domains. Background information was also available regarding the apps' country of origin, targeted condition areas, subjective user ratings, download numbers, and risk (as per the National Institute for Health and Care Excellence Evidence Standards Framework [ESF]). Descriptive statistics, Mann-Whitney U tests, and Pearson chi-square analyses were applied to the data.

RESULTS

User involvement was reported by 8.71% (139/1595) of apps for only the development phase, by 33.67% (537/1595) of apps for only the testing phase, by 21.88% (349/1595) of apps for both phases, and by 35.74% (570/1595) of apps for neither phase. The highest percentage of health apps with reported user input during development was observed in Denmark (19/24, 79%); in the condition areas of diabetes (38/79, 48%), cardiology (15/32, 47%), pain management (20/43, 47%), and oncology (25/54, 46%); and for high app risk (ESF tier 3a; 105/263, 39.9%). The highest percentage of health apps with reported user input during testing was observed in Belgium (10/11, 91%), Sweden (29/34, 85%), and France (13/16, 81%); in the condition areas of neurodiversity (42/52, 81%), respiratory health (58/76, 76%), cardiology (23/32, 72%), and diabetes (56/79, 71%); and for high app risk (ESF tier 3a; 176/263, 66.9%). Notably, apps that reported seeking user input during testing demonstrated significantly more downloads than those that did not (P=.008), and user inclusion was associated with better compliance with best practices in clinical assurance, data privacy, risk management, and user experience.

CONCLUSIONS

The countries and condition areas in which the highest percentage of health apps with user involvement were observed tended to be those with higher digital maturity in health care and more funding availability, respectively. This suggests that there may be a trade-off between developers' willingness or ability to involve users and the need to meet challenges arising from infrastructure limitations and financial constraints. Moreover, the finding of a positive association between user inclusion and compliance with best practices indicates that, where no other guidance is available, users may benefit from prioritizing health apps developed with user input as the latter may be a proxy for broader app quality.

Importance-performance analysis in fitness apps. A study from the viewpoint of gender and age

Background

We are currently undergoing a profound process of digital transformation that has favoured the development and use of apps in multiple facets of people's daily lives. In the fitness industry, this situation has facilitated the control of exercise and the maintenance of healthier lifestyles. However, it is not known how the perceived quality and importance of fitness apps vary for users based on gender and age, which is the objective of this study conducted among users of fitness centres.

Methods

By means of a convenience sample, 321 users from different centres of the boutique fitness chain Sano Centre (238 females and 83 males) took part in the study. They answered the 16 items of the MARS scale, distributed in four dimensions, in terms of importance and perceived quality. The existence of significant differences was analysed using non-parametrical statistics such as the U-Mann-Whitney (gender) and the H-Kruskal-Wallis (age). In addition, a cluster analysis, combining hierarchical and non-hierarchical methods, was analysed considering as a dependent variable the level of recommendation of fitness apps.

Results

Considering gender, in importance-performance analysis (IPA), credibility was the most important attribute for females and quality of information for males. In the case of age, credibility was the most important attribute in all the ranges. The cluster analysis established two groups (high and low recommendations of the fitness app). In importance, the first group scored better on all factors except entertainment and interest. In valuation, the scores were lower than on importance, especially in the low recommendation group.

Conclusion

Regarding usage behaviour, credibility is the factor to which users attach the highest importance and rating, regardless of gender and age. The main demand focuses on improving the gestural design and visual appeal, which will facilitate a better user experience.

Rating analysis and BERTopic modeling of consumer versus regulated mHealth app reviews in Germany

Germany introduced prescription-based mobile health (mHealth) apps in October 2020, becoming the first country to offer them fully reimbursed by health insurance. These regulated apps, known as DiGAs, undergo a rigorous approval process similar to pharmaceuticals, including data protection measures and sometimes clinical trials. This study compares the user experience of DiGAs with non-prescription mHealth apps in Germany, analyzing both average app store ratings and written reviews. Our study pioneers the use of BERTopic for sentiment analysis and topic modeling in the mHealth research domain. The dataset comprises 15 DiGAs and 50 comparable apps, totaling 17,588 German-language reviews. Results reveal that DiGAs receive higher contemporary ratings than non-regulated apps (Android: 3.82 vs. 3.77; iOS: 3.78 vs. 3.53; p < 0.01; non-parametric Mann-Whitney-Wilcoxon test). Key factors contributing to positive user experience with DiGAs are customer service and personalization (15%) and ease of use (13%). However, challenges for DiGAs include software bugs (24%) and a cumbersome registration process (20%). Negative user reviews highlight concerns about therapy effectiveness (11%). Excessive pricing is the main concern for the non-regulated group (27%). Data privacy and security receive limited attention from users (DiGAs: 0.5%; comparators: 2%). In conclusion, DiGAs are generally perceived positively based on ratings and sentiment analysis of reviews. However, addressing pricing concerns in the non-regulated mHealth sector is crucial. Integrating user experience evaluation into the review process could improve adherence and health outcomes.