Spanish adaptation and validation of the User Version of the Mobile Application Rating Scale (uMARS)

Empowering Potential of the My Assistive Technology Guide: Exploring Experiences and User Perspectives

The use of assistive technology (AT) devices enhances older adults' function in daily activities. However, the lack of awareness of AT among potential AT users has been identified as a major barrier to its adoption. This study aimed to assess the quality of the Mi Guía de Asistencia Tecnológica (MGAT) web app, which provides information on AT, from the perspective of older Latinos with physical disabilities, and to explore their experience using the MGAT. We employed a convergent parallel mixed-method design involving 12 older Latinos living in Puerto Rico. In Phase I, the researchers trained the participants in the use of the MGAT. In Phase II, participants were encouraged to use it for 30 days. In Phase III, the participants completed the User Mobile Application Rating Scale and individual interviews, analyzed with descriptive statistics and a directed thematic content analysis. The quality of the MGAT was rated high in both the objective (mean = 3.99; SD = 0.7) and subjective (mean = 4.13; SD = 1.1) domains. Qualitative data revealed the MGAT was accessible, usable, desirable, credible, useful, and valuable to increasing older Latinos' AT knowledge, function, and autonomy. The MGAT has the potential to increase AT awareness and adoption among older adults.

Translation and cross-cultural adaptation into Portuguese-Brazil of NuHISS, Enlight, and uMARS

BACKGROUND

Easy access to the Internet enables the creation of many online applications. In this sense, questionnaires were developed to evaluate the usability of health area online applications: the National Usability-Focused Health Information System Scale (NuHISS), the Enlight, and the User Version of the Mobile Application Rating Scale (uMARS). Those scales do not have a Portuguese (Brazil) version which is adequate to Brazil's culture. As a consequence, they can not be properly used in Brazil.

OBJECTIVE

To translate and cross-cultural adapt the NuHISS, Enlight, and uMARS to Portuguese (Brazil).

METHODS

A methodological study involving the translation and cross-cultural adaptation of the questionnaires NuHISS, Enlight, and uMARS was conducted following international guidelines recommendations. The questionnaires pass trough an initial translation, translation synthesis, back translation, expert committee, and a pre-final version test.

RESULTS

Thirdy-two health professionals analyzed NuHiss, Enlight, and uMARS translated and cross-cultural adapted Portuguese (Brazil) version. There was conceptual equivalence between the translated and original versions, and no significant adaptations were needed during the translation process. 93.8% of professionals assume that the language is cohesive and 96.9% of them consider that the content is cohesive.

CONCLUSION

The NuHISS, Enlight, and uMARS were successfully translated and cross-culturally adapted to Portuguese (Brazil) and can be properly applied in Brazil. Brazilian health professionals should use the questionnaires NuHISS, Enlight, and uMARS to evaluate health area applications usability.

Comprehensive management of children and adolescents with type 1 diabetes mellitus through personalized physical exercise and education using an mHealth system: The Diactive-1 study protocol

Introduction

The use of new technologies presents an opportunity to promote physical activity, especially among young people with type 1 diabetes (T1DM), who tend to be less active compared to their healthy counterparts. The aim of this study is to investigate the impact of a personalized resistance exercise program, facilitated by the Diactive-1 App, on insulin requirements among children and adolescents diagnosed with T1DM.

Methods and analysis

A minimum of 52 children and adolescents aged 8-18 years, who were diagnosed with T1DM at least 6 months ago, will be randomly assigned to either a group engaging in an individualized resistance exercise program at least 3 times per week over a 24-week period or a waiting-list control group. The primary outcome will be the daily insulin dose requirement. The secondary outcomes will include glycemic control, cardiometabolic profile, body composition, vascular function, physical fitness, 24-hour movement behaviors, diet, and psychological parameters. The usability of the app will also be assessed.

Ethics and dissemination

Ethical approval to conduct this study has been granted by the University Hospital of Navarra Research Board (PI_2020/140). Parents or legal guardians of minors participating in the study will provide written consent, while children and adolescents will sign an assent form to indicate their voluntary agreement. The trial's main findings will be shared through conference presentations, peer-reviewed publications, and communication directly with participating families. This study aims to offer valuable insights into the holistic management of children and adolescents with T1DM by utilizing personalized exercise interventions through an mHealth system.

Trial registration

NCT06048757.

Assessment of healthcare application quality: Development of a standardized methods for healthcare professionals

The advancement of the mobile app market is reshaping healthcare, emphasizing the imperative for quality and efficacy in health applications. This methodology has been devised to assess mobile health applications, aiming to assist healthcare professionals in selecting apps for e-healthcare consumers. Key facets of this approach are: •A stringent selection process within mobile app stores•A standardized assessment using the Mobile App Rating Scale to achieve consistent and replicable evaluations, systematically organizing app evaluations•A comprehensive framework guiding healthcare practitioners in determining which apps to integrate into clinical practice and which to exclude Central to this method is the emphasis on distinguishing apps that enhance clinical practice from those that fall short in important areas such as the effectiveness of proposed health features, data accuracy, adherence to clinical guidelines, data security, and user privacy. With heightened attention to usability and accessibility, the methodology also addresses the common risks inherent in mHealth implementation, ensuring that selected apps not only meet technical criteria but also align with the broader healthcare ecosystem's needs and challenges.

The "Breast-4Y" web app for breast cancer prevention at young age: Development, evaluation, and validation

BACKGROUND

Improving knowledge of risk factors, signs and symptoms positively influence an individual's intention to acquire healthy lifestyle behaviors to prevent breast cancer, to identify breast cancer risk early and seek health advice early. The aim of the present study was to develop and to assess the usability and quality of a web-app (Breast-4Y) designed specifically for younger women to improve their knowledge about breast cancer risk factors and symptoms as well as protective behaviors to reduce their risk.

METHODS

The development of the Breast-4Y web-app, based on Health Belief Model and the Behaviour Change Wheel, comprised four steps: i) analysis of scientific literature regarding breast cancer risk factors, symptoms and preventive lifestyle behaviors; ii) design of web-app; iii) content review by experts; iv) quality and usability assessment by the end-users (n = 20). Web-app usability was evaluated using the Spanish version of the System Usability Scale for the Assessment of Electronic Tools and the quality using the Spanish version of uMARS.

RESULTS

The contents were rated 4.25 or above, indicating high content quality. The mean usability score was 84.9 (SD 12.4), the mean rating for objective quality and subjective quality dimensions mean were 4.2 (SD 0.4) and 3.4 (0.777) respectively, indicating excellent usability and quality. Positive associations (p < .05) were observed between numbers of app used and attitudes to change (r = 0.479), and intention to change (r = 0.539). Strong positive associations (p < .001) were also observed between usability satisfaction and attitudes to change (r = 0.584), intention to change (r = 0.656), and help-seeking (r = 0.656).

CONCLUSIONS

This study provided evidence that Breast-4Y has adequate contents, high quality, and usability. Breast-4Y can be tested in pragmatic trials to assess their effectiveness to reduce the risk of breast cancer, raise women's awareness of breast cancer risk factors, increase women's knowledge of breast cancer symptoms, and adopt protective lifestyle behaviors.

Importance-performance analysis in fitness apps. A study from the viewpoint of gender and age

Background

We are currently undergoing a profound process of digital transformation that has favoured the development and use of apps in multiple facets of people's daily lives. In the fitness industry, this situation has facilitated the control of exercise and the maintenance of healthier lifestyles. However, it is not known how the perceived quality and importance of fitness apps vary for users based on gender and age, which is the objective of this study conducted among users of fitness centres.

Methods

By means of a convenience sample, 321 users from different centres of the boutique fitness chain Sano Centre (238 females and 83 males) took part in the study. They answered the 16 items of the MARS scale, distributed in four dimensions, in terms of importance and perceived quality. The existence of significant differences was analysed using non-parametrical statistics such as the U-Mann-Whitney (gender) and the H-Kruskal-Wallis (age). In addition, a cluster analysis, combining hierarchical and non-hierarchical methods, was analysed considering as a dependent variable the level of recommendation of fitness apps.

Results

Considering gender, in importance-performance analysis (IPA), credibility was the most important attribute for females and quality of information for males. In the case of age, credibility was the most important attribute in all the ranges. The cluster analysis established two groups (high and low recommendations of the fitness app). In importance, the first group scored better on all factors except entertainment and interest. In valuation, the scores were lower than on importance, especially in the low recommendation group.

Conclusion

Regarding usage behaviour, credibility is the factor to which users attach the highest importance and rating, regardless of gender and age. The main demand focuses on improving the gestural design and visual appeal, which will facilitate a better user experience.

Greek validation of the user version of the Mobile Application Rating Scale (uMARS)

OBJECTIVE

The original user version of the Mobile Application Rating Scale (uMARS) is an English-language questionnaire that was designed to allow non-expert app users to assess the quality of health apps. We aimed to translate into the Greek language and validate the uMARS.

METHODS

This was a qualitative prospective study. The World Health Organization translation process was followed and a readily available and free-of-charge app was used for the validation process. Internal consistency and reliability were tested twice within one month by 91 Greek medical students.

RESULTS

The total uMARS score showed excellent internal consistency (Cronbach's alpha = 0.86). The internal consistencies of its subscales were also very high (engagement alpha = 0.71; functionality alpha = 0.71; aesthetics alpha = 0.67; information alpha = 0.63), with the notable exception of the satisfaction alpha, which was 0.61. The uMARS total score demonstrated almost perfect agreement levels in most of the subscales according to the r_WG index from baseline to 1 month.

CONCLUSIONS

The Greek uMARS is a reliable and valid tool for assessing the quality of mobile apps.

Consumers’ Willingness to Pay for eHealth and Its Influencing Factors: Systematic Review and Meta-analysis

Background

Despite the great potential of eHealth, substantial costs are involved in its implementation, and it is essential to know whether these costs can be justified by its benefits. Such needs have led to an increased interest in measuring the benefits of eHealth, especially using the willingness to pay (WTP) metric as an accurate proxy for consumers’ perceived benefits of eHealth. This offered us an opportunity to systematically review and synthesize evidence from the literature to better understand WTP for eHealth and its influencing factors.

Objective

This study aimed to provide a systematic review of WTP for eHealth and its influencing factors.

Methods

This study was performed and reported as per the Cochrane Collaboration and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. PubMed, CINAHL Plus, Cochrane Library, EconLit, and PsycINFO databases were searched from their inception to April 19, 2022. We conducted random-effects meta-analyses to calculate WTP values for eHealth (at 2021 US dollar rates) and meta-regression analyses to examine the factors affecting WTP.

Results

A total of 30 articles representing 35 studies were included in the review. We found that WTP for eHealth varied across studies; when expressed as a 1-time payment, it ranged from US $0.88 to US $191.84, and when expressed as a monthly payment, it ranged from US $5.25 to US $45.64. Meta-regression analyses showed that WTP for eHealth was negatively associated with the percentages of women (β=−.76; P<.001) and positively associated with the percentages of college-educated respondents (β=.63; P<.001) and a country’s gross domestic product per capita (multiples of US $1000; β=.03; P<.001). Compared with eHealth provided through websites, people reported a lower WTP for eHealth provided through asynchronous communication (β=−1.43; P<.001) and a higher WTP for eHealth provided through medical devices (β=.66; P<.001), health apps (β=.25; P=.01), and synchronous communication (β=.58; P<.001). As for the methods used to measure WTP, single-bounded dichotomous choice (β=2.13; P<.001), double-bounded dichotomous choice (β=2.20; P<.001), and payment scale (β=1.11; P<.001) were shown to obtain higher WTP values than the open-ended format. Compared with ex ante evaluations, ex post evaluations were shown to obtain lower WTP values (β=−.37; P<.001).

Conclusions

WTP for eHealth varied significantly depending on the study population, modality used to provide eHealth, and methods used to measure it. WTP for eHealth was lower among certain population segments, suggesting that these segments may be at a disadvantage in terms of accessing and benefiting from eHealth. We also identified the modalities of eHealth that were highly valued by consumers and offered suggestions for the design of eHealth interventions. In addition, we found that different methods of measuring WTP led to significantly different WTP estimates, highlighting the need to undertake further methodological explorations of approaches to elicit WTP values.

Development and validation of the Japanese version of the uMARS (user version of the mobile app rating system)

BACKGROUND

Although the global market of Mobile Health Apps (mHealth apps) continues to grow dramatically, most mHealth apps still not only lack evidence base but have even not been evaluated for the basic usability or functionality. The User Version of the Mobile App Rating Scale (uMARS) was developed to allow end users to assess mHealth apps objectively and subjectively. However, there is no Japanese version of uMARS to date.

OBJECTIVE

The purpose of this study is (1) to develop a validated Japanese version of uMARS and (2) to assess the translated version's reliability and validity in evaluating mHealth apps.

METHODS

The original uMARS was adapted for Japanese use by four specialists using universalist cross-cultural methods. Translation/back-translation was reviewed by the author of the original version of uMARS, and confirmed. Its reliability and validity were further evaluated as part of a prospective cohort study of postoperative patients using a new mHealth app.

RESULTS

Conceptual equivalence was analyzed and all items in all subcategories of the original uMARS were included in the Japanese version. Internal consistency was deemed acceptable for all subscales of objective and subjective quality with a Cronbach's alpha of 0.75-0.85. Test-retest reliability of all subscales was also acceptable with intraclass correlation coefficients (ICCs) of 0.57-0.88. Convergent/divergent validity and concurrent validity were also considered acceptable.

CONCLUSION

A Japanese version of uMARS was cross-culturally validated and found to be as reliable as the original uMARS. This Japanese version of uMARS is expected to become a standard tool in assessing the quality of mHealth apps in Japan.