Apps for People With Rheumatoid Arthritis to Monitor Their Disease Activity: A Review of Apps for Best Practice and Quality

Reporting quality of published reviews of commercial and publicly available mobile health apps (mHealth app reviews): a scoping review protocol

INTRODUCTION

Reviews of commercial and publicly available smartphone (mobile) health applications (mHealth app reviews) are being undertaken and published. However, there is variation in the conduct and reporting of mHealth app reviews, with no existing reporting guidelines. Building on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we aim to develop the Consensus for APP Review Reporting Items (CAPPRRI) guidance, to support the conduct and reporting of mHealth app reviews. This scoping review of published mHealth app reviews will explore their alignment, deviation, and modification to the PRISMA 2020 items for systematic reviews and identify a list of possible items to include in CAPPRRI.

METHOD AND ANALYSIS

We are following the Joanna Briggs Institute approach and Arksey and O'Malley's five-step process. Patient and public contributors, mHealth app review, digital health research and evidence synthesis experts, healthcare professionals and a specialist librarian gave feedback on the methods. We will search SCOPUS, CINAHL Plus, AMED, EMBASE, Medline, APA PsycINFO and the ACM Digital Library for articles reporting mHealth app reviews and use a two-step screening process to identify eligible articles. Information on whether the authors have reported, or how they have modified the PRISMA 2020 items in their reporting, will be extracted. Data extraction will also include the article characteristics, protocol and registration information, review question frameworks used, information about the search and screening process, how apps have been evaluated and evidence of stakeholder engagement. This will be analysed using a content synthesis approach and presented using descriptive statistics and summaries. This protocol is registered on OSF (https://osf.io/5ahjx).

ETHICS AND DISSEMINATION

Ethical approval is not required. The findings will be disseminated through peer-reviewed journal publications (shared on our project website and on the EQUATOR Network website where the CAPPRRI guidance has been registered as under development), conference presentations and blog and social media posts in lay language.

Toward Telemonitoring in Immune-Mediated Inflammatory Diseases: Protocol for a Mixed Attention Model Study

BACKGROUND

Rheumatic and musculoskeletal diseases (RMDs) are chronic diseases that may alternate between asymptomatic periods and flares. These conditions require complex treatments and close monitoring by rheumatologists to mitigate their effects and improve the patient's quality of life. Often, delays in outpatient consultations or the patient's difficulties in keeping appointments make such close follow-up challenging. For this reason, it is very important to have open communication between patients and health professionals. In this context, implementing telemonitoring in the field of rheumatology has great potential, as it can facilitate the close monitoring of patients with RMDs. The use of these tools helps patients self-manage certain aspects of their disease. This could result in fewer visits to emergency departments and consultations, as well as enable better therapeutic compliance and identification of issues that would otherwise go unnoticed.

OBJECTIVE

The main objective of this study is to evaluate the implementation of a hybrid care model called the mixed attention model (MAM) in clinical practice and determine whether its implementation improves clinical outcomes compared to conventional follow-up.

METHODS

This is a multicenter prospective observational study involving 360 patients with rheumatoid arthritis (RA) and spondylarthritis (SpA) from 5 Spanish hospitals. The patients will be followed up by the MAM protocol, which is a care model that incorporates a digital tool consisting of a mobile app that patients can use at home and professionals can review asynchronously to detect incidents and follow patients' clinical evolution between face-to-face visits. Another group of patients, whose follow-up will be conducted in accordance with a traditional face-to-face care model, will be assessed as the control group. Sociodemographic characteristics, treatments, laboratory parameters, assessment of tender and swollen joints, visual analog scale for pain, and electronic patient-reported outcome (ePRO) reports will be collected for all participants. In the MAM group, these items will be self-assessed via both the mobile app and during face-to-face visits with the rheumatologist, who will do the same for patients included in the traditional care model. The patients will be able to report any incidence related to their disease or treatment through the mobile app.

RESULTS

Participant recruitment began in March 2024 and will continue until December 2024. The follow-up period will be extended by 12 months for all patients. Data collection and analysis are scheduled for completion in December 2025.

CONCLUSIONS

This paper aims to provide a detailed description of the development and implementation of a digital solution, specifically an MAM. The goal is to achieve significant economic and psychosocial impact within our health care system by enhancing control over RMDs.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06273306; https://clinicaltrials.gov/ct2/show/NCT06273306.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/55829.

Digital Therapeutics for Improving Effectiveness of Pharmaceutical Drugs and Biological Products: Preclinical and Clinical Studies Supporting Development of Drug + Digital Combination Therapies for Chronic Diseases

Limitations of pharmaceutical drugs and biologics for chronic diseases (e.g., medication non-adherence, adverse effects, toxicity, or inadequate efficacy) can be mitigated by mobile medical apps, known as digital therapeutics (DTx). Authorization of adjunct DTx by the US Food and Drug Administration and draft guidelines on "prescription drug use-related software" illustrate opportunities to create drug + digital combination therapies, ultimately leading towards drug-device combination products (DTx has a status of medical devices). Digital interventions (mobile, web-based, virtual reality, and video game applications) demonstrate clinically meaningful benefits for people living with Alzheimer's disease, dementia, rheumatoid arthritis, cancer, chronic pain, epilepsy, depression, and anxiety. In the respective animal disease models, preclinical studies on environmental enrichment and other non-pharmacological modalities (physical activity, social interactions, learning, and music) as surrogates for DTx "active ingredients" also show improved outcomes. In this narrative review, we discuss how drug + digital combination therapies can impact translational research, drug discovery and development, generic drug repurposing, and gene therapies. Market-driven incentives to create drug-device combination products are illustrated by Humira® (adalimumab) facing a "patent-cliff" competition with cheaper and more effective biosimilars seamlessly integrated with DTx. In conclusion, pharma and biotech companies, patients, and healthcare professionals will benefit from accelerating integration of digital interventions with pharmacotherapies.

Attitudes towards technology supported rheumatoid arthritis care: investigating patient- and clinician-perceived opportunities and barriers

Objectives

Globally, demand outstrips capacity in rheumatology services, making Mobile Health (mHealth) attractive, with the potential to improve access, empower patient self-management and save costs. Existing mHealth interventions have poor uptake by end users. This study was designed to understand existing challenges, opportunities and barriers for computer technology in the RA care pathway.

Methods

People with RA were recruited from Barts Health NHS Trust rheumatology clinics to complete paper questionnaires and clinicians were recruited from a variety of centres in the UK to complete an online questionnaire. Data collected included demographics, current technology use, challenges managing RA, RA medications and monitoring, clinic appointments, opportunities for technology and barriers to technology.

Results

A total of 109 patient and 41 clinician questionnaires were completed. A total of 83.5% of patients and 93.5% of clinicians use smartphones daily. However, only 25% had ever used an arthritis app and only 5% had persisted with one. Both groups identified managing pain, flares and RA medications as areas of existing need. Access to care, medication support and disease education were mutually agreeable opportunities; however, discrepancies existed between groups with clinicians prioritizing education over access, likely due to concerns of data overwhelm (80.6% considered this a barrier).

Conclusions

In spite of high technology use and willingness from both sides, our cohort did not utilize technology to support care, suggesting inadequacies in the existing software. The lack of an objective biomarker for RA disease activity, existing challenges in the healthcare system and the need for integration with existing technical systems were identified as the greatest barriers.

Trial registration

Registered on the Clinical Research Network registry (IRAS ID: 264690).

A systematic review of menopause apps with an emphasis on osteoporosis

BACKGROUND

Menopause can significantly hasten bone loss. Mobile phones provide an efficient way to manage, track and understand menopause using apps. A previous review of menopause apps found numerous apps designed to help women manage menopause. However, it did not use validated measures to assess the quality of the apps and did not focus on content related to osteoporosis.

METHODS

This app review aligns with the updated Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines. The keywords used to search for the apps were "menopause" and "menopausal". Apps were included if they were in English, for individuals or groups and had a lifestyle focus. Apps that looked at other aspects of women's health, required external devices, cost to download, or were symptom-tracking were excluded. The quality and functionality were assessed using the Mobile App Rating Scale and IMS Institute for Healthcare Informatics Functionality score. Data were synthesised descriptively.

RESULTS

Twenty-eight apps were selected and reviewed from the 236 apps screened from the Apple store and Google play store. Only 57% of the apps reviewed (n = 16) had content on osteoporosis which was educational in purpose. The readability of the apps was complex and best understood by university graduates. The average functionality score of the apps reviewed was 4.57 out of 11 and that of quality is 3.1 out of 5, both of which need improvement.

CONCLUSIONS

Existing menopause apps need more input from experts to improve the quality and functionality, using simple language. More emphasis on specific health problems during menopause, including osteoporosis, is required.

TRIAL REGISTRATION

Not relevant.

Protocol for a systematic literature review of smartphone apps to support the self-management of rheumatic and musculoskeletal diseases: development strategies, theoretical underpinnings and barriers to engagement

BACKGROUND

Rheumatic and musculoskeletal diseases (RMDs) cause significant burden to the individual and society, requiring lifelong management and specialist healthcare resource use. Costing over 200 billion euros per year in Europe, RMDs are the most expensive of all diseases for European healthcare systems. The incidence and burden of RMDs are projected to rise with the ageing global population and increase in sedentary, obesogenic lifestyles. In parallel, there is a global crisis in the rheumatology workforce, whereby capacity to deliver specialist care is being exceeded by demand. Pervasive, scalable mobile health technologies, such as apps, are being developed to support the self-management of RMDs and reduce pressure on healthcare services. However, it is unknown whether these apps are informed by theory or their use supported by an appropriate evidence base. The purpose of this review is therefore to provide a comprehensive overview of the development strategies, interventional components and theoretical underpinnings of existing smartphone apps, designed to support the self-management of RMDs.

METHODS

Searches will be conducted within PubMed, Scopus, Web of Science, Embase, MEDLINE and PsycINFO. Reference lists and citing articles of the included studies will be searched. Identified publications will be screened for eligibility by two independent reviewers. Any discrepancies between reviewers will be resolved by consensus, with input from a third reviewer if required. Data will be extracted on study designs, methods, populations, setting, utilised theoretical frameworks, intervention components, behaviour change techniques, methods to evaluate effectiveness and barriers/facilitators to intervention engagement. Exploratory outcomes include reported effectiveness, acceptability and usability. A systematic, narrative synthesis of evidence will be presented. If appropriate (depending on quality and pool of evidence identified), qualitative meta-summary techniques will be used to combine and summarise qualitative findings regarding barriers/facilitators to intervention engagement.

DISCUSSION

The results of this systematic literature review will provide insights for healthcare professionals, researchers, app designers and policy makers, to inform future development and implementation of smartphone apps to support self-management of RMDs. Evidence gaps for future research will be identified. Findings will be disseminated through a final manuscript/publication of results and via a conference abstract, patient organisations and social media.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42022359704.

Conducting a systematic review and evaluation of commercially available mobile applications (apps) on a health-related topic: the TECH approach and a step-by-step methodological guide

OBJECTIVES

To provide an overview of the methodological considerations for conducting commercial smartphone health app reviews (mHealth reviews), with the aim of systematising the process and supporting high-quality evaluations of mHealth apps.

DESIGN

Synthesis of our research team's experiences of conducting and publishing various reviews of mHealth apps available on app stores and hand-searching the top medical informatics journals (eg, The Lancet Digital Health, npj Digital Medicine, Journal of Biomedical Informatics and the Journal of the American Medical Informatics Association) over the last five years (2018-2022) to identify other app reviews to contribute to the discussion of this method and supporting framework for developing a research (review) question and determining the eligibility criteria.

RESULTS

We present seven steps to support rigour in conducting reviews of health apps available on the app market: (1) writing a research question or aims, (2) conducting scoping searches and developing the protocol, (3) determining the eligibility criteria using the TECH framework, (4) conducting the final search and screening of health apps, (5) data extraction, (6) quality, functionality and other assessments and (7) analysis and synthesis of findings. We introduce the novel TECH approach to developing review questions and the eligibility criteria, which considers the Target user, Evaluation focus, Connectedness and the Health domain. Patient and public involvement and engagement opportunities are acknowledged, including co-developing the protocol and undertaking quality or usability assessments.

CONCLUSION

Commercial mHealth app reviews can provide important insights into the health app market, including the availability of apps and their quality and functionality. We have outlined seven key steps for conducting rigorous health app reviews in addition to the TECH acronym, which can support researchers in writing research questions and determining the eligibility criteria. Future work will include a collaborative effort to develop reporting guidelines and a quality appraisal tool to ensure transparency and quality in systematic app reviews.

Customer-centric product presentations for monoclonal antibodies

Delivering customer-centric product presentations for biotherapeutics, such as monoclonal antibodies (mAbs), represents a long-standing and paramount area of engagement for pharmaceutical scientists. Activities include improving experience with the dosing procedure, reducing drug administration-related expenditures, and ultimately shifting parenteral treatments outside of a controlled healthcare institutional setting. In times of increasingly cost-constrained markets and reinforced with the coronavirus pandemic, this discipline of "Product Optimization" in healthcare has gained momentum and changed from a nice-to-have into a must. This review summarizes latest trends in the healthcare ecosystem that inform key strategies for developing customer-centric products, including the availability of a wider array of sustainable drug delivery options and treatment management plans that support dosing in a flexible care setting. Three disease area archetypes with varying degree of implementation of customer-centric concepts are introduced to highlight relevant market differences and similarities. Namely, rheumatoid arthritis and inflammatory bowel disease, multiple sclerosis, and oncology have been chosen due to differences in the availability of subcutaneously dosed and ready-to-use self-administration products for mAb medicines and their follow-on biologics. Different launch scenarios are described from a manufacturer's perspective highlighting the necessity of platform approaches. To unfold the full potential of customer-centric care, value-based healthcare provider reimbursement schemes that incentivize the efficiency of care need to be broadly implemented.

Mobile Health Apps for Patient-Centered Care: Review of United States Rheumatoid Arthritis Apps for Engagement and Activation

BACKGROUND

Rheumatoid arthritis (RA) is a highly dynamic and individualized disease in terms of its patterns of symptomatic flare-ups and periods of remission. Patient-centered care (PCC) aligns patients' lifestyle goals with their preferences for managing symptoms and side effects through the selection of therapies appropriate for disease management. Mobile health (mHealth) apps have the potential to engage and activate patients in PCC. mHealth apps can provide features that increase disease knowledge, collect patient-generated health indicators and behavioral metrics, and highlight goals for disease management. However, little evidence-based guidance exists as to which apps contain functionality essential for supporting the delivery of PCC.

OBJECTIVE

The objective of this study was to evaluate the patient-centeredness of United States-based rheumatoid arthritis mobile apps in terms of patient engagement and activation.

METHODS

A search of mobile apps on 2 major United States app stores (Apple App Store and Google Play) was conducted from June 2020 to July 2021 to identify apps designed for use by patients with RA by adapting the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines for mobile health app screening based on the literature. Reviewers conducted a content analysis of mobile app features to evaluate their functionality for patient engagement and activation. Engagement and activation were assessed using the Mobile Application Rating Scale (MARS) and social cognitive theory, respectively. Apps were ranked by their ability to facilitate PCC care along 2 dimensions: engagement and activation.

RESULTS

A total of 202 mobile apps were initially identified, and 20 remained after screening. Two apps emerged with the greatest ability to facilitate PCC. Both apps were scored as having acceptable or good patient engagement according to the MARS. These 2 apps also had high patient activation according to social cognitive theory, with many features within those apps representing theoretical constructs such as knowledge, perceived self-efficacy, and expectations about outcomes that support behavioral management of RA.

CONCLUSIONS

We found very few mobile apps available within the United States that have functionality that both engages and activates the patient to facilitate PCC. As the prevalence of mobile apps expands, the design of mobile apps needs to integrate patients to ensure that their functionality promotes engagement and activation. More research is needed to understand how mobile app use impacts patient engagement and activation, and ultimately, treatment decisions and disease trajectory.

Monitoring chronic inflammatory musculoskeletal diseases mixing virtual and face-to-face assessments-Results of the digireuma study

Mobile health technology holds great promise for the clinical management of patients with chronic disease. However, evidence on the implementation of projects involving digital health solutions in rheumatology is scarce. We aimed to study the feasibility of a hybrid (virtual and face-to-face) monitoring strategy for personalized care in rheumatoid arthritis (RA) and spondyloarthritis (SpA). This project included the development of a remote monitoring model and its assessment. After a focus group with patients and rheumatologists, relevant concerns regarding the management of RA and SpA were raised, leading to the development of the Mixed Attention Model (MAM), which combined hybrid (virtual and face-to-face) monitoring. Then, a prospective study using the mobile solution Adhera for Rheumatology was conducted. Over a 3-month follow-up period, patients were given the opportunity to complete disease-specific electronic patient reported outcomes (ePROs) for RA and SpA with a pre-established frequency, as well as flares and changes in medication at any time. Number of interactions and alerts were assessed. The usability of the mobile solution was measured by the Net-Promoter Score (NPS) and through a 5-star Likert scale. Following the MAM development, forty-six patients were recruited to utilize the mobile solution, of whom 22 had RA and 24 SpA. There were 4,019 total interactions in the RA group, and 3,160 in the SpA group. Fifteen patients generated a total of 26 alerts, of which 24 were flares and 2 were medication-related problems; most (69%) were managed remotely. Regarding patient satisfaction, 65% of the respondents were considered to have endorsed Adhera for Rheumatology, yielding a NPS of 57 and an overall rating was 4.3 out of 5 stars. We concluded that the use of the digital health solution is feasible in clinical practice to monitor ePROs for RA and SpA. Next steps involve the implementation of this telemonitoring method in a multicentric setting.

Mobile Apps for the Management of Gastrointestinal Diseases: Systematic Search and Evaluation Within App Stores

Background

Gastrointestinal diseases are associated with substantial cost in health care. In times of the COVID-19 pandemic and further digitalization of gastrointestinal tract health care, mobile health apps could complement routine health care. Many gastrointestinal health care apps are already available in the app stores, but the quality, data protection, and reliability often remain unclear.

Objective

This systematic review aimed to evaluate the quality characteristics as well as the privacy and security measures of mobile health apps for the management of gastrointestinal diseases.

Methods

A web crawler systematically searched for mobile health apps with a focus on gastrointestinal diseases. The identified mobile health apps were evaluated using the Mobile Application Rating Scale (MARS). Furthermore, app characteristics, data protection, and security measures were collected. Classic user star rating was correlated with overall mobile health app quality.

Results

The overall quality of the mobile health apps (N=109) was moderate (mean 2.90, SD 0.52; on a scale ranging from 1 to 5). The quality of the subscales ranged from low (mean 1.89, SD 0.66) to good (mean 4.08, SD 0.57). The security of data transfer was ensured only by 11 (10.1%) mobile health apps. None of the mobile health apps had an evidence base. The user star rating did not correlate with the MARS overall score or with the individual subdimensions of the MARS (all P>.05).

Conclusions

Mobile health apps might have a positive impact on diagnosis, therapy, and patient guidance in gastroenterology in the future. We conclude that, to date, data security and proof of efficacy are not yet given in currently available mobile health apps.

Evaluation of Oral Hygiene-Related Mobile Apps for Children in Sub-Saharan Africa

In sub-Saharan Africa, oral health is a real epidemiological challenge. Mobile applications represent a hope for the learning of oral hygiene in children and the fight against oral diseases. This study overviews and assesses the quality of mobile applications linked to oral hygiene for children currently featured on the iOS and Android stores in sub-Saharan Africa. Ten oral health professionals (OHP) used the French Mobile App Rating Scale (MARS-F) to rate 15 selected applications. The highest MARS-F scores for overall quality were reported for Bonne nuit Caillou (3.89 ± 0.74), Mon Raccoon (3.63 ± 0.95), and Chomper Chums (3.54 ± 0.54) while the lowest MARS-F scores for overall quality were achieved by Brushing time (2.31 ± 0.61), De belles dents (2.55 ± 0.55) and Brushing Hero (2.77 ± 0.53). The subjective quality scores ranged from 1.50 ± 0.68 for Brushing time to 3.25 ± 0.97 for Bonne nuit Caillou. Specificity scores ranged from 1.95 ± 0.88 (Brushing time) to 3.75 ± 0.84 (Bonne nuit Caillou). Thus, OHP rated positively the quality of the majority of mobile applications linked to oral hygiene for children, their effect on users' knowledge, attitudes, and intentions to change, and the probability of effective oral hygiene behavior modification. They stated that they would recommend their use to their patients who need them. However, studies analyzing the change in oral hygiene behavior of children using these apps need to be conducted.

Efficacy and safety of a mobile app intervention in patients with inflammatory arthritis: a prospective pilot study

EULAR highlighted the essential role of digital health in increasing self-management and improving clinical outcomes in patients with arthritis. The objective of this study was to evaluate the efficacy and safety of the digital health application (DHA) in patients with inflammatory arthritis. We assessed demographic parameters, treatment regimen, disease activity, and other patient-reported outcomes at baseline and after 4 weeks of DHA use added to standard care treatment. Of 17 patients, who completed the study, 7 (41.2%) patients were male, ranging from 19 to 63 (40.5 ± 12.2) years. No significant change in antirheumatic treatment was observed during the study. Statistically significant improvements (p < 0.05) were noted for health-related quality of life (increase in Physical Component Summary of Short Form-36 (SF-36) by 23.6%) and disease activity (decrease of Clinical Disease Activity Index and Simple Disease Activity Index by 38.4% and 39.9%, respectively). Clinically significant improvement was demonstrated for SF-36 Total Score (+ 14.4%), disease activity (Rheumatoid Arthritis Disease Activity Index− 5 to 15.9%), and depression (Patient Health Questionnaire− 9 to 13.5%). None of the efficacy parameters showed negative trends. No adverse events were reported throughout the study. The usability level was high i.e., the mean mHealth Application Usability Questionnaire Score of 5.96 (max.: 7.0) demonstrated a high level of application usability. This suggests that using a personalized disease management program based on DHA significantly improves several measures of patient-reported outcomes and disease activity in patients with inflammatory arthritis in a timely manner. These findings highlight the potential of complementary digital therapy in patients with inflammatory arthritis.

Development and real-life use assessment of a self-management smartphone application for patients with inflammatory arthritis. A user-centred step-by-step approach

Background

Mobile health applications (apps) are increasing in interest to enhance patient self-management. Few apps are actually used by patients and have been developed for patients with inflammatory arthritis (IA) treated with disease-modifying anti-rheumatic drugs which use entails risk of adverse effects such as infections.

Objective

To develop Hiboot, a self-management mobile app for patients with IA, by using a user-centred step-by-step approach and assess its real-life use.

Methods

The app development included first a qualitative study with semi-guided audiotaped interviews of 21 patients to identify the impact of IA on daily life and patient treatments practices and an online cross-sectional survey of 344 patients to assess their health apps use in general and potential user needs. A multidisciplinary team developed the first version of the app via five face-to-face meetings. After app launch, a second qualitative study of 21 patients and a users’ test of 13 patients and 3 rheumatologists led to the app’s current version. The number of app installations, current users and comments were collected from the Google Play store and the Apple store.

Results

The qualitative study revealed needs for counselling, patient–health professional partnership, and skills to cope with risk situations; 86.8% participants would be ready to use an app primarily on their rheumatologist’s recommendation. Six functionalities were implemented: a safety checklist before treatment administration, aids in daily life situations based on the French academic recommendations, treatment reminders, global well-being self-assessment, periodic counselling messages, and a diary. The Hiboot app was installed 20,500 times from September 2017 to October 2020, with 4300 regular current users. Scores were 4.4/5 stars at Android and iOS stores.

Conclusion

Hiboot is a free self-management app for patients with IA developed by a step-by-step process including patients and health professionals. Further evaluation of the Hiboot benefit is needed.

Oral-Hygiene-Related Mobile Apps in the French App Stores: Assessment of Functionality and Quality

Mobile health apps can contribute to increased quality of individual oral hygiene behaviors. This study provides an overview and an evaluation of quality of oral-hygiene-related mobile apps currently available in Google Play Store and the French Apple App. A shortlist of nine apps was assessed by 10 oral health professionals using the Mobile App Rating Scale. Intraclass correlation was used to evaluate interrater agreement. Best quality scores were obtained by Oral-B (3.4 ± 0.97), Colgate Connect (3.20 ± 0.63), and Preventeeth (3.10 ± 1.1) and worst ones by Mimizaur se brosse les dents (1.80 ± 0.79) and Kolibree (2.30 ± 0.82). The subjective quality scores ranged from 2.62 ± 0.61 (Oral-B) to 1.5 ± 0.61 (MSD). Specificity of the content ranged from 3.46 ± 0.84 (Preventeeth) to 1.78 ± 0.47 (Mimizaur se brosse les dents). Thus, even if oral health professionals positively evaluated the quality of oral-hygiene-related mobile apps, they are less assertive concerning their impact on the user's knowledge, attitudes, and intentions to change, as well as the likelihood of actual change in the oral hygiene behavior. Further investigations are needed to assess whether information from these apps is consistent with oral hygiene recommendations and to determine the long-term impacts of these apps.

Usability Evaluation and Classification of mHealth Applications for Type 2 Diabetes Mellitus Using MARS and ID3 Algorithm

The rapid growth of mHealth applications for Type 2 Diabetes Mellitus (T2DM) patients’ self-management has motivated the evaluation of these applications from both the usability and user point of view. The objective of this study was to identify mHealth applications that focus on T2DM from the Android store and rate them from the usability perspective using the MARS tool. Additionally, a classification of these mHealth applications was conducted using the ID3 algorithm to identify the most preferred application. The usability of the applications was assessed by two experts using MARS. A total of 11 mHealth applications were identified from the initial search, which fulfilled our inclusion criteria. The usability of the applications was rated using the MARS scale, from 1 (inadequate) to 5 (excellent). The Functionality (3.23) and Aesthetics (3.22) attributes had the highest score, whereas Information (3.1) had the lowest score. Among the 11 applications, “mySugr” had the highest average MARS score for both Application Quality (4.1/5) as well as Application Subjective Quality (4.5/5). Moreover, from the classification conducted using the ID3 algorithm, it was observed that 6 out of 11 mHealth applications were preferred for the self-management of T2DM.

Smartphones for musculoskeletal research - hype or hope? Lessons from a decennium of mHealth studies

BACKGROUND

Smartphones provide opportunities for musculoskeletal research: they are integrated in participants' daily lives and can be used to collect patient-reported outcomes as well as sensor data from large groups of people. As the field of research with smartphones and smartwatches matures, it has transpired that some of the advantages of this modern technology are in fact double-edged swords. BODY: In this narrative review, we illustrate the advantages of using smartphones for data collection with 18 studies from various musculoskeletal domains. We critically appraised existing literature, debunking some myths around the advantages of smartphones: the myth that smartphone studies automatically enable high engagement, that they reach more representative samples, that they cost little, and that sensor data is objective. We provide a nuanced view of evidence in these areas and discuss strategies to increase engagement, to reach representative samples, to reduce costs and to avoid potential sources of subjectivity in analysing sensor data.

CONCLUSION

If smartphone studies are designed without awareness of the challenges inherent to smartphone use, they may fail or may provide biased results. Keeping participants of smartphone studies engaged longitudinally is a major challenge. Based on prior research, we provide 6 actions by researchers to increase engagement. Smartphone studies often have participants that are younger, have higher incomes and high digital literacy. We provide advice for reaching more representative participant groups, and for ensuring that study conclusions are not plagued by bias resulting from unrepresentative sampling. Costs associated with app development and testing, data storage and analysis, and tech support are substantial, even if studies use a 'bring your own device'-policy. Exchange of information on costs, collective app development and usage of open-source tools would help the musculoskeletal community reduce costs of smartphone studies. In general, transparency and wider adoption of best practices would help bringing smartphone studies to the next level. Then, the community can focus on specific challenges of smartphones in musculoskeletal contexts, such as symptom-related barriers to using smartphones for research, validating algorithms in patient populations with reduced functional ability, digitising validated questionnaires, and methods to reliably quantify pain, quality of life and fatigue.

Alberta Rating Index for Apps: Study of Reliability and Validity

Background. The number of mobile health applications is rapidly increasing, yet no reliable tool exists for occupational therapists and their clients to rate the quality of these apps. Purpose. To develop the Alberta Rating Index for Apps (ARIA). Methods. Through a sequential design in three phases, we developed a rating index for mobile health applications and examined its reliability and validity with 10 participants. Findings. The coefficients of reliability were 0.95 for occupational therapists, 0.60 for older adults, and 0.88 for adults with a mental health condition. ARIA's correlation with another scale used in app review studies, U-MARS, was low to moderate. Implications. ARIA showed a high inter-rater reliability in two of the three user groups. ARIA is comprehensive and includes criteria not captured by U-MARS, such as privacy and security. Further studies are warranted with diverse raters and health apps.

Nutrition-Related Mobile Apps in the French App Stores: Assessment of Functionality and Quality

BACKGROUND

The global burden of disease attributes 20% of deaths to poor nutrition. Although hundreds of nutrition-related mobile apps have been created, and these have been downloaded by millions of users, the effectiveness of these technologies on the adoption of healthy eating has had mixed.

OBJECTIVE

The aim of this study was to review which nutrition-related mobile apps are currently available on the French market and assess their quality.

METHODS

We screened apps on the Google Play Store and the French Apple App Store, from March 10 to 17, 2021, to identify those related to nutritional health. A shortlist of 15 apps was identified, and each was assessed using the French version of the Mobile App Rating Scale: 8 dietitians and nutritionists assessed 7 apps, and the remaining apps were randomly allocated to ensure 4 assessments per app. Intraclass correlation was used to evaluate interrater agreement. Means and standard deviations of scores for each section and each item were calculated.

RESULTS

The top scores for overall quality were obtained by Yazio - Régime et Calories (mean 3.84, SD 0.32), FeelEat (mean 3.71, SD 0.47), and Bonne App (mean 3.65, SD 0.09). Engagement scores ranged from a mean of 1.95 (SD 0.5) for iEatBetter: Journal alimentaire to a mean of 3.85 (SD 0.44) for FeelEat. Functionality scores ranged from a mean of 2.25 (SD 0.54) for Naor to a mean of 4.25 (SD 0.46) for Yazio. Aesthetics scores ranged from a mean of 2.17 (SD 0.34) for Naor to a mean of 3.88 (SD 0.47) for Yazio. Information scores ranged from a mean of 2.38 (SD 0.60) for iEatBetter to a mean of 3.73 (SD 0.29) for Yazio. Subjective quality scores ranged from a mean of 1.13 (SD 0.25) for iEatBetter to a mean of 2.28 (SD 0.88) for Compteur de calories FatSecret. Specificity scores ranged from a mean of 1.38 (SD 0.64) for iEatBetter to a mean of 3.50 (SD 0.91) for FeelEat. The app-specific score was always lower than the subjective quality score, which was always lower than the quality score, which was lower than the rating from the iOS or Android app stores.

CONCLUSIONS

Although prevention and information messages in apps regarding nutritional habits are not scientifically verified before marketing, we found that app quality was good. Subjective quality and specificity were associated with lower ratings. Further investigations are needed to assess whether information from these apps is consistent with recommendations and to determine the long-term impacts of these apps on users.

The Characteristics and Functionalities of Mobile Apps Aimed at Patients Diagnosed With Immune-Mediated Inflammatory Diseases: Systematic App Search

Background

Immune-mediated inflammatory diseases (IMIDs) are systemic conditions associated with a high social and health impact. New treatments have changed the prognosis of IMIDs and have increased patient autonomy in disease management. Mobile apps have enormous potential to improve health outcomes in patients with IMIDs. Although a large number of IMID apps are available, the app market is not regulated, and functionality and reliability remain uncertain.

Objective

Our aims are to review available apps for patients with IMIDs or caregivers and to describe the main characteristics and functionalities of these apps.

Methods

We performed an observational, cross-sectional, descriptive study of all apps for patients with IMIDs. Between April 5 and 14, 2021, we conducted a search of the App Store (iOS) and Play Store (Android) platforms. We used the names of the different IMIDs as search terms. The inclusion criteria were as follows: content related to IMIDs, English or Spanish language, and user population consisting of patients and health care consumers, including family and caregivers. The variables analyzed were as follows: app name, type of IMID, platform (Android or iOS), country of origin, language, category of the app, cost, date of the last update, size, downloads, author affiliation, and functionalities.

Results

We identified 713 apps in the initial search, and 243 apps met the criteria and were analyzed. Of these, 37% (n=90) were on Android, 27.2% (n=66) on iOS, and 35.8% (n=87) on both platforms. The most frequent categories were health and well-being/fitness apps (n=188, 48.5%) and medicine (n=82, 37.9%). A total of 211 (82.3%) apps were free. The mean time between the date of the analysis and the date of the most recent update was 18.5 (SD 19.3) months. Health care professionals were involved in the development of 100 (41.1%) apps. We found differences between Android and iOS in the mean time since the last update (16.2, SD 14.7 months vs 30.3, SD 25.7 months) and free apps (85.6% vs 75.8%; respectively). The functionalities were as follows: general information about lifestyles, nutrition, or exercises (n=135, 55.6%); specific information about the disease or treatment (n=102, 42%); recording of symptoms or adverse events (n=51, 21%); agenda/calendar (n=44, 18.1%); reminder medication (n=41, 16.9%); and recording of patient-reported outcomes (n=41, 16.9%). A total of 147 (60.5%) apps had more than one functionality.

Conclusions

IMID-related apps are heterogeneous in terms of functionality and reliability. Apps may be a useful complement to IMID care, especially inpatient education (their most frequent functionality). However, more than half of the IMID apps had not been developed by health care professionals or updated in the last year.

Patient-facing genetic and genomic mobile apps in the UK: a systematic review of content, functionality, and quality

Close relative (consanguineous) marriage is widely practised globally, and it increases the risk of genetic disorders. Mobile apps may increase awareness and education regarding the associated risks in a sensitive, engaging, and accessible manner. This systematic review of patient-facing genetic/genomic mobile apps explores content, function, and quality. We searched the NHS Apps Library and the UK Google Play and Apple App stores for patient-facing genomic/genetic smartphone apps. Descriptive information and information on content was extracted and summarized. Readability was examined using the Flesch–Kincaid metrics. Two raters assessed each app, using the Mobile App Rating Scale (MARS) and the IMS Institute for Healthcare Informatics functionality score. A total of 754 apps were identified, of which 22 met the eligibility criteria. All apps intended to inform/educate users, while 32% analyzed genetic data, and 18% helped to diagnose genetic conditions. Most (68%) were clearly about genetics, but only 14% were affiliated with a medical/health body or charity, and only 36% had a privacy strategy. Mean reading scores were 35 (of 100), with the average reading age being equivalent to US grade 12 (UK year 13). On average, apps had 3.3 of the 11 IMS functionality criteria. The mean MARS quality score was 3.2 ± 0.7. Half met the minimum acceptability score (3 of 5). None had been formally evaluated. It was evident that there are few high-quality genomic/genetic patient-facing apps available in the UK. This demonstrates a need for an accessible, culturally sensitive, evidence-based app to improve genetic literacy within patient populations and specific communities.

The Digital Way to Intercept Psoriatic Arthritis

Psoriasis (PsO) and Psoriatic Arthritis (PsA) are chronic, immune-mediated diseases that share common etiopathogenetic pathways. Up to 30% of PsO patient may later develop PsA. In nearly 75% of cases, skin psoriatic lesions precede arthritic symptoms, typically 10 years prior to the onset of joint symptoms, while PsO diagnosis occurring after the onset of arthritis is described only in 15% of cases. Therefore, skin involvement offers to the rheumatologist a unique opportunity to study PsA in a very early phase, having a cohort of psoriatic “risk patients” that may develop the disease and may benefit from preventive treatment. Progression from PsO to PsA is often characterized by non-specific musculoskeletal symptoms, subclinical synovio-entheseal inflammation, and occasionally asymptomatic digital swelling such as painless toe dactylitis, that frequently go unnoticed, leading to diagnostic delay. The early diagnosis of PsA is crucial for initiating a treatment prior the development of significant and permanent joint damage. With the ongoing development of pharmacological treatments, early interception of PsA has become a priority, but many obstacles have been reported in daily routine. The introduction of digital technology in rheumatology may fill the gap in the physician-patient relationship, allowing more targeted monitoring of PsO patients. Digital technology includes telemedicine, virtual visits, electronic health record, wearable technology, mobile health, artificial intelligence, and machine learning. Overall, this digital revolution could lead to earlier PsA diagnosis, improved follow-up and disease control as well as maximizing the referral capacity of rheumatic centers.

The Challenges of Telemedicine in Rheumatology

During the past 20 years, the development of telemedicine has accelerated due to the rapid advancement and implementation of more sophisticated connected technologies. In rheumatology, e-health interventions in the diagnosis, monitoring and mentoring of rheumatic diseases are applied in different forms: teleconsultation and telecommunications, mobile applications, mobile devices, digital therapy, and artificial intelligence or machine learning. Telemedicine offers several advantages, in particular by facilitating access to healthcare and providing personalized and continuous patient monitoring. However, some limitations remain to be solved, such as data security, legal problems, reimbursement method, accessibility, as well as the application of recommendations in the development of the tools.

Brazilian Mobile Phone Applications Related to Hand Hygiene and Their Applicability for Healthcare Professionals

The objective of this study was to identify available mobile applications regarding education for hand hygiene and their applicability as a resource for nurses and other healthcare professionals. The aim was to assess the quality of the mobile apps for education on hand hygiene for health professionals. A review of mobile apps available from Apple App Store and Google Play Store in Brazil was conducted. The World Health Organization recommendations and the Mobile Application Rating Scale for evaluating quality were used. Six applications were selected, only three presented gamification elements incorporated into the learning method and only two of them-SureWash Pocket and Give Me 5-used the international recommendations to improve hand hygiene compliance in a more substantial and interactive way. The mean quality total score for the five rated apps was 3.41, indicating poor to acceptable quality. SureWash Pocket was the only application that reached Mobile Application Rating Scale ≥4 in all dimensions. These mobile applications can be used as complementary alternatives in addition to other available education strategies to improve the standards of hand hygiene and change the behavior of health professionals.

Impact of assessing patient-reported outcomes with mobile apps on patient-provider interaction

Objective

To explore the effect of apps measuring patient-reported outcomes (PROs) on patient–provider interaction in the rheumatic diseases in an observational setting.

Methods

Patients in the Swiss Clinical Quality Management in Rheumatic Diseases Registry were offered mobile apps (iDialog and COmPASS) to track disease status between rheumatology visits using validated PROs (Rheumatoid Arthritis Disease Activity Index-5 score, Bath Ankylosing Spondylitis Disease Activity Index score, Routine Assessment of Patient Index Data-3 score and Visual Analogue Scale score for pain, disease activity and skin symptoms). We assessed two aspects of patient–provider interaction: shared decision making (SDM) and physician awareness of disease fluctuations. We used logistic regressions to compare outcomes among patients who (1) used an app and discussed app data with their physician (app+discussion group), (2) used an app without discussing the data (app-only group) or (3) did not use any app (non-app users).

Results

2111 patients were analysed, including 1799 non-app users, 150 app-only users and 162 app+discussion users (43% male; with 902 patients with rheumatoid arthritis, 766 patients with axial spondyloarthritis and 443 patients with psoriatic arthritis). App users were younger than non-app users (mean age of 47 vs 51 years, p<0.001). Compared with non-app users, the app+discussion group rated their rheumatologist more highly in SDM (OR 1.7, 95% CI 1.1 to 2.4) and physician awareness of disease fluctuations (OR 2.0, 95% CI 1.3 to 3.1). This improvement was absent in the app-only group.

Conclusion

App users who discussed app data with their rheumatologist reported more favourably on patient–provider interactions than app users who did not and non-app users. Apps measuring PROs may contribute little to patient–provider interactions without integration of app data into care processes.

Digital Approaches for a Reliable Early Diagnosis of Psoriatic Arthritis

Psoriatic arthritis (PsA) is a chronic inflammatory disease that develops in up to 30% of patients with psoriasis. In the vast majority of cases, cutaneous symptoms precede musculoskeletal complaints. Progression from psoriasis to PsA is characterized by subclinical synovio-entheseal inflammation and often non-specific musculoskeletal symptoms that are frequently unreported or overlooked. With the development of increasingly effective therapies and a broad drug armamentarium, prevention of arthritis development through careful clinical monitoring has become priority. Identifying high-risk psoriasis patients before PsA onset would ensure early diagnosis, increased treatment efficacy, and ultimately better outcomes; ideally, PsA development could even be averted. However, the current model of care for PsA offers only limited possibilities of early intervention. This is attributable to the large pool of patients to be monitored and the limited resources of the health care system in comparison. The use of digital technologies for health (eHealth) could help close this gap in care by enabling faster, more targeted and more streamlined access to rheumatological care for patients with psoriasis. eHealth solutions particularly include telemedicine, mobile technologies, and symptom checkers. Telemedicine enables rheumatological visits and consultations at a distance while mobile technologies can improve monitoring by allowing patients to self-report symptoms and disease-related parameters continuously. Symptom checkers have the potential to direct patients to medical attention at an earlier point of their disease and therefore minimizing diagnostic delay. Overall, these interventions could lead to earlier diagnoses of arthritis, improved monitoring, and better disease control while simultaneously increasing the capacity of referral centers.

The ideal mHealth-application for rheumatoid arthritis: qualitative findings from stakeholder focus groups

Background

Shifts in treatment strategies for rheumatoid arthritis (RA) have made ambulatory care more labour-intensive. These developments have prompted innovative care models, including mobile health (mHealth) applications. This study aimed to explore the perceptions of mHealth-inexperienced stakeholders concerning these applications in RA care.

Methods

We performed a qualitative study by focus group interviews of stakeholders including RA patients, nurses specialised in RA care and rheumatologists. The qualitative analysis guide of Leuven (QUAGOL), which is based on grounded theory principles, was used to thematically analyse the data. In addition, the Persuasive Systems Design (PSD) model was used to structure recommended app-features.

Results

In total, 2 focus groups with nurses (total n = 16), 2 with patients (n = 17) and 2 with rheumatologists (n = 25) took place. Six overarching themes emerged from the analysis. Efficiency of care and enabling patient empowerment were the two themes considered as expected benefits of mHealth-use in practice by the stakeholders. In contrast, 4 themes emerged as possible barriers of mHealth-use: the burden of chronic app-use, motivational aspects, target group aspects, and legal and organisational requirements. Additionally, recommendations for an ideal mHealth-app could be structured into 4 domains (Primary Task Support, Dialogue Support, Social Support and System Credibility) according to the PSD-framework. Most recommended features were related to improving ease of use (Task Support) and System Credibility.

Conclusions

Although mHealth-apps were expected to improve care efficiency and stimulate patient empowerment, stakeholders were concerned that mHealth-app use could reinforce negative illness behaviour. For mHealth-apps to be successful in practice, challenges according to stakeholders were avoiding long-term poor compliance, finding the target audience and tailoring a legal and organisational framework. Finally, the ideal mHealth-application should above all be trustworthy and easy to use.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12891-021-04624-8.

Sticky apps, not sticky hands: A systematic review and content synthesis of hand hygiene mobile apps

OBJECTIVE

The study sought to identify smartphone apps that support hand hygiene practice and to assess their content, technical and functional features, and quality. A secondary objective was to make design and research recommendations for future apps.

MATERIALS AND METHODS

We searched the UK Google Play and Apple App stores for hand hygiene smartphone apps aimed at adults. Information regarding content, technical and functional features was extracted and summarized. Two raters evaluated each app, using the IMS Institute for Healthcare Informatics functionality score and the Mobile App Rating Scale (MARS).

RESULTS

A total of 668 apps were identified, with 90 meeting the inclusion criteria. Most (96%) were free to download. The majority (78%) intended to educate or inform or remind users to hand wash (69%), using behavior change techniques such as personalization and prompting practice. Only 20% and 4% named a best practice guideline or had expert involvement in development, respectively. Innovative means of engagement were used in 42% (eg, virtual or augmented reality or geolocation-based reminders). Apps included an average of 2.4 out of 10 of the IMS functionality criteria (range, 0-8). The mean MARS score was 3.2 ± 0.5 out of 5, and 68% had a minimum acceptability score of 3. Two had been tested or trialed.

CONCLUSIONS

Although many hand hygiene apps exist, few provide content on best practice. Many did not meet the minimum acceptability criterion for quality or were formally trialed or tested. Research should assess the feasibility and effectiveness of hand hygiene apps (especially within healthcare settings), including when and how they "work." We recommend that future apps to support hand hygiene practice are developed with infection prevention and control experts and align with best practice. Robust research is needed to determine which innovative methods of engagement create "sticky" apps.

An experience selecting quality features of apps for people with disabilities using abductive approach to explanatory theory generation

This study determines one of the most relevant quality factors of apps for people with disabilities utilizing the abductive approach to the generation of an explanatory theory. First, the abductive approach was concerned with the results' description, established by the apps' quality assessment, using the Mobile App Rating Scale (MARS) tool. However, because of the restrictions of MARS outputs, the identification of critical quality factors could not be established, requiring the search for an answer for a new rule. Finally, the explanation of the case (the last component of the abductive approach) to test the rule's new hypothesis. This problem was solved by applying a new quantitative model, compounding data mining techniques, which identified MARS' most relevant quality items. Hence, this research defines a much-needed theoretical and practical tool for academics and also practitioners. Academics can experiment utilizing the abduction reasoning procedure as an alternative to achieve positivism in research. This study is a first attempt to improve the MARS tool, aiming to provide specialists relevant data, reducing noise effects, accomplishing better predictive results to enhance their investigations. Furthermore, it offers a concise quality assessment of disability-related apps.

Outcomes of a Mobile App to Monitor Patient-Reported Outcomes in Rheumatoid Arthritis: A Randomized Controlled Trial

OBJECTIVE

To examine the effects of a smartphone application (app) to monitor longitudinal electronic patient-reported outcomes (ePROs) on patient satisfaction and disease activity in patients with rheumatoid arthritis (RA).

METHODS

We conducted a 6-month randomized controlled trial of care coordination along with an app (intervention) versus care coordination alone (control) in 191 RA patients. Participants in the intervention group were prompted to provide information daily using ePROs. In both the intervention and control groups, a care coordinator contacted participants at 6 and 18 weeks to assess for flares. The main outcome measures were the global satisfaction score from the Treatment Satisfaction Questionnaire for Medication (TSQM), the score from the Perceived Efficacy in Patient-Physician Interactions (PEPPI) Questionnaire, and the Clinical Disease Activity Index (CDAI) score.

RESULTS

Groups were similar at baseline. The median TSQM score at 6 months was 83.3 in both groups, and the median PEPPI score at 6 months was 50 in both groups. The median CDAI score at 6 months was 8 in the intervention group versus 10 in the control group. No statistically significant group differences in the medians of TSQM, PEPPI, or CDAI scores at 6 months were detected. Of the 67 intervention participants who completed the exit survey, 90% rated their likelihood of recommending the app as ≥7 of 10. Of the 11 physicians who completed the exit survey, 73% agreed/strongly agreed that they wanted to continue offering the app to patients.

CONCLUSION

A mobile app designed to collect ePRO data on RA symptoms did not significantly improve patient satisfaction or disease activity compared to care coordination alone. However, both patients and physicians reported positive experiences with the app.

Tele-health interventions to support self-management in adults with rheumatoid arthritis: a systematic review

Rheumatoid arthritis (RA), a long-term auto-immune condition is a challenging condition for patients to manage. Goals of treatment include reducing pain, decreasing inflammation, and improving an individual's overall function. Increasingly technology is being utilised to support patients to self-manage their condition. The aim of this systematic narrative review was to synthesise and critically appraise published evidence concerning the effectiveness of tele-health interventions to support self-management in RA. Bibliographic databases searched from 2014 to March 2020 included MedLINE, Embase, Cochrane Library. Search strategy combined the following concepts: (1) rheumatoid arthritis, (2) tele-health interventions, and (3) self-management. Only randomised controlled trials (RCTs) involving adults with RA were included. Titles, abstracts, full-text articles were screened, any discrepancies were checked by a second reviewer. Risk of bias was assessed using Cochrane risk of bias tool and data were extracted utilising the Cochrane data collection form for RCT interventions along with the TiDier checklist. Due to high heterogeneity, results were not meta-analysed and instead data were synthesised narratively. The search identified 98 articles, seven were included. The completed RCTs varied in the nature of the interventions, duration/severity of RA, outcomes measured and effectiveness of the interventions. The completed RCTs included a total of 791 participants Disease duration was largely between 4 and 10 years and disease severity on average was moderate. There was extensive variation in intervention components, theories underpinning theories and outcomes measured. Five RCTs reported a positive effect on factors such as disease activity, medication adherence, physical activity and self-efficacy levels. This study suggests that tele-health interventions that are well-designed, tailored and multi-faceted can help to achieve positive self-management outcomes in RA. None of the studies showed evidence of harm.

Quality of a Supporting Mobile App for Rheumatic Patients: Patient-Based Assessment Using the User Version of the Mobile Application Scale (uMARS)

Introduction: Mobile applications promise to improve current health care. However, current mobile app quality ratings are mostly physician-based. The aim of this study was (1) to assess the quality of the self-management app Rheuma Auszeit using the validated uMARS (User Version of the Mobile App Rating Scale) app quality assessment tool and (2) to evaluate the association between uMARS scores and patients' characteristics.

Materials and Methods: Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to test Rheuma Auszeit, evaluate its quality using uMARS and complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. The association between uMARS scores and patients' characteristics was further explored.

Results: Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P < 0.004). Older male rheumatic patients reported a higher subjective quality score (P < 0.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho = 0.18; P < 0.042). Preferred time of app usage significantly correlated with engagement (Rho = 0.20; P < 0.024), functionality (Rho = 0.19; P < 0.029), total uMARS score (Rho = 0.21; P < 0.017) and subjective quality score (Rho = 0.21; P < 0.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%).

Conclusion: Rheuma Auszeit was well-accepted by German patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. Lower functionality scores among older female rheumatic patients highlight the need for patient education. The study underlines the potential and feasibility of therapeutic complementary digital solutions in rheumatology.

Evaluating Chinese Mobile Health Apps for Ankylosing Spondylitis Management: Systematic App Search

BACKGROUND

Patients with ankylosing spondylitis (AS), a chronic systematic inflammatory disease, require long-term treatment and management. Mobile health (mHealth) apps can deliver health services through mobile devices, facilitate long-term disease management, support patient-health care provider communication, and enable patients to engage in disease management. There are some apps targeted at patients with AS, but the feature and quality of these apps have not been systematically examined.

OBJECTIVE

The aim of this study was to identify existing, publicly available Chinese mHealth apps for AS management and to evaluate their features and quality.

METHODS

We systematically searched potential apps for AS management on the Apple and Huawei App Stores, using 4 search terms: ankylosing spondylitis, spondyloarthritis, rheumatic disease, and arthritis. Apps were included if they were in the Chinese language, targeted at patients with AS, could be downloaded and run on Android and/or iOS operating systems, and incorporated elements of disease management and/or patient education. We excluded apps that were not for patient use, not relevant to AS, or had not been updated since 2018. Apps that met the inclusion criteria were downloaded for final analysis. We formulated a list of app quality measures from and consistent with international guidelines for mHealth apps and AS management to evaluate the features and quality of the included app. The user version of the Mobile App Rating Scale (uMARS) was also used to rate the apps' quality.

RESULTS

Of the 354 apps screened, 5 met the inclusion criteria and were included in our analysis. All apps were free, and most apps (4/5, 80%) had a privacy policy. Of the 5 apps, 1 (20%) involved medical professionals in the development process, 2 (40%) were developed by companies, and 2 (40%) were developed by medical institutions. All apps provided educational information about AS. Around half of the apps had functions like a basic information record (ie, users can input gender, age, disease history, etc) (n=3, 60%), patient-health care provider (and patient-patient) communication (n=2, 40%), symptom tracking (n=2, 40%), and information sharing (n=3, 60%). Only 1 (20%) app provided comprehensive functions that adhered to international guidelines for AS management and mHealth apps. The overall uMARS scores ranged from 2.7 to 4.2; only 1 app, with an overall uMARS score of 4.2, was considered as a high-quality app.

CONCLUSIONS

Most apps lacked comprehensive functions for AS management. One high-quality app provided comprehensive functions to help patients manage their conditions. This study assessed and summarized the features and quality of the apps but did not evaluate their efficacy. Future studies should evaluate the feasibility and efficacy of these apps. International guidelines and regulations for the design, development, validation, and implementation of mHealth apps are needed in the future. Meanwhile, health care providers, patients with AS, and app developers should collaborate to develop high-quality, evidence-based apps that take into account patients' needs and health care professionals' perspectives.

Patient Perspectives on a Digital Mobile Health Application for RA

Background

Emerging evidence suggests that patients are increasingly willing to use digital mobile health applications for rheumatoid arthritis (RA apps). The development and diffusion of RA apps open the possibility of improved management of the disease and better physician–patient interactions. However, adoption rates among apps have been lower than hoped, and research shows that many available RA apps lack key features. There is little research exploring patient preferences for RA apps or patients’ habits and preferences for app payment, which are likely key factors affecting adoption of this technology. This study seeks to understand characteristics of RA patients who have adopted RA apps, their preferences for app features, and their willingness to pay for, and experiences with app payment.

Methods

Data for this study come from a 33-question online survey of patients with RA in Canada and the United States (N=30). Information on demographics, diagnosis and management of RA, current use and desired features of RA apps, and prior experience with and willingness to pay for an app was collected. Descriptive statistics are reported, and bivariate analyses (chi-square, point-biserial correlation, and ANOVA) were performed to understand relationships between variables.

Results

Respondents showed a clear preference for certain app features, namely symptom tracking, scheduling appointments, and reminders. Physician recommendation for an app and patient tracking of symptoms with an app were significantly related to patient adoption of an RA app. Years since diagnosis with RA, physician recommendation for an RA app, and current use of a non-RA health tracking app were significantly related to patients’ willingness to pay a subscription for an RA app.

Conclusion

RA patients appear to prefer task support features in an RA app, notably symptom tracking, appointment scheduling, and reminders, over other features such as those related to dialogue support and social support. The choice of whether an RA app will be free or based on a subscription, pay-per-service, or one-time purchase model may also play a role in eventual adoption. Similarly, physician recommendation appears to influence patients’ decision to use an RA app as well as their willingness to pay a subscription for an app.

Measuring the Quality of Clinical Skills Mobile Apps for Student Learning: Systematic Search, Analysis, and Comparison of Two Measurement Scales

BACKGROUND

Mobile apps are widely used in health professions, which increases the need for simple methods to determine the quality of apps. In particular, teachers need the ability to curate high-quality mobile apps for student learning.

OBJECTIVE

This study aims to systematically search for and evaluate the quality of clinical skills mobile apps as learning tools. The quality of apps meeting the specified criteria was evaluated using two measures-the widely used Mobile App Rating Scale (MARS), which measures general app quality, and the Mobile App Rubric for Learning (MARuL), a recently developed instrument that measures the value of apps for student learning-to assess whether MARuL is more effective than MARS in identifying high-quality apps for learning.

METHODS

Two mobile app stores were systematically searched using clinical skills terms commonly found in medical education and apps meeting the criteria identified using an approach based on PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A total of 9 apps were identified during the screening process. The apps were rated independently by 2 reviewers using MARS and MARuL.

RESULTS

The intraclass correlation coefficients (ICCs) for the 2 raters using MARS and MARuL were the same (MARS ICC [two-way]=0.68; P<.001 and MARuL ICC [two-way]=0.68; P<.001). Of the 9 apps, Geeky Medics-OSCE revision (MARS Android=3.74; MARS iOS=3.68; MARuL Android=75; and MARuL iOS=73) and OSCE PASS: Medical Revision (MARS Android=3.79; MARS iOS=3.71; MARuL Android=69; and MARuL iOS=73) scored highly on both measures of app quality and for both Android and iOS. Both measures also showed agreement for the lowest rated app, Patient Education Institute (MARS Android=2.21; MARS iOS=2.11; MARuL Android=18; and MARuL iOS=21.5), which had the lowest scores in all categories except information (MARS) and professional (MARuL) in both operating systems. MARS and MARuL were both able to differentiate between the highest and lowest quality apps; however, MARuL was better able to differentiate apps based on teaching and learning quality.

CONCLUSIONS

This systematic search and rating of clinical skills apps for learning found that the quality of apps was highly variable. However, 2 apps-Geeky Medics-OSCE revision and OSCE PASS: Medical Revision-rated highly for both versions and with both quality measures. MARS and MARuL showed similar abilities to differentiate the quality of the 9 apps. However, MARuL's incorporation of teaching and learning elements as part of a multidimensional measure of quality may make it more appropriate for use with apps focused on teaching and learning, whereas MARS's more general rating of quality may be more appropriate for health apps targeting a general health audience. Ratings of the 9 apps by both measures also highlighted the variable quality of clinical skills mobile apps for learning.

Assessing the Quality of Mobile Health-Related Apps: Interrater Reliability Study of Two Guides

Background

There is a huge number of health-related apps available, and the numbers are growing fast. However, many of them have been developed without any kind of quality control. In an attempt to contribute to the development of high-quality apps and enable existing apps to be assessed, several guides have been developed.

Objective

The main aim of this study was to study the interrater reliability of a new guide — the Mobile App Development and Assessment Guide (MAG) — and compare it with one of the most used guides in the field, the Mobile App Rating Scale (MARS). Moreover, we also focused on whether the interrater reliability of the measures is consistent across multiple types of apps and stakeholders.

Methods

In order to study the interrater reliability of the MAG and MARS, we evaluated the 4 most downloaded health apps for chronic health conditions in the medical category of IOS and Android devices (ie, App Store and Google Play). A group of 8 reviewers, representative of individuals that would be most knowledgeable and interested in the use and development of health-related apps and including different types of stakeholders such as clinical researchers, engineers, health care professionals, and end users as potential patients, independently evaluated the quality of the apps using the MAG and MARS. We calculated the Krippendorff alpha for every category in the 2 guides, for each type of reviewer and every app, separately and combined, to study the interrater reliability.

Results

Only a few categories of the MAG and MARS demonstrated a high interrater reliability. Although the MAG was found to be superior, there was considerable variation in the scores between the different types of reviewers. The categories with the highest interrater reliability in MAG were “Security” (α=0.78) and “Privacy” (α=0.73). In addition, 2 other categories, “Usability” and “Safety,” were very close to compliance (health care professionals: α=0.62 and 0.61, respectively). The total interrater reliability of the MAG (ie, for all categories) was 0.45, whereas the total interrater reliability of the MARS was 0.29.

Conclusions

This study shows that some categories of MAG have significant interrater reliability. Importantly, the data show that the MAG scores are better than the ones provided by the MARS, which is the most commonly used guide in the area. However, there is great variability in the responses, which seems to be associated with subjective interpretation by the reviewers.

Systematic evaluation of content and quality of English and German pain apps in European app stores

BACKGROUND AND OBJECTIVE

Pain spans a broad spectrum of diseases and types that are highly prevalent and cause substantial disease burden for individuals and society. Up to 40% of people affected by pain receive no or inadequate treatment. Providing a scalable, time-, and location-independent way for pain diagnostic, management, prevention and treatment mobile health applications (MHA) might be a promising approach to improve health care for pain. However, the commercial app market is rapidly growing and unregulated, resulting in an opaque market. Studies investigating the content, privacy and security features, quality and scientific evidence of the available apps are highly needed, to guide patients and clinicians to high quality MHA.Contributing to this challenge, the present study investigates the content, quality, and privacy features of pain apps available in the European app stores.

METHODS

An automated search engine was used to identify pain apps in the European Google Play and Apple App store. Pain apps were screened and checked for systematic criteria (pain-relatedness, functionality, availability, independent usability, English or German). Content, quality and privacy features were assessed by two independent reviewers using the German Mobile Application Rating Scale (MARS-G). The MARS-G assesses quality on four objectives (engagement, functionality, aesthetics, information quality) and two subjective scales (perceived impact, subjective quality).

RESULTS

Out of 1034 identified pain apps 218 were included. Pain apps covered eight different pain types. Content included basic information, advice, assessment and tracking, and stand-alone interventions. The overall quality of the pain apps was average M = 3.13 (SD = 0.56, min = 1, max = 4.69). The effectiveness of less than 1% of the included pain apps was evaluated in a randomized controlled trial. Major problems with data privacy were present: 59% provided no imprint, 70% had no visible privacy policy.

CONCLUSION

A multitude of pain apps is available. Most MHA lack scientific evaluation and have serious privacy issues, posing a potential threat to users. Further research on evidence and improvements privacy and security are needed. Overall, the potential of pain apps is not exploited.

Measuring Spinal Mobility Using an Inertial Measurement Unit System: A Reliability Study in Axial Spondyloarthritis

The objectives of this study were to evaluate the reliability of wearable inertial motion unit (IMU) sensors in measuring spinal range of motion under supervised and unsupervised conditions in both laboratory and ambulatory settings. A secondary aim of the study was to evaluate the reliability of composite IMU metrology scores (IMU-ASMI (Amb)). Forty people with axSpA participated in this clinical measurement study. Participant spinal mobility was assessed by conventional metrology (Bath Ankylosing Spondylitis Metrology Index, linear version—BASMI_Lin) and by a wireless IMU sensor-based system which measured lumbar flexion-extension, lateral flexion and rotation. Each sensor-based movement test was converted to a normalized index and used to calculate IMU-ASMI (Amb) scores. Test-retest reliability was evaluated using intra-class correlation coefficients (ICC). There was good to excellent agreement for all spinal range of movements (ICC > 0.85) and IMU-ASMI (Amb) scores (ICC > 0.87) across all conditions. Correlations between IMU-ASMI (Amb) scores and conventional metrology were strong (Pearson correlation ≥ 0.85). An IMU sensor-based system is a reliable way of measuring spinal lumbar mobility in axSpA under supervised and unsupervised conditions. While not a replacement for established clinical measures, composite IMU-ASMI (Amb) scores may be reliably used as a proxy measure of spinal mobility.

Remote Measurement in Rheumatoid Arthritis: Qualitative Analysis of Patient Perspectives

BACKGROUND

Rheumatoid arthritis (RA) is characterized by recurrent fluctuations in symptoms such as joint pain, swelling, and stiffness. Remote measurement technologies (RMTs) offer the opportunity to track symptoms continuously and in real time; therefore, they may provide a more accurate picture of RA disease activity as a complement to prescheduled general practitioner appointments. Previous research has shown patient interest in remote symptom tracking in RA and has provided evidence for its clinical validity. However, there is a lack of co-design in the current development of systems, and the features of RMTs that best promote optimal engagement remain unclear.

OBJECTIVE

This study represents the first in a series of work that aims to develop a multiparametric RMT system for symptom tracking in RA. The objective of this study is to determine the important outcomes for disease management in patients with RA and how these can be best captured via remote measurement.

METHODS

A total of 9 patients (aged 23-77 years; mean 55.78, SD 17.54) with RA were recruited from King's College Hospital to participate in two semistructured focus groups. Both focus group discussions were conducted by a facilitator and a lived-experience researcher. The sessions were recorded, transcribed, independently coded, and analyzed for themes.

RESULTS

Thematic analysis identified a total of four overarching themes: important symptoms and outcomes in RA, management of RA symptoms, views on the current health care system, and views on the use of RMTs in RA. Mobility and pain were key symptoms to consider for symptom tracking as well as symptom triggers. There is a general consensus that the ability to track fluctuations and transmit such data to clinicians would aid in individual symptom management and the effectiveness of clinical care. Suggestions for visually capturing symptom fluctuations in an app were proposed.

CONCLUSIONS

The findings support previous work on the acceptability of RMT with RA disease management and address key outcomes for integration into a remote monitoring system for RA self-management and clinical care. Clear recommendations for RMT design are proposed. Future work will aim to take these recommendations into a user testing phase.

Development of an Educational Video for Self-Assessment of Patients with RA: Steps, Challenges, and Responses

Objectives:

The primary objective was to develop an educational video to teach patients with rheumatoid arthritis (RA) self-assessment of their disease activity. Secondary objectives were to validate the video, identify the challenges in producing it, and the responses to these challenges.

Methods:

Rheumatologists from 7 Middle Eastern Arab countries (MEAC) discussed unmet needs in the education of patients with RA. They reviewed pre-existing educational audiovisual material and drafted the script for a new video in Arabic. The video was produced in collaboration with a technical team, then validated by patients using a standardized interview. At each step of production, challenges were identified.

Results:

Twenty-three rheumatologists from MEAC identified unmet needs in patients’ education. A video was produced, explaining the concepts of treat-to-target and showing a patient performing self-assessment using DAS-28. Sixty-two patients were interviewed for validation and found the video to be useful and easy to understand, albeit not replacing the physician’s visit. Most common challenges encountered included acceptance of patient empowerment, agreement on DAS-28 as composite measure, production of a comprehensible written Arabic text, and addressing the population cultural mix.

Conclusion:

Despite challenges, the video was well accepted among patients and can be used for clinical and research purposes. It is particularly useful in pandemic periods where social distancing is recommended.

Effectiveness of web-based and mobile health interventions designed to enhance adherence to physical activity for people with inflammatory arthritis: a systematic review

Objective

The aim of this systematic review was to assess the evidence from randomized controlled trials (RCTs) and cohort studies for the effectiveness of digital interventions designed to enhance adherence to physical activity (PA) for people with inflammatory arthritis and describe the intervention content using established coding criteria.

Methods

Six electronic databases were searched for published and unpublished studies. Independent data extraction and quality assessment (Cochrane risk of bias II or ROBINS-I) were conducted by two reviewers. The primary outcome was self-reported adherence to PA post-intervention. Secondary outcomes included self-reported adherence to PA at other time points, level of PA or engagement with intervention at any follow-up time point. Intervention content was assessed using the Consensus on Exercise Reporting Template and the Behaviour Change Techniques Taxonomy version 1.

Results

From 11 136 citations, four moderate risk of bias studies (three RCTs and one cohort study) including 1160 participants with RA or JIA were identified. Owing to heterogeneity of outcomes, a narrative synthesis was conducted. Only one RCT reported a small between-group difference in adherence to PA [mean difference (95% CI) −0.46 (−0.82, −0.09)] in favour of the intervention. There were no between-group differences in any secondary outcomes. Interventions included between 3 and 11 behaviour change techniques but provided minimal information on exercise prescription.

Conclusion

There is currently limited moderate-quality evidence available to provide confident evaluation of the effect of web-based and mobile health interventions on adherence to PA or level of PA post-intervention in people with inflammatory arthritis.

Perceptions of patients with rheumatoid arthritis about self-assessment of disease activity after watching an educational video: a qualitative pilot study from the AUTO-DAS in Middle Eastern Arab countries project

To evaluate the perceptions of patients with rheumatoid arthritis (RA) about self-assessment of their disease activity after watching an educational video. Consecutive patients with RA consulting their rheumatologist in six Middle Eastern Countries were invited to watch an educational video developed to teach self-assessment using Disease Activity Score (DAS-28). Then, a rheumatology nurse conducted a semi-structured interview and collected the patients’ perception about the understanding of the video, feasibility, capability and confidence in performing self-assessment using Likert-type items. The degree of confidence with self-assessment was correlated to the patients’ socio-demographic characteristics. Sixty-two patients were included and had an overall positive reaction to the video. It was easy to understand in 96% and helped facilitate self-assessment in 92% of cases. Self-assessment was considered totally feasible in 74%, and 66% of patients were capable of always doing it, with a confidence of 60% (always) to 34% (sometimes). Confidence was associated with a higher educational level. Nevertheless, 77% of patients felt that the self-assessment would not fully replace the physician’s visit. Open-ended questions identified five themes: better understanding of the disease, easier communication with the rheumatologist, less consultation time, difficulty with the scoring part and importance of practice. Patients with RA felt that self-assessment was feasible and helpful in understanding RA, improving communication with the rheumatologist and shortening the visit time.

Managing patients using telerheumatology: Lessons from a pandemic

The coronavirus disease 2019 (COVID-19) pandemic has presented unique challenges to rheumatology provision. Measures to control the pandemic have limited face-to-face contact with rheumatology healthcare professionals. One innovation has been the widespread adoption of telerheumatology to assist in the care of patients with rheumatic and musculoskeletal diseases, building on an existing evidence base in rheumatology. Widespread adoption has only occurred following the COVID-19 pandemic. We discuss the evidence supporting telerheumatology adoption prior to the pandemic, and outline several innovative approaches used to assist in the care of rheumatology patients that have been introduced. Alongside the advantages of these interventions, we discuss the limitations and regulatory challenges. Advances must be balanced, considering wider issues of equity of access, implementation, adoption, and sustainability of telerheumatology post-pandemic. We propose it is not ‘if’, but ‘how’ rheumatologists embrace newer telerheumatology technology, outlining practice points and future research agenda.

Mobile health technologies for the management of rheumatic diseases: a systematic review of online stores in Brazil

Rheumatic diseases are serious conditions with a low uptake of conservative treatments. Mobile health (mHealth) applications (apps) offer potential to assist the self-management of rheumatic diseases. Our goal was to perform a systematic review of available mHealth apps for rheumatic diseases in Brazil. We focused on the most prevalent rheumatic diseases: osteoarthritis, rheumatoid arthritis, fibromyalgia, systemic lupus erythematosus, osteoporosis, and axial spondylarthritis. Google Play Store and AppStore in Brazil were queried by two independent reviewers on September 2020, and the quality of eligible mHealth apps was assessed using the Mobile App Rating Scale (MARS). Of the 3173 mHealth apps found, five were eligible for inclusion. Two for fibromyalgia and two for axial spondylarthritis offered exercise, educational content, and tools to track patient-reported symptoms; and one for osteoporosis offered educational content and tracking tools only. The included apps scored moderately on the MARS quality scale, with a mean score (SD) of 3.1 (0.7) on a 0-5 scale. Most apps scored poorly based on credibility, user interface and experience, and engagement. There is growing interest in the development of mHealth technologies to support rheumatic diseases patients. Although the majority of the included apps came from non-profit organizations, they are still of poor quality and limited functionality. This study is a call for to the development of new user-centered mHealth apps that can empower rheumatic diseases patients in Brazil, especially in the area of osteoarthritis, rheumatoid arthritis, and lupus, since no apps were found.

Quality Evaluation of English Mobile Applications for Gestational Diabetes: App Review using Mobile Application Rating Scale (MARS)

BACKGROUND

Mobile applications and social media serve their users as convenient tools to improve and monitor diseases and conditions such as pregnancy. These tools also exert a positive impact on Gestational diabetes mellitus (GDM) self-management.

INTRODUCTION

Despite the expansion of mobile health apps for the management of GDM, no study has evaluated these apps using a valid tool. This study aimed to search and review the apps developed for this purpose, providing overall and specific rating scores for each aspect of MARS.

METHODS

Two cases of app stores (IOS and Google Play) were searched in January 2019 for apps related to GDM. Search keywords included "gestational diabetes", "pregnant diabetes", and "Health apps". Eligibility criteria include: capable of running on Android or IOS operating systems, in the English language, especially for GDM, and available in Iran. After removal of duplicates, the apps were reviewed, rated, and evaluated independently by two reviewers with Mobile App Rating Scale (MARS) tools.

RESULTS

Initially, 102 apps were identified after the exclusion process, five selected apps were downloaded and analyzed. All apps were classified into four categories according to contents and their interactive capabilities. In most quadrants of MARS, the Pregnant with Diabetes app received the highest scores. Also, in general, the maximum app quality mean score belonged to Pregnant with Diabetes (3.10 / 5.00).

CONCLUSION

Findings revealed that apps designed for GDM are small in number and poor in quality based on MARS tools. Therefore, considering pregnant women's need for using the capabilities of these apps in pregnancy management and promoting community-based care, it seems essential to develop and design a series of high-quality apps in all four specified categories (only giving comments, obtaining data and giving comments, diagnosis of GDM, and diet calculator).

Implementing disruptive technological change in UK healthcare: exploring development of a smart phone app for remote patient monitoring as a boundary object using qualitative methods

PURPOSE

Developing technological innovations in healthcare is made complex and difficult due to effects upon the practices of professional, managerial and other stakeholders. Drawing upon the concept of boundary object, this paper explores the challenges of achieving effective collaboration in the development and use of a novel healthcare innovation in the English healthcare system.

DESIGN/METHODOLOGY/APPROACH

A case study is presented of the development and implementation of a smart phone application (app) for use by rheumatoid arthritis patients. Over a two-year period (2015-2017), qualitative data from recorded clinical consultations (n = 17), semi-structured interviews (n = 63) and two focus groups (n = 13) were obtained from participants involved in the app's development and use (clinicians, patients, researchers, practitioners, IT specialists and managers).

FINDINGS

The case focuses on the use of the app and its outputs as a system of inter-connected boundary objects. The analysis highlights the challenges overcome in the innovation's development and how knowledge sharing between patients and clinicians was enhanced, altering the nature of the clinical consultation. It also shows how conditions surrounding the innovation both enabled its development and inhibited its wider scale-up.

ORIGINALITY/VALUE

By recognizing that technological artefacts can simultaneously enable and inhibit collaboration, this paper highlights the need to overcome tensions between the transformative capability of such healthcare innovations and the inhibiting effects simultaneously created on change at a wider system level.

Validation of the Mobile Application Rating Scale (MARS)

BACKGROUND

Mobile health apps (MHA) have the potential to improve health care. The commercial MHA market is rapidly growing, but the content and quality of available MHA are unknown. Instruments for the assessment of the quality and content of MHA are highly needed. The Mobile Application Rating Scale (MARS) is one of the most widely used tools to evaluate the quality of MHA. Only few validation studies investigated its metric quality. No study has evaluated the construct validity and concurrent validity.

OBJECTIVE

This study evaluates the construct validity, concurrent validity, reliability, and objectivity, of the MARS.

METHODS

Data was pooled from 15 international app quality reviews to evaluate the metric properties of the MARS. The MARS measures app quality across four dimensions: engagement, functionality, aesthetics and information quality. Construct validity was evaluated by assessing related competing confirmatory models by confirmatory factor analysis (CFA). Non-centrality (RMSEA), incremental (CFI, TLI) and residual (SRMR) fit indices were used to evaluate the goodness of fit. As a measure of concurrent validity, the correlations to another quality assessment tool (ENLIGHT) were investigated. Reliability was determined using Omega. Objectivity was assessed by intra-class correlation.

RESULTS

In total, MARS ratings from 1,299 MHA covering 15 different health domains were included. Confirmatory factor analysis confirmed a bifactor model with a general factor and a factor for each dimension (RMSEA = 0.074, TLI = 0.922, CFI = 0.940, SRMR = 0.059). Reliability was good to excellent (Omega 0.79 to 0.93). Objectivity was high (ICC = 0.82). MARS correlated with ENLIGHT (ps<.05).

CONCLUSION

The metric evaluation of the MARS demonstrated its suitability for the quality assessment. As such, the MARS could be used to make the quality of MHA transparent to health care stakeholders and patients. Future studies could extend the present findings by investigating the re-test reliability and predictive validity of the MARS.

Feasibility of Self-Monitoring Rheumatoid Arthritis With a Smartphone App: Results of Two Mixed-Methods Pilot Studies

Background

Several mobile apps that monitor symptoms of rheumatoid arthritis (RA) exist, but a recent systematic review indicated that high-quality apps are lacking. When patients self-monitor their own disease with patient-reported outcomes (PROs) and self-initiate care at the right moment, it may be possible to reduce the frequency of their clinic visits, which would reduce health care burden and costs. We developed an app, that is, the MijnReuma Reade app, for this purpose and performed 2 pilot tests with weekly self-monitoring.

Objective

The primary objective of this study was to design, develop, and evaluate the usability, satisfaction, and usage of the MijnReuma Reade app—an app that allows patients with RA to monitor their own disease. The secondary objective was to review the patients’ perspectives on app usage and its intended purpose.

Methods

This app was designed in collaboration with patients with RA, rheumatologists, and information technology experts. Two 1-month pilot studies were performed, after which satisfaction (0-10 scale), usability (system usability scale, 0-100), and usage (proportion of completed questionnaires) of this app were assessed. After the second pilot study, semistructured interviews were performed to determine patients’ perspectives and the promoters and barriers of app usage.

Results

In the first and second pilot study, 42 and 27 patients were included, respectively. Overall, the patients were satisfied (medians, 8 and 7) and found the app usable (mean system usability scores, 76 and 71) in pilot studies 1 and 2, respectively. App usage declined over time in both the pilot studies; 61% (17/28) and 37% (10/27) of the patients who disclosed their usage statistics completed the final weekly questionnaire in pilot study 1 and pilot study 2, respectively. Approximately 81% (25/31) of the patients indicated they would like to skip hospital visits if the self-monitored disease activity is low. In the semistructured interviews, technical problems, internal resistance (respondent fatigue, the app reminded them of their disease), and a lack of symptoms were identified as barriers for usage. Patients reported that “experiencing more grip on their disease” and “improved communication with their physician” were promoters for usage. Patients reported that pain positively mediated usage, that is, more pain promoted and less pain discouraged app usage.

Conclusions

This study illustrates the feasibility of the MijnReuma Reade app that enables self-monitoring of the disease activity in patients with RA with the overarching aim to allocate clinical consultations according to need. Satisfaction with the app and usability of the app were found to be high; however, app usage declined over time. Patients acknowledged the potential of the app to self-monitor their own disease and would like to be able to skip clinic visits if the monitored disease activity is low. To evaluate this strategy, a randomized controlled trial is underway.