Usability and Workflow Evaluation of "RhEumAtic Disease activitY" (READY). A Mobile Application for Rheumatology Patients and Providers

Development and User Testing of a Dynamic Tool for Rheumatic Heart Disease Management

OBJECTIVE

Most rheumatic heart disease (RHD) registries are static and centralized, collecting epidemiological and clinical data without providing tools to improve care. We developed a dynamic cloud-based RHD case management application with the goal of improving care for patients with RHD in Uganda.

METHODS

The Active Community Case Management Tool (ACT) was designed to improve community-based case management for chronic disease, with RHD as the first test case. Global and local partner consultation informed selection of critical data fields and prioritization of application functionality. Multiple stages of review and revision culminated in user testing of the application at the Uganda Heart Institute.

RESULTS

Global and local partners provided feedback of the application via survey and interview. The application was well received, and top considerations included avenues to import existing patient data, considering a minimum data entry form, and performing a situation assessment to tailor ACT to the health system setup for each new country. Test users completed a postuse survey. Responses were favorable regarding ease of use, desire to use the application in regular practice, and ability of the application to improve RHD care in Uganda. Concerns included appropriate technical skills and supports and potential disruption of workflow.

CONCLUSION

Creating the ACT application was a dynamic process, incorporating iterative feedback from local and global partners. Results of the user testing will help refine and optimize the application. The ACT application showed potential for utility and integration into existing care models in Uganda.

Impact of assessing patient-reported outcomes with mobile apps on patient-provider interaction

OBJECTIVE

To explore the effect of apps measuring patient-reported outcomes (PROs) on patient-provider interaction in the rheumatic diseases in an observational setting.

METHODS

Patients in the Swiss Clinical Quality Management in Rheumatic Diseases Registry were offered mobile apps (iDialog and COmPASS) to track disease status between rheumatology visits using validated PROs (Rheumatoid Arthritis Disease Activity Index-5 score, Bath Ankylosing Spondylitis Disease Activity Index score, Routine Assessment of Patient Index Data-3 score and Visual Analogue Scale score for pain, disease activity and skin symptoms). We assessed two aspects of patient-provider interaction: shared decision making (SDM) and physician awareness of disease fluctuations. We used logistic regressions to compare outcomes among patients who (1) used an app and discussed app data with their physician (app+discussion group), (2) used an app without discussing the data (app-only group) or (3) did not use any app (non-app users).

RESULTS

2111 patients were analysed, including 1799 non-app users, 150 app-only users and 162 app+discussion users (43% male; with 902 patients with rheumatoid arthritis, 766 patients with axial spondyloarthritis and 443 patients with psoriatic arthritis). App users were younger than non-app users (mean age of 47 vs 51 years, p<0.001). Compared with non-app users, the app+discussion group rated their rheumatologist more highly in SDM (OR 1.7, 95% CI 1.1 to 2.4) and physician awareness of disease fluctuations (OR 2.0, 95% CI 1.3 to 3.1). This improvement was absent in the app-only group.

CONCLUSION

App users who discussed app data with their rheumatologist reported more favourably on patient-provider interactions than app users who did not and non-app users. Apps measuring PROs may contribute little to patient-provider interactions without integration of app data into care processes.

Systematic Review of Outcomes and Patient Experience with Virtual Care in Rheumatoid Arthritis

OBJECTIVE

To conduct a systematic review on patient outcomes of virtual care compared to conventional care in rheumatoid arthritis (RA) including disease activity and patient experience.

METHODS

A systematic search of MEDLINE, EMBASE, CINAHL, and the Cochrane Central Register of Controlled Trials was performed from database inception to 03/19/2020. Observational and randomized controlled trials (RCTs) describing the use of RA virtual care supplanting conventional visits and reporting on disease activity and/or patient experience were included. A narrative synthesis of results was conducted as a meta-analysis was not possible due to heterogeneity of study designs and outcome reporting.

RESULTS

352 studies were identified, and 6 were selected for final inclusion: 3 were RCTs and 3 were observational studies. Disease activity and patient experience were comparable between virtual and conventional care models. In addition, one RCT found no difference in observed outcomes between virtual care delivered by a rheumatologist and by a rheumatology nurse. Virtual care was found to have additional benefits for improved treatment adherence, maintenance of functional status, and quality of life. The overall risk of bias was low in 2/3 RCTs, but high in the observational studies. Study quality was limited by incomplete data reporting, lack of sample size justification and sufficient timeframe to assess objectives.

CONCLUSIONS

There is limited evidence that virtual RA care is an acceptable alternative to conventional care, maintaining comparable patient outcomes and experience of care. Additional research into effective implementation strategies and long-term health system and patient outcomes of virtual care are needed.

SIGNIFICANCE AND INNOVATIONS

There is a paucity of research in the use of virtual care for rheumatology, especially describing the ability of virtual care modalities to supplant in person visits. Virtual care for rheumatoid arthritis (RA) management appears in the short term to provide equivalent control of disease activity and good patient experience compared to conventional follow-up strategies. Future studies should evaluate the long-term impacts of virtual care on RA outcomes and health service utilization.

Assessing Rheumatoid Arthritis Disease Activity With Patient-Reported Outcomes Measurement Information System Measures Using Digital Technology

OBJECTIVE

Health information technology has enabled efficient measurement of patient-reported outcomes (PROs). The National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS) is becoming more widely adopted for research and routine care, and some PROMIS instruments might be substituted for lengthier, legacy PRO instruments.

METHODS

Four PROMIS computer-adaptive testing (CAT) instruments (pain interference, physical function, sleep disturbance, and fatigue) and the Routine Assessment of Patient Index Data 3 (RAPID3), along with pain intensity and patient global assessment score, were administered to participants in the ArthritisPower registry. The RAPID3 was predicted using different combinations of these variables to create a new score (CAT-PROMIS RAPID3). Kappa statistics and Bland-Altman 95% limits of agreement were used to measure agreement between the observed versus predicted RAPID3.

RESULTS

A total of 6,154 eligible patients contributed 11,275 observations. The mean ± SD age was 52.7 ± 10.5 years, and 93% of patients were women. The median assessment times ranged from 29 seconds (PROMIS sleep disturbance) to 116 seconds (RAPID3). As single pairwise comparisons, the PROMIS CATs examined were modestly correlated (r approximately 0.4-0.7) to one other and RAPID3. Together with the pain intensity and patient global assessment, the PROMIS instruments explained a high fraction of total variance (R² = 0.97) of the RAPID3 score. In the model with the highest agreement (κ = 0.93) between the observed RAPID3 and the CAT-PROMIS predicted RAPID3, Bland-Altman 95% limits of agreement showed minimal residual differences and no systematic biases.

CONCLUSION

There was excellent agreement between the observed RAPID3 and predicted RAPID3 scores estimated using several PROMIS instruments. The Multidimensional Health Assessment Questionnaire and patient global assessment components of RAPID3 may be unnecessary if PROMIS scores are available.

Nurses' Stress Associated with Nursing Activities and Electronic Health Records: Data Triangulation from Continuous Stress Monitoring, Perceived Workload, and a Time Motion Study

As health IT has become overloaded with patient information, provider burnout and stress has accelerated. Studies have shown that EHR usage leads to heightened cognitive workload for nurses, and increases in cognitive workload can result in stronger feelings of exhaustion and burnout. We conducted a time motion study in an oncology division to examine the relationships between nurses' perceived workload, stress measured by blood pulse wave (BPw), and their time spent on nursing activities, and to identify stress associated with EHR use. We had a total of 33 observations from 7 nurses. We found that EHR-related stress is associated with nurses' perceived physical demand and frustration. We also found that nurses' perceived workload is a strong predictor of nurses' stress as well as how they spent time with their patients. They also experienced higher perceived mental demand, physical demand, and temporal demand when they were assigned to more patients, regardless of patient acuity. Our study presents a unique data triangulation approach from continuous stress monitoring, perceived workload, and a time motion study.

Methodological Quality of Manuscripts Reporting on the Usability of Mobile Applications for Pain Assessment and Management: A Systematic Review

BACKGROUND

There has been increasing use of mobile mHealth applications, including pain assessment and pain self-management apps. The usability of mHealth applications has vital importance as it affects the quality of apps. Thus, usability assessment with methodological rigor is essential to minimize errors and undesirable consequences, as well as to increase user acceptance.

OBJECTIVE

this study aimed to synthesize and evaluate existing studies on the assessment of the usability of pain-related apps using a newly developed scale.

METHODS

an electronic search was conducted in several databases, combining relevant keywords. Then titles and abstracts were screened against inclusion and exclusion criteria. The eligible studies were retrieved and independently screened for inclusion by two authors. Disagreements were resolved by discussion until consensus was reached.

RESULTS

a total of 31 articles were eligible for inclusion. Quality assessment revealed that most manuscripts did not assess usability using valid instruments or triangulation of methods of usability assessment. Most manuscripts also failed to assess the three domains of usability (effectiveness, efficiency and satisfaction).

CONCLUSIONS

future studies should consider existing guidelines on usability assessment design, development and assessment of pain-related apps.

Tools and Methods for Real-World Evidence Generation: Pragmatic Trials, Electronic Consent, and Data Linkages

Real-world evidence requires use of new tools and methods to support efficient evidence generation. Among those tools are pragmatic trials, utilization of central/single institutional review board and electronic consent, and data linkages between diverse types of data sources (eg, a trial or registry to administrative claims or electronic medical record data). This article reviews these topics in the context of describing several exemplar use cases specific to rheumatology and provides perspective regarding both the promise and potential pitfalls in using these tools and approaches.

Using Health Information Technology to Support Use of Patient-Reported Outcomes in Rheumatology

Technology can help health care providers understand their patients' experience of illness in a way that was previously impossible. Experience in using health information technology (IT) to capture this information through PROs within rheumatology suggests that careful attention to human centered design, including detailed workflow planning, consideration of patient and physician burden, integration into the health IT ecosystem, and delivering information to the right person at the right time are all important. Technology applications must be tested in diverse health systems and populations to ensure they are simple to interpret, useful for clinical decision making and effective in impacting outcomes.

Mobile Health Apps for Self-Management of Rheumatic and Musculoskeletal Diseases: Systematic Literature Review

BACKGROUND

Although the increasing availability of mobile health (mHealth) apps may enable people with rheumatic and musculoskeletal diseases (RMDs) to better self-manage their health, there is a general lack of evidence on ways to ensure appropriate development and evaluation of apps.

OBJECTIVE

This study aimed to obtain an overview on existing mHealth apps for self-management in patients with RMDs, focusing on content and development methods.

METHODS

A search was performed up to December 2017 across 5 databases. For each publication relevant to an app for RMDs, information on the disease, purpose, content, and development strategies was extracted and qualitatively assessed.

RESULTS

Of 562 abstracts, 32 were included in the analysis. Of these 32 abstracts, 11 (34%) referred to an app linked to a connected device. Most of the apps targeted rheumatoid arthritis (11/32, 34%). The top three aspects addressed by the apps were pain (23/32, 71%), fatigue (15/32, 47%), and physical activity (15/32, 47%). The development process of the apps was described in 84% (27/32) of the articles and was of low to moderate quality in most of the cases. Despite most of the articles having been published within the past two years, only 5 apps were still commercially available at the time of our search. Moreover, only very few studies showed improvement of RMD outcome measures.

CONCLUSIONS

The development process of most apps was of low or moderate quality in many studies. Owing to the increasing RMD patients' willingness to use mHealth apps for self-management, optimal standards and quality assurance of new apps are mandatory.

Development of an Evaluative, Educational, and Communication-Facilitating App for Older Adults with Chronic Low Back Pain: Patient Perceptions of Usability and Utility

OBJECTIVE

The purpose of this study is to examine the usability and utility of an office-based iPad app that we developed for older adults with chronic low back pain (CLBP). The app screens for conditions that contribute to back pain and pain interference and provides personalized education based on patient responses. It also facilitates patient-provider communication regarding treatment targets and expectations.

METHODS

Forty-six older adults (age ≥60 years) with CLBP were recruited from the Veterans Affairs and from the Pittsburgh community. Testing was split into two phases. Alpha testing (N = 15) was used to drive design changes to the app. Beta testing (N = 30, after one participant withdrew) used a structured questionnaire to evaluate the app's usability and utility.

RESULTS

The application was rated highly for usability and utility (9.6 and 8.9 out of 10, respectively). The majority of participants (82.1%) agreed that the app would help them communicate with their doctor and that it gave them useful information about potentially harmful or unnecessary interventions such as opioids and imaging (79.2% and 75.0%). Participants (age ≥60 years, mean age = 75.5 years) were able to successfully use the application without assistance and would be willing to do so in their primary care office.

CONCLUSIONS

We present the development of a CLBP app that screens for pain contributors and provides personalized education based on patient responses. Such an app could be employed in a variety of clinical settings to help educate patients about their CLBP and to curtail unnecessary interventions. Patient outcomes are being tested in an ongoing clinical trial.

EULAR points to consider for the development, evaluation and implementation of mobile health applications aiding self-management in people living with rheumatic and musculoskeletal diseases

Background

Mobile health applications (apps) are available to enable people with rheumatic and musculoskeletal diseases (RMDs) to better self-manage their health. However, guidance on the development and evaluation of such apps is lacking.

Objectives

The objective of this EULAR task force was to establish points to consider (PtC) for the development, evaluation and implementation of apps for self-management of RMDs.

Methods

A systematic literature review of app content and development strategies was conducted, followed by patient focus group and an online survey. Based on this information and along with task force expert opinion, PtC were formulated in a face-to-face meeting by a multidisciplinary task force panel of experts, including two patient research partners. The level of agreement among the panel in regard to each PtC was established by anonymous online voting.

Results

Three overarching principles and 10 PtC were formulated. Three PtC are related to patient safety, considered as a critical issue by the panel. Three are related to relevance of the content and functionalities. The requirement for transparency around app development and funding sources, along with involvement of relevant health professionals, were also raised. Ease of app access across ages and abilities was highlighted, in addition to considering the cost benefit of apps from the outset. The level of agreement was from 8.8 to 9.9 out of 10.

Conclusion

These EULAR PtC provide guidance on important aspects that should be considered for the development, evaluation and implementation of existing and new apps.

The promise and perils of 'Big Data': focus on spondyloarthritis

PURPOSE OF REVIEW

This review will describe the available large-scale data sources to study spondyloarthritis (SpA), enumerate approaches to identify SpA and its disease-related manifestations and outcomes, and will outline existing and future methods to collect novel data types [e.g. patient-reported outcomes (PRO), passive data from wearables and biosensors].

RECENT FINDINGS

In addition to traditional clinic visit-based SpA registries, newer data sources, such as health plan claims data, single and multispecialty electronic health record (EHR) based registries, patient registries and linkages between data sources, have catalyzed the breadth and depth of SpA research. Health activity tracker devices and PRO collected via PROMIS instruments have been shown to have good validity when assessed in SpA patients as compared to legacy disease-specific instruments. In certain cases, machine learning outperforms traditional methods to identify SpA and its associated manifestations in EHR and claims data, and may predict disease flare.

SUMMARY

Although caution remains in the application of newer data sources and methods including the important need for replication, the availability of new data sources, health tracker devices and analytic methods holds great promise to catalyze SpA research.

Routine Use of Quantitative Disease Activity Measurements among US Rheumatologists: Implications for Treat-to-target Management Strategies in Rheumatoid Arthritis

OBJECTIVE

The aim of our study was to examine why real-world practices and attitudes regarding quantitative measurements of rheumatoid arthritis (RA) have received limited attention.

METHODS

An e-mail survey asked US rheumatologists to self-report on their use of quantitative measurements (metric).

RESULTS

Among 439 respondents, metric rheumatologists (58%) were more likely to be in group practice and to use tumor necrosis factor inhibitors. The quantitative tools most commonly used were the Health Assessment Questionnaire (35.5%) and the Routine Assessment of Patient Index Data 3 (27.1%). Reasons for not measuring included time needed and electronic availability. Based on simulated case scenarios, providing more quantitative information increased the likelihood that a patient would change to a different disease-modifying antirheumatic drug or biologic.

CONCLUSION

Routine use of quantitative measurement for patients in the United States with RA is increasing over time but remains low.