Exploring the Specific Needs of Persons with Multiple Sclerosis for mHealth Solutions for Physical Activity: Mixed-Methods Study

User Experience of a Large-Scale Smartphone-Based Observational Study in Multiple Sclerosis: Global, Open-Access, Digital-Only Study

BACKGROUND

The Floodlight Open app is a digital health technology tool (DHTT) that comprises remote, smartphone sensor-based tests (daily activities) for assessing symptoms of multiple sclerosis (MS). User acquisition, engagement, and retention remain a barrier to successfully deploying such tools.

OBJECTIVE

This study aims to quantitatively and qualitatively investigate key user experience (UX) factors associated with the Floodlight Open app.

METHODS

Floodlight Open is a global, open-access, digital-only study designed to understand the drivers and barriers in deploying a DHTT in a naturalistic setting without supervision and onboarding by a clinician. Daily activities included tests assessing cognition (Information Processing Speed and Information Processing Speed Digit-Digit), hand-motor function (Pinching Test and Draw a Shape Test), and postural stability and gait (Static Balance Test, U-Turn Test, and Two-Minute Walk Test [2MWT]). All daily activities except the 2MWT were taken in a fixed sequence. Qualitative UX was studied through semistructured interviews in a substudy of US participants with MS. The quantitative UX analysis investigated the impact of new UX design features on user engagement and retention in US participants for 3 separate test series: all daily activities included in the fixed sequence (DA), all daily activities included in the fixed sequence except the Static Balance Test and U-Turn Test (DAx), and the 2MWT.

RESULTS

The qualitative UX substudy (N=22) revealed the need for 2 new UX design features: a more seamless user journey during the activation process that eliminates the requirement of switching back and forth between the app and the email that the participants received upon registration, and configurable reminders and push notifications to help plan and remind the participants to complete their daily activities. Both UX design features were assessed in the quantitative UX analysis. Introducing the more seamless user journey (original user journey: n=608; more seamless user journey: n=481) improved the conversion rate of participants who enrolled in the study and proceeded to successfully activate the app from 53.9% (328/608) to 74.6% (359/481). Introducing reminders and push notifications (with reminders and notifications: n=350; without reminders and notifications: n=172) improved continuous usage time (proportion of participants with ≥3 consecutive days of usage: DA and DAx: ~30% vs ~12%; 2MWT: ~30% vs ~20%); test completion rates (maximum number of test series completed: DA: 279 vs 64; DAx: 283 vs 126; 2MWT: 302 vs 76); and user retention rates (at day 30: DA: 53/172, 30.8% vs 34/350, 9.7%; DAx: 53/172, 30.8% vs 60/350, 17.1%; 2MWT: 39/172, 22.6% vs 22/350, 6.2%). Inactivity times remained comparable.

CONCLUSIONS

The remote assessment of MS with DHTTs is a relatively nascent but growing field of research. The continued assessment and improvement of UX design features can play a crucial role in the successful long-term adoption of new DHTTs.

Informing the development of a mobile application for the physical activity guidelines in multiple sclerosis: a qualitative, pluralistic approach

PURPOSE

The uptake of Physical Activity Guidelines (PAGs) for adults with multiple sclerosis (MS) may be facilitated through mHealth solutions such as a mobile app. To date, there is limited information regarding preferred features of an app for people with MS. We explored desired features for an app that supports physical activity behaviour among persons with MS.

MATERIALS AND METHODS

Using a pluralistic analytical approach, we conducted a secondary qualitative analysis on a portion of data collected from an earlier study to explore (i) what persons with MS wanted in an app based on the PAGs and (ii) how the PAG-based app should facilitate behaviour change. The data were subjected to deductive, content analysis to identify populous mentions of desired PAG-based app elements. We then used inductive, semantic reflexive thematic analysis to further explore the opinions and evaluations of participants.

RESULTS

Participants (n = 16) perceived features such as activity tracking, incentives for completing milestones, and customization as both triggers for doing PA and supporting engagement with the app. Participants desired a personalized PA prescription based on mobility and fitness level, expert feedback based on data entered in the app, and an exercise library with a range of evidence-based content. Participants insisted the app be backed by a solid scientific foundation and that accessibility of personal data be controlled by the user.

CONCLUSIONS

This study identifies several design considerations for an app based on the PAGs. The results suggest a simple, trustworthy, and evidence-based app that focuses on helping persons with MS reach the PAGs.

Tablet app-based dexterity training in multiple sclerosis (TAD-MS): a randomized controlled trial

PURPOSE

Mobile health applications (mHealth apps) may lead to health benefits. In recent years, the use of apps in multiple sclerosis (MS) has increased. Apps to train and improve dexterity in MS are scarce. This study investigated the effectiveness of a tablet app-based home-based training to improve dexterity in individuals with MS.

MATERIALS AND METHODS

In a randomized controlled trial, two standardized 4-week home-based interventions focussing on different aspects of dexterity and upper limb function were compared. Assessments were done at baseline, post-intervention and 12-week follow-up. The primary endpoint was the Arm Function in Multiple Sclerosis Questionnaire, a dexterity-related measure of patient-reported activities of daily living. Secondary endpoints were dexterous function, grip strength and health-related quality of life.

RESULTS

Forty-eight individuals were randomly assigned to a tablet app-based program (n = 26) or a control strengthening exercise program (n = 22). No significant differences were found for the primary endpoint (p = 0.35). Some significant differences in favour of the app-group were found in fine coordinated finger movements and strength. No significant differences were found at the 12-week follow-up for all endpoints. Adherence in both groups was above 90%.

CONCLUSIONS

App-based training was not superior compared to a control strengthening exercise program concerning the arm- and hand function from the participant's perspective. However, app-based training was found to be effective in improving specific dimensions (finger movements and strength), and can easily be applied at home. Therefore, individuals living with MS with impaired dexterity should consider app-based training.

CLINICAL TRIAL REGISTRATION

Clinicaltrials.gov NCT03369470.

Identifying app components that promote physical activity: a group concept mapping study

Background

Digital interventions are a promising avenue to promote physical activity in healthy adults. Current practices recommend to include end-users early on in the development process. This study focuses on the wishes and needs of users regarding an a mobile health (mHealth) application that promotes physical activity in healthy adults, and on the differences between participants who do or do not meet the World Health Organization's recommendation of an equivalent of 150 minutes of moderate intensity physical activity.

Methods

We used a mixed-method design called Group Concept Mapping. In a first phase, we collected statements completing the prompt "In an app that helps me move more, I would like to see/ do/ learn the following…" during four brainstorming sessions with physically inactive individuals (n = 19). The resulting 90 statements were then sorted and rated by a new group of participants (n = 46). Sorting data was aggregated, and (dis)similarity matrices were created using multidimensional scaling. Hierarchical clustering was applied using Ward's method. Analyses were carried out for the entire group, a subgroup of active participants and a subgroup of inactive participants. Explorative analyses further investigated ratings of the clusters as a function of activity level, gender, age and education.

Results

Six clusters of statements were identified, namely 'Ease-of-use and Self-monitoring', 'Technical Aspects and Advertisement', 'Personalised Information and Support', 'Motivational Aspects', 'Goal setting, goal review and rewards', and 'Social Features'. The cluster 'Ease-of-use and Self-monitoring' was rated highest in the overall group and the active subgroup, whereas the cluster 'Technical Aspects and Advertisement' was scored as most relevant in the inactive subgroup. For all groups, the cluster 'Social Features' was scored the lowest. Explorative analysis revealed minor between-group differences.

Discussion

The present study identified priorities of users for an mHealth application that promotes physical activity. First, the application should be user-friendly and accessible. Second, the application should provide personalized support and information. Third, users should be able to monitor their behaviour and compare their current activity to their past performance. Fourth, users should be provided autonomy within the app, such as over which and how many notifications they would like to receive, and whether or not they want to engage with social features. These priorities can serve as guiding principles for developing mHealth applications to promote physical activity in the general population.

Experiences With Mobile Health-Enabled Ambulatory Monitoring Among Stroke Survivors: A Qualitative Study

Inquiring into the experiences of stroke survivors toward ambulatory monitoring is crucial for optimizing user adoption, design, implementation, and sustainability of ambulatory monitoring in the stroke population. This study was aimed to identify facilitators and barriers for ambulatory monitoring among stroke survivors, as well as their suggestions for development and implementation of ambulatory monitoring. We conducted individual semi-structured interviews with 40 stroke survivors who received ambulatory monitoring. The interviews were analyzed using thematic content analysis. Six themes about facilitators associated with ambulatory monitoring emerged: (1) user support, (2) technological features, (3) convenience, (4) personal strategies, (5)social influence, and (6)time commitment. Three themes about barriers to using ambulatory monitoring emerged: (1) personal factors, (2) functionality, (3) study design. Three themes about suggestions emerged: (1) personalization, (2) functionality, and (3) interactive feedback. As mobile health technology is becoming more popular, the findings of this study provide timely implications and practical considerations for ambulatory monitoring in the stroke population.

Cocreating an Automated mHealth Apps Systematic Review Process With Generative AI: Design Science Research Approach

BACKGROUND

The use of mobile devices for delivering health-related services (mobile health [mHealth]) has rapidly increased, leading to a demand for summarizing the state of the art and practice through systematic reviews. However, the systematic review process is a resource-intensive and time-consuming process. Generative artificial intelligence (AI) has emerged as a potential solution to automate tedious tasks.

OBJECTIVE

This study aimed to explore the feasibility of using generative AI tools to automate time-consuming and resource-intensive tasks in a systematic review process and assess the scope and limitations of using such tools.

METHODS

We used the design science research methodology. The solution proposed is to use cocreation with a generative AI, such as ChatGPT, to produce software code that automates the process of conducting systematic reviews.

RESULTS

A triggering prompt was generated, and assistance from the generative AI was used to guide the steps toward developing, executing, and debugging a Python script. Errors in code were solved through conversational exchange with ChatGPT, and a tentative script was created. The code pulled the mHealth solutions from the Google Play Store and searched their descriptions for keywords that hinted toward evidence base. The results were exported to a CSV file, which was compared to the initial outputs of other similar systematic review processes.

CONCLUSIONS

This study demonstrates the potential of using generative AI to automate the time-consuming process of conducting systematic reviews of mHealth apps. This approach could be particularly useful for researchers with limited coding skills. However, the study has limitations related to the design science research methodology, subjectivity bias, and the quality of the search results used to train the language model.

A Brain Computer Interface Neuromodulatory Device for Stroke Rehabilitation: Iterative User-Centered Design Approach

BACKGROUND

Rehabilitation technologies for people with stroke are rapidly evolving. These technologies have the potential to support higher volumes of rehabilitation to improve outcomes for people with stroke. Despite growing evidence of their efficacy, there is a lack of uptake and sustained use in stroke rehabilitation and a call for user-centered design approaches during technology design and development. This study focuses on a novel rehabilitation technology called exciteBCI, a complex neuromodulatory wearable technology in the prototype stage that augments locomotor rehabilitation for people with stroke. The exciteBCI consists of a brain computer interface, a muscle electrical stimulator, and a mobile app.

OBJECTIVE

This study presents the evaluation phase of an iterative user-centered design approach supported by a qualitative descriptive methodology that sought to (1) explore users' perspectives and experiences of exciteBCI and how well it fits with rehabilitation, and (2) facilitate modifications to exciteBCI design features.

METHODS

The iterative usability evaluation of exciteBCI was conducted in 2 phases. Phase 1 consisted of 3 sprint cycles consisting of single usability sessions with people with stroke (n=4) and physiotherapists (n=4). During their interactions with exciteBCI, participants used a "think-aloud" approach, followed by a semistructured interview. At the end of each sprint cycle, device requirements were gathered and the device was modified in preparation for the next cycle. Phase 2 focused on a "near-live" approach in which 2 people with stroke and 1 physiotherapist participated in a 3-week program of rehabilitation augmented by exciteBCI (n=3). Participants completed a semistructured interview at the end of the program. Data were analyzed from both phases using conventional content analysis.

RESULTS

Overall, participants perceived and experienced exciteBCI positively, while providing guidance for iterative changes. Five interrelated themes were identified from the data: (1) "This is rehab" illustrated that participants viewed exciteBCI as having a good fit with rehabilitation practice; (2) "Getting the most out of rehab" highlighted that exciteBCI was perceived as a means to enhance rehabilitation through increased engagement and challenge; (3) "It is a tool not a therapist," revealed views that the technology could either enhance or disrupt the therapeutic relationship; and (4) "Weighing up the benefits versus the burden" and (5) "Don't make me look different" emphasized important design considerations related to device set-up, use, and social acceptability.

CONCLUSIONS

This study offers several important findings that can inform the design and implementation of rehabilitation technologies. These include (1) the design of rehabilitation technology should support the therapeutic relationship between the patient and therapist, (2) social acceptability is a design priority in rehabilitation technology but its importance varies depending on the use context, and (3) there is value in using design research methods that support understanding usability in the context of sustained use.

Implementation of Remote Activity Sensing to Support a Rehabilitation Aftercare Program: Observational Mixed Methods Study With Patients and Health Care Professionals

BACKGROUND

Physical activity is central to maintaining the quality of life for patients with complex chronic conditions and is thus at the core of neurorehabilitation. However, maintaining activity improvements in daily life is challenging. The novel Stay With It program aims to promote physical activity after neurorehabilitation by cultivating self-monitoring skills and habits.

OBJECTIVE

We examined the implementation of the Stay With It program at the Valens Rehabilitation Centre in Switzerland using the normalization process theory framework, focusing on 3 research aims. We aimed to examine the challenges and facilitators of program implementation from the perspectives of patients and health care professionals. We aimed to evaluate the potential of activity sensors to support program implementation and patient acceptance. Finally, we aimed to evaluate patients' engagement in physical activity after rehabilitation, patients' self-reported achievement of home activity goals, and factors influencing physical activity.

METHODS

Patients were enrolled if they had a disease that was either chronic or at risk for chronicity and participated in the Stay With It program. Patients were assessed at baseline, the end of rehabilitation, and a 3-month follow-up. The health care professionals designated to deliver the program were surveyed before and after program implementation. We used a mixed methods approach combining standardized questionnaires, activity-sensing data (patients only), and free-text questions.

RESULTS

This study included 23 patients and 13 health care professionals. The diverse needs of patients and organizational hurdles were major challenges to program implementation. Patients' intrinsic motivation and health care professionals' commitment to refining the program emerged as key facilitators. Both groups recognized the value of activity sensors in supporting program implementation and sustainability. Although patients appreciated the sensor's ability to monitor, motivate, and quantify activity, health care professionals saw the sensor as a motivational tool but expressed concerns about technical difficulties and potential inaccuracies. Physical activity levels after patients returned home varied considerably, both within and between individuals. The self-reported achievement of activity goals at home also varied, in part because of vague definitions. Common barriers to maintaining activity at home were declining health and fatigue often resulting from heat and pain. At the 3-month follow-up, 35% (8/23) of the patients withdrew from the study, with most citing deteriorating physical health as the reason and that monitoring and discussing their low activity would negatively affect their mental health.

CONCLUSIONS

Integrating aftercare programs like Stay With It into routine care is vital for maintaining physical activity postrehabilitation. Although activity trackers show promise in promoting motivation through monitoring, they may lead to frustration during health declines. Their acceptability may also be influenced by an individual's health status, habits, and technical skills. Our study highlights the importance of considering health care professionals' perspectives when integrating new interventions into routine care.

A Proposal for a Robust Validated Weighted General Data Protection Regulation-Based Scale to Assess the Quality of Privacy Policies of Mobile Health Applications: An eDelphi Study

BACKGROUND

Health care services are undergoing a digital transformation in which the Participatory Health Informatics field has a key role. Within this field, studies aimed to assess the quality of digital tools, including mHealth apps, are conducted. Privacy is one dimension of the quality of an mHealth app. Privacy consists of several components, including organizational, technical, and legal safeguards. Within legal safeguards, giving transparent information to the users on how their data are handled is crucial. This information is usually disclosed to users through the privacy policy document. Assessing the quality of a privacy policy is a complex task and several scales supporting this process have been proposed in the literature. However, these scales are heterogeneous and even not very objective. In our previous study, we proposed a checklist of items guiding the assessment of the quality of an mHealth app privacy policy, based on the General Data Protection Regulation.

OBJECTIVE

To refine the robustness of our General Data Protection Regulation-based privacy scale to assess the quality of an mHealth app privacy policy, to identify new items, and to assign weights for every item in the scale.

METHODS

A two-round modified eDelphi study was conducted involving a privacy expert panel.

RESULTS

After the Delphi process, all the items in the scale were considered "important" or "very important" (4 and 5 in a 5-point Likert scale, respectively) by most of the experts. One of the original items was suggested to be reworded, while eight tentative items were suggested. Only two of them were finally added after Round 2. Eleven of the 16 items in the scale were considered "very important" (weight of 1), while the other 5 were considered "important" (weight of 0.5).

CONCLUSION

The Benjumea privacy scale is a new robust tool to assess the quality of an mHealth app privacy policy, providing a deeper and complementary analysis to other scales. Also, this robust scale provides a guideline for the development of high-quality privacy policies of mHealth apps.

An Exploratory Study on the Utility of Patient-Generated Health Data as a Tool for Health Care Professionals in Multiple Sclerosis Care

BACKGROUND

Patient-generated health data (PGHD) are data collected through technologies such as mobile devices and health apps. The integration of PGHD into health care workflows can support the care of chronic conditions such as multiple sclerosis (MS). Patients are often willing to share data with health care professionals (HCPs) in their care team; however, the benefits of PGHD can be limited if HCPs do not find it useful, leading patients to discontinue data tracking and sharing eventually. Therefore, understanding the usefulness of mobile health (mHealth) solutions, which provide PGHD and serve as enablers of the HCPs' involvement in participatory care, could motivate them to continue using these technologies.

OBJECTIVE

The objective of this study is to explore the perceived utility of different types of PGHD from mHealth solutions which could serve as tools for HCPs to support participatory care in MS.

METHOD

A mixed-methods approach was used, combining qualitative research and participatory design. This study includes three sequential phases: data collection, assessment of PGHD utility, and design of data visualizations. In the first phase, 16 HCPs were interviewed. The second and third phases were carried out through participatory workshops, where PGHD types were conceptualized in terms of utility.

RESULTS

The study found that HCPs are optimistic about PGHD in MS care. The most useful types of PGHD for HCPs in MS care are patients' habits, lifestyles, and fatigue-inducing activities. Although these subjective data seem more useful for HCPs, it is more challenging to visualize them in a useful and actionable way.

CONCLUSION

HCPs are optimistic about mHealth and PGHD as tools to further understand their patients' needs and support care in MS. HCPs from different disciplines have different perceptions of what types of PGHD are useful; however, subjective types of PGHD seem potentially more useful for MS care.

Ethical, Legal, Organisational and Social Issues of Teleneurology: A Scoping Review

BACKGROUND

Neurological disorders are the leading cause of disability and the second leading cause of death worldwide. Teleneurology (TN) allows neurology to be applied when the doctor and patient are not present in the same place, and sometimes not at the same time. In February 2021, the Spanish Ministry of Health requested a health technology assessment report on the implementation of TN as a complement to face-to-face neurological care.

METHODS

A scoping review was conducted to answer the question on the ethical, legal, social, organisational, patient (ELSI) and environmental impact of TN. The assessment of these aspects was carried out by adapting the EUnetHTA Core Model 3.0 framework, the criteria established by the Spanish Network of Health Technology Assessment Agencies and the analysis criteria of the European Validate (VALues In Doing Assessments of healthcare TEchnologies) project. Key stakeholders were invited to discuss their concerns about TN in an online meeting. Subsequently, the following electronic databases were consulted from 2016 to 10 June 2021: MEDLINE and EMBASE.

RESULTS

79 studies met the inclusion criteria. This scoping review includes 37 studies related to acceptability and equity, 15 studies developed during COVID and 1 study on environmental aspects. Overall, the reported results reaffirm the necessary complementarity of TN with the usual face-to-face care.

CONCLUSIONS

This need for complementarity relates to factors such as acceptability, feasibility, risk of dehumanisation and aspects related to privacy and the confidentiality of sensitive data.

Factors that influence the provision of home-based rehabilitation services for people needing rehabilitation: a qualitative evidence synthesis

BACKGROUND

To increase people's access to rehabilitation services, particularly in the context of the COVID-19 pandemic, we need to explore how the delivery of these services can be adapted. This includes the use of home-based rehabilitation and telerehabilitation. Home-based rehabilitation services may become frequently used options in the recovery process of patients, not only as a solution to accessibility barriers, but as a complement to the usual in-person inpatient rehabilitation provision. Telerehabilitation is also becoming more viable as the usability and availability of communication technologies improve.

OBJECTIVES

To identify factors that influence the organisation and delivery of in-person home-based rehabilitation and home-based telerehabilitation for people needing rehabilitation.

SEARCH METHODS

We searched PubMed, Global Health, the VHL Regional Portal, Epistemonikos, Health Systems Evidence, and EBM Reviews as well as preprints, regional repositories, and rehabilitation organisations websites for eligible studies, from database inception to search date in June 2022.  SELECTION CRITERIA: We included studies that used qualitative methods for data collection and analysis; and that explored patients, caregivers, healthcare providers and other stakeholders' experiences, perceptions and behaviours about the provision of in-person home-based rehabilitation and home-based telerehabilitation services responding to patients' needs in different phases of their health conditions.   DATA COLLECTION AND ANALYSIS: We used a purposive sampling approach and applied maximum variation sampling in a four-step sampling frame. We conducted a framework thematic analysis using the CFIR (Consolidated Framework for Implementation Research) framework as our starting point. We assessed our confidence in the findings using the GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) approach.  MAIN RESULTS: We included 223 studies in the review and sampled 53 of these for our analysis. Forty-five studies were conducted in high-income countries, and eight in low-and middle-income countries. Twenty studies addressed in-person home-based rehabilitation, 28 studies addressed home-based telerehabilitation services, and five studies addressed both modes of delivery. The studies mainly explored the perspectives of healthcare providers, patients with a range of different health conditions, and their informal caregivers and family members.  Based on our GRADE-CERQual assessments, we had high confidence in eight of the findings, and moderate confidence in five, indicating that it is highly likely or likely respectively that these findings are a reasonable representation of the phenomenon of interest. There were two findings with low confidence. High and moderate confidence findings Home-based rehabilitation services delivered in-person or through telerehabilitation  Patients experience home-based services as convenient and less disruptive of their everyday activities. Patients and providers also suggest that these services can encourage patients' self-management and can make them feel empowered about the rehabilitation process. But patients, family members, and providers describe privacy and confidentiality issues when services are provided at home. These include the increased privacy of being able to exercise at home but also the loss of privacy when one's home life is visible to others.  Patients and providers also describe other factors that can affect the success of home-based rehabilitation services. These include support from providers and family members, good communication with providers, the requirements made of patients and their surroundings, and the transition from hospital to home-based services. Telerehabilitation specifically Patients, family members and providers see telerehabilitation as an opportunity to make services more available. But providers point to practical problems when assessing whether patients are performing their exercises correctly. Providers and patients also describe interruptions from family members.  In addition, providers complain of a lack of equipment, infrastructure and maintenance and patients refer to usability issues and frustration with digital technology. Providers have different opinions about whether telerehabilitation is cost-efficient for them. But many patients see telerehabilitation as affordable and cost-saving if the equipment and infrastructure have been provided. Patients and providers suggest that telerehabilitation can change the nature of their relationship. For instance, some patients describe how telerehabilitation leads to easier and more relaxed communication. Other patients describe feeling abandoned when receiving telerehabilitation services.  Patients, family members and providers call for easy-to-use technologies and more training and support. They also suggest that at least some in-person sessions with the provider are necessary. They feel that telerehabilitation services alone can make it difficult to make meaningful connections. They also explain that some services need the provider's hands. Providers highlight the importance of personalising the services to each person's needs and circumstances.

AUTHORS' CONCLUSIONS

This synthesis identified several factors that can influence the successful implementation of in-person home-based rehabilitation and telerehabilitation services. These included factors that facilitate implementation, but also factors that can challenge this process. Healthcare providers, program planners and policymakers might benefit from considering these factors when designing and implementing programmes.

Non-equivalent, but still valid: Establishing the construct validity of a consumer fitness tracker in persons with multiple sclerosis

Tools for monitoring daily physical activity (PA) are desired by persons with multiple sclerosis (MS). However, current research-grade options are not suitable for longitudinal, independent use due to their cost and user experience. Our objective was to assess the validity of step counts and PA intensity metrics derived from the Fitbit Inspire HR, a consumer-grade PA tracker, in 45 persons with MS (Median age: 46, IQR: 40-51) undergoing inpatient rehabilitation. The population had moderate mobility impairment (Median EDSS 4.0, Range 2.0-6.5). We assessed the validity of Fitbit-derived PA metrics (Step count, total time in PA, time in moderate to vigorous PA (MVPA)) during scripted tasks and free-living activity at three levels of data aggregation (minute, daily, and average PA). Criterion validity was assessed though agreement with manual counts and multiple methods for deriving PA metrics via the Actigraph GT3X. Convergent and known-groups validity were assessed via relationships with reference standards and related clinical measures. Fitbit-derived step count and time in PA, but not time in MVPA, exhibited excellent agreement with reference measures during scripted tasks. During free-living activity, step count and time in PA correlated moderately to strongly with reference measures, but agreement varied across metrics, data aggregation levels, and disease severity strata. Time in MVPA weakly agreed with reference measures. However, Fitbit-derived metrics were often as different from reference measures as reference measures were from each other. Fitbit-derived metrics consistently exhibited similar or stronger evidence of construct validity than reference standards. Fitbit-derived PA metrics are not equivalent to existing reference standards. However, they exhibit evidence of construct validity. Consumer-grade fitness trackers such as the Fitbit Inspire HR may therefore be suitable as a PA tracking tool for persons with mild or moderate MS.

Experiences of health tracking in mobile apps for multiple sclerosis: A qualitative content analysis of user reviews

BACKGROUND

Mobile health applications (apps) are promising condition self-management tools for people living with multiple sclerosis (MS). However, most existing apps do not include health tracking features. This gap has been raised as a priority research topic, but the development of new self-management apps will require designers to understand the context and needs of those living with MS. Our aim was to conduct a content analysis of publicly available user reviews of existing MS self-management apps to understand desired features and guide the design of future apps.

METHODS

We systematically reviewed MS self-management apps which were publicly available in English on the Google Play and iOS app stores. We then conducted sentiment and content analysis of recent user reviews which referenced health tracking and data visualization to understand self-reported experiences and feedback.

RESULTS

Searches identified 75 unique apps, of which six met eligibility criteria and had reviews. One hundred and thirty-seven user reviews of these apps were eligible, though most were associated with a single app (n=108). Overall, ratings and sentiment scores skewed highly positive (Median [IQR]: Ratings - 5 [4-5], Sentiment scores - 0.70 [0.44-0.86]), though scores of individual apps varied. Content analysis revealed five themes: reasons for app usage, simple user experience, customization and flexibility, feature requests, and technical issues. Reviewers suggested that app customization, interconnectivity, and consolidated access to desired features should be considered in the design of future apps. User ratings weakly correlated with review sentiment scores (ρ = 0.27 [0.11-0.42]).

CONCLUSIONS

Self-tracking options in MS apps are currently limited, though the apps that offer these functions are considered useful by individuals with MS. Additional qualitative research is required to understand how specific app features and opportunities for personalization should be incorporated into new self-management tools for this population.

Feasibility and scalability of a fitness tracker study: Results from a longitudinal analysis of persons with multiple sclerosis

Background

Consumer-grade fitness trackers offer exciting opportunities to study persons with chronic diseases in greater detail and in their daily-life environment. However, attempts to bring fitness tracker measurement campaigns from tightly controlled clinical environments to home settings are often challenged by deteriorating study compliance or by organizational and resource limitations.

Objectives

By revisiting the study design and patient-reported experiences of a partly remote study with fitness trackers (BarKA-MS study), we aimed to qualitatively explore the relationship between overall study compliance and scalability. On that account, we aimed to derive lessons learned on strengths, weaknesses, and technical challenges for the conduct of future studies.

Methods

The two-phased BarKA-MS study employed Fitbit Inspire HR and electronic surveys to monitor physical activity in 45 people with multiple sclerosis in a rehabilitation setting and in their natural surroundings at home for up to 8 weeks. We examined and quantified the recruitment and compliance in terms of questionnaire completion and device wear time. Furthermore, we qualitatively evaluated experiences with devices according to participants' survey-collected reports. Finally, we reviewed the BarKA-MS study conduct characteristics for its scalability according to the Intervention Scalability Assessment Tool checklist.

Results

Weekly electronic surveys completion reached 96%. On average, the Fitbit data revealed 99% and 97% valid wear days at the rehabilitation clinic and in the home setting, respectively. Positive experiences with the device were predominant: only 17% of the feedbacks had a negative connotation, mostly pertaining to perceived measurement inaccuracies. Twenty-five major topics and study characteristics relating to compliance were identified. They broadly fell into the three categories: "effectiveness of support measures", "recruitment and compliance barriers", and "technical challenges". The scalability assessment revealed that the highly individualized support measures, which contributed greatly to the high study compliance, may face substantial scalability challenges due to the strong human involvement and limited potential for standardization.

Conclusion

The personal interactions and highly individualized participant support positively influenced study compliance and retention. But the major human involvement in these support actions will pose scalability challenges due to resource limitations. Study conductors should anticipate this potential compliance-scalability trade-off already in the design phase.

A mobile app (IDoThis) for multiple sclerosis self-management: development and initial evaluation

BACKGROUND

Multiple sclerosis (MS) is one of the most common neurological disorders worldwide, and self-management is considered an essential dimension in its control. This study aimed to develop an evidence-based mobile application for MS self-management and evaluate it.

METHODS

This study was undertaken in three phases: content preparation, design, and evaluation. In the content preparation phase, the researchers extracted MS self-management needs based on related guidelines and guides, existing apps on the self-management of MS, and the field experts' views and confirmation. The design phase was conducted in five steps: defining app functionalities, depicting the wireframe, preparing the media, coding the app, and testing the app's performance. The app was developed using the Android Studio environment and Java programming language for the Android operating system. The performance of the developed app was tested separately in several turns, and existing defects were corrected in each turn. Finally, after using the app for three weeks, the app was evaluated for its short-term impact on MS management and user-friendliness using a researcher-constructed questionnaire from participants' (N = 20) perspectives.

RESULTS

The IDoThis app is an offline app for people with MS that includes five main modules: three modules for training or informing users about different aspects of MS, one module for monitoring the user's MS condition, and a reporting module. In the initial evaluation of the app, 75% (n = 15) of participants mentioned that using this app improved MS self-management status at intermediate and higher levels, but 25% (n = 5) of the participants mentioned that the effect of using the app on the self-management tasks was low or was very low. The majority of users rated the user-friendliness of the app as high. The users found the sections "exercises in MS" and "monitoring of MS status" beneficial to their self-management. Still, the fatigue and sleep management sections are needed to meet users' expectations.

CONCLUSION

Using IDoThis app as a self-management tool for individuals with MS appears feasible, that can meet the need for a free and accessible self-management tool for individuals with MS. Future directions should consider the users' fatigue and sleep management expectations.

Communication between persons with multiple sclerosis and their health care providers: A scoping review

OBJECTIVES

This study undertakes a scoping review of research about communication between persons with MS and their health care providers.

DESIGN

PubMed, PsycInfo, Communication Source, Socindex, Sociological Abstracts, Cinahl, and Proquest Dissertations and Theses were used to identify studies since each database's inception. Research team members engaged in study selection, coding for communication issues, and data extraction for descriptive information.

RESULTS

Of the 419 empirical articles identified, 175 were included. Codes represented all elements of ecological and pathway models, emphasizing emerging technologies for facilitating communication, uncertainty and anxiety for persons with MS, and communication issues surrounding diagnosis, information seeking, and decision making.

CONCLUSION

This review synthesizes and organizes influences on communication, communication processes, and health outcomes of communication for persons with MS and their providers. Findings extend the ecological model with illness context and the pathway model with communication breakdowns and provider outcomes.

PRACTICE IMPLICATIONS

Health care providers should consider the complexity of communication when interacting with persons with MS, including the larger context in which it occurs, communication processes and their purposes, and short-term and long-term consequences of interactions. Ecological and pathway models can be frameworks for developing educational materials, as they succinctly capture key communication issues and outcomes.

Do people with multiple sclerosis perceive upper limb improvements from robotic-mediated therapy? A mixed methods study

BACKGROUND

Robot-mediated training is increasingly considered as a rehabilitation intervention targeting upper limb disability. However, experiences of such an intervention have been rarely explored in the multiple sclerosis population. This mixed methods study sought to explore the impact of an eight week upper limb robotic intervention on experiences of people with multiple sclerosis.

METHODS

Eleven participants (Median EDSS- score: 6.5) with moderate to severe upper limb impairment, performed eight week robot- mediated training of the most affected arm. The training involved a virtual learning platform called I-TRAVLE with duration of 30 min per training session, twice to three times per week. Two subjective questionnaires with items from the Intrinsic Motivation Inventory (IMI) and Credibility and Expectancy Questionnaire (CEQ) were collected bi-weekly during the intervention. Approximately one month after completing the training, three focus groups were conducted. Main themes were identified using thematic analysis.

RESULTS

Results from the IMI and CEQ indicated high patient satisfaction and expectation that the intervention will be beneficial for them. Two main themes were identified: (1) Effect of the intervention on impairment and activity in that participants felt that there was a positive impact of the training on strength, endurance and during activities of daily living and that it met their expectations; (2) Experiences based on system usage from the system in that participants expressed feelings of motivation and self-improvement. The participants also perceived the training as enjoyable and concluded that the use of games instigated a competitive spirit between the participants.

CONCLUSIONS

Robot-mediated training could have a motivating effect and induce a general positive experience while reducing disabilities of people with multiple sclerosis.

Real-time tracking and detection of patient conditions in the intelligent m-Health monitoring system

In order to help patients monitor their personal health in real time, this paper proposes an intelligent mobile health monitoring system and establishes a corresponding health network to track and process patients' physical activity and other health-related factors in real time. Performance was analyzed. The experimental results show that after comparing the accuracy, delay time, error range, efficiency, and energy utilization of Im-HMS and existing UCD systems, it is found that the accuracy of Im-HMS is mostly between 98 and 100%, while the accuracy of UCD is mostly between 98 and 100%. Most of the systems are between 91 and 97%; in terms of delay comparison, the delay of the Im-HMS system is between 18 and 39 ms, which is far lower than the lowest value of the UCD system of 84 ms, and the Im-HMS is significantly better than the existing UCD system; the error range of Im-HMS is mainly between 0.2 and 1.4, while the error range of UCD system is mainly between -2 and 14; and in terms of efficiency and energy utilization, Im-HMS values are higher than those of UCD system. In general, the Im-HMS system proposed in this study is more accurate than UCD system and has lower delay, smaller error, and higher efficiency, and energy utilization is more efficient than UCD system, which is of great significance for mobile health monitoring in practical applications.

Patient Work Personas of Type 2 Diabetes—A Data-Driven Approach to Persona Development and Validation

Introduction

Many have argued that a “one-size-fits-all” approach to designing digital health is not optimal and that personalisation is essential to achieve targeted outcomes. Yet, most digital health practitioners struggle to identify which design aspect require personalisation. Personas are commonly used to communicate patient needs in consumer-oriented digital health design, however there is often a lack of reproducible clarity on development process and few attempts to assess their accuracy against the targeted population. In this study, we present a transparent approach to designing and validating personas, as well as identifying aspects of “patient work,” defined as the combined total of work tasks required to manage one's health and the contextual factors influencing such tasks, that are sensitive to an individual's context and may require personalisation.

Methods

A data-driven approach was used to develop and validate personas for people with Type 2 diabetes mellitus (T2DM), focusing on patient work. Eight different personas of T2DM patient work were constructed based physical activity, dietary control and contextual influences of 26 elderly Australian participants (median age = 72 years) via wearable camera footage, interviews, and self-reported diaries. These personas were validated for accuracy and perceived usefulness for design, both by the original participants and a younger (median age bracket = 45–54 years) independent online cohort f 131 T2DM patients from the United Kingdom and the United States.

Results

Both the original participants and the independent online cohort reported the personas to be accurate representations of their patient work routines. For the independent online cohort, 74% (97/131) indicated personas stratified to their levels of exercise and diet control were similar to their patient work routines. Findings from both cohorts highlight aspects that may require personalisation include daily routine, use of time, and social context.

Conclusion

Personas made for a specific purpose can be very accurate if developed from real-life data. Our personas retained their accuracy even when tested against an independent cohort, demonstrating their generalisability. Our data-driven approach clarified the often non-transparent process of persona development and validation, suggesting it is possible to systematically identify whether persona components are accurate or. and which aspects require more personalisation and tailoring.

Data Visualization for Chronic Neurological and Mental Health Condition Self-management: Systematic Review of User Perspectives

BACKGROUND

Remote measurement technologies (RMT) such as mobile health devices and apps are increasingly used by those living with chronic neurological and mental health conditions. RMT enables real-world data collection and regular feedback, providing users with insights about their own conditions. Data visualizations are an integral part of RMT, although little is known about visualization design preferences from the perspectives of those living with chronic conditions.

OBJECTIVE

The aim of this review was to explore the experiences and preferences of individuals with chronic neurological and mental health conditions on data visualizations derived from RMT to manage health.

METHODS

In this systematic review, we searched peer-reviewed literature and conference proceedings (PubMed, IEEE Xplore, EMBASE, Web of Science, Association for Computing Machinery Computer-Human Interface proceedings, and the Cochrane Library) for original papers published between January 2007 and September 2021 that reported perspectives on data visualization of people living with chronic neurological and mental health conditions. Two reviewers independently screened each abstract and full-text article, with disagreements resolved through discussion. Studies were critically appraised, and extracted data underwent thematic synthesis.

RESULTS

We identified 35 eligible publications from 31 studies representing 12 conditions. Coded data coalesced into 3 themes: desire for data visualization, impact of visualizations on condition management, and visualization design considerations. Data visualizations were viewed as an integral part of users' experiences with RMT, impacting satisfaction and engagement. However, user preferences were diverse and often conflicting both between and within conditions.

CONCLUSIONS

When used effectively, data visualizations are valuable, engaging components of RMT. They can provide structure and insight, allowing individuals to manage their own health more effectively. However, visualizations are not "one-size-fits-all," and it is important to engage with potential users during visualization design to understand when, how, and with whom the visualizations will be used to manage health.

Digital Self-monitoring of Multiple Sclerosis: Interview Study With Dutch Health Care Providers on the Expected New Configuration of Roles and Responsibilities

Background

Digital self-monitoring allows patients to produce and share personal health data collected at home. This creates a novel situation in which health care providers and patients must engage in a reconfiguration of roles and responsibilities. Although existing research pays considerable attention to the perceptions of patients regarding digital self-monitoring, less attention has been paid to the needs, wishes, and concerns of health care providers. As several companies and public institutions are developing and testing digital self-monitoring at the time of writing, it is timely and relevant to explore how health care providers envision using these technologies in their daily work practices. Our findings can be considered in decision-making processes concerning the further development and implementation of digital self-monitoring.

Objective

This study aims to explore how health care providers envisage using smartphone apps for digital self-monitoring of multiple sclerosis (MS) in their daily work practices, with a particular focus on physician-patient communication and on how health care providers respond to self-monitoring data and delegate tasks and responsibilities to patients.

Methods

We conducted semistructured in-depth interviews with 14 MS health care providers: 4 neurologists, 7 MS specialist nurses, and 3 rehabilitation professionals. They are affiliated with 3 different hospitals in the Netherlands that will participate in a pilot study to assess the efficiency and effectiveness of a specific smartphone app for self-monitoring.

Results

The interviewed health care providers seemed willing to use these smartphone apps and valued the quantitative data they produce that can complement the narratives that patients provide during medical appointments. The health care providers primarily want to use digital self-monitoring via prescription, meaning that they want a standardized smartphone app and want to act as its gatekeepers. Furthermore, they envisioned delegating particular tasks and responsibilities to patients via digital self-monitoring, such as sharing data with the health care providers or acting on the data, if necessary. The health care providers expected patients to become more proactive in the management of their disease. However, they also acknowledged that not all patients are willing or able to use digital self-monitoring apps and were concerned about the potential psychological and emotional burden on patients caused by this technology.

Conclusions

Our findings show that health care providers envisage a particular type of patient empowerment and personalized health care in which tensions arise between health care providers acting as gatekeepers and patient autonomy, between patient empowerment and patient disempowerment, and between the weight given to quantitative objective data and that given to patients’ subjective experiences. In future research, it would be very interesting to investigate the actual experiences of health care providers with regard to digital self-monitoring to ascertain how the tensions mentioned in this paper play out in practice.

Addressing and evaluating health literacy in mHealth: a scoping review

BACKGROUND

Recent surveys have revealed many adults have basic or below basic health literacy, which is linked to medical errors, increased illness, and compromised public health. Health literacy as a concept is multi-faceted extending beyond the individual to include social structures and the context in which health information is being accessed. Delivering health information via mobile devices (mHealth) expands the amount of information available while presenting challenges to ensuring these materials are suitable for a variety of literacy needs. The aims of this study are to discover how health literacy is addressed and evaluated in mHealth app development.

METHODS

A scoping review of 5 peer-reviewed databases was conducted. Eligible articles were written in English, addressed general literacy or mHealth/digital/eHealth literacy, and collected literacy information in order to incorporate literacy into the design and/or modification of an app or collected literacy information to describe the population being studied. The "Health Literacy Online" (HLO) United States (U.S.) government guide was used as a framework.

RESULTS

Thirty-two articles were reviewed. Articles included health literacy recommendations for all HLO categories and some recommendations not aligned with these categories. Most articles addressed health literacy using specific HLO categories though none incorporated every HLO category. The most common categories addressed engagement and testing of mHealth content. Though several studies addressed health literacy through a formal assessment tool, most did not. Evaluation of health literacy in mHealth was end-user focused and did not extensively evaluate content for fit to a variety of individuals with limited health literacy.

CONCLUSIONS

The recommendations seen consistently in our results in conjunction with formal HLO categories can act as beginning steps towards development of a health literacy evaluation tool for mHealth apps themselves. It is clear efforts are being made to reduce barriers to using mHealth for those with literacy deficits, however, it was also clear that this space has room to be more pragmatic in evaluation of mHealth tools for literacy. End user engagement in design and testing is necessary in future mHealth literacy tool development.

The feasibility of an online educational lifestyle program for people with multiple sclerosis: A qualitative analysis of participant semi-structured interviews

Objective

To explore the feasibility of a randomised controlled trial of a multiple sclerosis online course (MSOC) via qualitative analysis of participant semi-structured interviews.

Methods

The MSOC was developed in two arms: intervention arm which contained evidence-based lifestyle modification recommendations, and standard-care arm which delivered information from MS websites reflecting standard advice. Participants were recruited via online advertisements, completed a baseline questionnaire, and randomised. Seven modules were delivered over six weeks. Course completers were invited to participate in semi-structured interviews. Within a qualitative paradigm, interviews were analysed using reflexive thematic analysis.

Results

Fourteen of the 17 course completers were interviewed: 86% (12/14) female; mean age 50 years; residing in Australia, New Zealand, and the USA, predominantly had relapsing-remitting MS, mean time from diagnosis 9.5 years, and patient-determined disease steps disability assessment distributed evenly across all three categories. Four themes were identified: 1) “Hearing our stories” (hope for the future, feeling represented, exploring the journey of others with MS, learning from diversity, and wanting to connect with others); 2) “Taking the plunge” (not wanting to be first, feelings of nervousness or reluctance and feeling confronted); 3) “The accessibility and safety of being online” (ease of access, going at your own pace, making it work and not letting others down); and 4) “unpacking the course” (ease of navigation, visuals, understandability, and length and timing).

Conclusion

Participants felt represented, found the course accessible and content was easy to understand. These experiences provide important insights and considerations for this digital health intervention.

Cognitive fatigability assessment test (cFAST): Development of a new instrument to assess cognitive fatigability and pilot study on its association to perceived fatigue in multiple sclerosis

Background

Fatigue is a common symptom of many diseases, including multiple sclerosis. It manifests as a cognitive or physical condition. Fatigue is poorly understood, and effective therapies are missing. Furthermore, there is a lack of methods to measure fatigue objectively. Fatigability, the measurable decline in performance during a task, has been suggested as a complementary method to quantify fatigue.

Objective

To develop a new and objective measurement of cognitive fatigability and investigate its association with perceived fatigue.

Methods

We introduced the cognitive fatigability assessment test (cFAST), a novel smartphone-based test to quantify cognitive fatigability. Forty-two people with multiple sclerosis (23 fatigued and 19 non-fatigued, defined by the Fatigue Scale for Motor and Cognitive Functions) took part in our validation study. Patients completed cFAST twice. We used t-tests, Monte Carlo sampling, and area under the receiver operating characteristic curves to evaluate our approach using two sets of proposed metrics.

Results

When classifying fatigue, our fatigability metric Δresponse time has a mean area under the receiver operating characteristic curve of 0.74 (95% CI 0.64–0.84), making it the best performing metric for this task. Furthermore, Δresponse time shows a statistically significant difference between the fatigued and non-fatigued groups (t = 2.27, P = .03). Particularly, cognitively-fatigued patients decline in performance, while non-fatigued patients do not.

Conclusions

We introduce cFAST, a new instrument to quantify cognitive fatigability. Our pilot study provides evidence that cognitive fatigability assessment test produces a quantifiable drop in cognitive performance in a short period. Furthermore, our results indicate that cFAST may have the potential to serve as a surrogate for subjective cognitive fatigue. cFAST is significantly shorter than the existing fatigability assessments and does not require specialized equipment. Thus, it could enable frequent and remote monitoring, which could substantially aid clinicians in better understanding and treating fatigue.

Creating a Digital Toolkit to Reduce Fatigue and Promote Quality of Life in Multiple Sclerosis: Participatory Design and Usability Study

Background

Fatigue is one of the most common and debilitating symptoms of multiple sclerosis (MS), experienced by more than 80% of people with MS. FACETS (Fatigue: Applying Cognitive Behavioral and Energy Effectiveness Techniques to Lifestyle) is an evidence-based, face-to-face, 6-session group fatigue management program for people with MS. Homework tasks are an integral part of FACETS and are currently undertaken in a paper-based form. Feedback from a consultation undertaken with FACETS attendees and health care professionals with experience in delivering the FACETS program suggested that being able to complete the homework tasks digitally would be desirable, potentially enhancing engagement and adherence and enabling on-the-go access to fit into busy lifestyles. Relative to other long-term conditions, there are few apps specifically for MS and, of those available, many have been developed with little or no input from people with MS.

Objective

The purpose of this mixed methods study was to create a digital toolkit comprising the homework tasks (eg, activity diary, goal planner, thought diary) of the FACETS program for people with MS, considering end users’ unique requirements throughout the design, build, prototyping, and testing stages.

Methods

Phase 1 involved the elicitation of detailed user requirements for the toolkit via 2 focus groups with previous attendees of FACETS (n=3 and n=6) and wireframing. Phase 2 involved supervised usability testing with people with MS (n=11) with iterative prototyping. The usability sessions involved going through test scenarios using the FACETS toolkit on an Android test phone with video capture and concurrent think-aloud followed by completion of the System Usability Scale (SUS) and a semistructured interview collecting feedback about design, content, and functionality.

Results

The mean SUS score for the digital toolkit was 74.3 (SD 16.8, 95% CI 63.2-85.6; range 37.5-95), which equates to an adjective rating of good and a B grade (70th-79th percentile range) on the Sauro-Lewis curved grading scale. A number of usability and design issues (such as simplifying overall screen flow to better meet users’ needs) and suggestions for improvements (such as using location-based services and displaying personalized information and progress via a central dashboard) were addressed and implemented during the usability testing cycle.

Conclusions

This work highlights the importance of the participation of people with MS across the entire development cycle, working to a human-centered design methodology to enable a considered and MS-centered solution to be developed. Continued horizon scanning for emergent technological enhancements will enable us to identify opportunities for further improvements to the FACETS toolkit prior to launch. The toolkit supports self-monitoring and management of fatigue and has potential applicability to other long-term conditions where fatigue is a significant issue.

An Electronic Patient-Reported Outcome Mobile App for Data Collection in Type A Hemophilia: Design and Usability Study

Background

There is currently limited evidence on the level and intensity of physical activity in individuals with hemophilia A. Mobile technologies can offer a rigorous and reliable alternative to support data collection processes but they are often associated with poor user retention. The lack of longitudinal continuity in their use can be partly attributed to the insufficient consideration of stakeholder inputs in the development process of mobile apps. Several user-centered models have been proposed to guarantee that a thorough knowledge of the end user needs is considered in the development process of mobile apps.

Objective

The aim of this study is to design and validate an electronic patient-reported outcome mobile app that requires sustained active input by individuals during POWER, an observational study that aims at evaluating the relationship between physical activity levels and bleeding in patients with hemophilia A.

Methods

We adopted a user-centered design and engaged several stakeholders in the development and usability testing of this mobile app. During the concept generation and ideation phase, we organized a need-assessment focus group (FG) with patient representatives to elicit specific design requirements for the end users. We then conducted 2 exploratory FGs to seek additional inputs for the app’s improvement and 2 confirmatory FGs to validate the app and test its usability in the field through the mobile health app usability questionnaire.

Results

The findings from the thematic analysis of the need-assessment FG revealed that there was a demand for sense making, for simplification of app functionalities, for maximizing integration, and for minimizing the feeling of external control. Participants involved in the later stages of the design refinement contributed to improving the design further by upgrading the app’s layout and making the experience with the app more efficient through functions such as chatbots and visual feedback on the number of hours a wearable device had been worn, to ensure that the observed data were actually registered. The end users rated the app highly during the quantitative assessment, with an average mobile health app usability questionnaire score of 5.32 (SD 0.66; range 4.44-6.23) and 6.20 (SD 0.43; range 5.72-6.88) out of 7 in the 2 iterative usability testing cycles.

Conclusions

The results of the usability test indicated a high, growing satisfaction with the electronic patient-reported outcome app. The adoption of a thorough user-centered design process using several types of FGs helped maximize the likelihood of sustained retention of the app’s users and made it fit for data collection of relevant outcomes in the observational POWER study. The continuous use of the app and the actual level of engagement will be evaluated during the ongoing trial.

Trial Registration

ClinicalTrials.gov NCT04165135; https://clinicaltrials.gov/ct2/show/NCT04165135

Dental EHR-infused Persona Ontologies to Enrich Dental Dialogue Interaction of Agents

The quality of patient-provider communication can predict the healthcare outcomes in patients, and therefore, training dental providers to handle the communication effort with patients is crucial. In our previous work, we developed an ontology model that can standardize and represent patient-provider communication, which can later be integrated in conversational agents as tools for dental communication training. In this study, we embark on enriching our previous model with an ontology of patient personas to portray and express types of dental patient archetypes. The Ontology of Patient Personas that we developed was rooted in terminologies from an OBO Foundry ontology and dental electronic health record data elements. We discuss how this ontology aims to enhance the aforementioned dialogue ontology and future direction in executing our model in software agents to train dental students.

Non-use of telemedicine: A scoping review

Many telemedicine interventions fail to be implemented in medical care with non-use and discontinued use by patients being among the major reasons. The aim of this scoping review was to provide an overview of barriers associated with non-use and discontinued use of telemedicine. An electronic search was conducted in Pubmed in October 2019 and updated in November 2020, followed by a hand search in the beginning of 2021. All potential articles were screened by two independent reviewers based on predefined inclusion and exclusion criteria. A qualitative content analysis according to Mayring was carried out. The topics 'intervention', 'context of use' and 'user' were chosen as overarching themes. Out of 1377 potentially relevant articles, 73 were included. User-related barriers were mentioned in most of the analysed studies, followed by barriers related to the intervention. The analysis provides the basis for overcoming non-use issues in telemedicine.

Profiles of eHealth Adoption in Persons with Multiple Sclerosis and Their Caregivers

(1) Background: Persons with multiple sclerosis (pwMS) are often characterized as ideal adopters of new digital healthcare trends, but it is worth thinking about whether and which pwMS will be targeted and served by a particular eHealth service like a patient portal. With our study, we wanted to explore needs and barriers for subgroups of pwMS and their caregivers when interacting with eHealth services in care and daily living. (2) Methods: This study comprises results from two surveys: one collecting data from pwMS and their relatives (as informal caregivers) and another one providing information on the opinions and attitudes of healthcare professionals (HCPs). Data were analyzed descriptively and via generalized linear models. (3) Results: 185 pwMS, 25 informal caregivers, and 24 HCPs in the field of MS participated. Nine out of ten pwMS used information technology on a daily base. Individual impairments like in vision and cognition resulted in individual needs like the desire to actively monitor their disease course or communicate with their physician in person. HCPs reported that a complete medication overview, additional medication information, overview of future visits and a reminder of medication intake would be very helpful eHealth features for pwMS, while they themselves preferred features organizing and enriching future visits. (4) Conclusions: A closer look at the various profiles of eHealth adoption in pwMS and their caregivers indicated that there is a broad and robust enthusiasm across several subgroups that does not exclude anyone in general, but constitutes specific areas of interest. For pwMS, the focus was on eHealth services that connect previously collected information and make them easily accessible and understandable.

Mobile health (mHealth) usage, barriers, and technological considerations in persons with multiple sclerosis: a literature review

OBJECTIVES

Persons with multiple sclerosis (MS) can face a number of potential healthcare-related barriers, for which mobile health (mHealth) technology can be potentially beneficial. This review aimed to understand the frequency, current uses, and potential barriers with mHealth usage among persons with MS.

METHODS

A query string was used to identify articles on PubMed, MEDLINE, CINAHL, and IEEE Xplore that were published in English between January 2010 and December 2019. Abstracts were reviewed and selected based on a priori inclusion and exclusion criteria. Fifty-nine peer-reviewed research studies related to the study questions are summarized.

RESULTS

The majority of persons with MS were reported as using smartphones, although rates of mHealth utilization varied widely. mHealth usage was grouped into 3 broad categories: (1) disability and symptom measurement; (2) interventions and symptom management; and (3) tracking and promoting adherence. While there have been an increasing number of mHealth options, certain limitations associated with MS (eg, poor dexterity, memory problems) may affect usage, although including persons with MS in the design process can address some of these issues.

DISCUSSION

Given the increased attention to mHealth in this population and the current need for telehealth and at home devices, it is important that persons with MS and healthcare providers are involved in the development of new mHealth tools to ensure that the end product meets their needs. Considerations for addressing the potential mHealth use barriers in persons with MS are discussed.

Usability of a Mobile App for Real-Time Assessment of Fatigue and Related Symptoms in Patients With Multiple Sclerosis: Observational Study

Background

Although fatigue is one of the most debilitating symptoms in patients with multiple sclerosis (MS), its pathogenesis is not well understood. Neurogenic, inflammatory, endocrine, and metabolic mechanisms have been proposed. Taking into account the temporal dynamics and comorbid mood symptoms of fatigue may help differentiate fatigue phenotypes. These phenotypes may reflect different pathogeneses and may respond to different mechanism-specific treatments. Although several tools have been developed to assess various symptoms (including fatigue), monitor clinical status, or improve the perceived level of fatigue in patients with MS, options for a detailed, real-time assessment of MS-related fatigue and relevant comorbidities are still limited.

Objective

This study aims to present a novel mobile app specifically designed to differentiate fatigue phenotypes using circadian symptom monitoring and state-of-the-art characterization of MS-related fatigue and its related symptoms. We also aim to report the first findings regarding patient compliance and the relationship between compliance and patient characteristics, including MS disease severity.

Methods

After developing the app, we used it in a prospective study designed to investigate the brain magnetic resonance imaging correlates of MS-related fatigue. In total, 64 patients with MS were recruited into this study and asked to use the app over a 2-week period. The app features the following modules: Visual Analogue Scales (VASs) to assess circadian changes in fatigue, depression, anxiety, and pain; daily sleep diaries (SLDs) to assess sleep habits and quality; and 10 one-time questionnaires to assess fatigue, depression, anxiety, sleepiness, physical activity, and motivation, as well as several other one-time questionnaires that were created to assess those relevant aspects of fatigue that were not captured by existing fatigue questionnaires. The app prompts subjects to assess their symptoms multiple times a day and enables real-time symptom monitoring through a web-accessible portal.

Results

Of 64 patients, 56 (88%) used the app, of which 51 (91%) completed all one-time questionnaires and 47 (84%) completed all one-time questionnaires, VASs, and SLDs. Patients reported no issues with the usage of the app, and there were no technical issues with our web-based data collection system. The relapsing-remitting MS to secondary-progressive MS ratio was significantly higher in patients who completed all one-time questionnaires, VASs, and SLDs than in those who completed all one-time questionnaires but not all VASs and SLDs (P=.01). No other significant differences in demographics, fatigue, or disease severity were observed between the degrees of compliance.

Conclusions

The app can be used with reasonable compliance across patients with relapsing-remitting and secondary-progressive MS irrespective of demographics, fatigue, or disease severity.

Electronic Health Interventions in the Case of Multiple Sclerosis: From Theory to Practice

(1) Background: eHealth interventions play a growing role in shaping the future healthcare system. The integration of eHealth interventions can enhance the efficiency and quality of patient management and optimize the course of treatment for chronically ill patients. In this integrative review, we discuss different types of interventions, standards and advantages of quality eHealth approaches especially for people with multiple sclerosis (pwMS). (2) Methods: The electronic databases PubMed, Cochrane and Web of Science were searched to identify potential articles for eHealth interventions in pwMS; based on 62 articles, we consider different ways of implementing health information technology with various designs. (3) Results: There already exist some eHealth interventions for single users with a single-use case, interventions with a social setting, as well as eHealth interventions that integrate various single and social interventions and even those that may be used additionally for complex use cases. A key determinant of consumer acceptance is a high-quality user-centric design for healthcare practitioners and pwMS. In pwMS, the different neurological disabilities should be considered, and particular attention must be paid to the course of the treatment and the safety processes of each treatment option. (4) Conclusion: Depending on the field of application and the respective users, interventions are designed for single, social, integrated or complex use. In order to be accepted by their target group, interventions must be beneficial and easy to use.

Design considerations for a multiple sclerosis fatigue mobile app MS Energize: A pragmatic iterative approach using usability testing and resonance checks

Multiple sclerosis (MS) is a chronic neurological condition affecting around 2.2 million people worldwide. The illness includes a range of symptoms, with fatigue considered to be one of the most disabling. This paper describes how a pragmatic and iterative approach, supported by usability and resonance testing, was used to build a minimum viable product of MS Energize-or MS Energise in UK English regions. MS Energise is a mobile application focused on self-management of fatigue for people with MS. The iterative approach included various stages of testing, during which user feedback including comments about interface, navigation and content, was sought to inform incremental app development and continual improvement. Usability testing was conducted with 11 people with longstanding multiple sclerosis in New Zealand and the United Kingdom, and focused on particular sections of the app as well as the accessibility of the app to users with MS. Two participants contributed to further resonance testing post-release to ensure the app was perceived as relevant and useful to the user. The usability testing and resonance testing phases suggested that user experience of MS Energise was mostly positive. Participants provided a number of suggestions for improvements to aspects of content and design; some of which we implemented during our app development process. Findings will also contribute to future planning and design iteration to enhance the user experience. The next step is further improvement of MS Energise prior to a trial of its clinical and cost effectiveness.

Analysis of Diabetes Apps to Assess Privacy-Related Permissions: Systematic Search of Apps

Background

Mobile health has become a major vehicle of support for people living with diabetes. Accordingly, the availability of mobile apps for diabetes has been steadily increasing. Most of the previous reviews of diabetes apps have focused on the apps’ features and their alignment with clinical guidelines. However, there is a lack of knowledge on the actual compliance of diabetes apps with privacy and data security guidelines.

Objective

The aim of this study was to assess the levels of privacy of mobile apps for diabetes to contribute to the raising of awareness of privacy issues for app users, developers, and governmental data protection regulators.

Methods

We developed a semiautomatic app search module capable of retrieving Android apps’ privacy-related information, particularly the dangerous permissions required by apps, with the aim of analyzing privacy aspects related to diabetes apps. Following the research selection criteria, the original 882 apps were narrowed down to 497 apps that were included in the analysis.

Results

Approximately 60% of the analyzed diabetes apps requested potentially dangerous permissions, which pose a significant risk to users’ data privacy. In addition, 28.4% (141/497) of the apps did not provide a website for their privacy policy. Moreover, it was found that 40.0% (199/497) of the apps contained advertising, and some apps that claimed not to contain advertisements actually did. Ninety-five percent of the apps were free, and those belonging to the “medical” and “health and fitness” categories were the most popular. However, app users do not always realize that the free apps’ business model is largely based on advertising and, consequently, on sharing or selling their private data, either directly or indirectly, to unknown third parties.

Conclusions

The aforementioned findings confirm the necessity of educating patients and health care providers and raising their awareness regarding the privacy aspects of diabetes apps. Therefore, this research recommends properly and comprehensively training users, ensuring that governments and regulatory bodies enforce strict data protection laws, devising much tougher security policies and protocols in Android and in the Google Play Store, and implicating and supervising all stakeholders in the apps’ development process.

Evaluation of two mobile health apps for patients with breast cancer using the Mobile Application Rating Scale

BACKGROUND

Breast cancer is one of the most frequently diagnosed cancers worldwide. Screening, education about signs and symptoms, and improved access to treatment has helped reduce mortality. An understanding of the informational needs of women with breast cancer can help identify areas where mobile apps can further improve the experience of this patient group.

METHODS

Personas are a commonly used tools in user centred design to help represent particular user archetypes. Knowledge of existing informational needs and prior research using personas in breast cancer app design were used to create two different personas through which to source apps for evaluation. The Mobile Application Rating Scale, a common evaluation framework, was used to evaluate the mobile apps across several important domains.

RESULTS

Becca and OWise, two apps for breast cancer, were found through a discovery process in line with the personas described. Overall, both apps scored highly on the Mobile Application Rating Scale. Both apps had limited or no research to support their use in this patient group, and had issues related to data privacy. Becca scored particularly highly in domains related to accessibility while OWise's extensive range of features scored highly for functionality.

CONCLUSIONS

Both apps demonstrate the ability to fill an informational needs gap as evidenced in the existing literature. As with many mobile health apps, more clinical evidence and improved data handling would help support the widespread recommendation of their use in women who are undergoing or have completed treatment for breast cancer.

Evaluating the Utility of Smartphone-Based Sensor Assessments in Persons With Multiple Sclerosis in the Real-World Using an App (elevateMS): Observational, Prospective Pilot Digital Health Study

Background

Multiple sclerosis (MS) is a chronic neurodegenerative disease. Current monitoring practices predominantly rely on brief and infrequent assessments, which may not be representative of the real-world patient experience. Smartphone technology provides an opportunity to assess people’s daily-lived experience of MS on a frequent, regular basis outside of episodic clinical evaluations.

Objective

The objectives of this study were to evaluate the feasibility and utility of capturing real-world MS-related health data remotely using a smartphone app, “elevateMS,” to investigate the associations between self-reported MS severity and sensor-based active functional tests measurements, and the impact of local weather conditions on disease burden.

Methods

This was a 12-week, observational, digital health study involving 3 cohorts: self-referred participants who reported an MS diagnosis, clinic-referred participants with neurologist-confirmed MS, and participants without MS (controls). Participants downloaded the elevateMS app and completed baseline assessments, including self-reported physical ability (Patient-Determined Disease Steps [PDDS]), as well as longitudinal assessments of quality of life (Quality of Life in Neurological Disorders [Neuro-QoL] Cognitive, Upper Extremity, and Lower Extremity Function) and daily health (MS symptoms, triggers, health, mobility, pain). Participants also completed functional tests (finger-tapping, walk and balance, voice-based Digit Symbol Substitution Test [DSST], and finger-to-nose) as an independent assessment of MS-related cognition and motor activity. Local weather data were collected each time participants completed an active task. Associations between self-reported baseline/longitudinal assessments, functional tests, and weather were evaluated using linear (for cross-sectional data) and mixed-effects (for longitudinal data) regression models.

Results

A total of 660 individuals enrolled in the study; 31 withdrew, 495 had MS (n=359 self-referred, n=136 clinic-referred), and 134 were controls. Participation was highest in clinic-referred versus self-referred participants (median retention: 25.5 vs 7.0 days). The top 5 most common MS symptoms, reported at least once by participants with MS, were fatigue (310/495, 62.6%), weakness (222/495, 44.8%), memory/attention issues (209/495, 42.2%), and difficulty walking (205/495, 41.4%), and the most common triggers were high ambient temperature (259/495, 52.3%), stress (250/495, 50.5%), and late bedtime (221/495, 44.6%). Baseline PDDS was significantly associated with functional test performance in participants with MS (mixed model–based estimate of most significant feature across functional tests [β]: finger-tapping: β=–43.64, P<.001; DSST: β=–5.47, P=.005; walk and balance: β=–.39, P=.001; finger-to-nose: β=.01, P=.01). Longitudinal Neuro-QoL scores were also significantly associated with functional tests (finger-tapping with Upper Extremity Function: β=.40, P<.001; walk and balance with Lower Extremity Function: β=–99.18, P=.02; DSST with Cognitive Function: β=1.60, P=.03). Finally, local temperature was significantly associated with participants’ test performance (finger-tapping: β=–.14, P<.001; DSST: β=–.06, P=.009; finger-to-nose: β=–53.88, P<.001).

Conclusions

The elevateMS study app captured the real-world experience of MS, characterized some MS symptoms, and assessed the impact of environmental factors on symptom severity. Our study provides further evidence that supports smartphone app use to monitor MS with both active assessments and patient-reported measures of disease burden. App-based tracking may provide unique and timely real-world data for clinicians and patients, resulting in improved disease insights and management.

Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study

Background

The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS.

Objective

The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT).

Methods

We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT.

Results

The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS.

Conclusions

The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Smartphone based behavioral therapy for pain in multiple sclerosis (MS) patients: A feasibility acceptability randomized controlled study for the treatment of comorbid migraine and ms pain

BACKGROUND

Multiple Sclerosis (MS) and Migraine are comorbid neurologic conditions. Migraine prevalence is three times higher in the MS clinic population compared to the general population, and patients with MS and migraine are more symptomatic than patients with MS without migraine.

OBJECTIVE

We sought to conduct a pilot feasibility and acceptability study of the RELAXaHEAD app in MS-Migraine patients and to assess whether there was any change in migraine disability and MS pain-related disability.

METHODS

Randomized controlled study of patients with MS-migraine ages 18-80 years with 4+ headache days/ month who were willing to engage in smartphone based behavioral therapy. Half received the RELAXaHEAD app with progressive muscle relaxation (PMR) and the other half received the app without the PMR. Data was collected for 90 days on measures of recruitment, retention, engagement, and adherence to RELAXaHEAD. Preliminary data was also collected on migraine disability (MIDAS) and MS pain (PES).

RESULTS

Sixty-two subjects with MS-migraine were enrolled in the study (34 in PMR arm, 28 in monitored usual care arm). On average, during the 90 days, participants played the PMR on average 1.8 times per week, and for 12.9 min on days it was played. Forty-one percent (14/34) of the participants played the PMR two or more times weekly on average. Data was entered into the daily diaries, on average, 49% (44/90) of the days. There were major challenges in reaching subjects in follow-up for the efficacy data, and there was no significant change in migraine disability (MIDAS) scores or MS Pain (PES) scores from baseline to the endpoints. During the six-month follow-up, most patients felt either positively or neutral about the relaxation therapy.

CONCLUSION

There was interest in scalable accessible forms of behavioral therapy to treat migraine and MS-related pain in patients with MS and comorbid migraine. Similar to prior studies, a significant minority were willing to practice the PMR at least twice weekly. In the societal shift from telephone to more text and internet-based interactions, follow up was challenging, but those reached indicated that they appreciated the PMR and would recommend it to others. Future work should focus on engagement and efficacy.

Evaluation of More Stamina, a Mobile App for Fatigue Management in Persons with Multiple Sclerosis: Protocol for a Feasibility, Acceptability, and Usability Study

BACKGROUND

Multiple sclerosis (MS) is one of the world's most common neurologic disorders leading to severe disability in young adults. MS-related fatigue directly impacts on the quality of life and activity levels of people with MS. Self-management strategies are used to support them in the care of their health. Mobile health (mHealth) solutions can offer tools to help symptom management. Following a user-centered design and evidence-based process, an mHealth solution called More Stamina was created to help persons with MS manage their fatigue.

OBJECTIVE

The overall study aims are to explore the feasibility, acceptability, and usability of More Stamina, a mobile app for fatigue self-management for persons with MS.

METHODS

A mixed-methods, multicenter study will be used to assess the feasibility, acceptability, and usability of More Stamina. The study will take place during the third and fourth quarters of 2020 (Q3-Q4 2020) in 3 locations: Argentina, Spain, and Switzerland. A longitudinal cohort study will take place, and think-aloud protocols, open-ended interviews, and short answer questionnaires will be used. Persons with MS will be recruited from the different locations. This study seeks to enroll at least 20 patients that meet the criteria from each site for the longitudinal cohort study (total n=60).

RESULTS

Ethical approval has been granted in Argentina and is pending in Spain and Switzerland. Outcomes will be published in peer-reviewed medical journals and presented at international conferences.

CONCLUSIONS

Findings from this study will be used to help understand the role that mHealth can play in fatigue management in MS.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04244214; https://clinicaltrials.gov/ct2/show/NCT04244214.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/18196.

Barriers to diabetes awareness and self-help are influenced by people's demographics: perspectives of South Asians with type 2 diabetes

Aim: To determine whether barriers to diabetes awareness and self-help differ in South Asian participants of different demographic characteristics (age, gender, and literacy) with type 2 diabetes living in the United Kingdom. Methods: Six focus group discussions (FGDs) were carried out in patients who were categorized according to age (30-60 years, ≥60 years), gender (male, female) and literacy status (literate, illiterate). Data were analysed following the iterative process of thematic analysis techniques. Results: Barriers were demographic-specific. The illiterate groups reported language as the major barrier to improved diabetes awareness and self-help. The literate groups reported that information provided by healthcare providers was general, and not specific to their diet/culture. Major barriers to adherence to the recommended diet for diabetes included: insufficient knowledge/awareness about nutritional content of food (all groups); lack of self-will to resist eating sweets, especially during weddings/festivals (literate older groups/literate younger females/illiterate older males); difficulty cooking separate meals for diabetic and non-diabetic family members (illiterate/literate older females). Other barriers to seeking advice/help ranged from not wanting to disclose their diabetes as it may affect employment/work (literate groups) to fear of being singled out at social gatherings (illiterate groups). General lack of motivation to exercise was reported by all groups. Time constraints and not knowing what/how to exercise was reported by literate younger groups whilst the illiterate older groups reported to not having suitable exercising facilities at local communities. Different barriers were also reported when accessing healthcare; language barriers (illiterate groups), restricted access to doctors' appointments/difficulty attending specific appointment slots offered by General Practitioners (literate females). Conclusion: Different barriers exist to improved awareness about diabetes and self-help in different patient demographics. Lack of culturally appropriate diabetes educational/awareness programs in the community appeared to be a major barrier in most older and illiterate participants while younger participants reported time constraint.

Assessment of the Fairness of Privacy Policies of Mobile Health Apps: Scale Development and Evaluation in Cancer Apps

BACKGROUND

Cancer patients are increasingly using mobile health (mHealth) apps to take control of their health. Many studies have explored their efficiency, content, usability, and adherence; however, these apps have created a new set of privacy challenges, as they store personal and sensitive data.

OBJECTIVE

The purpose of this study was to refine and evaluate a scale based on the General Data Protection Regulation and assess the fairness of privacy policies of mHealth apps.

METHODS

Based on the experience gained from our previous work, we redefined some of the items and scores of our privacy scale. Using the new version of our scale, we conducted a case study in which we analyzed the privacy policies of cancer Android apps. A systematic search of cancer mobile apps was performed in the Spanish version of the Google Play website.

RESULTS

The redefinition of certain items reduced discrepancies between reviewers. Thus, use of the scale was made easier, not only for the reviewers but also for any other potential users of our scale. Assessment of the privacy policies revealed that 29% (9/31) of the apps included in the study did not have a privacy policy, 32% (10/31) had a score over 50 out of a maximum of 100 points, and 39% (12/31) scored fewer than 50 points.

CONCLUSIONS

In this paper, we present a scale for the assessment of mHealth apps that is an improved version of our previous scale with adjusted scores. The results showed a lack of fairness in the mHealth app privacy policies that we examined, and the scale provides developers with a tool to evaluate their privacy policies.

A Personalized Physical Activity Coaching App for Breast Cancer Survivors: Design Process and Early Prototype Testing

Background

Existing evidence supports the many benefits of physical activity (PA) in breast cancer survival. However, few breast cancer survivors adhere to the recommended levels of activity. A PA coaching app that provides personalized feedback, guidance, and motivation to the user might have the potential to engage these individuals in a more active lifestyle, in line with the general recommendations. To develop a successful tool, it is important to involve the end users in the design process and to make theoretically grounded design decisions.

Objective

This study aimed to execute the design process and early prototype evaluation of a personalized PA coaching app for posttreatment breast cancer survivors. In particular, the study explored a design combining behavioral theory and tailored coaching strategies.

Methods

The design process was led by a multidisciplinary team, including technical and health professionals, and involved input from a total of 22 survivors. The process comprised 3 stages. In stage 1, the literature was reviewed and 14 patients were interviewed to understand the needs and considerations of the target population toward PA apps. In stage 2, the global use case for the tool was defined, the features were ideated and refined based on theory, and a digital interactive prototype was created. In stage 3, the prototype went through usability testing with 8 patients and was subjected to quality and behavior change potential evaluations by 2 human-computer interaction experts.

Results

The design process has led to the conceptualization of a personalized coaching app for walking activities that addresses the needs of breast cancer survivors. The main features of the tool include a training plan and schedule, adaptive goal setting, real-time feedback and motivation during walking sessions, activity status through the day, activity history, weekly summary reports, and activity challenges. The system was designed to measure users’ cadence during walking, use this measure to infer their training zone, and provide real-time coaching to control the intensity of the walking sessions. The outcomes from user testing and expert evaluation of the digital prototype were very positive, with scores from the system usability scale, mobile app rating scale, and app behavior change scale of 95 out of 100, 4.6 out of 5, and 15 out of 21, respectively.

Conclusions

Implementing a user-centered design approach for the development and early evaluation of an app brings essential considerations to tailor the solution to the user’s needs and context. In addition, informing the design on behavioral and tailored coaching theories supports the conceptualization of the PA coaching system. This is critical for optimizing the usability, acceptability, and long-term effectiveness of the tool. After successful early in-laboratory testing, the app will be developed and evaluated in a pilot study in a real-world setting.

Users' Experiences of a Mobile Health Self-Management Approach for the Treatment of Cystic Fibrosis: Mixed Methods Study

Background

Despite a large number of clinical trials aiming at evaluating the digital self-management of chronic diseases, there is little discussion about users’ experiences with digital approaches. However, a good user experience is a critical factor for technology adoption. Understanding users’ experiences can inform the design of approaches toward increased motivation for digital self-management.

Objective

This study aimed to evaluate the self-management of cystic fibrosis (CF) with a focus on gastrointestinal concerns and the care of young patients. Following a user-centered design approach, we developed a self-management app for patients and parents and a web tool for health care professionals (HCPs). To evaluate the proposed solutions, a 6-month clinical trial was conducted in 6 European CF competence centers. This paper analyzes the user acceptance of the technology and the benefits and disadvantages perceived by the trial participants.

Methods

A mixed methods approach was applied. Data were collected through 41 semistructured qualitative interviews of patients, parents, and HCPs involved in the clinical trial. In addition, data were collected through questionnaires embedded in the self-management app.

Results

Support for enzyme dose calculation and nutrition management was found to be particularly useful. Patients and parents rapidly strengthened their knowledge about the treatment and increased their self-efficacy. Reported benefits include reduced occurrence of symptoms and enhanced quality of life. Patients and parents had different skills, requiring follow-up by HCPs in an introductory phase. HCPs valued obtaining precise information about the patients, allowing for more personalized advice. However, the tight follow-up of several patients led to an increased workload. Over time, as patient self-efficacy increased, patient motivation for using the app decreased and the quality of the reported data was reduced.

Conclusions

Self-management enfolds a collaboration between patients and HCPs. To be successful, a self-management approach should be accepted by both parties. Through understanding behaviors and experiences, this study defines recommendations for a complex case—the demanding treatment of CF. We identify target patient groups and situations for which the app is most beneficial and suggest focusing on these rather than motivating for regular app usage over a long time. We also advise the personalized supervision of patients during the introduction of the approach. Finally, we propose to develop guidance for HCPs to facilitate changes in practice. As personalization and technology literacy are factors found to influence the acceptance of digital self-management of other chronic diseases, it is relevant to consider the proposed recommendations beyond the case of CF.

A Precision Medicine Tool for Patients With Multiple Sclerosis (the Open MS BioScreen): Human-Centered Design and Development

Background

Patients with multiple sclerosis (MS) face several challenges in accessing clinical tools to help them monitor, understand, and make meaningful decisions about their disease course. The University of California San Francisco MS BioScreen is a web-based precision medicine tool initially designed to be clinician facing. We aimed to design a second, openly available tool, Open MS BioScreen, that would be accessible, understandable, and actionable by people with MS.

Objective

This study aimed to describe the human-centered design and development approach (inspiration, ideation, and implementation) for creating the Open MS BioScreen platform.

Methods

We planned an iterative and cyclical development process that included stakeholder engagement and iterative feedback from users. Stakeholders included patients with MS along with their caregivers and family members, MS experts, generalist clinicians, industry representatives, and advocacy experts. Users consisted of anyone who wants to track MS measurements over time and access openly available tools for people with MS. Phase I (inspiration) consisted of empathizing with users and defining the problem. We sought to understand the main challenges faced by patients and clinicians and what they would want to see in a web-based app. In phase II (ideation), our multidisciplinary team discussed approaches to capture, display, and make sense of user data. Then, we prototyped a series of mock-ups to solicit feedback from clinicians and people with MS. In phase III (implementation), we incorporated all concepts to test and iterate a minimally viable product. We then gathered feedback through an agile development process. The design and development were cyclical—many times throughout the process, we went back to the drawing board.

Results

This human-centered approach generated an openly available, web-based app through which patients with MS, their clinicians, and their caregivers can access the site and create an account. Users can enter information about their MS (basic level as well as more advanced concepts), visualize their data longitudinally, access a series of algorithms designed to empower them to make decisions about their treatments, and enter data from wearable devices to encourage realistic goal setting about their ambulatory activity. Agile development will allow us to continue to incorporate precision medicine tools, as these are validated in the clinical research arena.

Conclusions

After engaging intended users into the iterative human-centered design of the Open MS BioScreen, we will now monitor the adaptation and dissemination of the tool as we expand its functionality and reach. The insights generated from this approach can be applied to the development of a number of self-tracking, self-management, and user engagement tools for patients with chronic conditions.

Privacy Assessment in Mobile Health Apps: Scoping Review

Background

Privacy has always been a concern, especially in the health domain. The proliferation of mobile health (mHealth) apps has led to a large amount of sensitive data being generated. Some authors have performed privacy assessments of mHealth apps. They have evaluated diverse privacy components; however, different authors have used different criteria for their assessments.

Objective

This scoping review aims to understand how privacy is assessed for mHealth apps, focusing on the components, scales, criteria, and scoring methods used. A simple taxonomy to categorize the privacy assessments of mHealth apps based on component evaluation is also proposed.

Methods

We followed the methodology defined by Arksey and O’Malley to conduct a scoping review. Included studies were categorized based on the privacy component, which was assessed using the proposed taxonomy.

Results

The database searches retrieved a total of 710 citations—24 of them met the defined selection criteria, and data were extracted from them. Even though the inclusion criteria considered articles published since 2009, all the studies that were ultimately included were published from 2014 onward. Although 12 papers out of 24 (50%) analyzed only privacy, 8 (33%) analyzed both privacy and security. Moreover, 4 papers (17%) analyzed full apps, with privacy being just part of the assessment. The evaluation criteria used by authors were heterogeneous and were based on their experience, the literature, and/or existing legal frameworks. Regarding the set of items used for the assessments, each article defined a different one. Items included app permissions, analysis of the destination, analysis of the content of communications, study of the privacy policy, use of remote storage, and existence of a password to access the app, among many others. Most of the included studies provided a scoring method that enables the comparison of privacy among apps.

Conclusions

The privacy assessment of mHealth apps is a complex task, as the criteria used by different authors for their evaluations are very heterogeneous. Although some studies about privacy assessment have been conducted, a very large set of items to evaluate privacy has been used up until now. In-app information and privacy policies are primarily utilized by the scientific community to extract privacy information from mHealth apps. The creation of a scale based on more objective criteria is a desirable step forward for privacy assessment in the future.

Proposal for the User-Centered Design Approach for Health Apps Based on Successful Experiences: Integrative Review

Background

Different strategies encompassed within mHealth have shown themselves to be effective for maintaining good health or controlling certain diseases. However, there is usually a very high rate of abandonment of health apps. Therefore, it would seem obvious that there is a need for involving the end users (whether they are health professionals, patients, or both) in the design process from the early stages in order to enable their needs and characteristics to be identified. In this sense, it is common knowledge that focusing on the user permits the consideration of valuable details aimed at making the correct adjustment between the patient, the technology, and the organization of attention.

Objective

The goal of the research was to propose a methodology based on the review of previous successful user experiences in setting up health apps by using qualitative techniques (focus groups and discussion groups) that includes the participation of information technology and health professionals and the patients themselves.

Methods

An integrative review was made of studies in which a qualitative methodology was employed mainly through focus and/or discussion groups for the design and development of health apps, consulting diverse databases (PubMed, Scopus, and Proquest) with the following search strategy: “mHealth AND apps AND focus group OR discussion group.” A total of 69 papers were included in the review.

Results

A proposal structured in 4 sessions of variable duration was made in which information technology and health professionals and patients take part: composing, preparing, and organizing contents (session 1); testing structure and usability (session 2); does the app fit the needs of end users? (session 3); and last testing—keep on improving (session 4). Throughout the sessions, we propose studying aspects like previous user experiences in mHealth, barriers to the adoption of mHealth, interface contents, management and browsability, usability, perceived quality, security and privacy, capacity to self-manage disease with the app, ergonomics, and glanceability, etc. Specific tools that have proved useful in previous research for measuring these aspects are presented.

Conclusions

These work sessions would be based on predominantly qualitative methodologies although, as they evolve, validated questionnaires permitting the assessment of the objectivity of certain technical aspects could be incorporated. With this proposal, a project centered on end users could be effected, responding to their needs. However, this requires validation that will be made via implementation in the development of health apps, with the subsequent measurement of results in terms of adherence and improvement in the clinical variables of the end users.

Feasibility study of a 10-week community-based program using the WalkWithMe application on physical activity, walking, fatigue and cognition in persons with Multiple Sclerosis

BACKGROUND

People with Multiple Sclerosis (pwMS) show diverse symptoms, such as fatigue and decline in motor and cognitive function. Physical activity shows to have a positive impact on many of these symptoms. However, many pwMS lead sedentary lives. Objectives of this study were to evaluate the feasibility of prolonged use of the WalkWithMe, a personalized mobile application that supports pwMS in walking at home, and its effect on physical activity, walking, fatigue and cognition in persons with MS.

METHODS

Nineteen pwMS were enrolled in a 10-week home-based intervention with the WalkWithMe application after setting personal goals based on baseline testing values, where twelve patients completed the program. Before and after the intervention, motor (6MWT, T25FW, 5-STS, NHPT) and cognitive function (PASAT and SDMT) were evaluated, together with the patient reported impact on walking, physical activity, quality of life and fatigue by MSWS-12, IPAQ, SF-36, MSIS-29, MFIS and FSS, respectively.

RESULTS

Significant improvement was seen for some parts of self-reported physical activity and quality of life (IPAQ: walking, p = 0.04, leisure, p = 0.02; SF-36: physical functioning, p = 0.02), cognition (SDMT, p = 0.01), cognitive fatigability (PASAT, p = 0.05), lower limb strength (5-STS, p = 0.05) and dominant hand function (NHPT, p = 0.002).

CONCLUSION

This feasibility study was successful at improving categories of self-reported physical activity, lower limb functional strength, hand function and cognition, but results need to be interpreted with caution, given the small and not always clinically relevant changes. Larger sample sizes in a controlled experimental design are needed to confirm these results.