Wearable technologies to measure clinical outcomes in multiple sclerosis: A scoping review

Japanese translation and validation of the 12-item Multiple Sclerosis Walking Scale version 2

BACKGROUND

Disability in ambulation has a critical impact on activities of daily living in patients with multiple sclerosis (MS). The 12-item Multiple Sclerosis Walking Scale (MSWS-12) is a self-reported instrument developed to assess the impact of MS on walking. The scale's 12 items assess various aspects of walking-related tasks during the past 2 weeks. MSWS-12 has been used in multiple clinical studies and translated into several languages. In the present study, we translated the MSWS-12 into Japanese and evaluated its psychometric properties in a cross-sectional study.

METHODS

The original English MSWS-12 version 2 (v2) was translated into Japanese through a standard procedure. Sixty consecutive Japanese MS patients completed the newly prepared Japanese MSWS-12v2 questionnaire and repeated the test 14 days later. Physical disability was assessed by the Expanded Disability Status Scale (EDSS), Timed 25-foot Walk (T25FW), and 9-hole Peg Test (9HPT). Cognitive performance was evaluated using the Processing Speed Test (PST). Fatigue and health-related quality of life were assessed using the Japanese versions of the Fatigue Severity Scale (FSS) and the Functional Assessment of MS (FAMS).

RESULTS

The mean age of the patients was 42.5 years, with median disease duration of 10 years, and median EDSS of 2.0 (range 0, 6.5). Forty-seven patients (78.3 %) had relapsing-remitting, 9 (15.0 %) had secondary-progressive, and 4 (6.7 %) had primary-progressive phenotypes. The median score of the MSWS-12v2 was 5.95 (interquartile range 0, 50.6). Twenty-seven patients (45 %) scored the lowest possible score (0 points), while one (1.7 %) scored the highest possible score (100 points). Cronbach's alpha was 0.98 (95 % confidence interval [CI] 0.97, 0.98), and the test-retest intraclass correlation was 0.95 (95%CI 0.94, 0.96). MSWS-12v2 score was strongly correlated with EDSS (Spearman's ρ = 0.73 [95%CI 0.58, 0.83]), T25FW (ρ = 0.70 [95%CI 0.55, 0.81]), and total FAMS score (ρ = -0.80 [95%CI -0.88, -0.69]), and moderately correlated with 9HPT (ρ = 0.65 [95%CI 0.47, 0.77] for the dominant hand; ρ = 0.62 [95%CI 0.43, 0.75] for the non-dominant hand), PST (ρ = -0.65 [95%CI -0.78, -0.47]), and FSS (ρ = 0.68 [95%CI 0.52, 0.80]). Among the subcomponents of FAMS, the mobility subcomponent showed the most robust correlation with MSWS-12v2 score (ρ = -0.91 [95%CI -0.94, -0.81]). In patients with minimal or no objective disability (EDSS < 3.0, n = 40), only the mobility subcomponent of FAMS was strongly correlated with MSWS-12v2 score (ρ = -0.76 [95% CI -0.87, -0.58]). In contrast, correlations of MSWS-12v2 score with EDSS and T25FW were weak in this subgroup (ρ = 0.28 [95%CI -0.03, 0.55] for EDSS; ρ = 0.25 [95%CI -0.06, 0.52] for T25FW). Response patterns for the single items showed that 32.5 % of the patients with EDSS below 3.0 reported having problems with balance, followed by climbing stairs and standing while doing things (both 25 %).

CONCLUSION

The Japanese version of the MSWS-12v2 developed in this study is reliable, valid, and helpful for screening walking disability in Japanese MS patients, including those with minimal objective disability.

Perceptions of digital technology use for monitoring health in people living with neurological disorders

BACKGROUND

Digital technology offers individuals the opportunity to monitor their symptoms. Information gathered from apps, devices, and web platforms may be used to direct clinical care and to support research.

AIM

Using this survey, we aim to explore the views of people attending the Anne Rowling Regenerative Neurology Clinic (ARRNC) and their relatives/caregivers regarding the use of digital health technologies to monitor health.

METHOD

People attending the ARRNC were invited to complete a structured 18-item questionnaire evaluating their experience and attitudes to using technology for monitoring health. People with neurodegenerative disease (pwND) and their caregivers completed a mix of closed and open-ended questions.

RESULTS

249 people responded, 51 relatives/caregivers and 198 pwND. 67.1% (n= 167) of respondents do not use technology for monitoring their health, but 98.2% (n = 164) of these are interested in their future use. 29.7% (n = 74) respondents currently use a smartphone for health monitoring, 20.9% (n = 52) use a wearable device, and 13.3% (n = 33) use a tablet. 79.3% (n = 65) of users use their technology for monitoring physical activity, 37.8% (n = 31) use it for assisting with self-management, and 41.5% (n = 34) use it for tracking sleep. Factors which would encourage use of technology are ease of access to devices and ability to monitor health. Respondents reported data security concerns and difficulty using technology as potential barriers.

CONCLUSION

People attending a neurology clinic, and their relatives/caregivers, support the use of digital technologies as an adjunct to routine care. There is a need for coordinated digital strategies for development and delivery of validated measures.

Sufficiency for PSS tracking gait disorders in multiple sclerosis: A managerial perspective

This study primarily aimed to explore the capabilities of digitalisation in the healthcare context, focusing on a specific disease. In this case, the study examined the potential of remote monitoring of gait to address the sensitivity of multiple sclerosis progression to gait characteristics by adopting a non-invasive approach to remotely quantify gait disturbances in a patient's daily life. To better understand the managerial aspects associated with this approach, the researchers conducted a literature review along with a set of semi-structured interviews. The target population included MS patients as well as the key agents involved in their care: patients' family members, neurologists, MS nurses, physiotherapists, medical directors, and pharmacist. The study identifies the perceived barriers and drivers that could contribute to the successful deployment of PSS remote gait monitoring as a healthcare service: i) At mega-level governance. Implications on privacy and security data are notable barriers missing on the speech. ii) At macro level, funding is highlighted as main barrier. The cost and lack of health system subsidies may render initiatives unsustainable, as emphasised by the interviewees. iii) At meso level, useable data is recognised as a driver. The data collection process can align with diverse interests to create value and business opportunities for the ecosystem actors, enhance care, attract stakeholders, such as insurers and pharma, and form partnerships. iv) At micro-level processes, we find two potential barriers: wearable device and app usability (comfort, navigation, efficiency) and organisational/behavioural aspects (training, digital affinity, skills), which are crucial for value creation in innovation ecosystems among patients and healthcare professionals. Finally, we find an interesting gap in the literature and interviews. Stakeholders' limited awareness of technological demands, especially from information technologies, for a successful long-term service, can be consider two key barriers for PSS.

Exploring the Major Barriers to Physical Activity in Persons With Multiple Sclerosis: Observational Longitudinal Study

BACKGROUND

Physical activity (PA) represents a low-cost and readily available means of mitigating multiple sclerosis (MS) symptoms and alleviating the disease course. Nevertheless, persons with MS engage in lower levels of PA than the general population.

OBJECTIVE

This study aims to enhance the understanding of the barriers to PA engagement in persons with MS and to evaluate the applicability of the Barriers to Health Promoting Activities for Disabled Persons (BHADP) scale for assessing barriers to PA in persons with MS, by comparing the BHADP score with self-reported outcomes of fatigue, depression, self-efficacy, and health-related quality of life, as well as sensor-measured PA.

METHODS

Study participants (n=45; median age 46, IQR 40-51 years; median Expanded Disability Status Scale score 4.5, IQR 3.5-6) were recruited among persons with MS attending inpatient neurorehabilitation. They wore a Fitbit Inspire HR (Fitbit Inc) throughout their stay at the rehabilitation clinic (phase 1; 2-4 wk) and for the 4 following weeks at home (phase 2; 4 wk). Sensor-based step counts and cumulative minutes in moderate to vigorous PA were computed for the last 7 days at the clinic and at home. On the basis of PA during the last 7 end-of-study days, we grouped the study participants as active (≥10,000 steps/d) and less active (<10,000 steps/d) to explore PA barriers compared with PA level. PA barriers were repeatedly assessed through the BHADP scale. We described the relevance of the 18 barriers of the BHADP scale assessed at the end of the study and quantified their correlations with the Spearman correlation test. We evaluated the associations of the BHADP score with end-of-study reported outcomes of fatigue, depression, self-efficacy, and health-related quality of life with multivariable regression models. We performed separate regression analyses to examine the association of the BHADP score with different sensor-measured outcomes of PA.

RESULTS

The less active group reported higher scores for the BHADP items Feeling what I do doesn't help, No one to help me, and Lack of support from family/friends. The BHADP items Not interested in PA and Impairment were positively correlated. The BHADP score was positively associated with measures of fatigue and depression and negatively associated with self-efficacy and health-related quality of life. The BHADP score showed an inverse relationship with the level of PA measured but not when dichotomized according to the recommended PA level thresholds.

CONCLUSIONS

The BHADP scale is a valid and well-adapted tool for persons with MS because it reflects common MS symptoms such as fatigue and depression, as well as self-efficacy and health-related quality of life. Moreover, decreases in PA levels are often related to increases in specific barriers in the lives of persons with MS and should hence be addressed jointly in health care management.

Progression events defined by home-based assessment of motor function in multiple sclerosis: protocol of a prospective study

Background

This study relates to emerging concepts of appropriate trial designs to evaluate effects of intervention on the accumulation of irreversible disability in multiple sclerosis (MS). Major starting points of our study are the known limitations of current definitions of disability progression by rater-based clinical assessment and the high relevance of gait and balance dysfunctions in MS. The study aims to explore a novel definition of disease progression using repeated instrumental assessment of relevant motor functions performed by patients in their home setting.

Methods

The study is a prospective single-center observational cohort study with the primary outcome acquired by participants themselves, a home-based assessment of motor functions based on an RGB-Depth (RGB-D) camera, a camera that provides both depth (D) and color (RGB) data. Participants are instructed to perform and record a set of simple motor tasks twice a day over a one-week period every 6 months. Assessments are complemented by a set of questionnaires. Annual research grade assessments are acquired at dedicated study visits and include clinical ratings as well as structural imaging (MRI and optical coherence tomography). In addition, clinical data from routine visits is provided semiannually by treating neurologists. The observation period is 24 months for the primary endpoint with an additional clinical assessment at 27 month to confirm progression defined by the Expanded Disability Status Scale (EDSS). Secondary analyses aim to explore the time course of changes in motor parameters and performance of the novel definition against different alternative definitions of progression in MS. The study was registered at Deutsches Register für Klinische Studien (DRKS00027042).

Discussion

The study design presented here investigates disease progression defined by marker-less home-based assessment of motor functions against 3-month confirmed disease progression (3 m-CDP) defined by the EDSS. The technical approach was chosen due to previous experience in lab-based settings. The observation time per participant of 24, respectively, 27 months is commonly conceived as the lower limit needed to study disability progression. Defining a valid digital motor outcome for disease progression in MS may help to reduce observation times in clinical trials and add confidence to the detection of progression events in MS.

Management of multiple sclerosis fatigue in the digital age: from assessment to treatment

Fatigue is one of the most disabling symptoms of Multiple Sclerosis (MS), affecting more than 80% of patients over the disease course. Nevertheless, it has a multi-faceted and complex nature, making its diagnosis, evaluation, and treatment extremely challenging in clinical practice. In the last years, digital supporting tools have emerged to support the care of people with MS. These include not only smartphone or table-based apps, but also wearable devices or novel techniques such as virtual reality. Furthermore, an additional effective and cost-efficient tool for the therapeutic management of people with fatigue is becoming increasingly available. Virtual reality and e-Health are viable and modern tools to both assess and treat fatigue, with a variety of applications and adaptability to patient needs and disability levels. Most importantly, they can be employed in the patient's home setting and can not only bridge clinic visits but also be complementary to the monitoring and treatment means for those MS patients who live far away from healthcare structures. In this narrative review, we discuss the current knowledge and future perspectives in the digital management of fatigue in MS. These may also serve as sources for research of novel digital biomarkers in the identification of disease activity and progression.

No Increase in Symptoms Toward the End of the Ocrelizumab Infusion Cycle in Patients With Multiple Sclerosis: Symptom Burden on Ocrelizumab: A Longitudinal Study (SymBOLS)

Background and Objectives

Some patients with multiple sclerosis (MS) receiving ocrelizumab (OCR) report worsening symptoms toward the end of the 6-month infusion cycle ('wearing off'). The objective of our study was to comprehensively assess changes in symptom burden across 2 consecutive OCR infusion cycles.

Methods

SYMptom Burden on Ocrelizumab, a Longitudinal Study (SymBOLS; NCT04855617) was an investigator-initiated, 2-center study of patients with MS starting or receiving OCR. Patients' symptoms were assessed with NeuroQoL short forms, SymptoMScreen, and Work Productivity and Activity Impairment Questionnaire at the start-cycle, mid-cycle, and end-cycle time points in each of the 2 infusion cycles. Symptom scores at the 3 time points within each cycle were compared with repeated-measures ANOVA or the Friedman rank-sum test for non-normal variables. The proportions of patients with a meaningful symptomatic change from the start to the end of each infusion cycle were calculated, and patients whose symptoms improved, worsened, and stayed the same from the start to the end of the cycle were compared with respect to demographic and clinical characteristics.

Results

One hundred three patients with MS provided longitudinal data for analyses (mean age [SD]: 46.7 [12.2] years, 68% female, 33% non-White, disease duration: 15.5 [5] years, 41% with the Extended Disability Status Scale score >3). On a group level, NeuroQoL and SymptoMScreen scores mostly remained stable or even improved slightly toward the end of each cycle. On an individual level, symptoms remained unchanged across either cycle for most patients, and meaningful symptom worsening from the start to the end of the cycle was no more common than improvement. Meaningful change in symptoms in both cycles was very rare and generally in the direction of improvement toward the end cycle. Despite the lack of evidence for symptom worsening with a longer time from infusion, 54% of patients endorsed feeling of "wearing off" at least sometimes, most commonly as an increase in fatigue.

Discussion

Our prospective study failed to uncover evidence for the worsening of symptoms with a longer time from OCR infusion. These findings cast doubt on the existence of wearing off as a physiologic phenomenon in OCR-treated patients with MS. The perception of wearing off is likely the result of natural fluctuations in MS symptoms and attribution bias.

Multiple sclerosis functional tests and their comparability with self-administered values: A pilot study

Introduction

Neurological impairment in multiple sclerosis is highly variable among patients and over time it is difficult to quantify. The Multiple Sclerosis Outcome Assessment Consortium established sensitive, cost-effective, clinically significant, and reproducible measures of different functional systems to measure outcomes in clinical trials. However, their use in clinical care routines is not widespread due to time and training constraints.

Objective

To evaluate the self-administration feasibility of the timed 25-foot walking, symbol-digit-modality, and 9-peg hole tests in healthy individuals.

Materials and methods

We performed a descriptive pilot study. Healthy individuals between 18 and 80 years of age were included. The Timed 25-Foot Walking Test (T25- FWT), the Symbol Digit Modality Test (SDMT), and the Nine-Hole Peg Test (9-HPT) (using the dominant and non-dominant hand) were administered by a trained physician, who also instructed the subjects about test self-administration. The correlation and agreement, between the guided and self-administered tests were assessed with Pearson and Spearman coefficients and the Bland-Altman method.

Results

Thirty-eight healthy volunteers were included. The median age was 36 (range: 23-55) years old, and 55.26% were female. The correlation coefficient between guided and selfadministered tests was 0.37 for the T25-FWT (p=0.01), 0.54 for the SDMT (p<0.001), and 0.64 and 0.65 for the 9-HPT, in the dominant and non-dominant hands, respectively (p<0,001). Both forms of administration were concordant for the T25-FWT (95%CI: -1,49 to 1,43), the 9-HPT with dominant hand (95%CI: -5,23 to 4,09), the 9-HPT with non-dominant hand (95%CI: -7,75 to 7,14) and the SDMT (95% CI: -20,94 to 24,10).

Conclusions

We provide a proof of concept related to the feasibility of the selfadministration of the T25-FWT, the 9-HPT, and the SDMT, as a tool to improve monitoring in routine clinical practice.

Wearable Sensor Technologies to Assess Motor Functions in People With Multiple Sclerosis: Systematic Scoping Review and Perspective

BACKGROUND

Wearable sensor technologies have the potential to improve monitoring in people with multiple sclerosis (MS) and inform timely disease management decisions. Evidence of the utility of wearable sensor technologies in people with MS is accumulating but is generally limited to specific subgroups of patients, clinical or laboratory settings, and functional domains.

OBJECTIVE

This review aims to provide a comprehensive overview of all studies that have used wearable sensors to assess, monitor, and quantify motor function in people with MS during daily activities or in a controlled laboratory setting and to shed light on the technological advances over the past decades.

METHODS

We systematically reviewed studies on wearable sensors to assess the motor performance of people with MS. We scanned PubMed, Scopus, Embase, and Web of Science databases until December 31, 2022, considering search terms "multiple sclerosis" and those associated with wearable technologies and included all studies assessing motor functions. The types of results from relevant studies were systematically mapped into 9 predefined categories (association with clinical scores or other measures; test-retest reliability; group differences, 3 types; responsiveness to change or intervention; and acceptability to study participants), and the reporting quality was determined through 9 questions. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) reporting guidelines.

RESULTS

Of the 1251 identified publications, 308 were included: 176 (57.1%) in a real-world context, 107 (34.7%) in a laboratory context, and 25 (8.1%) in a mixed context. Most publications studied physical activity (196/308, 63.6%), followed by gait (81/308, 26.3%), dexterity or tremor (38/308, 12.3%), and balance (34/308, 11%). In the laboratory setting, outcome measures included (in addition to clinical severity scores) 2- and 6-minute walking tests, timed 25-foot walking test, timed up and go, stair climbing, balance tests, and finger-to-nose test, among others. The most popular anatomical landmarks for wearable placement were the waist, wrist, and lower back. Triaxial accelerometers were most commonly used (229/308, 74.4%). A surge in the number of sensors embedded in smartphones and smartwatches has been observed. Overall, the reporting quality was good.

CONCLUSIONS

Continuous monitoring with wearable sensors could optimize the management of people with MS, but some hurdles still exist to full clinical adoption of digital monitoring. Despite a possible publication bias and vast heterogeneity in the outcomes reported, our review provides an overview of the current literature on wearable sensor technologies used for people with MS and highlights shortcomings, such as the lack of harmonization, transparency in reporting methods and results, and limited data availability for the research community. These limitations need to be addressed for the growing implementation of wearable sensor technologies in clinical routine and clinical trials, which is of utmost importance for further progress in clinical research and daily management of people with MS.

TRIAL REGISTRATION

PROSPERO CRD42021243249; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=243249.

Machine learning based estimation of dynamic balance and gait adaptability in persons with neurological diseases using inertial sensors

Poor dynamic balance and impaired gait adaptation to different contexts are hallmarks of people with neurological disorders (PwND), leading to difficulties in daily life and increased fall risk. Frequent assessment of dynamic balance and gait adaptability is therefore essential for monitoring the evolution of these impairments and/or the long-term effects of rehabilitation. The modified dynamic gait index (mDGI) is a validated clinical test specifically devoted to evaluating gait facets in clinical settings under a physiotherapist's supervision. The need of a clinical environment, consequently, limits the number of assessments. Wearable sensors are increasingly used to measure balance and locomotion in real-world contexts and may permit an increase in monitoring frequency. This study aims to provide a preliminary test of this opportunity by using nested cross-validated machine learning regressors to predict the mDGI scores of 95 PwND via inertial signals collected from short steady-state walking bouts derived from the 6-minute walk test. Four different models were compared, one for each pathology (multiple sclerosis, Parkinson's disease, and stroke) and one for the pooled multipathological cohort. Model explanations were computed on the best-performing solution; the model trained on the multipathological cohort yielded a median (interquartile range) absolute test error of 3.58 (5.38) points. In total, 76% of the predictions were within the mDGI's minimal detectable change of 5 points. These results confirm that steady-state walking measurements provide information about dynamic balance and gait adaptability and can help clinicians identify important features to improve upon during rehabilitation. Future developments will include training of the method using short steady-state walking bouts in real-world settings, analysing the feasibility of this solution to intensify performance monitoring, providing prompt detection of worsening/improvements, and complementing clinical assessments.

Locomotor Strategy to Perform 6-Minute Walk Test in People with Multiple Sclerosis: A Prospective Observational Study

Two-thirds of people with Multiple Sclerosis (PwMS) have walking disabilities. Considering the literature, prolonged tests, such as the 6 min walk test, better reflect their everyday life walking capacities and endurance. However, in most studies, only the distance traveled during the 6MWT was measured. This study aims to analyze spatio-temporal (ST) walking patterns of PwMS and healthy people in the 6MWT. Participants performed a 6MWT with measures of five ST variables during three 1 min intervals (initial: 0'-1', middle: 2'30″-3'30″, end: 5'-6') of the 6MWT, using the GAITRite system. Forty-five PwMS and 24 healthy people were included. We observed in PwMS significant changes between initial and final intervals for all ST parameters, whereas healthy people had a rebound pattern but the changes between intervals were rather negligible. Moreover, ST variables' changes were superior to the standard measurement error only for PwMS between initial and final intervals for all ST parameters. This result suggests that the modification in PwMS' walking pattern is effectively due to their walking ability and not to a measurement, and suggests that PwMS could not manage their walking efficiently compared to healthy people, who could maintain their rhythm throughout the 6MWT. Further studies are needed to detect these patterns changes in the early evolution of the disease, identify clinical determinants involved in PwMS' walking pattern, and investigate whether interventions can positively impact this pattern.

Personalized monitoring of ambulatory function with a smartphone 2-minute walk test in multiple sclerosis

BACKGROUND

Remote smartphone-based 2-minute walking tests (s2MWTs) allow frequent and potentially sensitive measurements of ambulatory function.

OBJECTIVE

To investigate the s2MWT on assessment of, and responsiveness to change in ambulatory function in MS.

METHODS

One hundred two multiple sclerosis (MS) patients and 24 healthy controls (HCs) performed weekly s2MWTs on self-owned smartphones for 12 and 3 months, respectively. The timed 25-foot walk test (T25FW) and Expanded Disability Status Scale (EDSS) were assessed at 3-month intervals. Anchor-based (using T25FW and EDSS) and distribution-based (curve fitting) methods were used to assess responsiveness of the s2MWT. A local linear trend model was used to fit weekly s2MWT scores of individual patients.

RESULTS

A total of 4811 and 355 s2MWT scores were obtained in patients (n = 94) and HC (n = 22), respectively. s2MWT demonstrated large variability (65.6 m) compared to the average score (129.5 m), and was inadequately responsive to anchor-based change in clinical outcomes. Curve fitting separated the trend from noise in high temporal resolution individual-level data, and statistically reliable changes were detected in 45% of patients.

CONCLUSIONS

In group-level analyses, clinically relevant change was insufficiently detected due to large variability with sporadic measurements. Individual-level curve fitting reduced the variability in s2MWT, enabling the detection of statistically reliable change in ambulatory function.

Balance Impairments in People with Early-Stage Multiple Sclerosis: Boosting the Integration of Instrumented Assessment in Clinical Practice

The balance of people with multiple sclerosis (PwMS) is commonly assessed during neurological examinations through clinical Romberg and tandem gait tests that are often not sensitive enough to unravel subtle deficits in early-stage PwMS. Inertial sensors (IMUs) could overcome this drawback. Nevertheless, IMUs are not yet fully integrated into clinical practice due to issues including the difficulty to understand/interpret the big number of parameters provided and the lack of cut-off values to identify possible abnormalities. In an attempt to overcome these limitations, an instrumented modified Romberg test (ImRomberg: standing on foam with eyes closed while wearing an IMU on the trunk) was administered to 81 early-stage PwMS and 38 healthy subjects (HS). To facilitate clinical interpretation, 21 IMU-based parameters were computed and reduced through principal component analysis into two components, sway complexity and sway intensity, descriptive of independent aspects of balance, presenting a clear clinical meaning and significant correlations with at least one clinical scale. Compared to HS, early-stage PwMS showed a 228% reduction in sway complexity and a 63% increase in sway intensity, indicating, respectively, a less automatic (more conscious) balance control and larger and faster trunk movements during upright posture. Cut-off values were derived to identify the presence of balance abnormalities and if these abnormalities are clinically meaningful. By applying these thresholds and integrating the ImRomberg test with the clinical tandem gait test, balance impairments were identified in 58% of PwMS versus the 17% detected by traditional Romberg and tandem gait tests. The higher sensitivity of the proposed approach would allow for the direct identification of early-stage PwMS who could benefit from preventive rehabilitation interventions aimed at slowing MS-related functional decline during neurological examinations and with minimal modifications to the tests commonly performed.

The utility of wearable devices in assessing ambulatory impairments of people with multiple sclerosis in free-living conditions

BACKGROUND AND OBJECTIVES

Multiple sclerosis (MS) is a progressive inflammatory and neurodegenerative disease of the central nervous system affecting over 2.5 million people globally. In-clinic six-minute walk test (6MWT) is a widely used objective measure to evaluate the progression of MS. Yet, it has limitations such as the need for a clinical visit and a proper walkway. The widespread use of wearable devices capable of depicting patients' activity profiles has the potential to assess the level of MS-induced disability in free-living conditions.

METHODS

In this work, we extracted 96 features in different temporal granularities (from minute-level to day-level) from wearable data and explored their utility in estimating 6MWT scores in a European (Italy, Spain, and Denmark) MS cohort of 337 participants over an average of 10 months' duration. We combined these features with participants' demographics using three regression models including elastic net, gradient boosted trees and random forest. In addition, we quantified the individual feature's contribution using feature importance in these regression models, linear mixed-effects models, generalized estimating equations, and correlation-based feature selection (CFS).

RESULTS

The results showed promising estimation performance with R2 of 0.30, which was derived using random forest after CFS. This model was able to distinguish the participants with low disability from those with high disability. Furthermore, we observed that the minute-level (≤ 8 minutes) step count, particularly those capturing the upper end of the step count distribution, had a stronger association with 6MWT. The use of a walking aid was indicative of ambulatory function measured through 6MWT.

CONCLUSIONS

This study demonstrates the utility of wearables devices in assessing ambulatory impairments in people with MS in free-living conditions and provides a basis for future investigation into the clinical relevance.

Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review

Background

With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.

Objective

We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.

Methods

A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.

Results

A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).

Conclusions

Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.

The mSteps pilot study: Analysis of the distance walked using a novel smartphone application in multiple sclerosis

BACKGROUND

Clinical studies in multiple sclerosis (MS) often require accurate measurement of walking distance. Utilisation of electronic devices could theoretically improve this. Mobile devices have the potential to continuously monitor health by collecting movement data. Popular fitness trackers record steps taken and distance travelled, typically using a fixed-stride length. However, applications using fixed-stride length may be less accurate in those with altered gait patterns. While useful for everyday purposes, medical monitoring requires greater accuracy.

OBJECTIVE

Our aim was to determine the agreement and reliability of using a smartphone application to measure distance walked.

METHOD

A phone application (mSteps) was developed and tested in a pilot study and then a validation study, looking at an indoor and outdoor setting with people with multiple sclerosis (PwMS) and a control cohort.

RESULTS

In the pilot study, the 95% limits of agreement (LOA) for outdoor tracking in control cohort lay within the a priori defined limit; however, the indoor tracking in both cohorts did not meet the defined limit. The app was then successfully validated outdoors in PwMS.

CONCLUSION

mSteps could be used to accurately measure distance outdoors in PwMS. There is still a need for solutions to accurately and reliably measure distance walked indoors.

Proposal for Post Hoc Quality Control in Instrumented Motion Analysis Using Markerless Motion Capture: Development and Usability Study

Background

Instrumented assessment of motor symptoms has emerged as a promising extension to the clinical assessment of several movement disorders. The use of mobile and inexpensive technologies such as some markerless motion capture technologies is especially promising for large-scale application but has not transitioned into clinical routine to date. A crucial step on this path is to implement standardized, clinically applicable tools that identify and control for quality concerns.

Objective

The main goal of this study comprises the development of a systematic quality control (QC) procedure for data collected with markerless motion capture technology and its experimental implementation to identify specific quality concerns and thereby rate the usability of recordings.

Methods

We developed a post hoc QC pipeline that was evaluated using a large set of short motor task recordings of healthy controls (2010 recordings from 162 subjects) and people with multiple sclerosis (2682 recordings from 187 subjects). For each of these recordings, 2 raters independently applied the pipeline. They provided overall usability decisions and identified technical and performance-related quality concerns, which yielded respective proportions of their occurrence as a main result.

Results

The approach developed here has proven user-friendly and applicable on a large scale. Raters’ decisions on recording usability were concordant in 71.5%-92.3% of cases, depending on the motor task. Furthermore, 39.6%-85.1% of recordings were concordantly rated as being of satisfactory quality whereas in 5.0%-26.3%, both raters agreed to discard the recording.

Conclusions

We present a QC pipeline that seems feasible and useful for instant quality screening in the clinical setting. Results confirm the need of QC despite using standard test setups, testing protocols, and operator training for the employed system and by extension, for other task-based motor assessment technologies. Results of the QC process can be used to clean existing data sets, optimize quality assurance measures, as well as foster the development of automated QC approaches and therefore improve the overall reliability of kinematic data sets.

Visual Search in Naturalistic Scenes Reveals Impaired Cognitive Processing Speed in Multiple Sclerosis

BACKGROUND

Standardized neuropsychological testing serves to quantify cognitive impairment in multiple sclerosis (MS) patients. However, the exact mechanism underlying the translation of cognitive dysfunction into difficulties in everyday tasks has remained unclear. To answer this question, we tested if MS patients with intact vs. impaired information processing speed measured by the Symbol Digit Modalities Test (SDMT) differ in their visual search behavior during ecologically valid tasks reflecting everyday activities.

METHODS

Forty-three patients with relapsing-remitting MS enrolled in an eye-tracking experiment consisting of a visual search task with naturalistic images. Patients were grouped into "impaired" and "unimpaired" according to their SDMT performance. Reaction time, accuracy and eye-tracking parameters were measured.

RESULTS

The groups did not differ regarding age, gender, and visual acuity. Patients with impaired SDMT (cut-off SDMT-z-score < -1.5) performance needed more time to find and fixate the target (q = 0.006). They spent less time fixating the target (q = 0.042). Impaired patients had slower reaction times and were less accurate (both q = 0.0495) even after controlling for patients' upper extremity function. Exploratory analysis revealed that unimpaired patients had higher accuracy than impaired patients particularly when the announced target was in unexpected location (p = 0.037). Correlational analysis suggested that SDMT performance is inversely linked to the time to first fixation of the target only if the announced target was in its expected location (r = -0.498, p = 0.003 vs. r = -0.212, p = 0.229).

CONCLUSION

Dysfunctional visual search behavior may be one of the mechanisms translating cognitive deficits into difficulties in everyday tasks in MS patients. Our results suggest that cognitively impaired patients search their visual environment less efficiently and this is particularly evident when top-down processes have to be employed.

Identification and Description of Balance, Mobility, and Gait Assessments Conducted via Telerehabilitation for Individuals With Neurological Conditions: Protocol for a Scoping Review

BACKGROUND

The COVID-19 global pandemic pushed many rehabilitation practitioners to pivot their in-person practice to adopt telerehabilitation as their main method of delivery. In addition to documenting information on interventions used with clients, it is best practice for therapists to use reliable and validated outcome measures to inform their interventions.

OBJECTIVE

Through this scoping review, we aim to identify (1) which outcomes are being used remotely to assess balance, mobility, and gait in patients with neurological conditions, and (2) what psychometric data (validity, reliability, etc.) for remotely administered outcomes are available.

METHODS

Three main concepts will be included in our search: (1) neurological conditions; (2) administration by telerehabilitation; and (3) outcome measures for balance, mobility, and gait. Studies reporting remote assessment of neurological conditions published since 1990 will be included. The database search will be completed in MEDLINE (Ovid), CINAHL, PubMed, PsycINFO, EMBASE, and Cochrane. Gray literature including dissertations, conference papers, and protocol papers will also be sourced. Two reviewers will independently screen each title and abstract using pre-established inclusion and exclusion criteria. Manuscripts that appear to meet the criteria will be subject to further review, and full-text extraction using a pre-piloted extraction sheet if all criteria are met. The data will be categorized by assessment types describing impairments (such as balance, strength, and mobility) or activity limitations or participation restriction (such as functional mobility, ambulatory functions, and activities of daily living).

RESULTS

This scoping review will document outcome measures currently used in the remote assessment of neurological conditions. To date, 235 titles and abstracts were screened. We are in the process of finalizing the full text screening for the inclusion of articles. We expect the full screening to be completed in November 2021 and data analysis in January 2022. Our results are expected to be published in early 2022.

CONCLUSIONS

The optimal use of telerehabilitation as a mode to deliver rehabilitation intervention should be coupled with the completion of validated outcome measures. Therefore, it is crucial to further our knowledge on remote outcome measures and therapeutic assessments.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/27186.

Creating a Digital Toolkit to Reduce Fatigue and Promote Quality of Life in Multiple Sclerosis: Participatory Design and Usability Study

Background

Fatigue is one of the most common and debilitating symptoms of multiple sclerosis (MS), experienced by more than 80% of people with MS. FACETS (Fatigue: Applying Cognitive Behavioral and Energy Effectiveness Techniques to Lifestyle) is an evidence-based, face-to-face, 6-session group fatigue management program for people with MS. Homework tasks are an integral part of FACETS and are currently undertaken in a paper-based form. Feedback from a consultation undertaken with FACETS attendees and health care professionals with experience in delivering the FACETS program suggested that being able to complete the homework tasks digitally would be desirable, potentially enhancing engagement and adherence and enabling on-the-go access to fit into busy lifestyles. Relative to other long-term conditions, there are few apps specifically for MS and, of those available, many have been developed with little or no input from people with MS.

Objective

The purpose of this mixed methods study was to create a digital toolkit comprising the homework tasks (eg, activity diary, goal planner, thought diary) of the FACETS program for people with MS, considering end users’ unique requirements throughout the design, build, prototyping, and testing stages.

Methods

Phase 1 involved the elicitation of detailed user requirements for the toolkit via 2 focus groups with previous attendees of FACETS (n=3 and n=6) and wireframing. Phase 2 involved supervised usability testing with people with MS (n=11) with iterative prototyping. The usability sessions involved going through test scenarios using the FACETS toolkit on an Android test phone with video capture and concurrent think-aloud followed by completion of the System Usability Scale (SUS) and a semistructured interview collecting feedback about design, content, and functionality.

Results

The mean SUS score for the digital toolkit was 74.3 (SD 16.8, 95% CI 63.2-85.6; range 37.5-95), which equates to an adjective rating of good and a B grade (70th-79th percentile range) on the Sauro-Lewis curved grading scale. A number of usability and design issues (such as simplifying overall screen flow to better meet users’ needs) and suggestions for improvements (such as using location-based services and displaying personalized information and progress via a central dashboard) were addressed and implemented during the usability testing cycle.

Conclusions

This work highlights the importance of the participation of people with MS across the entire development cycle, working to a human-centered design methodology to enable a considered and MS-centered solution to be developed. Continued horizon scanning for emergent technological enhancements will enable us to identify opportunities for further improvements to the FACETS toolkit prior to launch. The toolkit supports self-monitoring and management of fatigue and has potential applicability to other long-term conditions where fatigue is a significant issue.

Practice Effects of Mobile Tests of Cognition, Dexterity, and Mobility on Patients With Multiple Sclerosis: Data Analysis of a Smartphone-Based Observational Study

Background

Smartphones and their built-in sensors allow for measuring functions in disease-related domains through mobile tests. This could improve disease characterization and monitoring, and could potentially support treatment decisions for multiple sclerosis (MS), a multifaceted chronic neurological disease with highly variable clinical manifestations. Practice effects can complicate the interpretation of both improvement over time by potentially exaggerating treatment effects and stability by masking deterioration.

Objective

The aim of this study is to identify short-term learning and long-term practice effects in 6 active tests for cognition, dexterity, and mobility in user-scheduled, high-frequency smartphone-based testing.

Methods

We analyzed data from 264 people with self-declared MS with a minimum of 5 weeks of follow-up and at least 5 repetitions per test in the Floodlight Open study, a self-enrollment study accessible by smartphone owners from 16 countries. The collected data are openly available to scientists. Using regression and bounded growth mixed models, we characterized practice effects for the following tests: electronic Symbol Digit Modalities Test (e-SDMT) for cognition; Finger Pinching and Draw a Shape for dexterity; and Two Minute Walk, U-Turn, and Static Balance for mobility.

Results

Strong practice effects were found for e-SDMT (n=4824 trials), Finger Pinching (n=19,650), and Draw a Shape (n=19,019) with modeled boundary improvements of 40.8% (39.9%-41.6%), 86.2% (83.6%-88.7%), and 23.1% (20.9%-25.2%) over baseline, respectively. Half of the practice effect was reached after 11 repetitions for e-SDMT, 28 repetitions for Finger Pinching, and 17 repetitions for Draw a Shape; 90% was reached after 35, 94, and 56 repetitions, respectively. Although baseline performance levels were highly variable across participants, no significant differences between the short-term learning effects in low performers (5th and 25th percentile), median performers, and high performers (75th and 95th percentile) were found for e-SDMT up to the fifth trial (β=1.50-2.00). Only small differences were observed for Finger Pinching (β=1.25-2.5). For U-Turn (n=15,051) and Static Balance (n=16,797), only short-term learning effects could be observed, which ceased after a maximum of 5 trials. For Two Minute Walk (n=14,393), neither short-term learning nor long-term practice effects were observed.

Conclusions

Smartphone-based tests are promising for monitoring the disease trajectories of MS and other chronic neurological diseases. Our findings suggest that strong long-term practice effects in cognitive and dexterity functions have to be accounted for to identify disease-related changes in these domains, especially in the context of personalized health and in studies without a comparator arm. In contrast, changes in mobility may be more easily interpreted because of the absence of long-term practice effects, even though short-term learning effects might have to be considered.

Reliability, construct and concurrent validity of a smartphone-based cognition test in multiple sclerosis

Background:

Early detection and monitoring of cognitive dysfunction in multiple sclerosis (MS) may be enabled with smartphone-adapted tests that allow frequent measurements in the everyday environment.

Objectives:

The aim of this study was to determine the reliability, construct and concurrent validity of a smartphone-adapted Symbol Digit Modalities Test (sSDMT).

Methods:

During a 28-day follow-up, 102 patients with MS and 24 healthy controls (HC) used the MS sherpa^® app to perform the sSDMT every 3 days on their own smartphone. Patients performed the Brief International Cognitive Assessment for MS at baseline. Test–retest reliability (intraclass correlation coefficients, ICC), construct validity (group analyses between cognitively impaired (CI), cognitively preserved (CP) and HC for differences) and concurrent validity (correlation coefficients) were assessed.

Results:

Patients with MS and HC completed an average of 23.2 (SD = 10.0) and 18.3 (SD = 10.2) sSDMT, respectively. sSDMT demonstrated high test–retest reliability (ICCs > 0.8) with a smallest detectable change of 7 points. sSDMT scores were different between CI patients, CP patients and HC (all ps < 0.05). sSDMT correlated modestly with the clinical SDMT (highest r = 0.690), verbal (highest r= 0.516) and visuospatial memory (highest r= 0.599).

Conclusion:

Self-administered smartphone-adapted SDMT scores were reliable and different between patients who were CI, CP and HC and demonstrated concurrent validity in assessing information processing speed.

Usability of a Mobile App for Real-Time Assessment of Fatigue and Related Symptoms in Patients With Multiple Sclerosis: Observational Study

Background

Although fatigue is one of the most debilitating symptoms in patients with multiple sclerosis (MS), its pathogenesis is not well understood. Neurogenic, inflammatory, endocrine, and metabolic mechanisms have been proposed. Taking into account the temporal dynamics and comorbid mood symptoms of fatigue may help differentiate fatigue phenotypes. These phenotypes may reflect different pathogeneses and may respond to different mechanism-specific treatments. Although several tools have been developed to assess various symptoms (including fatigue), monitor clinical status, or improve the perceived level of fatigue in patients with MS, options for a detailed, real-time assessment of MS-related fatigue and relevant comorbidities are still limited.

Objective

This study aims to present a novel mobile app specifically designed to differentiate fatigue phenotypes using circadian symptom monitoring and state-of-the-art characterization of MS-related fatigue and its related symptoms. We also aim to report the first findings regarding patient compliance and the relationship between compliance and patient characteristics, including MS disease severity.

Methods

After developing the app, we used it in a prospective study designed to investigate the brain magnetic resonance imaging correlates of MS-related fatigue. In total, 64 patients with MS were recruited into this study and asked to use the app over a 2-week period. The app features the following modules: Visual Analogue Scales (VASs) to assess circadian changes in fatigue, depression, anxiety, and pain; daily sleep diaries (SLDs) to assess sleep habits and quality; and 10 one-time questionnaires to assess fatigue, depression, anxiety, sleepiness, physical activity, and motivation, as well as several other one-time questionnaires that were created to assess those relevant aspects of fatigue that were not captured by existing fatigue questionnaires. The app prompts subjects to assess their symptoms multiple times a day and enables real-time symptom monitoring through a web-accessible portal.

Results

Of 64 patients, 56 (88%) used the app, of which 51 (91%) completed all one-time questionnaires and 47 (84%) completed all one-time questionnaires, VASs, and SLDs. Patients reported no issues with the usage of the app, and there were no technical issues with our web-based data collection system. The relapsing-remitting MS to secondary-progressive MS ratio was significantly higher in patients who completed all one-time questionnaires, VASs, and SLDs than in those who completed all one-time questionnaires but not all VASs and SLDs (P=.01). No other significant differences in demographics, fatigue, or disease severity were observed between the degrees of compliance.

Conclusions

The app can be used with reasonable compliance across patients with relapsing-remitting and secondary-progressive MS irrespective of demographics, fatigue, or disease severity.