Patient reported outcome measures (PROMs) in amyotrophic lateral sclerosis

Tracking amyotrophic lateral sclerosis disease progression using passively collected smartphone sensor data

BACKGROUND

Passively collected smartphone sensor data provide an opportunity to study physical activity and mobility unobtrusively over long periods of time and may enable disease monitoring in people with amyotrophic lateral sclerosis (PALS).

METHODS

We enrolled 63 PALS who used Beiwe mobile application that collected their smartphone accelerometer and GPS data and administered the self-entry ALS Functional Rating Scale-Revised (ALSFRS-RSE) survey. We identified individual steps from accelerometer data and used the Activity Index to summarize activity at the minute level. Walking, Activity Index, and GPS outcomes were then aggregated into day-level measures. We used linear mixed effect models (LMMs) to estimate baseline and monthly change for ALSFRS-RSE scores (total score, subscores Q1-3, Q4-6, Q7-9, Q10-12) and smartphone sensor data measures, as well as the associations between them.

FINDINGS

The analytic sample (N = 45) was 64.4% male with a mean age of 60.1 years. The mean observation period was 292.3 days. The ALSFRS-RSE total score baseline mean was 35.8 and had a monthly rate of decline of -0.48 (p-value <0.001). We observed statistically significant change over time and association with ALSFRS-RSE total score for four smartphone sensor data-derived measures: walking cadence from top 1 min and log-transformed step count, step count from top 1 min, and Activity Index from top 1 min.

INTERPRETATION

Smartphone sensors can unobtrusively track physical changes in PALS, potentially aiding disease monitoring and future research.

Improvement of fatigue in generalised myasthenia gravis with zilucoplan

BACKGROUND

Fatigue is a debilitating symptom of myasthenia gravis (MG). The impact of fatigue on MG can be assessed by Quality of Life in Neurological Disorders (Neuro-QoL) Short Form Fatigue scale. Transformation of raw Neuro-QoL fatigue scores to T-scores is a known approach for facilitating clinical interpretation of clinically meaningful and fatigue severity thresholds.

METHODS

In the Phase 3, double-blind, placebo-controlled RAISE study (NCT04115293), adults with acetylcholine receptor autoantibody-positive generalised MG (MG Foundation of America Disease Class II-IV) were randomised 1:1 to daily subcutaneous zilucoplan 0.3 mg/kg or placebo for 12 weeks. Patients completing RAISE could opt to receive zilucoplan 0.3 mg/kg in an ongoing, open-label extension study, RAISE-XT (NCT04225871). In this post-hoc analysis, we evaluated the long-term effect of zilucoplan on fatigue in RAISE patients who entered RAISE-XT. We report change in Neuro-QoL Short Form Fatigue T-scores and fatigue severity levels from RAISE baseline to Week 60.

RESULTS

Mean Neuro-QoL Short Form Fatigue T-scores improved from baseline to Week 12 in the zilucoplan group (n = 86) with a clinically meaningful difference versus placebo (n = 88; least squares mean difference: - 3.61 (nominal p-value = 0.0060]), and these improvements continued further to Week 60. At Week 12, more patients on zilucoplan (n = 34, 47.2%) experienced improvements in ≥ 1 fatigue severity level from baseline versus placebo (n = 23, 28.4%; p = 0.017). At Week 60, most (n = 55, 65.5%) patients had mild fatigue or none.

CONCLUSION

Treatment with zilucoplan demonstrated statistical and clinically meaningful improvements in fatigue scores and severity versus placebo during RAISE, which were sustained to Week 60 in RAISE-XT.

Assessing the Measurement Properties of the Self-Administered Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R): A Rasch Analysis

OBJECTIVE

The self-administered version of the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-R) is used to monitor function and disease progression in individuals with amyotrophic lateral sclerosis (ALS). However, the performance of the self-administered ALSFRS-R has not been assessed using Rasch Measurement Theory. Therefore, the purpose of this study was to examine the psychometric properties of the self-administered ALSFRS-R using Rasch analysis.

METHODS

Rasch analysis was performed on self-administered ALSFRS-R data from individuals with ALS across Canada. The following 6 aspects of Rasch analysis were examined using RUMM2030: fit via residuals and chi-square statistics, targeting via person-item threshold maps, dependency via item residual correlations, unidimensionality through principal components analysis of residuals, reliability via person separation index, and stability through differential item functioning analyses for sex, age, and language.

RESULTS

Analysis was performed on 122 participants (mean age: 52.9 years; 62.8% men). The overall scale demonstrated good fit, reliability, and stability; however, multidimensionality was found. To address this issue, items were divided into 3 subscales (bulbar, motor, and respiratory function), and Rasch analysis was performed for each subscale. The subscales demonstrated good fit, reliability, stability, and unidimensionality. However, there were still issues with item dependency for all subscale and targeting for bulbar and respiratory subscales.

CONCLUSIONS

The self-administered ALSFRS-R is reliable, internally valid, and stable across sex, age, and language subgroups; however, it is recommended that the ALSFRS-R be scored by subscale. Future studies can look at revising and/or adding items to tackle misfit, redundancy, and ceiling effects.

IMPACT

Self-administered measures are simple to administer and inexpensive. The self-administered ALSFRS-R was found to be psychometrically sound and can be used as a tool to monitor disease progression and function in ALS.

Assessing the psychometric properties of quality of life measures in individuals with amyotrophic lateral sclerosis: a systematic review

PURPOSE

Amyotrophic lateral sclerosis (ALS) is the most common motor neuron disease in adults. There are many patient-reported outcome measures (PROMs) for measuring quality of life (QoL) and health-related QoL (HRQoL) within this population; however, there is limited consensus regarding which are most valid, reliable, responsive, and interpretable. This systematic review assesses the psychometric properties and interpretability of QoL and HRQoL PROMs for individuals with ALS.

METHODS

This review was conducted following the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) methodology for systematic reviews of PROMs. MEDLINE, EMBASE, and CINAHL databases were searched. Studies were included if their aim was to evaluate one or more psychometric properties or the interpretability of QoL or HRQoL PROMs in individuals with ALS.

RESULTS

We screened 2713 abstracts, reviewed 60 full-text articles, and included 37 articles. Fifteen PROMs were evaluated including generic HRQoL (e.g., SF-36), ALS-specific HRQoL (e.g., ALSAQ-40), and individualized QoL (e.g., SEIQoL) measures. Evidence for internal consistency and test-retest reliability were acceptable. For convergent validity, 84% of hypotheses were met. For known-groups validity, outcomes were able to distinguish between healthy cohorts and other conditions. Responsiveness results ranged from low to high correlations with other measures over 3-24 months. Evidence for content validity, structural validity, measurement error, and divergent validity was limited.

CONCLUSION

This review identified evidence in support of the ALSAQ-40 or ALSAQ-5 for individuals with ALS. These findings can guide healthcare practitioners when selecting evidence-based QoL and HRQoL PROMs for patients and provide researchers with insight into gaps in the literature.

Wearable device and smartphone data quantify ALS progression and may provide novel outcome measures

Amyotrophic lateral sclerosis (ALS) therapeutic development has largely relied on staff-administered functional rating scales to determine treatment efficacy. We sought to determine if mobile applications (apps) and wearable devices can be used to quantify ALS disease progression through active (surveys) and passive (sensors) data collection. Forty ambulatory adults with ALS were followed for 6-months. The Beiwe app was used to administer the self-entry ALS functional rating scale-revised (ALSFRS-RSE) and the Rasch Overall ALS Disability Scale (ROADS) surveys every 2-4 weeks. Each participant used a wrist-worn activity monitor (ActiGraph Insight Watch) or an ankle-worn activity monitor (Modus StepWatch) continuously. Wearable device wear and app survey compliance were adequate. ALSFRS-R highly correlated with ALSFRS-RSE. Several wearable data daily physical activity measures demonstrated statistically significant change over time and associations with ALSFRS-RSE and ROADS. Active and passive digital data collection hold promise for novel ALS trial outcome measure development.

Der Einsatz von Patient-reported Outcome Measures (PROM) und die Perspektive digitaler Biomarker bei der Amyotrophen Lateralsklerose

Die systematische Erfassung des klinischen Zustands sowie der Erfahrung mit Behandlung oder Versorgung durch einen strukturierten Bericht des Patienten wird als „Patient-reported Outcome Measures“ (PROM) bezeichnet. Bei der Amyotrophen Lateralsklerose (ALS) haben sich PROM insbesondere zur Dokumentation funktioneller Defizite, z. B. mit der ALS-Funktionsskala, und weiterer komplexer Symptome im Rahmen von klinischer Forschung etabliert. In der Behandlungspraxis werden PROM dazu genutzt, den Verlauf und die Prognose der Erkrankung einzuschätzen. Mit PROM werden neue biologische Biomarker (z. B. Neurofilamente) und digitale Biomarker (z. B. durch den Einsatz von Sensorik) auf ihre patientenzentrierte Relevanz evaluiert. Durch die digitale Anwendung von PROM und die Verknüpfung mit digitalen Biomarkern kann eine engmaschigere Erhebung von zu Hause aus erfolgen und damit die Datenqualität erhöht werden. Patienten können selbst den Gesundheitszustand monitorieren sowie Behandlungs- und Versorgungsergebnisse dokumentieren. Damit nehmen sie zunehmend eine aktive Rolle in der individuellen Behandlung und Versorgung ein.

Longitudinal comparison of the self-entry Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALSFRS-RSE) and Rasch-Built Overall Amyotrophic Lateral Sclerosis Disability Scale (ROADS) as outcome measures in people with amyotrophic lateral sclerosis

INTRODUCTION/AIMS

Improved functional outcome measures in amyotrophic lateral sclerosis (ALS) would aid ALS trial design and help hasten drug discovery. We evaluate the longitudinal performance of the Rasch-Built Overall Amyotrophic Lateral Sclerosis Disability Scale (ROADS) compared to the Amyotrophic Lateral Sclerosis Functional Rating Scale Revised for Self-Entry (ALSFRS-RSE) as patient reported outcomes of functional status in people with ALS.

METHODS

Participants completed the ROADS and the ALSFRS-RSE questionnaires at baseline, 3-, 6-, and 12- mo using Research Electronic Data Capture as part of a prospective, longitudinal, remote, online survey study of fatigue in ALS from 9/2020 to 12/2021. The scales were compared cross-sectionally (at baseline) and longitudinally. Correlation coefficients, coefficients of variation, and descriptive statistics were assessed.

RESULTS

A total of 182 adults with ALS consented to the study. This volunteer sample was comprised of predominantly White, non-Hispanic, non-smoking participants. Consented participant survey completion was approximately 90% at baseline and greater than 40% at 12 mo. The ALSFRS-RSE and the ROADS had high, significant agreement at 3 and 6 mo by Cohen's kappa ≥71% (p < 0.001); the number of functional increases or plateaus on the two scales were not significantly different; and the coefficient of variation of functional decline was similar at the 6-month mark, though higher for the ROADS at 3 mo and lower at 12 mo.

DISCUSSION

Although the ROADS performed similarly to the ALSFRS-RSE in an observational cohort, it has psychometric advantages, such as Rasch-modeling and unidimensionality. It merits further investigation as a patient reported outcome of overall disability and efficacy outcome measure in ALS trials.

Fatigue in Chinese Patients With Amyotrophic Lateral Sclerosis: Associated Factors and Impact on Quality of Life

Objectives

Fatigue was considered as a common symptom in amyotrophic lateral sclerosis (ALS). Previous studies about the impact of fatigue on Quality of Life (QoL) in patients with ALS were limited and inconsistent. Besides, a systematic investigation of fatigue in Chinese patients with ALS was lacking. Therefore, this study aimed to comprehensively evaluate the frequency and associated factors of fatigue and impact on QoL in Chinese patients with ALS.

Participants and Methods

Probable and definitive patients with ALS and age- and gender-matched healthy controls (HCs) were consecutively recruited. The frequency of fatigue between both the groups was determined by the Fatigue Severity Scale (FSS). Disease severity, sleep quality, sleepiness, anxiety, depression, and QoL were evaluated in patients with ALS by the ALS Functional Rating Scale-revised (ALSFRS-R) and the ALS Severity Scale (ALSSS), the Pittsburgh Sleep Quality Index (PSQI), the Epworth Sleepiness Scale (ESS), the Hamilton Anxiety Rating Scale (HARS), the Hamilton Depression Rating Scale (HDRS), and the McGill Quality of Life Questionnaire (MQOL). Then, clinical characteristics of patients with ALS with fatigue were compared with those without fatigue. Lastly, associated factors of fatigue and impact on QoL in Chinese patients with ALS were assessed.

Results

A total of 175 patients with ALS and 175 HCs were included. Fatigue was significantly more frequent in patients with ALS than in controls (32.6 vs. 17.7%, p = 0.001). Patients with ALS with fatigue scored lower on the ALSFRS-R, the ALSSS [lower extremity (LE) + upper extremity (UE)], the total ALSSS, higher in the HARS, HDRS, PSQI, ESS scores, and a poorer QoL. Daytime dysfunction and the ALSSS (LE + UE) score were associated with a higher risk of fatigue. The ALSSS (LE + UE), the FSS, age, the HARS, and the HDRS score were significantly associated with various aspects of QoL.

Conclusion

This study has described fatigue in Chinese patients with ALS and finding daytime dysfunction and the lower ALSSS (LE + UE) were associated with a higher risk of fatigue. Also, we identified an inverse relationship of fatigue intensity with the psychological domain of QoL.

Qualitative measures that assess functional disability and quality of life in ALS

BACKGROUND

Selection of appropriate trial endpoints and outcome measures is particularly important in rare disease and rapidly progressing disease such as amyotrophic lateral sclerosis (ALS) where the challenges to conducting clinical trials, are substantial: patient and disease heterogeneity, limited understanding of exact disease pathophysiology, and lack of robust and available biomarkers. To address these challenges in ALS, the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised version (ALSFRS-R) was developed and has become a key primary endpoint in ALS clinical trials to assess functional disability and disease progression, often replacing survival as a primary outcome. However, increased understanding of the ALS disease journey and improvements in assistive technology for ALS patients have exposed issues with the ALSFRS-R, including non-linearity, multidimensionality and floor and ceiling effects that could challenge its continued utility as a primary outcome measure in ALS clinical trials. Recently, other qualitative scale measures of functioning disability have been developed to help address these issues. With this in mind, we conducted a literature search aimed at identifying both established and promising new measures for potential use in clinical trials.

METHODS

We searched PubMed, Google, Google Scholar, and the reference sections of key studies to identify papers that discussed qualitative measures of functional status for potential use in ALS studies. We also searched clinicaltrials.gov to identify functional status and health-related quality of life (HRQoL) measures that have been used in ALS interventional studies.

RESULTS

In addition to the ALSFRS-R, we identified several newer qualitative scales including ALSFRS-EX, ALS-MITOS, CNS-BFS, DALS-15, MND-DS, and ROADS. Strengths and limitations of each measure were identified and discussed, along with their potential to act as a primary or secondary outcome to assess patient functional status in ALS clinical trials.

CONCLUSION

This paper serves as a reference guide for researchers deciding which qualitative measures to use as endpoints in their ALS clinical trials to assess functional status. This paper also discusses the importance of including ALS HRQoL and ALS cognitive screens in future clinical trials to assess the value of a new ALS therapy more comprehensively.

Digital Disparities: Lessons learned from a Patient Reported Outcomes Program During the COVID-19 Pandemic

The collection of patient reported outcomes (PROs) allows us to incorporate the patient's voice within their care in a quantifiable, validated manner. Large scale collection of PROs is facilitated by the electronic health record (EHR) and its portal, though historically patients have eschewed the portal and completed patient reported outcome measures (PROMS) in clinic via tablet. Furthermore, access to and use of the portal is associated with known racial inequities. Our institution oversees the largest clinical PRO program in the world, and has a long history of racially equitable PRO completion rates via tablet. However, when the COVID-19 pandemic forced us to remove tablets from clinics and rely exclusively on portal use for PRO completion, profound racial disparities resulted immediately. Our experience quantifiably demonstrates the magnitude of inequity that the portal, in its current configuration, generates and serves as a cautionary tale to other health care systems and EHRs.

Patient reported outcomes in ALS: characteristics of the self-entry ALS Functional Rating Scale-revised and the Activities-specific Balance Confidence Scale

Objective: This study characterized two patient-reported outcome measures (PROMs): a patient-facing adaptation of the revised amyotrophic lateral sclerosis (ALS) Functional Rating Scale ("self-entry ALSFRS-R") and the Activities-specific Balance Confidence (ABC) Scale. Methods: ALS patients presenting to clinic completed PROMs that included (1) the self-entry ALSFRS-R, (2) the Activities-specific Balance Confidence Scale (ABC Scale), and (3) a question about falls. PROM data were compared to one another and to the traditional ALSFRS-R collected by trained evaluators in clinic ("standard ALSFRS-R"). Results: Over the data collection period, 449 ALS patients completed at least one of the three PROMs. Self-entry vs. standard ALSFRS-R total scores (n = 183) had high agreement (intraclass correlation (ICC)=0.81, 95% CI = 0.67, 0.88). Self-entry ALSFRS-R total scores were significantly higher than standard ALSFRS-R total scores (2.3 points, p < 0.001). In a subset of participants who contributed data at two timepoints, the average ALSFRS-R decline was not significantly different between methods (n = 49). ABC scores correlated highly with self-entry and standard ALSFRS-R Gross Motor subdomain scores (Pearson's r = 0.72, p < 0.001 and Pearson's r = 0.76, p < 0.001, respectively; n = 130). ABC score was negatively correlated with the number of reported falls within the last month (Spearman's r=-0.40; p < 0.001; n = 130). A 10-point decrease in ABC score increased odds of a reported fall by 16%. Conclusions: In a multidisciplinary clinic setting, self-entry and standard ALSFRS-R scores were similar, but not interchangeable. Self-entry scores were higher than standard ALSFRS-R scores but declined at a similar rate to the standard ALSFRS-R. ABC scores correlated with self-reported fall history and thus may provide useful data for clinical care.

The 6-min walk test as a new outcome measure in Amyotrophic lateral sclerosis

One of the issues highlighted in amyotrophic lateral sclerosis (ALS) clinical trials is the lack of appropriate outcome measures. The aim of this multicentric study was to evaluate the 6-min walk test (6MWT) as tool to monitor the natural history of a cohort of ALS patients followed up over a 6-month interval. Forty-four ambulant patients were assessed at baseline and after 1, 3 and 6 months. Eight out of forty-four lost the ability to walk before the end of the study. The 6MWT and the objective measures linked to motor function, such as 10 m walking test (10MWT) and Time-up and go (TUG), the ALSFRS-R and the ALSFRS-R items 7–9 showed a good responsiveness to change over the 6-month interval. There was a strong correlation between 6 and 10MWT, TUG, ALSFRS-R, ALSFRS-R items 7–9 and FVC% at baseline. There was no correlation with Edinburgh Cognitive and Behavioural ALS Screen (ECAS) and Modified Borg Scale (MBS). The Δ of 6MWT from T0 to T6 significantly correlated with the Δs of 10MWT and TUG. There was no correlation with the Δs of ALSFRS-R, ALSFRS-R items 7 9, ECAS, MBS and FVC%. The discordance between changes of the 6MWT and ALSFRS-R at 6 month highlights the different content validity among these instruments. The concordance among 6MWT, 10MWT and TUG indicates that the 6MWT is an objective, sensitive and robust tool to measure motor performances in a longitudinal setting. The main limitations of our study were the small sample size and the high percentage of patients (18%) lost at follow-up. Therefore, further studies on larger cohorts, and exploring the relation between 6MWT and need of ventilator support or survival could strengthen our results.

Using patient-reported symptoms of dyspnea for screening reduced respiratory function in patients with motor neuron diseases

Background

Poor monitoring of respiratory function may lead to late initiation of non-invasive ventilation (NIV) in patients with motor neuron diseases (MND). Monitoring could be improved by remotely assessing hypoventilation symptoms between clinic visits. We aimed to determine which patient-reported hypoventilation symptoms are best for screening reduced respiratory function in patients with MND, and compared them to the respiratory domain of the amyotrophic lateral sclerosis functional rating scale (ALSFRS-R).

Methods

This prospective multi-center study included 100 patients with MND, who were able to perform a supine vital capacity test. Reduced respiratory function was defined as a predicted supine vital capacity ≤ 80%. We developed a 14-item hypoventilation symptom questionnaire (HYSQ) based on guidelines, expert opinion and think-aloud interviews with patients. Symptoms of the HYSQ were related to dyspnea, sleep quality, sleepiness/fatigue and pneumonia. The diagnostic performances of these symptoms and the ALSFRS-R respiratory domain were determined from the receiver operating characteristic (ROC) curves, area under the curve (AUC), sensitivity, specificity, predictive values and accuracy.

Results

Dyspnea-related symptoms (dyspnea while eating/talking, while lying flat and during light activity) were combined into the MND Dyspnea Scale (MND-DS). ROC curves showed that the MND-DS had the best diagnostic performance, with the highest AUC = 0.72, sensitivity = 75% and accuracy = 71%. Sleep-quality symptoms, sleepiness/fatigue-related symptoms and the ALSFRS-R respiratory domain showed weak diagnostic performance.

Conclusion

The diagnostic performance of the MND-DS was better than the respiratory domain of the ALSFRS-R for screening reduced respiratory function in patients with MND, and is, therefore, the preferred method for (remotely) monitoring respiratory function.

Electronic supplementary material

The online version of this article (10.1007/s00415-020-10003-5) contains supplementary material, which is available to authorized users.