Lending a hand: can DASH items help ABILHAND improve manual ability measurement in multiple sclerosis?

Development and Validation of the Rasch-Built Overall Amyotrophic Lateral Sclerosis Disability Scale (ROADS)

Importance

A new outcome measure for overall disability level with improved responsiveness is needed for amyotrophic lateral sclerosis (ALS) clinical trials.

Objective

To describe the creation and development of a new self-reported ALS disability scale with improved item targeting and psychometric properties that used a mathematically rigorous Rasch methodology.

Design, Setting, and Participants

A preliminary ALS disability questionnaire with 119 questions was created based on literature review, clinical judgement of an expert panel, and patient input. Patients with ALS were recruited from January 2017 to June 2019 from the Emory University and Atlanta VA Medical Center ALS clinics, both in Atlanta, Georgia, during regularly scheduled clinic appointments to complete the draft questionnaire and standard ALS outcome measures. All consecutive patients seen at the Emory University and Atlanta VA Medical Center ALS clinics during the recruitment period with a diagnosis of ALS who were able to provide informed consent were invited to participate in the study. Rasch analyses were performed, and items were systematically removed based on missing data, model fit, disordered thresholds, item bias, and clinical judgment. A total of 509 patients with ALS were seen at the 2 sites during the recruitment period, and 264 patients provided informed consent.

Interventions

Participants completed the draft Rasch questionnaire and the revised Amyotrophic Lateral Sclerosis Functional Rating Scale (ALSFRS-R).

Main Outcomes and Measures

Rasch analyses and standard scale metrics were performed to create the new scale, and Rasch analyses were performed on the ALSFRS-R for comparison.

Results

Overall, 243 participants with ALS completed the draft questionnaire, and 230 participants were included for Rasch analyses. The mean (SD) age for study participants was 61.9 (11.1) years, 146 (60.1%) were men, and site of onset was 23.0% bulbar (n = 56), 36.2% upper extremity (n = 88), and 39.5% lower extremity (n = 96). A 28-question Rasch-Built Overall ALS Disability Scale (ROADS) was constructed with each item scored 0, 1, or 2. The ROADS fulfilled Rasch model requirements, demonstrated improved item targeting compared with the ALSFRS-R, and had test-retest reliability of 0.97. Individual question fit statistics demonstrated infit values from 0.68 to 1.37 and outfit values from 0.66 to 1.43. The difference between the empirical variance explained by the measures and the modeled variance was 0.1%. The ALSFRS-R violated Rasch model expectations and demonstrated disordered thresholds for 9 of 12 questions; 13 of 48 answer choices on the ALSFRS-R were never the most probable answer choice for any overall disability level.

Conclusions and Relevance

In this study, the 28-question, self-reported ROADS, which is linearly weighted, had improved item targeting compared with the ALSFRS-R, had high test-retest reliability, and was validated. ROADS may serve as a valuable and easily accessible outcome measure for use in ALS trials and in the clinic with improved responsiveness compared with the ALSFRS-R.

Differential item functioning of the Arm function in Multiple Sclerosis Questionnaire (AMSQ) by language, a study in six countries

BACKGROUND

The Arm function in Multiple Sclerosis Questionnaire (AMSQ) has been developed as a self-reported measure of arm and hand functioning for patients with multiple sclerosis (MS). The AMSQ was originally developed in Dutch and to date translated into five languages (i.e. English, German, Spanish, French, and Italian).

OBJECTIVE

The aim of this study was to evaluate differential item functioning (DIF) of the AMSQ in these languages.

METHODS

We performed DIF analyses, using "language" as the polytomous group variable. To detect DIF, logistic regression and item response theory principles were applied. Multiple logistic regression models were evaluated. We used a pseudo R² value of 0.02 or more as the DIF threshold.

RESULTS

A total of 1733 male and female patients with all subtypes of MS were included. The DIF analysis for the whole dataset showed no uniform or non-uniform DIF on any of the 31 items. All R² values were below 0.02.

CONCLUSION

The AMSQ is validated in six languages. All items have the same meaning to MS patients in Dutch, English, German, Spanish, French, and Italian. This validation study enables use of the AMSQ in international studies, for monitoring treatment response and disease progression.

Performance Measures for Upper Extremity Functions in Persons with Multiple Sclerosis

Recent studies suggest that upper extremity dysfunction is a quite common symptom in multiple sclerosis (MS), and affects adversely the activities of daily living even in the early stages of the disease. It is an undeniable fact that assessment is a crucial component for a disease management. The performance is defined as "what an individual does in his or her current environment" according to the International Classification of Functioning, Disability and Health (ICF). Performance measures for upper extremity have been used relatively recent in persons with MS. ABILHAND, Manual Ability Measurement (MAM), Disabilities of the Arm Shoulder and Hand Outcome Measure, and Motor Activity Log are commonly used perceived performance measures for upper extremity functions in persons with MS. Because of their modern psychometric properties, ABILHAND and MAM stands out from other measures. Only available actual performance measures for upper extremity functions in persons with MS are accelerometers. In addition to their advantages, they have some disadvantages waiting to be solved.

Assessment of Clinically Meaningful Improvements in Self-Reported Walking Ability in Participants with Multiple Sclerosis: Results from the Randomized, Double-Blind, Phase III ENHANCE Trial of Prolonged-Release Fampridine

BACKGROUND

Walking impairment is a hallmark of multiple sclerosis (MS). It affects > 90% of individuals over time, reducing independence and negatively impacting health-related quality of life, productivity, and daily activities. Walking impairment is consistently reported as one of the most distressing impairments by individuals with MS. Prolonged-release (PR)-fampridine previously has been shown to improve objectively measured walking speed in walking-impaired adults with MS. The impact of PR-fampridine from the perspective of the individual with MS warrants full and detailed examination.

OBJECTIVE

The objective of this study was to evaluate whether PR-fampridine has a clinically meaningful effect on self-reported walking ability in walking-impaired participants with MS.

METHODS

ENHANCE was a phase III, randomized, double-blind, placebo-controlled study of PR-fampridine 10 mg twice daily in walking-impaired individuals age 18-70 years with either relapsing or progressive forms of MS and an Expanded Disability Status Scale (EDSS) score of 4.0-7.0 at screening. Participants were stratified by EDSS score (≤ 6.0 or 6.5-7.0) at randomization to ensure a balanced level of disability in the treatment groups. The primary endpoint was the proportion of participants with a mean improvement in the 12-item Multiple Sclerosis Walking Scale (MSWS-12) score exceeding the predefined threshold for clinically meaningful improvement (≥ 8 points) over 24 weeks. Secondary endpoints included the proportion with ≥ 15% improvement in Timed Up and Go (TUG) speed, and mean changes in Multiple Sclerosis Impact Scale physical impact subscale (MSIS-29 PHYS), Berg Balance Scale (BBS), and ABILHAND scores over 24 weeks.

RESULTS

In total, 636 participants with MS were randomized (PR-fampridine, n = 317; placebo, n = 319; modified intention-to-treat sample: PR-fampridine, n = 315; placebo, n = 318). At baseline in the PR-fampridine and placebo groups, 46% and 51% had a progressive form of MS, median [range] EDSS scores were 6.0 [4.0-7.0] and 5.5 [4.0-7.0], mean [range] MSWS-12 scores were 63.6 [0-100] and 65.4 [0-100], and mean [range] TUG speed was 0.38 [0.0-1.0] and 0.38 [0.0-1.2] feet/s, respectively. A significantly higher percentage of PR-fampridine-treated participants (136/315 [43.2%]) had clinically meaningful improvement in MSWS-12 score over 24 weeks versus placebo (107/318 [33.6%]; odds ratio 1.61 [95% confidence interval 1.15-2.26]; p = 0.006). For PR-fampridine versus placebo, significantly more participants had a ≥ 15% improvement in TUG speed, and there was significantly greater mean improvement in MSIS-29 PHYS score (p < 0.05); numerical improvements that were not statistically significant were observed in BBS/ABILHAND. Adverse events that were more common in the PR-fampridine group than placebo group (difference ≥ 3%) by Medical Dictionary for Regulatory Activities (MedDRA^®) Preferred Term were urinary tract infection and insomnia. There were no seizures reported.

CONCLUSIONS

PR-fampridine treatment resulted in sustained, clinically meaningful improvements over 24 weeks in self-reported walking and functional ability in walking-disabled participants with MS. CLINICALTRIALS.

GOV IDENTIFIER

NCT02219932.

Development of the Arm Function in Multiple Sclerosis Questionnaire-Short Form (AMSQ-SF): A static 10-item version

BACKGROUND

Assessing arm and hand function of multiple sclerosis (MS) patients is important as impaired functioning may impact daily activities and reduce quality of life.

OBJECTIVE

A short-form of the Arm Function in Multiple Sclerosis Questionnaire (AMSQ), a recently developed patient-reported outcome measure containing 31 items, is developed to allow non-adaptive application.

METHODS

Complete data from 690 patients with MS, recruited via outpatient clinics, a residential center or via a Dutch website aimed at MS patients, were included in the analyses. A graded response model was fit to these data to estimate item response theory (IRT) parameters, which were used to perform post hoc computerized adaptive test (CAT) simulations with a cutoff standard error of measurement (SEM) of 0.32. The optimal test length was determined by the correlation between the static short-form and full-length theta, the mean SEM, and the amount of patients reaching a satisfactory SEM in CAT simulations.

RESULTS AND CONCLUSION

Based on five selection criteria (i.e. discrimination parameters, total information, times selected in CAT simulations, raw item means, and item content), 10 items were selected for inclusion in the short-form. The score on the final 10-item short-form correlated strongly with the full-length AMSQ and provided reliable ability estimations, indicating its usefulness instrument in research and clinical settings.

Addressing the targeting range of the ABILHAND-56 in relapsing-remitting multiple sclerosis: A mixed methods psychometric study

Background

ABILHAND, a manual ability patient-reported outcome instrument originally developed for stroke patients, has been used in multiple sclerosis clinical trials; however, psychometric analyses indicated the measure’s limited measurement range and precision in higher-functioning multiple sclerosis patients.

Objective

The purpose of this study was to identify candidate items to expand the measurement range of the ABILHAND-56, thus improving its ability to detect differences in manual ability in higher-functioning multiple sclerosis patients.

Methods

A step-wise mixed methods design strategy was used, comprising two waves of patient interviews, a combination of qualitative (concept elicitation and cognitive debriefing) and quantitative (Rasch measurement theory) analytic techniques, and consultation interviews with three clinical neurologists specializing in multiple sclerosis.

Results

Original ABILHAND was well understood in this context of use. Eighty-two new manual ability concepts were identified. Draft supplementary items were generated and refined with patient and neurologist input. Rasch measurement theory psychometric analysis indicated supplementary items improved targeting to higher-functioning multiple sclerosis patients and measurement precision. The final pool of Early Multiple Sclerosis Manual Ability items comprises 20 items.

Conclusion

The synthesis of qualitative and quantitative methods used in this study improves the ABILHAND content validity to more effectively identify manual ability changes in early multiple sclerosis and potentially help determine treatment effect in higher-functioning patients in clinical trials.