Development of a gait module to complement the 12-item Multiple Sclerosis Walking Scale: a mixed methods study

Translation and validation of the multiple sclerosis walking scale 12 for the German population - the MSWS-12/D

BACKGROUND

Gait impairment is a relevant problem in persons with multiple sclerosis (pwMS). The Multiple Sclerosis Walking Scale 12 (MSWS-12) is a valid Patient Reported Outcome Measure (PROM) to evaluate walking ability in pwMS. The aim of this study was to provide a linguistically valid translation of MSWS-12 into German language (MSWS-12/D) and to evaluate its psychometric properties.

METHODS

The MSWS-12 was translated in a process modified from guidelines for the cross-cultural adaption of PROMs, and a pre-test was applied in a small sample of 20 pwMS to evaluate comprehensibility and acceptance. Psychometric properties (floor and ceiling effects, internal consistency, construct validity) were then assessed in 124 pwMS seen at academic MS centers. Construct validity was evaluated against Expanded Disability Status Scale (EDSS) and maximum gait speed in the Timed 25-Foot Walk (T25FW).

RESULTS

Although the sample covered a wide spectrum of symptom severity, the majority had rather low levels of disability (EDSS median 2.0) and 6.5% scored EDSS of 0. In this sample, MSWS-12/D showed floor effects (36% with score 0) and for internal consistency, a Cronbach's alpha of 0.98 was calculated. MSWS-12/D score showed a relevant correlation to EDSS (ρ = 0.73) and T25FW speed (r=-0.72).

CONCLUSION

We provide MSWS-12/D as a linguistically valid German version of MSWS-12. Psychometric properties (acceptance, floor and ceiling effects, internal consistency and construct validity) in pwMS were similar to those described for the original version. This indicates that MSWS-12/D can be applied as equivalent to the original version in German speaking pwMS. Results support the relevance of PROMs to capture patient perception of walking ability in addition to performance-based assessments such as maximum walking speed or maximum walking distance.

Does the Multiple Sclerosis Impact Scale-29 (MSIS-29) have the range to capture the experience of fully ambulatory multiple sclerosis patients? Learnings from the ASCLEPIOS studies

Background

Trials of disease-modifying therapies (DMTs) for multiple sclerosis (MS) often include patients with minimal disability. Patient-reported outcome instruments used in these trials have often not captured physical and psychological treatment effects concomitant with observed clinical benefits.

Objective

To examine whether the Multiple Sclerosis Impact Scale-29 (MSIS-29) captures changes in the impact of MS in a sample of patients enrolled in the Phase 3 ASCLEPIOS studies (ofatumumab vs. teriflunomide).

Methods

Measurement properties (i.e. item fit, reliability, and targeting) of the MSIS-29 were analyzed using Rasch measurement theory (RMT) in data from two phase 3 ofatumumab clinical trials including patients with relapsing-remitting or secondary progressive MS (N = 1882). Targeting of the MSIS-29 items to the patient population was explored within groups categorized by Expanded Disability Status Scale (EDSS) scores.

Results

Under RMT analyses, both the Physical and Psychological Impact scales of the MSIS-29 were not appropriately targeted to the overall sample of patients. In particular, 49% and 30% of patients with an EDSS score ≤ 2.5 had fewer physical and psychological impacts, respectively, than would typically be captured by these MSIS-29 items compared to patients with EDSS scores of ≥ 3.

Conclusion

The MSIS-29 is commonly used to evaluate the patient-reported physical and psychological impact of MS. However, it may be limited in evaluating changes associated with DMTs in patients with minimal disability.

Applying a mixed methods design to test saturation for qualitative data in health outcomes research

Saturation, a core concept in qualitative research, suggests when data collection might end. It is reached when no new relevant information emerges with additional interviews. The aim of this research was to explore whether a mixed methods design could contribute to the demonstration of saturation. Firstly, saturation was conceptualized mathematically using set theory. Secondly, a conversion mixed design was conducted: a set of codes derived from qualitative interviews were quantitized and analyzed using partial least squares (PLS) regression to document whether saturation was reached. A qualitative study conducted by other researchers prior to this work (i.e. none of the present authors was involved in this study) was used to test saturation using PLS regression. This illustrative qualitative study aimed to investigate the impact of Clostridium difficile infection (CDI) on nurses' work in the hospital and the results were published elsewhere (Guillemin et al. 2015). Semi-structured interviews were conducted with 12 nurses. Saturation was characterized by the cumulative percentage of variability accounted for by PLS factors. After 12 interviews, this percentage was 51% which suggests that saturation was achieved at least on main themes. Two main themes identifying similarities in the experience of nurses caring for patients with CDI were identified: Organization/Coordination of the working day and Time-consuming work. Although dependent on the coding of qualitative data, PLS regression of quantitized data from qualitative interviews generated useful information for the determination of saturation.

Psychometric Properties of the Walking Impact Scale (Walk-12) in Persons with Late Effects of Polio

BACKGROUND

Many persons with late effects of polio (LEoP) perceive walking limitations in everyday life. A common rating scale to assess walking limitations is the Walking Impact Scale (Walk-12). However, there is limited knowledge about its psychometric properties.

OBJECTIVE

To investigate the psychometric properties of Walk-12 in persons with LEoP.

DESIGN

Rasch model analysis of cross-sectional data.

SETTING

University hospital.

PARTICIPANTS

A total of 325 persons with LEoP (175 women; mean age 70 ± 10 years).

MAIN OUTCOME MEASUREMENT

The Walk-12, comprising 12 items with five response categories ranging from 1 (not at all) to 5 (extremely).

METHODS

Data of Walk-12 were collected by a postal survey. The Rasch model analysis was used to analyze unidimensionality of the scale, local dependency, targeting, hierarchical order of items, Differential Item Functioning (DIF), response category functioning, and reliability (Person Separation Index, PSI). Raw score transformation to interval measurements was also performed.

RESULTS

The analysis revealed that Walk-12 was multidimensional and suffered from some local dependency. Targeting was compromised among persons with less and more walking limitations. Hierarchically, the most difficult item to perform was "running" and the easiest was "walking indoors with support". There was a minor DIF for gender in one item ("support when walking outdoors"). Reliability was high (PSI = 0.94). Disordered response category thresholds were found for three items; when merging the middle response categories for these items model fit slightly improved and unidimensionality was achieved.

CONCLUSIONS

The Walk-12, in its current version, does not fully meet the rigorous psychometric Rasch measurement standards in persons with LEoP. Further development of the scale is warranted, including merging response categories and complementing Walk-12 with objective measures of gait in order to improve targeting. As these limitations can be considered minor, the current version of Walk-12 can still be useful for research and clinical practice.