Testing patient-reported outcome measurement equivalence in multinational clinical trials: An exemplar using the 12-item Multiple Sclerosis Walking Scale

Agreement between video-based clinician-rated tools and patient-reported outcomes on gait assessment in individuals with multiple sclerosis

PURPOSE

To our knowledge, no studies compared the video-clinician-based tools and patient-reported questionnaires in assessing gait and balance in people with MS (pwMS). The present study investigated the correlation and agreement between video-clinician-based objective measurement tools and patient-reported outcome measures (PROMs) in gait and balance evaluation.

METHODS

A prospective cross-sectional study was conducted with 55 pwMS. Video analysis-based gait was evaluated by the Tinetti Gait Assessment (TGA), Gait Assessment and Intervention Tool (GAIT), and Functional Ambulation Classification Scale (FACS) by the clinician. Participants' self-reported gait and balance were assessed with the Multiple Sclerosis Walking Scale-12 (MSWS-12) and Activity-Specific Balance Confidence Scale (ABC).

RESULTS

There was a moderate positive correlation between ABC with TGA and FACS (r1: 0.552, r2: 0.510, p < 0.001). ABC was strongly correlated with GAIT (r: - 0.652, p < 0.001). A moderate positive correlation was observed between MSWS-12 with TGA and FACS (r1: - 0.575, r2: - 0.524, p < 0.001). In addition, there was a strong positive correlation between MSWS-12 and GAIT (r: - 0.652, p < 0.001). Clinician-rated tools and PROMs were within the agreement limits regarding the unstandardized beta values p < 0.001).

CONCLUSIONS

Clinician-based gait and balance tools demonstrate consistent results with PROMs in pwMS. Considering the low cost and practical use of PROMs, in cases where video-based clinician-based measurements cannot be provided (time, space, and technical inadequacies), questionnaires can provide concordant results at moderate and severe levels compared with objective tools.

Psychometric properties of the Croatian version of the Multiple Sclerosis Walking Scale (MSWS-12)

PURPOSE

Walking difficulties in people with multiple sclerosis (pwMS) are one of the most pronounced predictors affecting patients' quality of life. The study objective was to determine the psychometric properties of the Croatian version of the Multiple Sclerosis Walking Scale (MSWS-12) among pwMS in Croatia and to examine the association between MSWS-12 and Depression, Anxiety, and Stress Scale-21 (DASS-21), and Multiple Sclerosis Impact Scale-29 (MSIS-29).

MATERIALS AND METHODS

A cross-sectional study included a sample of pwMS (N = 148). Psychometric properties were examined by estimating the validity and reliability of the MSWS-12. The predictive validity of MSWS-12 and demographic and disease-related factors were assessed by a hierarchical regression model using MSIS-29 and DASS-21 as criterion variables.

RESULTS

Scale reliability was good for the MSWS-12 scale, expressed by Cronbach's alpha coefficient (α = 0.98). Correlations between MSWS-12 and DASS-21 (0.20-0.27) and between MSWS-12 and MSIS-29 subscales (0.47-0.83) provided initial support for the convergent validity. Factor analysis demonstrated the unidimensional structure of the MSWS-12.

CONCLUSIONS

The Croatian version of the MSWS-12 is a reliable, valid, and clinically useful tool for assessing walking impairments in pwMS.Implications for rehabilitationWalking difficulties in people with multiple sclerosis (pwMS) are one of the most pronounced predictors affecting patients' quality of life.Multiple Sclerosis Walking Scale (MSWS-12) is a measure of the disease's impact on walking abilities from the patient's perspective.MSWS-12 is a reliable scale for assessing walking speed, endurance, and gait quality in multiple sclerosis and is validated in several languages (Korean, Italian, Brazilian, and Persian).The Croatian version of the MSWS-12 is a reliable, predictive, and valid tool for screening walking impairments in pwMS.

The Preference-Based Multiple Sclerosis Index: an assessment of its psychometric properties and translation into Turkish

PURPOSE

To translate Preference-Based Multiple Sclerosis Index (PBMSI) into Turkish, investigate its psychometric properties and differences between its two scoring algorithms: PBMSI-Rating Scale (PBMSI-RS) and PBMSI-Standard Gamble (PBMSI-SG).

METHODS

An expert committee supervised the translation process. Psychometric properties were evaluated in 104 people with multiple sclerosis. Exploratory common factor analysis was used to investigate structural validity. Convergent validity was assessed by formulating hypotheses about correlations between PBMSI and other HRQL measures, disability level, walking-related measures, and MS symptoms. Known-groups validity was assessed against different measures of disability and walking capacity. Test-retest reliability was assessed by calculating the intraclass correlation coefficient (ICC), standard error of measurement (SEM), and minimal detectable change (MDC95%).

RESULTS

Factor analysis revealed one factor (Eigenvalue = 2.46). PBMSI-RS and PBMSI-SG correlated significantly with other measures (p < .001). Both could differentiate between individuals with different levels of disability and walking capacity (p < .05, d  ≥  0.50). Relative test-retest reliability was moderate for PBMSI-RS (ICC = 0.75) and good for PBMSI-SG (ICC = 0.83). SEM and MDC95% values were 0.16 and 0.44 for PBMSI-RS and 0.10 and 0.28 for PBMSI-SG, respectively.

CONCLUSION

Turkish version of PBMSI has good psychometric properties to assess health-related quality of life in people with multiple sclerosis. PBMSI-SG should be preferred over PBMSI-RS.IMPLICATIONS FOR REHABILITATIONHealth-related quality of life is often used as a primary or secondary endpoint in multiple sclerosis research.The Preference-Based Multiple Sclerosis Index is the first preference-based health-related quality of life measure developed in multiple sclerosis using patient preferences.Preference-Based Multiple Sclerosis Index was translated to Turkish and demonstrated good psychometric properties, including structural, convergent, known-groups validity, internal consistency, and test-retest reliability.Professionals working in the field of multiple sclerosis research and rehabilitation may benefit from using the Preference-Based Multiple Sclerosis Index as it is a short and psychometrically robust instrument.

Effect of exergaming in people with restless legs syndrome with multiple sclerosis: A single-blind randomized controlled trial

BACKGROUND

Restless legs syndrome (RLS) is a sensory-motor disorder characterized by an uncomfortable sensation in the lower extremity, triggered by sitting and lying positions and release with motion. There is strong evidence that RLS prevalence is higher in persons with multiple sclerosis (MS, pwMS) than in the general population. Current literature has shown that exergaming as non-pharmacological therapy may be an effective method for symptoms such as balance, walking, fatigue, cognitive functions in pwMS, but the effects on RLS are not known. Therefore, the study's main aim is to investigate the effects of exergaming in pwMS with RLS.

METHODS

Thirty-one pwMS with RLS and 34 pwMS without RLS were randomly divided as exergaming group and control group. The outcome measures were International RLS Study Group Rating Scale, Modified Fatigue Impact Scale, MS Walking Scale, Timed 25-Foot Walk Test, Hospital Anxiety and Depression Scale, Godin-Shephard Leisure-Time Physical Activity Questionnaire, Pittsburgh Sleep Quality Index, Epworth Sleepiness Scale, 6 min Walk Test, Timed and Up Go, MS International Quality of Life questionnaire, MS-Related Symptom Checklist.

RESULTS

26 pwMS with RLS (11 exergaming group, 15 control group) and 27 pwMS without RLS (12 exergaming group, 15 control group) were included in 8-week post-treatment analyses. After an 8-week long-term follow-up, 16 pwMS with and without RLS completed the protocol. The RLS severity (p = 0.004), anxiety level (p = 0.024), sleep quality (0.005), walking (0.004), and balance functions (0.041) were improved in pwMS with RLS exergaming group, while RLS severity increased in control group (p = 0.004). At 8-week follow-up, the effect of exergaming on RLS severity, quality of life, sleep quality, and walking capacity was preserved. There was significant improvement in gait and balance functions in pwMS without RLS exergaming group, there was no significant differences control group. In 8-week follow-up, improvement obtained in pwMS without RLS exergaming group was not preserved.

CONCLUSIONS

This study suggests that exergaming training could be an effective method for managing RLS severity, anxiety, sleep quality, gait, balance, and quality of life in pwMS with RLS.

Associations between smoking and walking, fatigue, depression, and health-related quality of life in persons with multiple sclerosis

Smoking is associated with increased multiple sclerosis (MS) risk. In addition, some studies have reported that smoking is associated with anxiety and depression. However, the associations between smoking, walking, and fatigue are needed to be investigated. The objective was to investigate the associations between cigarette smoking and walking, fatigue, depression symptom severity, and health-related quality of life in persons with MS. Two hundred seventy-nine persons with MS were evaluated in this cross-sectional study. Study outcomes were neurological disability level, walking speed, walking endurance, perceived walking impact of MS, fatigue, depression symptom severity, and health-related quality of life. There were 95 (34.1%) current smokers who had significantly higher fatigue (p = 0.003, pη² = 0.031) and depression (p = 0.044, pη² = 0.015), and lower health-related quality of life (p = 0.003, pη² = 0.031) after adjusting for age, gender, neurological disability level, and disease duration compared to non-smokers (n = 184). There was no significant difference between smokers and non-smokers in walking measures (p > 0.05). Smoking intensity was significantly correlated with age (r = 0.487), neurological disability level (r = 0.227), disease duration (r = 0.30), walking speed (r = 0.574), walking endurance (r =  - 0.461), perceived walking impact of MS (r = 0.684), fatigue (r = 0.370), health-related quality of life (r =  - 0.259), and depression (r = 0.269) in current smokers. Cigarette smokers with MS had significantly more fatigue and depression symptom severity and less health-related quality of life compared to non-smokers. Increased pack-years of cigarette smoking was associated with worse walking ability and health-related quality of life, and greater depression symptom severity and fatigue.

Cross-cultural adaptation, validity and reliability of the Turkish version of the patient determined disease steps scale in persons with multiple sclerosis

Background: Patient Determined Disease Steps (PDDS) scale is a patient-reported outcome measure to assess disability in persons with multiple sclerosis (pwMS). This scale can be used as an alternative to Expanded Disability Status Scale (EDSS) as it is a costly, more time-consuming, and clinician-based method. This study aimed to conduct Turkish translation and cross-cultural adaptation of PDDS and investigate its psychometric properties.Methods: Turkish translation and cross-cultural adaptation of PDDS was conducted. Its psychometric properties including validity (i.e. content, criterion, and construct) and test-retest reliability (relative and absolute) were investigated in 100 pwMS.Results: PDDS had a significant strong correlation with EDSS (r_s = 0.61, p < .001). Regression model to predict EDSS scores from PDDS scores was significant (p < .001, R² = 0.67). Both PDDS and EDSS were significantly correlated with age, disease duration, walking speed and endurance, perceived impact of MS on walking, functional mobility, working memory and information processing speed, visual memory, manual dexterity, and health-related quality of life (p < .05). No significant difference was observed in the correlation coefficients of PDDS and EDSS (p > .05). Relative test-retest reliability was found high [ICC = 0.99 (95%CI = 0.99, 0.99)]. Absolute test-retest reliability was high as the Bland-Altman analyses showed no significant systematic bias between the repeated assessments. A narrow range of the limits of agreement indicated that PDDS had high stability and low variation between first and second assessments.Conclusion: Turkish version of PDDS presented high validity and test-retest reliability in pwMS.

Exploring regional variations in the cross-cultural, international implementation of the Patient Reported Outcomes Burdens and Experience (PROBE) study

BACKGROUND

The Patient Reported Outcomes Burdens and Experience (PROBE) study has developed and validated the PROBE questionnaire for assessing patient-reported outcomes in people with haemophilia and participants without bleeding disorders.

OBJECTIVE

To explore the regional variations in the international implementation of the PROBE questionnaire.

METHODS

Data were collected from participants in four regions (Western Pacific, South America, North America and Europe). Participants were able to choose English or translated versions of the PROBE questionnaire into their first language. We used analysis of variance methods and multivariable regression to determine the relative contribution of the variance explained by region controlling for haemophilia diagnosis, age group and levels of educations. We also explored interactions between region and the other components.

RESULTS

We used 862 questionnaires from 14 countries. Mean age of participants was 40.03 years (standard deviation 13.89), and 73.67% were male. After adjusting, region contributed 0.44%-7.98% of the variance component in subitem scores and 0.26% in the PROBE score. Years of education contributed 0.34% in the PROBE score. Age and haemophilia diagnosis contributed 3.42% and 22.42% of the PROBE score.

CONCLUSIONS

The results demonstrate that the PROBE questionnaire is valid to implement for assessing health status among patients with haemophilia and participants without bleeding disorders across regions.

Physical, cognitive and psychosocial effects of telerehabilitation-based motor imagery training in people with multiple sclerosis: A randomized controlled pilot trial

INTRODUCTION

Motor imagery training delivered at home via telerehabilitation is a novel rehabilitation concept. The aim was to investigate the effects of telerehabilitation-based motor imaging training (Tele-MIT) on gait, balance and cognitive and psychosocial outcomes in people with multiple sclerosis (pwMS).

METHODS

This randomized, controlled pilot trial included pwMS and healthy individuals. pwMS were randomly divided into two groups, intervention and control. The intervention group received Tele-MIT twice a week for 8 weeks. The control group was a wait-list group without any additional specific treatment. Healthy participants served as a baseline comparison. The Dynamic Gait Index, used to assess dynamic balance during walking, was the primary outcome. Secondary outcomes included assessments of walking speed, endurance and perceived ability, balance performance assessed by a computerized posturography device, balance confidence, cognitive functions, fatigue, anxiety, depression and quality of life.

RESULTS

Baseline comparisons with healthy individuals revealed that motor imagery abilities were preserved in pwMS (p > 0.05). The intervention group exhibited significant improvements in dynamic balance during walking (p = 0.002), walking speed (p = 0.007), perceived walking ability (p = 0.008), balance confidence (p = 0.002), most cognitive functions (p = 0.001-0.008), fatigue (p = 0.001), anxiety (p = 0.001), depression (p = 0.005) and quality of life (p = 0.002). No significant changes were observed in the control group in any of the outcome measures (p > 0.05).

DISCUSSION

Tele-MIT is a novel method that proved feasible and effective in improving dynamic balance during walking, walking speed and perceived walking ability, balance confidence, cognitive functions, fatigue, anxiety, depression and quality of life in pwMS.

The multiple sclerosis work difficulties questionnaire: translation and cross-cultural adaptation to Turkish and assessment of validity and reliability

Purpose: To linguistically and culturally adapt the Multiple Sclerosis Work Difficulties Questionnaire-23 (MSWDQ-23) for use in Turkey, and to examine its reliability and validity. Methods: Following standard forward-back translation of the MSWDQ-23, it was administered to 124 people with multiple sclerosis (MS). Validity was evaluated using related outcome measures including those related to employment status and expectations, disability level, fatigue, walking, and quality of life. Randomly selected participants were asked to complete the MSWDQ-23 again to assess test-retest reliability. Results: Confirmatory factor analysis on the MSWDQ-23 demonstrated a good fit for the data, and the internal consistency of each subscale was excellent. The test-retest reliability for the total score, psychological/cognitive barriers, physical barriers, and external barriers subscales were high. The MSWDQ-23 and its subscales were positively correlated with the employment, disability level, walking, and fatigue outcome measures. Conclusions: This study suggests that the Turkish version of MSWDQ-23 has high reliability and adequate validity, and it can be used to determine the difficulties faced by people with multiple sclerosis in workplace. Moreover, the study provides evidence about the test-retest reliability of the questionnaire. Implications for rehabilitation Multiple sclerosis affects young people of working age. Understanding work-related problems is crucial to enhance people with multiple sclerosis likelihood of maintaining their job. The Multiple Sclerosis Work Difficulties Questionnaire-23 (MSWDQ-23) is a valid and reliable measure of perceived workplace difficulties in people with multiple sclerosis: we presented its validation to Turkish. Professionals working in the field of vocational rehabilitation may benefit from using the MSWDQ-23 to predict the current work outcomes and future employment expectations.