Reliability of remote evaluation for the Fugl–Meyer assessment and the action research arm test in hemiparetic patients after stroke

Interrater reliability of the Fugl-Meyer Motor assessment in stroke patients: a quality management project within the ESTREL study

Introduction

The Fugl-Meyer Motor Assessment (FMMA) is recommended for evaluating stroke motor recovery in clinical practice and research. However, its widespread use requires refined reliability data, particularly across different health professions. We therefore investigated the interrater reliability of the FMMA scored by a physical therapist and a physician using video recordings of stroke patients.

Methods

The FMMA videos of 50 individuals 3 months post stroke (28 females, mean age 71.64 years, median National Institutes of Health Stroke Scale score 3.00) participating in the ESTREL trial (Enhancement of Stroke Rehabilitation with Levodopa: a randomized placebo-controlled trial) were independently scored by two experienced assessors (i.e., a physical therapist and a physician) with specific training to ensure consistency. As primary endpoint, the interrater reliability was calculated for the total scores of the entire FMMA and the total scores of the FMMA for the upper and lower extremities using intraclass correlation coefficients (ICC). In addition, Spearman's rank order correlation coefficients (Spearman's rho) were calculated for the total score and subscale levels. Secondary endpoints included the FMMA item scores using percentage agreement, weighted Cohen's kappa coefficients, and Gwet's AC1/AC2 coefficients.

Results

ICCs were 0.98 (95% confidence intervals (CI) 0.96-0.99) for the total scores of the entire FMMA, 0.98 (95% CI 0.96-0.99) for the total scores of the FMMA for the upper extremity, and 0.85 (95% CI 0.70-0.92) for the total scores of the FMMA for the lower extremity. Spearman's rho ranged from 0.61 to 0.94 for total and subscale scores. The interrater reliability at the item level of the FMMA showed (i) percentage agreement values with a median of 77% (range 44-100%), (ii) weighted Cohen's kappa coefficients with a median of 0.69 (range 0.00-0.98) and (iii) Gwet's AC1/AC2 coefficients with a median of 0.84 (range 0.42-0.98).

Discussion and conclusion

The FMMA appears to be a highly reliable measuring instrument at the overall score level for assessors from different health professions. The FMMA total scores seem to be suitable for the quantitative measurement of stroke recovery in both clinical practice and research, although there is potential for improvement at the item level.

Validity and reliability of selective control of upper extremity scale (SCUES) in patients with chronic stroke

PURPOSE

The aim of this study is to investigate the validity and reliability of the Selective Control of Upper Extremity Scale (SCUES) in patients with stroke.

MATERIALS AND METHODS

Forty-two patients with stroke aged 18-75 years, were included in the study. Patients were video-recorded while SCUES was administered. The videos were scored to determine the intrarater and inter-rater reliability. Fugl Meyer Assessment of Upper Extremity (FMA-UE), Box and Block test (BBT) and Brunnstrom Stages of Motor Recovery were measured to evaluate validity of SCUES. Spearman correlation analysis was used to assess the validity of SCUES. Intraclass correlation coefficient (ICC), Kappa (κ) and weighted Kappa (κw) were calculated to determine intrarater and inter-rater reliability.

RESULTS

There were significant positive high correlations between SCUES and FMA-UE and BBT and Brunnstrom upper extremity proximal and distal values (rho = 0.944, p = 0.01; rho = 0,875, p = 0.01; rho = 0.84, p = 0.01, rho = 0.82, p = 0.01; respectively) showing validity of SCUES. The ICC value of inter-rater reliability of SCUES was 0,99 (%95 CI: 0,989-0,997, p = 0,001) showing excellent reliability. κ and κ w values for inter-rater and intrarater reliability of individual SCUES items were above 0.7 indicating excellent reliability. ICC of SCUES and FMA-UE indicated excellent intrarater reliability (ICC = 0,99; %95 CI: 0,989-0,997, p = 0,001; ICC = 0.943; %95 CI: 0.9-0.97, p = 0,0001, consecutively).

CONCLUSIONS

SCUES showed similar validity and reliability with FMA-UE and SCUES can be used in the evaluation of upper extremity selective motor control in patients with stroke.

Psychometric properties of the Action Research Arm Test using decision rules for skipping items in hemiparetic patients after stroke: a retrospective study

PURPOSE

Important properties have been studied using the Action Research Arm Test (ARAT) in patients with stroke. However, whether the ARAT subtests constitute a Guttman scale (i.e., items hierarchically ordered according to difficulty) remains unclear. Guttman scales can define decision rules for skipping items in patients with low endurance. This study investigated the psychometric properties of the ARAT when applying decision rules for post-stroke hemiparetic patients.

METHODS

A retrospective, single-institution study was conducted between 2020 and 2021. Datasets of 30 patients with stroke-induced hemiparesis were collected from a previous study which employed the ARAT without decision rules, Fugl-Meyer assessment (FMA), Box and Block Test (BBT), and Motor Activity Log (MAL). The ARAT was rescored with decision rules for this study, and inter-rater reliability/agreement, parallel forms reliability, and construct validity were assessed.

RESULTS

Parallel forms reliability (Spearman's rho) was 0.99 (95% CI, 0.99-0.99) for both raters. The lower 95% CI limits of the sum and individual item scores in the reliability analysis exceeded the planned value (0.8). Construct validity values exceeded the planned value (0.8) for FMA, BBT, and MAL.

CONCLUSION

Decision rules can be used to skip ARAT items when assessing upper extremity motor function in stroke patients.IMPLICATIONS FOR REHABILITATIONThe Action Research Arm Test with decision rules for skipping items was valid and reliable for measuring upper extremity motor function in hemiparetic patients after stroke.The decision rules may reduce the burden of both patients and evaluators by decreasing the number of Action Research Arm Test items to be administrated.

Effects of cerebellar transcranial direct current stimulation on upper limb motor function after stroke: study protocol for the pilot of a randomized controlled trial

Background

Transcranial direct current stimulation (tDCS) is a technique that can noninvasively modulate neural states in a targeted brain region. As cerebellar activity levels are associated with upper limb motor improvement after stroke, the cerebellum is a plausible target of tDCS. However, the effect of tDCS remains unclear. Here, we designed a pilot study to assess: (1) the feasibility of a study that aims to examine the effects of cerebellar tDCS combined with an intensive rehabilitation approach based on the concept of constraint-induced movement therapy (CIMT) and (2) the preliminary outcome of the combined approach on upper limb motor function in patients with stroke in the chronic stage.

Methods

This pilot study has a double-blind randomized controlled design. Twenty-four chronic stroke patients with mild to moderate levels of upper limb motor impairment will be randomly assigned to an active or sham tDCS group. The participants will receive 20 min of active or sham tDCS to the contralesional cerebellum at the commencement of 4 h of daily intensive training, repeatedly for 5 days per week for 2 weeks. The primary outcomes are recruitment, enrollment, protocol adherence, and retention rates and measures to evaluate the feasibility of the study. The secondary outcome is upper limb motor function which will be evaluated using the Action Research Arm Test, Fugl-Meyer Assessment, for the upper extremity and the Motor Activity Log. Additionally, neurophysiological and neuroanatomical assessments of the cerebellum will be performed using transcranial magnetic stimulation and magnetic resonance imaging. These assessments will be conducted before, at the middle, and after the 2-week intervention, and finally, 1 month after the intervention. Any adverse events that occur during the study will be recorded.

Discussion

Cerebellar tDCS combined with intensive upper limb training may increase the gains of motor improvement when compared to the sham condition. The present study should provide valuable evidence regarding the feasibility of the design and the efficacy of cerebellar tDCS for upper limb motor function in patients with stroke before a future large trial is conducted.

Trial registration

This study has been registered at the Japan Registry of Clinical Trials (jRCTs042200078). Registered 17 December 2020

Functional and neuromuscular changes induced via a low-cost, muscle-computer interface for telerehabilitation: A feasibility study in chronic stroke

Stroke is a leading cause of adult disability in the United States. High doses of repeated task-specific practice have shown promising results in restoring upper limb function in chronic stroke. However, it is currently challenging to provide such doses in clinical practice. At-home telerehabilitation supervised by a clinician is a potential solution to provide higher-dose interventions. However, telerehabilitation systems developed for repeated task-specific practice typically require a minimum level of active movement. Therefore, severely impaired people necessitate alternative therapeutic approaches. Measurement and feedback of electrical muscle activity via electromyography (EMG) have been previously implemented in the presence of minimal or no volitional movement to improve motor performance in people with stroke. Specifically, muscle neurofeedback training to reduce unintended co-contractions of the impaired hand may be a targeted intervention to improve motor control in severely impaired populations. Here, we present the preliminary results of a low-cost, portable EMG biofeedback system (Tele-REINVENT) for supervised and unsupervised upper limb telerehabilitation after stroke. We aimed to explore the feasibility of providing higher doses of repeated task-specific practice during at-home training. Therefore, we recruited 5 participants (age = 44-73 years) with chronic, severe impairment due to stroke (Fugl-Meyer = 19-40/66). They completed a 6-week home-based training program that reinforced activity of the wrist extensor muscles while avoiding coactivation of flexor muscles via computer games. We used EMG signals to quantify the contribution of two antagonistic muscles and provide biofeedback of individuated activity, defined as a ratio of extensor and flexor activity during movement attempt. Our data suggest that 30 1-h sessions over 6 weeks of at-home training with our Tele-REINVENT system is feasible and may improve individuated muscle activity as well as scores on standard clinical assessments (e.g., Fugl-Meyer Assessment, Action Research Arm Test, active wrist range of motion) for some individuals. Furthermore, tests of neuromuscular control suggest modest changes in the synchronization of electroencephalography (EEG) and EMG signals within the beta band (12-30 Hz). Finally, all participants showed high adherence to the training protocol and reported enjoying using the system. These preliminary results suggest that using low-cost technology for home-based telerehabilitation after severe chronic stroke is feasible and may be effective in improving motor control via feedback of individuated muscle activity.

A Stroke Rehabilitation Educational Program for Occupational Therapy Students and Practitioners: Usability Study

BACKGROUND

There are gaps in knowledge translation (KT) of current evidence-based practices regarding stroke assessment and rehabilitation delivered through teletherapy. A lack of this knowledge can prevent occupational therapy (OT) students and practitioners from implementing current research findings.

OBJECTIVE

The aim of this pilot study was to create an educational program to translate knowledge into practice regarding the remote delivery of stroke assessment and rehabilitation to OT students and practitioners. Four areas of focus were addressed in the educational program, including KT, task-oriented training, stroke assessments, and telerehabilitation.

METHODS

Two pilot studies were conducted to assess the knowledge gained via pretests and posttests of knowledge, followed by a System Usability Scale and general feedback questionnaire. Participants in study 1 were 5 OT practitioners and 1 OT assistant. Participants in study 2 were 9 current OT students. Four 1-hour modules were emailed weekly to participants over the course of 4 weeks, with each module covering a different topic (KT, task-oriented training, stroke assessments, and telerehabilitation). Preliminary results were reviewed using descriptive statistics.

RESULTS

Statistically significant results were found with increased scores of knowledge for both students and practitioners. Most of the educational modules had an above-average score regarding value and positive feedback for the educational program as a whole from the participants.

CONCLUSIONS

Overall, the results of this pilot study indicate that a web-based educational program is a valuable, informational method of increasing the translation of knowledge in the remote delivery of stroke assessment and rehabilitation. OT students and practitioners found the information presented to be valuable and relevant to their future profession and current practice.

Rehabilitation of Upper Extremity by Telerehabilitation Combined With Exergames in Survivors of Chronic Stroke: Preliminary Findings From a Feasibility Clinical Trial

BACKGROUND

Exergames are increasingly being used among survivors of stroke with chronic upper extremity (UE) sequelae to continue exercising at home after discharge and maintain activity levels. The use of virtual reality exergames combined with a telerehabilitation app (VirTele) may be an interesting alternative to rehabilitate the UE sequelae in survivors of chronic stroke while allowing for ongoing monitoring with a clinician.

OBJECTIVE

This study aimed to determine the feasibility of using VirTele in survivors of chronic stroke at home and explore the impact of VirTele on UE motor function, quantity and quality of use, quality of life, and motivation in survivors of chronic stroke compared with conventional therapy.

METHODS

This study was a 2-arm feasibility clinical trial. Eligible participants were randomly allocated to an experimental group (receiving VirTele for 8 weeks) or a control group (receiving conventional therapy for 8 weeks). Feasibility was measured from the exergame and intervention logs completed by the clinician. Outcome measurements included the Fugl-Meyer Assessment-UE, Motor Activity Log-30, Stroke Impact Scale-16, and Treatment Self-Regulation Questionnaire-15, which were administered to both groups at four time points: time point 1 (T1; before starting the intervention), time point 2 (after the intervention), time point 3 (1 month after the intervention), and time point 4 (T4; 2 months after the intervention).

RESULTS

A total of 11 survivors of stroke were randomized and allocated to an experimental or a control group. At the onset of the COVID-19 pandemic, participants pursued the allocated treatment for 3 months instead of 8 weeks. VirTele intervention dose was captured in terms of time spent on exergames, frequency of use of exergames, total number of successful repetitions, and frequency of videoconference sessions. Technical issues included the loss of passwords, internet issues, updates of the system, and problems with the avatar. Overall, most survivors of stroke found the technology easy to use and useful, except for 9% (1/11) of participants. For the Fugl-Meyer Assessment-UE and Motor Activity Log-30, both groups exhibited an improvement in >50% of the participants, which was maintained over time (from time point 3 to T4). Regarding Stroke Impact Scale-16 scores, the control group reported improvement in activities of daily life (3/5, 60%), hand function (5/5, 100%), and mobility (2/5, 40%), whereas the experimental group reported varied and inconclusive results (from T1 to T4). For the Treatment Self-Regulation Questionnaire-15, 75% (3/4) of the experimental group demonstrated an increase in the autonomous motivation score (from T1 to time point 2), whereas, in the control group, this improvement was observed in only 9% (1/11) of participants.

CONCLUSIONS

The VirTele intervention constitutes another therapeutic alternative, in addition to conventional therapy, to deliver an intense personalized rehabilitation program for survivors of chronic stroke with UE sequelae.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/14629.

Remote Assessments of Hand Function in Neurological Disorders: Systematic Review

BACKGROUND

Loss of fine motor skills is observed in many neurological diseases, and remote monitoring assessments can aid in early diagnosis and intervention. Hand function can be regularly assessed to monitor loss of fine motor skills in people with central nervous system disorders; however, there are challenges to in-clinic assessments. Remotely assessing hand function could facilitate monitoring and supporting of early diagnosis and intervention when warranted.

OBJECTIVE

Remote assessments can facilitate the tracking of limitations, aiding in early diagnosis and intervention. This study aims to systematically review existing evidence regarding the remote assessment of hand function in populations with chronic neurological dysfunction.

METHODS

PubMed and MEDLINE, CINAHL, Web of Science, and Embase were searched for studies that reported remote assessment of hand function (ie, outside of traditional in-person clinical settings) in adults with chronic central nervous system disorders. We excluded studies that included participants with orthopedic upper limb dysfunction or used tools for intervention and treatment. We extracted data on the evaluated hand function domains, validity and reliability, feasibility, and stage of development.

RESULTS

In total, 74 studies met the inclusion criteria for Parkinson disease (n=57, 77% studies), stroke (n=9, 12%), multiple sclerosis (n=6, 8%), spinal cord injury (n=1, 1%), and amyotrophic lateral sclerosis (n=1, 1%). Three assessment modalities were identified: external device (eg, wrist-worn accelerometer), smartphone or tablet, and telerehabilitation. The feasibility and overall participant acceptability were high. The most common hand function domains assessed included finger tapping speed (fine motor control and rigidity), hand tremor (pharmacological and rehabilitation efficacy), and finger dexterity (manipulation of small objects required for daily tasks) and handwriting (coordination). Although validity and reliability data were heterogeneous across studies, statistically significant correlations with traditional in-clinic metrics were most commonly reported for telerehabilitation and smartphone or tablet apps. The most readily implementable assessments were smartphone or tablet-based.

CONCLUSIONS

The findings show that remote assessment of hand function is feasible in neurological disorders. Although varied, the assessments allow clinicians to objectively record performance in multiple hand function domains, improving the reliability of traditional in-clinic assessments. Remote assessments, particularly via telerehabilitation and smartphone- or tablet-based apps that align with in-clinic metrics, facilitate clinic to home transitions, have few barriers to implementation, and prompt remote identification and treatment of hand function impairments.

A Personalized Home-Based Rehabilitation Program Using Exergames Combined With a Telerehabilitation App in a Chronic Stroke Survivor: Mixed Methods Case Study

Background

In Canada, only 11% of stroke survivors have access to outpatient and community-based rehabilitation after discharge from inpatient rehabilitation. Hence, innovative community-based strategies are needed to provide adequate postrehabilitation services. The VirTele program, which combines virtual reality exergames and a telerehabilitation app, was developed to provide stroke survivors with residual upper extremity deficits, the opportunity to participate in a personalized home rehabilitation program.

Objective

This study aims to determine the feasibility of VirTele for remote upper extremity rehabilitation in a chronic stroke survivor; explore the preliminary efficacy of VirTele on upper extremity motor function, the amount and quality of upper extremity use, and impact on quality of life and motivation; and explore the determinants of behavioral intention and use behavior of VirTele along with indicators of empowerment.

Methods

A 63-year-old male stroke survivor (3 years) with moderate upper extremity impairment participated in a 2-month VirTele intervention. He was instructed to use exergames (5 games for upper extremity) for 30 minutes, 5 times per week, and conduct videoconference sessions with a clinician at least once per week. Motivational interviewing was incorporated into VirTele to empower the participant to continue exercising and use his upper extremities in everyday activities. Upper extremity motor function (Fugl-Meyer Assessment–upper extremity), amount and quality of upper extremity use (Motor Activity Log-30), and impact on quality of life (Stroke Impact Scale-16) and motivation (Treatment Self-Regulation Questionnaire-15) were measured before (T1), after (T2) VirTele intervention, and during a 1- (T3) and 2-month (T4) follow-up period. Qualitative data were collected through logs and semistructured interviews. Feasibility data (eg, number and duration of videoconference sessions and adherence) were documented at the end of each week.

Results

The participant completed 48 exergame sessions (33 hours) and 8 videoconference sessions. Results suggest that the VirTele intervention and the study protocol could be feasible for stroke survivors. The participant exhibited clinically meaningful improvements at T2 on the Fugl-Meyer and Stroke Impact Scale-16 and maintained these gains at T3 and T4. During the follow-up periods, the amount and quality of upper extremity use showed meaningful changes, suggesting more involvement of the affected upper extremity in daily activities. The participant demonstrated a high level of autonomous motivation, which may explain his adherence. Performance, effort, and social influence have meaningful weights in the behavioral intention of using VirTele. However, the lack of control of technical and organizational infrastructures may influence the long-term use of technology. At the end of the intervention, the participant demonstrated considerable empowerment at both the behavioral and capacity levels.

Conclusions

VirTele was shown to be feasible for use in chronic stroke survivors for remote upper extremity rehabilitation. Meaningful determinants of behavioral intention and use behavior of VirTele were identified, and preliminary efficacy results are promising.

International Registered Report Identifier (IRRID)

RR2-10.2196/14629

Clinimetric properties of the shortened Fugl-Meyer Assessment for the assessment of arm motor function in hemiparetic patients after stroke

Background: The Fugl-Meyer Assessment (FMA) is widely used as the gold standard in stroke research. However, the FMA has not been used in general clinical practice, which may be related to the fact that the FMA is a time-consuming measurement. Therefore, the FMA (upper extremity motor section) has already been shortened to a 6-item version using Rasch analysis for routine assessments of patients with low endurance. Although the shortened FMA has already demonstrated sound clinical utility, data on its psychometric properties remain insufficient.Objective: This study aimed to investigate the psychometric properties of the shortened FMA for the affected upper extremity in patients following stroke.Methods: A retrospective single-center study involving 30 patients was conducted. This study was registered in 2018 as a pre-initiation condition. The data used in this study were obtained from a study conducted between 2016 and 2017. The FMA (33- and 6-item versions) and the Action Research Arm Test, the Box-and-Block Test, and the Motor Activity Log were employed, and inter-rater reliability/agreement, validity, and internal consistency were assessed.Results: Regarding inter-rater reliability, the intraclass correlation coefficient was 0.994 (95% confidence interval: 0.988-0.997; P < .001). The mean differences between the raters of the shortened FMA were 0.07, and the limits of agreement were calculated to be between -0.81 and 0.95. Regarding the motor-related measurements, Spearman's rho were all higher than 0.91. On the other hand, regarding the sensation and joint motion/pain domain, Spearman's rho ranged from 0.25 to 0.50, and Cronbach's alpha was 0.92.Conclusions: The shortened FMA can reliably assess the affected upper extremity in patients with hemiparesis after stroke.