Recovery of hand function in virtual reality: Training hemiparetic hand and arm together or separately

A unified scheme for the benchmarking of upper limb functions in neurological disorders

BACKGROUND

In neurorehabilitation, we are witnessing a growing awareness of the importance of standardized quantitative assessment of limb functions. Detailed assessments of the sensorimotor deficits following neurological disorders are crucial. So far, this assessment has relied mainly on clinical scales, which showed several drawbacks. Different technologies could provide more objective and repeatable measurements. However, the current literature lacks practical guidelines for this purpose. Nowadays, the integration of available metrics, protocols, and algorithms into one harmonized benchmarking ecosystem for clinical and research practice is necessary.

METHODS

This work presents a benchmarking framework for upper limb capacity. The scheme resulted from a multidisciplinary and iterative discussion among several partners with previous experience in benchmarking methodology, robotics, and clinical neurorehabilitation. We merged previous knowledge in benchmarking methodologies for human locomotion and direct clinical and engineering experience in upper limb rehabilitation. The scheme was designed to enable an instrumented evaluation of arm capacity and to assess the effectiveness of rehabilitative interventions with high reproducibility and resolution. It includes four elements: (1) a taxonomy for motor skills and abilities, (2) a list of performance indicators, (3) a list of required sensor modalities, and (4) a set of reproducible experimental protocols.

RESULTS

We proposed six motor primitives as building blocks of most upper-limb daily-life activities and combined them into a set of functional motor skills. We identified the main aspects to be considered during clinical evaluation, and grouped them into ten motor abilities categories. For each ability, we proposed a set of performance indicators to quantify the proposed ability on a quantitative and high-resolution scale. Finally, we defined the procedures to be followed to perform the benchmarking assessment in a reproducible and reliable way, including the definition of the kinematic models and the target muscles.

CONCLUSIONS

This work represents the first unified scheme for the benchmarking of upper limb capacity. To reach a consensus, this scheme should be validated with real experiments across clinical conditions and motor skills. This validation phase is expected to create a shared database of human performance, necessary to have realistic comparisons of treatments and drive the development of new personalized technologies.

Haptic-Enabled Hand Rehabilitation in Stroke Patients: A Scoping Review

There is a plethora of technology-assisted interventions for hand therapy, however, less is known about the effectiveness of these interventions. This scoping review aims to explore studies about technology-assisted interventions targeting hand rehabilitation to identify the most effective interventions. It is expected that multifaceted interventions targeting hand rehabilitation are more efficient therapeutic approaches than mono-interventions. The scoping review will aim to map the existing haptic-enabled interventions for upper limb rehabilitation and investigates their effects on motor and functional recovery in patients with stroke. The methodology used in this review is based on the Arksey and O’Malley framework, which includes the following stages: identifying the research question, identifying relevant studies, study selection, charting the data, and collating, summarizing, and reporting the results. Results show that using three or four different technologies was more positive than using two technologies (one technology + haptics). In particular, when standardized as a percentage of outcomes, the combination of three technologies showed better results than the combination of haptics with one technology or with three other technologies. To conclude, this study portrayed haptic-enabled rehabilitation approaches that could help therapists decide which technology-enabled hand therapy approach is best suited to their needs. Those seeking to undertake research and development anticipate further opportunities to develop haptic-enabled hand telerehabilitation platforms.

Home-based transcranial direct current stimulation plus tracking training therapy in people with stroke: an open-label feasibility study

Background

Transcranial direct current stimulation (tDCS) is an effective neuromodulation adjunct to repetitive motor training in promoting motor recovery post-stroke. Finger tracking training is motor training whereby people with stroke use the impaired index finger to trace waveform-shaped lines on a monitor. Our aims were to assess the feasibility and safety of a telerehabilitation program consisting of tDCS and finger tracking training through questionnaires on ease of use, adverse symptoms, and quantitative assessments of motor function and cognition. We believe this telerehabilitation program will be safe and feasible, and may reduce patient and clinic costs.

Methods

Six participants with hemiplegia post-stroke [mean (SD) age was 61 (10) years; 3 women; mean (SD) time post-stroke was 5.5 (6.5) years] received five 20-min tDCS sessions and finger tracking training provided through telecommunication. Safety measurements included the Digit Span Forward Test for memory, a survey of symptoms, and the Box and Block test for motor function. We assessed feasibility by adherence to treatment and by a questionnaire on ease of equipment use. We reported descriptive statistics on all outcome measures.

Results

Participants completed all treatment sessions with no adverse events. Also, 83.33% of participants found the set-up easy, and all were comfortable with the devices. There was 100% adherence to the sessions and all recommended telerehabilitation.

Conclusions

tDCS with finger tracking training delivered through telerehabilitation was safe, feasible, and has the potential to be a cost-effective home-based therapy for post-stroke motor rehabilitation.

Trial registration

NCT02460809 (ClinicalTrials.gov).

Avascular necrosis of the humeral head following bilateral upper extremity vascular composite allotransplantation: a case report

Vascularised composite allotransplantation (VCA) represents an exciting and emerging field in plastic and reconstructive surgery. Despite the generally good functional and psychosocial outcomes, multiple complications can be associated with the procedure. The authors describe a case of avascular necrosis of the humeral head following successful upper extremity VCA.

A survey on robotic devices for upper limb rehabilitation

The existing shortage of therapists and caregivers assisting physically disabled individuals at home is expected to increase and become serious problem in the near future. The patient population needing physical rehabilitation of the upper extremity is also constantly increasing. Robotic devices have the potential to address this problem as noted by the results of recent research studies. However, the availability of these devices in clinical settings is limited, leaving plenty of room for improvement. The purpose of this paper is to document a review of robotic devices for upper limb rehabilitation including those in developing phase in order to provide a comprehensive reference about existing solutions and facilitate the development of new and improved devices. In particular the following issues are discussed: application field, target group, type of assistance, mechanical design, control strategy and clinical evaluation. This paper also includes a comprehensive, tabulated comparison of technical solutions implemented in various systems.

An interactive game-based shoulder wheel system for rehabilitation

BACKGROUND

Increases in the aging population and in the number of accidents have resulted in more people suffering from physical impairments or disabilities. Rehabilitation therapy thus attracts greater attention as a means of helping patients recover and return to a normal life. With the extremely long and tedious nature of traditional rehabilitation, patients are reluctant to continue the entire process, thus the expected effects of the therapy cannot be obtained. Games are well known to help patients improve their concentration and shift their attention away from the discomfort of their injuries during rehabilitation. Thus, incorporating game technology into a rehabilitation program may be a promising approach.

METHODS

In this study, a gaming system used for shoulder rehabilitation was developed. The mechanical parts and electric circuits were integrated to mimic the functionalities of a shoulder wheel. Several games were also designed to suit the rehabilitation needs of the patients based on the age and gender differences among the individual users, enabling individuals to undergo the rehabilitation process by playing games. Two surveys were conducted to evaluate the satisfaction of the participants regarding the gaming system.

RESULTS

The results of the online survey among a larger population coincide with the responses of the hands-on participants through a paper-and-pencil survey. Statistical results suggest that the participants are willing to accept this novel approach.

CONCLUSION

This gaming system can distract a patient from the sensation of pain or anxiety, and increase their motivation to participate in the therapeutic program. Advantages in terms of low-cost and easy setup increase the attractiveness of this new equipment for various potential users.

Visuomotor discordance in virtual reality: effects on online motor control

Virtual reality (VR) applications are rapidly permeating fields such as medicine, rehabilitation, research, and military training. However, VR-induced effects on human performance remain poorly understood, particularly in relation to fine-grained motor control of the hand and fingers. We designed a novel virtual reality environment suitable for hand-finger interactions and examined the ability to use visual feedback manipulations in VR to affect online motor performance. Ten healthy subjects performed a simple finger flexion movement toward a kinesthetically-defined 45° target angle while receiving one of three types of VR-based visual feedback in real-time: veridical (in which the virtual hand motion corresponded to subjects' actual motion), or scaled-down / scaled-up feedback (in which virtual finger motion was scaled by 25% / 175% relative to actual motion). Scaled down-and scaled-up feedback led to significant online modifications (increases and decreases, respectively) in angular excursion, despite explicit instructions for subjects to maintain constant movements across conditions. The latency of these modifications was similar across conditions. These findings demonstrate that a VR-based platform may be a robust medium for presenting visuomotor discordances to engender a sense of ownership and drive sensorimotor adaptation for (retraining motor skills. This may prove to be particularly important for retraining motor skills in patients with neurologically-based movement disorders.

Robotically facilitated virtual rehabilitation of arm transport integrated with finger movement in persons with hemiparesis

BACKGROUND

Recovery of upper extremity function is particularly recalcitrant to successful rehabilitation. Robotic-assisted arm training devices integrated with virtual targets or complex virtual reality gaming simulations are being developed to deal with this problem. Neural control mechanisms indicate that reaching and hand-object manipulation are interdependent, suggesting that training on tasks requiring coordinated effort of both the upper arm and hand may be a more effective method for improving recovery of real world function. However, most robotic therapies have focused on training the proximal, rather than distal effectors of the upper extremity. This paper describes the effects of robotically-assisted, integrated upper extremity training.

METHODS

Twelve subjects post-stroke were trained for eight days on four upper extremity gaming simulations using adaptive robots during 2-3 hour sessions.

RESULTS

The subjects demonstrated improved proximal stability, smoothness and efficiency of the movement path. This was in concert with improvement in the distal kinematic measures of finger individuation and improved speed. Importantly, these changes were accompanied by a robust 16-second decrease in overall time in the Wolf Motor Function Test and a 24-second decrease in the Jebsen Test of Hand Function.

CONCLUSIONS

Complex gaming simulations interfaced with adaptive robots requiring integrated control of shoulder, elbow, forearm, wrist and finger movements appear to have a substantial effect on improving hemiparetic hand function. We believe that the magnitude of the changes and the stability of the patient's function prior to training, along with maintenance of several aspects of the gains demonstrated at retention make a compelling argument for this approach to training.

Integrated versus isolated training of the hemiparetic upper extremity in haptically rendered virtual environments

This paper describes the preliminary results of an ongoing study of the effects of two training approaches on motor function and learning in persons with hemi paresis due to cerebrovascular accidents. Eighteen subjects with chronic stroke performed eight, three-hour sessions of sensorimotor training in haptically renedered environments. Eleven subjects performed training activities that integrated hand and arm movement while another seven subjects performed activities that trained the hand and arm with separately. As a whole, the eighteen subjects made statistically significant improvements in motor function as evidenced by robust improvements in Wolf Motor Function Test times and corresponding improvements in Jebsen Test of Hand Function times. There were no significant between group effects for these tests. However, the two training approaches elicited different patterns and magnitudes of performance improvement that suggest that they may elicit different types of change in motor learning and or control.

The New Jersey Institute of Technology Robot-Assisted Virtual Rehabilitation (NJIT-RAVR) system for children with cerebral palsy: a feasibility study

BACKGROUND

We hypothesize that the integration of virtual reality (VR) with robot assisted rehabilitation could be successful if applied to children with hemiparetic CP. The combined benefits of increased attention provided by VR and the larger training stimulus afforded by adaptive robotics may increase the beneficial effects of these two approaches synergistically. This paper will describe the NJIT-RAVR system, which combines adaptive robotics with complex VR simulations for the rehabilitation of upper extremity impairments and function in children with CP and examine the feasibility of this system in the context of a two subject training study.

METHODS

The NJIT-RAVR system consists of the Haptic Master, a 6 degrees of freedom, admittance controlled robot and a suite of rehabilitation simulations that provide adaptive algorithms for the Haptic Master, allowing the user to interact with rich virtual environments. Two children, a ten year old boy and a seven year old girl, both with spastic hemiplegia secondary to Cerebral Palsy were recruited from the outpatient center of a comprehensive pediatric rehabilitation facility. Subjects performed a battery of clinical testing and kinematic measurements of reaching collected by the NJIT-RAVR system. Subjects trained with the NJIT-RAVR System for one hour, 3 days a week for three weeks. The subjects played a combination of four or five simulations depending on their therapeutic goals, tolerances and preferences. Games were modified to increase difficulty in order to challenge the subjects as their performance improved. The testing battery was repeated following the training period.

RESULTS

Both participants completed 9 hours of training in 3 weeks. No untoward events occurred and no adverse responses to treatment or complaints of cyber sickness were reported. One participant showed improvements in overall performance on the functional aspects of the testing battery. The second subject made improvements in upper extremity active range of motion and in kinematic measures of reaching movements.

CONCLUSION

We feel that this study establishes the feasibility of integrating robotics and rich virtual environments to address functional limitations and decreased motor performance in children with mild to moderate cerebral palsy.

Incorporating haptic effects into three-dimensional virtual environments to train the hemiparetic upper extremity

Current neuroscience has identified several constructs to increase the effectiveness of upper extremity rehabilitation. One is the use of progressive, skill acquisition-oriented training. Another approach emphasizes the use of bilateral activities. Building on these principles, this paper describes the design and feasibility testing of a robotic/virtual environment system designed to train the arm of persons who have had strokes. The system provides a variety of assistance modes, scalable workspaces and hand-robot interfaces allowing persons with strokes to train multiple joints in three dimensions. The simulations utilize assistance algorithms that adjust task difficulty both online and offline in relation to subject performance. Several distinctive haptic effects have been incorporated into the simulations. An adaptive master-slave relationship between the unimpaired and impaired arm encourages active movement of the subject's hemiparetic arm during a bimanual task. Adaptive anti-gravity support and damping stabilize the arm during virtual reaching and placement tasks. An adaptive virtual spring provides assistance to complete the movement if the subject is unable to complete the task in time. Finally, haptically rendered virtual objects help to shape the movement trajectory during a virtual placement task. A proof of concept study demonstrated this system to be safe, feasible and worthy of further study.

A virtual reality-based system integrated with fmri to study neural mechanisms of action observation-execution: a proof of concept study

PURPOSE

Emerging evidence shows that interactive virtual environments (VEs) may be a promising tool for studying sensorimotor processes and for rehabilitation. However, the potential of VEs to recruit action observation-execution neural networks is largely unknown. For the first time, a functional MRI-compatible virtual reality system (VR) has been developed to provide a window into studying brain-behavior interactions. This system is capable of measuring the complex span of hand-finger movements and simultaneously streaming this kinematic data to control the motion of representations of human hands in virtual reality.

METHODS

In a blocked fMRI design, thirteen healthy subjects observed, with the intent to imitate (OTI), finger sequences performed by the virtual hand avatar seen in 1st person perspective and animated by pre-recorded kinematic data. Following this, subjects imitated the observed sequence while viewing the virtual hand avatar animated by their own movement in real-time. These blocks were interleaved with rest periods during which subjects viewed static virtual hand avatars and control trials in which the avatars were replaced with moving non-anthropomorphic objects.

RESULTS

We show three main findings. First, both observation with intent to imitate and imitation with real-time virtual avatar feedback, were associated with activation in a distributed frontoparietal network typically recruited for observation and execution of real-world actions. Second, we noted a time-variant increase in activation in the left insular cortex for observation with intent to imitate actions performed by the virtual avatar. Third, imitation with virtual avatar feedback (relative to the control condition) was associated with a localized recruitment of the angular gyrus, precuneus, and extrastriate body area, regions which are (along with insular cortex) associated with the sense of agency.

CONCLUSIONS

Our data suggest that the virtual hand avatars may have served as disembodied training tools in the observation condition and as embodied "extensions" of the subject's own body (pseudo-tools) in the imitation. These data advance our understanding of the brain-behavior interactions when performing actions in VE and have implications in the development of observation- and imitation-based VR rehabilitation paradigms.

Sensorimotor training in virtual reality: a review

Recent experimental evidence suggests that rapid advancement of virtual reality (VR) technologies has great potential for the development of novel strategies for sensorimotor training in neurorehabilitation. We discuss what the adaptive and engaging virtual environments can provide for massive and intensive sensorimotor stimulation needed to induce brain reorganization.Second, discrepancies between the veridical and virtual feedback can be introduced in VR to facilitate activation of targeted brain networks, which in turn can potentially speed up the recovery process. Here we review the existing experimental evidence regarding the beneficial effects of training in virtual environments on the recovery of function in the areas of gait,upper extremity function and balance, in various patient populations. We also discuss possible mechanisms underlying these effects. We feel that future research in the area of virtual rehabilitation should follow several important paths. Imaging studies to evaluate the effects of sensory manipulation on brain activation patterns and the effect of various training parameters on long term changes in brain function are needed to guide future clinical inquiry. Larger clinical studies are also needed to establish the efficacy of sensorimotor rehabilitation using VR in various clinical populations and most importantly, to identify VR training parameters that are associated with optimal transfer to real-world functional improvements.