Incorporating haptic effects into three-dimensional virtual environments to train the hemiparetic upper extremity

Smoothness metrics for reaching performance after stroke. Part 1: which one to choose?

Background

Smoothness is commonly used for measuring movement quality of the upper paretic limb during reaching tasks after stroke. Many different smoothness metrics have been used in stroke research, but a ‘valid’ metric has not been identified. A systematic review and subsequent rigorous analysis of smoothness metrics used in stroke research, in terms of their mathematical definitions and response to simulated perturbations, is needed to conclude whether they are valid for measuring smoothness. Our objective was to provide a recommendation for metrics that reflect smoothness after stroke based on: (1) a systematic review of smoothness metrics for reaching used in stroke research, (2) the mathematical description of the metrics, and (3) the response of metrics to simulated changes associated with smoothness deficits in the reaching profile.

Methods

The systematic review was performed by screening electronic databases using combined keyword groups Stroke, Reaching and Smoothness. Subsequently, each metric identified was assessed with mathematical criteria regarding smoothness: (a) being dimensionless, (b) being reproducible, (c) being based on rate of change of position, and (d) not being a linear transform of other smoothness metrics. The resulting metrics were tested for their response to simulated changes in reaching using models of velocity profiles with varying reaching distances and durations, harmonic disturbances, noise, and sub-movements. Two reaching tasks were simulated; reach-to-point and reach-to-grasp. The metrics that responded as expected in all simulation analyses were considered to be valid.

Results

The systematic review identified 32 different smoothness metrics, 17 of which were excluded based on mathematical criteria, and 13 more as they did not respond as expected in all simulation analyses. Eventually, we found that, for reach-to-point and reach-to-grasp movements, only Spectral Arc Length (SPARC) was found to be a valid metric.

Conclusions

Based on this systematic review and simulation analyses, we recommend the use of SPARC as a valid smoothness metric in both reach-to-point and reach-to-grasp tasks of the upper limb after stroke. However, further research is needed to understand the time course of smoothness measured with SPARC for the upper limb early post stroke, preferably in longitudinal studies.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12984-021-00949-6.

Haptic-Enabled Hand Rehabilitation in Stroke Patients: A Scoping Review

There is a plethora of technology-assisted interventions for hand therapy, however, less is known about the effectiveness of these interventions. This scoping review aims to explore studies about technology-assisted interventions targeting hand rehabilitation to identify the most effective interventions. It is expected that multifaceted interventions targeting hand rehabilitation are more efficient therapeutic approaches than mono-interventions. The scoping review will aim to map the existing haptic-enabled interventions for upper limb rehabilitation and investigates their effects on motor and functional recovery in patients with stroke. The methodology used in this review is based on the Arksey and O’Malley framework, which includes the following stages: identifying the research question, identifying relevant studies, study selection, charting the data, and collating, summarizing, and reporting the results. Results show that using three or four different technologies was more positive than using two technologies (one technology + haptics). In particular, when standardized as a percentage of outcomes, the combination of three technologies showed better results than the combination of haptics with one technology or with three other technologies. To conclude, this study portrayed haptic-enabled rehabilitation approaches that could help therapists decide which technology-enabled hand therapy approach is best suited to their needs. Those seeking to undertake research and development anticipate further opportunities to develop haptic-enabled hand telerehabilitation platforms.

Towards a Platform for Robot-Assisted Minimally-Supervised Therapy of Hand Function: Design and Pilot Usability Evaluation

Background

Robot-assisted therapy can increase therapy dose after stroke, which is often considered insufficient in clinical practice and after discharge, especially with respect to hand function. Thus far, there has been a focus on rather complex systems that require therapist supervision. To better exploit the potential of robot-assisted therapy, we propose a platform designed for minimal therapist supervision, and present the preliminary evaluation of its immediate usability, one of the main and frequently neglected challenges for real-world application. Such an approach could help increase therapy dose by allowing the training of multiple patients in parallel by a single therapist, as well as independent training in the clinic or at home.

Methods

We implemented design changes on a hand rehabilitation robot, considering aspects relevant to enabling minimally-supervised therapy, such as new physical/graphical user interfaces and two functional therapy exercises to train hand motor coordination, somatosensation and memory. Ten participants with chronic stroke assessed the usability of the platform and reported the perceived workload during a single therapy session with minimal supervision. The ability to independently use the platform was evaluated with a checklist.

Results

Participants were able to independently perform the therapy session after a short familiarization period, requiring assistance in only 13.46 (7.69–19.23)% of the tasks. They assigned good-to-excellent scores on the System Usability Scale to the user-interface and the exercises [85.00 (75.63–86.88) and 73.75 (63.13–83.75) out of 100, respectively]. Nine participants stated that they would use the platform frequently. Perceived workloads lay within desired workload bands. Object grasping with simultaneous control of forearm pronosupination and stiffness discrimination were identified as the most difficult tasks.

Discussion

Our findings demonstrate that a robot-assisted therapy device can be rendered safely and intuitively usable upon first exposure with minimal supervision through compliance with usability and perceived workload requirements. The preliminary usability evaluation identified usability challenges that should be solved to allow real-world minimally-supervised use. Such a platform could complement conventional therapy, allowing to provide increased dose with the available resources, and establish a continuum of care that progressively increases therapy lead of the patient from the clinic to the home.

Virtual Rehabilitation of the Paretic Hand and Arm in Persons With Stroke: Translation From Laboratory to Rehabilitation Centers and the Patient's Home

The anatomical and physiological heterogeneity of strokes and persons with stroke, along with the complexity of normal upper extremity movement make the possibility that any single treatment approach will become the definitive solution for all persons with upper extremity hemiparesis due to stroke unlikely. This situation and the non-inferiority level outcomes identified by many studies of virtual rehabilitation are considered by some to indicate that it is time to consider other treatment modalities. Our group, among others, has endeavored to build on the initial positive outcomes in studies of virtual rehabilitation by identifying patient populations, treatment settings and training schedules that will best leverage virtual rehabilitation's strengths. We feel that data generated by our lab and others suggest that (1) persons with stroke may adapt to virtual rehabilitation of hand function differently based on their level of impairment and stage of recovery and (2) that less expensive, more accessible home based equipment seems to be an effective alternative to clinic based treatment that justifies continued optimism and study.

Effects of Future Information and Trajectory Complexity on Kinematic Signal and Muscle Activation during Visual-Motor Tracking

Visual-motor tracking movement is a common and essential behavior in daily life. However, the contribution of future information to visual-motor tracking performance is not well understood in current research. In this study, the visual-motor tracking performance with and without future-trajectories was compared. Meanwhile, three task demands were designed to investigate their impact. Eighteen healthy young participants were recruited and instructed to track a target on a screen by stretching/flexing their elbow joint. The kinematic signals (elbow joint angle) and surface electromyographic (EMG) signals of biceps and triceps were recorded. The normalized integrated jerk (NIJ) and fuzzy approximate entropy (fApEn) of the joint trajectories, as well as the multiscale fuzzy approximate entropy (MSfApEn) values of the EMG signals, were calculated. Accordingly, the NIJ values with the future-trajectory were significantly lower than those without future-trajectory (p-value < 0.01). The smoother movement with future-trajectories might be related to the increasing reliance of feedforward control. When the task demands increased, the fApEn values of joint trajectories increased significantly, as well as the MSfApEn of EMG signals (p-value < 0.05). These findings enrich our understanding about visual-motor control with future information.

Hand Focused Upper Extremity Rehabilitation in the Subacute Phase Post-stroke Using Interactive Virtual Environments

Introduction: Innovative motor therapies have attempted to reduce upper extremity impairment after stroke but have not made substantial improvement as over 50% of people post-stroke continue to have sensorimotor deficits affecting their self-care and participation in daily activities. Intervention studies have focused on the role of increased dosing, however recent studies have indicated that timing of rehabilitation interventions may be as important as dosing and importantly, that dosing and timing interact in mediating effectiveness. This study is designed to empirically test dosing and timing. Methods and Analysis: In this single-blinded, interventional study, subjects will be stratified on two dimensions, impairment level (Fugl-Meyer Upper Extremity Assessment (FM) and presence or absence of Motor Evoked Potentials (MEPs) as follows; (1) Severe, FM score 10-19, MEP+, (2) Severe, FM score 10-19, MEP-, (3) Moderate, FM score 20-49, MEP+, (4) Moderate, FM score 20-49, MEP-. Subjects not eligible for TMS will be assigned to either group 2 (if severe) or group 3 (if moderate). Stratified block randomization will then be used to achieve a balanced assignment. Early Robotic/VR Therapy (EVR) experimental group will receive in-patient usual care therapy plus an extra 10 h of intensive upper extremity therapy focusing on the hand using robotically facilitated rehabilitation interventions presented in virtual environments and initiated 5-30 days post-stroke. Delayed Robotic/VR Therapy (DVR) experimental group will receive the same intervention but initiated 30-60 days post-stroke. Dose-matched usual care group (DMUC) will receive an extra 10 h of usual care initiated 5-30 days post-stroke. Usual Care Group (UC) will receive the usual amount of physical/occupational therapy. Outcomes: There are clinical, neurophysiological, and kinematic/kinetic measures, plus measures of daily arm use and quality of life. Primary outcome is the Action Research Arm Test (ARAT) measured at 4 months post-stroke. Discussion: Outcome measures will be assessed to determine whether there is an early time period in which rehabilitation will be most effective, and whether there is a difference in the recapture of premorbid patterns of movement vs. the development of an efficient, but compensatory movement strategy. Ethical Considerations: The IRBs of New Jersey Institute of Technology, Rutgers University, Northeastern University, and Kessler Foundation reviewed and approved all study protocols. Study was registered in https://ClinicalTrials.gov (NCT03569059) prior to recruitment. Dissemination will include submission to peer-reviewed journals and professional presentations.

Development of the Home based Virtual Rehabilitation System (HoVRS) to remotely deliver an intense and customized upper extremity training

Background

After stroke, sustained hand rehabilitation training is required for continuous improvement and maintenance of distal function.

Methods

In this paper, we present a system designed and implemented in our lab: the Home based Virtual Rehabilitation System (HoVRS). Fifteen subjects with chronic stroke were recruited to test the feasibility of the system as well as to refine the design and training protocol to prepare for a future efficacy study. HoVRS was placed in subjects’ homes, and subjects were asked to use the system at least 15 min every weekday for 3 months (12 weeks) with limited technical support and remote clinical monitoring.

Results

All subjects completed the study without any adverse events. Subjects on average spent 13.5 h using the system. Clinical and kinematic data were collected pre and post study in the subject’s home. Subjects demonstrated a mean increase of 5.2 (SEM = 0.69) on the Upper Extremity Fugl-Meyer Assessment (UEFMA). They also demonstrated improvements in six measurements of hand kinematics. In addition, a combination of these kinematic measures was able to predict a substantial portion of the variability in the subjects’ UEFMA score.

Conclusion

Persons with chronic stroke were able to use the system safely and productively with minimal supervision resulting in measurable improvements in upper extremity function.

Clinical Application of Virtual Reality for Upper Limb Motor Rehabilitation in Stroke: Review of Technologies and Clinical Evidence

Neurorehabilitation for stroke is important for upper limb motor recovery. Conventional rehabilitation such as occupational therapy has been used, but novel technologies are expected to open new opportunities for better recovery. Virtual reality (VR) is a technology with a set of informatics that provides interactive environments to patients. VR can enhance neuroplasticity and recovery after a stroke by providing more intensive, repetitive, and engaging training due to several advantages, including: (1) tasks with various difficulty levels for rehabilitation, (2) augmented real-time feedback, (3) more immersive and engaging experiences, (4) more standardized rehabilitation, and (5) safe simulation of real-world activities of daily living. In this comprehensive narrative review of the application of VR in motor rehabilitation after stroke, mainly for the upper limbs, we cover: (1) the technologies used in VR rehabilitation, including sensors; (2) the clinical application of and evidence for VR in stroke rehabilitation; and (3) considerations for VR application in stroke rehabilitation. Meta-analyses for upper limb VR rehabilitation after stroke were identified by an online search of Ovid-MEDLINE, Ovid-EMBASE, the Cochrane Library, and KoreaMed. We expect that this review will provide insights into successful clinical applications or trials of VR for motor rehabilitation after stroke.

Intensive virtual reality and robotic based upper limb training compared to usual care, and associated cortical reorganization, in the acute and early sub-acute periods post-stroke: a feasibility study

BACKGROUND

There is conflict regarding the benefits of greater amounts of intensive upper limb rehabilitation in the early period post-stroke. This study was conducted to test the feasibility of providing intensive therapy during the early period post-stroke and to develop a randomized control trial that is currently in process. Specifically, the study investigated whether an additional 8 h of specialized, intensive (200-300 separate hand or arm movements per hour) virtual reality (VR)/robotic based upper limb training introduced within 1-month post-stroke resulted in greater improvement in impairment and behavior, and distinct changes in cortical reorganization measured via Transcranial Magnetic Stimulation (TMS), compared to that of a control group.

METHODS

Seven subjects received 8-1 h sessions of upper limb VR/robotic training in addition to their inpatient therapy (PT, OT, ST). Six subjects only received their inpatient therapy. All were tested on measures of impairment [Upper Extremity Fugl-Meyer Assessment (UEFMA), Wrist AROM, Maximum Pinch Force], behavior [Wolf Motor Function Test (WMFT)], and also received TMS mapping until 6 months post training. ANOVAs were conducted to measure differences between groups across time for all outcome measures. Associations between changes in ipsilesional cortical maps during the early period of enhanced neuroplasticity and long-term changes in upper limb impairment and behavior measures were evaluated.

RESULTS

The VR/robotic group made significantly greater improvements on UEFMA and Wrist AROM scores compared to the usual care group. There was also less variability in the association between changes in the First Dorsal Interosseus (FDI) muscle map area and WMFT and Maximum Force change scores for the VR/robotic group.

CONCLUSIONS

An additional 8 h of intensive VR/robotic based upper limb training initiated within the first month post-stroke may promote greater gains in impairment compared to usual care alone. Importantly, the data presented demonstrated the feasibility of conducting this intervention and multiple outcome measures (impairment, behavioral, neurophysiological) in the early period post-stroke.

Devices and Protocols for Upper Limb Robot-Assisted Rehabilitation of Children with Neuromotor Disorders

Neuromotor disorders negatively affect the sensorimotor system, limiting the ability to perform daily activities autonomously. Rehabilitation of upper limb impairments is therefore essential to improve independence and quality of life. In the last two decades, there has been a growing interest in robot-assisted rehabilitation as a beneficial way to promote children recovery process. However, a common understanding of the best drivers of an effective intervention has not been reached yet. With this aim, the current study reviewed the existing literature on robot-assisted rehabilitation protocols for upper extremities in children, with the goal of examining the effects of robotic therapy on their sensorimotor recovery process. A literature search was conducted in several electronic database to identify the studies related to the application of robotic therapy on upper limbs in the pediatric population. We analyzed three reviews and 35 studies that used 14 different robotic devices, and an overview of their characteristics, applications in the clinical setting and results is provided. Besides, the potential benefits of robot-assisted assessment and therapy are discussed to identify the key factors yielding positive outcomes in children. Finally, this review aim to lay the foundations for more effective neuroplasticity-enhancement protocols and elicit insights into robot-based approaches.

The Association Between Reorganization of Bilateral M1 Topography and Function in Response to Early Intensive Hand Focused Upper Limb Rehabilitation Following Stroke Is Dependent on Ipsilesional Corticospinal Tract Integrity

Transcranial magnetic stimulation (TMS) induced motor evoked potentials (MEPs) are an established proxy of corticospinal excitability. As a binary measure, the presence (MEP+) or absence (MEP-) of ipsilesional hemisphere MEPs early following stroke is a robust indicator of long-term recovery, however this measure does not provide information about spatial cortical reorganization. MEPs have been systematically acquired over the sensorimotor cortex to "map" motor topography. In this investigation we compared the degree to which functional improvements resulting from early (<3 months post-stroke) intensive hand focused upper limb rehabilitation correlate with changes in motor topography between MEP+ and MEP- individuals. Following informed consent, 17 individuals (4 Female, 60.3 ± 9.4 years, 24.6 ± 24.01 days post first time stroke) received 8 one hour-sessions of training with virtual reality (VR)/Robotic simulations. Clinical tests [Box and Blocks Test (BBT), Wolf Motor Function Test (WMFT), Upper Extremity Fugl-Meyer (UEFMA)], kinematic and kinetic assessments [finger Active Range of Motion (finger AROM), Maximum Pinch Force (MPF)], and bilateral TMS mapping of 5 hand muscles were performed prior to (PRE), directly following (POST), and 1 month following (1M) training. Participants were divided into two groups (MEP+, MEP-) based on whether an MEP was present in the affected first dorsal interosseous (FDI) at any time point. MEP+ individuals improved significantly more than MEP- individuals from PRE to 1M on the WMFT, BBT, and finger AROM scores. Ipsilesional hemisphere FDI area increased significantly with time in the MEP+ group. FDI area of the contralesional hemisphere was not significantly different across time points or groups. In the MEP+ group, significant correlations were observed between PRE-1M changes in ipsilesional FDI area and WMFT, BBT, and finger AROM, and contralesional FDI area and UEFMA and MPF. In the MEP- group, no significant correlations were found between changes in contralesional FDI area and functional outcomes. We report preliminary evidence in a small sample that patterns of recovery and the association of recovery to bilateral changes in motor topography may depend on integrity of the ipsilesional cortical spinal tract as assessed by the presence of TMS evoked MEPs.

Neural Patterns of Reorganization after Intensive Robot-Assisted Virtual Reality Therapy and Repetitive Task Practice in Patients with Chronic Stroke

Several approaches to rehabilitation of the hand following a stroke have emerged over the last two decades. These treatments, including repetitive task practice (RTP), robotically assisted rehabilitation and virtual rehabilitation activities, produce improvements in hand function but have yet to reinstate function to pre-stroke levels-which likely depends on developing the therapies to impact cortical reorganization in a manner that favors or supports recovery. Understanding cortical reorganization that underlies the above interventions is therefore critical to inform how such therapies can be utilized and improved and is the focus of the current investigation. Specifically, we compare neural reorganization elicited in stroke patients participating in two interventions: a hybrid of robot-assisted virtual reality (RAVR) rehabilitation training and a program of RTP training. Ten chronic stroke subjects participated in eight 3-h sessions of RAVR therapy. Another group of nine stroke subjects participated in eight sessions of matched RTP therapy. Functional magnetic resonance imaging (fMRI) data were acquired during paretic hand movement, before and after training. We compared the difference between groups and sessions (before and after training) in terms of BOLD intensity, laterality index of activation in sensorimotor areas, and the effective connectivity between ipsilesional motor cortex (iMC), contralesional motor cortex, ipsilesional primary somatosensory cortex (iS1), ipsilesional ventral premotor area (iPMv), and ipsilesional supplementary motor area. Last, we analyzed the relationship between changes in fMRI data and functional improvement measured by the Jebsen Taylor Hand Function Test (JTHFT), in an attempt to identify how neurophysiological changes are related to motor improvement. Subjects in both groups demonstrated motor recovery after training, but fMRI data revealed RAVR-specific changes in neural reorganization patterns. First, BOLD signal in multiple regions of interest was reduced and re-lateralized to the ipsilesional side. Second, these changes correlated with improvement in JTHFT scores. Our findings suggest that RAVR training may lead to different neurophysiological changes when compared with traditional therapy. This effect may be attributed to the influence that augmented visual and haptic feedback during RAVR training exerts over higher-order somatosensory and visuomotor areas.

Assessment of Motor Control during Three-Dimensional Movements Tracking with Position-Varying Gravity Compensation

Active movements are important in the rehabilitation training for patients with neurological motor disorders, while weight of upper limb impedes movements due to muscles weakness. The objective of this study is to develop a position-varying gravity compensation strategy for a cable-based rehabilitation robot. The control strategy can estimate real-time gravity torque according to position feedback. Then, the performance of this control strategy was compared with the other two kinds of gravity compensation strategies (i.e., without compensation and with fixed compensation) during movements tracking. Seven healthy subjects were invited to conduct tracking tasks along four different directions (i.e., upward, forward, leftward, and rightward). The performance of movements with different compensation strategies was compared in terms of root mean square error (RMSE) between target and actual moving trajectories, normalized jerk score (NJS), mean velocity ratio (MVR) of main motion direction, and the activation of six muscles. The results showed that there were significant effects in control strategies in all four directions with the RMSE and NJS values in the following order: without compensation > fixed compensation > position-varying compensation and MVR values in the following order: without compensation < fixed compensation < position-varying compensation (p < 0.05). Comparing with movements without compensation in all four directions, the activation of muscles during movements with position-varying compensation showed significant reductions, except the activations of triceps and in forward and leftward movements, the activations of upper trapezius and middle parts of deltoid in upward movements and the activations of posterior parts of deltoid in all four directions (p < 0.05). Therefore, with position-varying gravity compensation, the upper limb cable-based rehabilitation robotic system might assist subjects to perform movements with higher quality and improve the participation of robot-aided rehabilitation training. Further studies are needed to explore the effectiveness and clinic application across pathologies.

PROJECT HEAVEN: Preoperative Training in Virtual Reality

A cephalosomatic anastomosis (CSA; also called HEAVEN: head anastomosis venture) has been proposed as an option for patients with neurological impairments, such as spinal cord injury (SCI), and terminal medical illnesses, for which medicine is currently powerless. Protocols to prepare a patient for life after CSA do not currently exist. However, methods used in conventional neurorehabilitation can be used as a reference for developing preparatory training. Studies on virtual reality (VR) technologies have documented VR's ability to enhance rehabilitation and improve the quality of recovery in patients with neurological disabilities. VR-augmented rehabilitation resulted in increased motivation towards performing functional training and improved the biopsychosocial state of patients. In addition, VR experiences coupled with haptic feedback promote neuroplasticity, resulting in the recovery of motor functions in neurologically-impaired individuals. To prepare the recipient psychologically for life after CSA, the development of VR experiences paired with haptic feedback is proposed. This proposal aims to innovate techniques in conventional neurorehabilitation to implement preoperative psychological training for the recipient of HEAVEN. Recipient's familiarity to body movements will prevent unexpected psychological reactions from occurring after the HEAVEN procedure.

A study on the operation of rehabilitation interfaces in active rehabilitation exercises for upper limb hemiplegic patients: Interfaces for lateral and bilateral exercises

BACKGROUND

For implementing autonomous rehabilitation exercises for upper limb hemiplegic patients, interfaces and a rehabilitation scenario that allow lateral and bilateral motions in a rehabilitation exercise robot are proposed.

OBJECTIVE

The proposed method measures the motion information generated from the unaffected part and projects it to an affected part in which the affected part expresses motions of the unaffected part.

METHODS

Both the accelerometer and gyro data were merged for estimating the motion information of the unaffected part. Also, HDR and complementary filters were applied to improve measurement errors in a data merging process.

RESULTS

For verifying the proposed method, a device, which is similar to a human body joint, was fabricated. Then, the angular values estimated by using an inertial sensor and the encoder values from the device were compared. In addition, a camera analysis was used to verify the proposed rehabilitation scenario by applying the rehabilitation interface proposed in this study to an exo-skeleton robot arm.

CONCLUSION

It is possible to apply the method proposed in this study to the control variables in different upper limb rehabilitation exercise robots. Thus, it is expected that patient centered active lateral/bilateral rehabilitation exercises can be performed through this interface method.

An intelligent control framework for robot-aided resistance training using hybrid system modeling and impedance estimation

This study presents a novel therapy control method for robot-assisted resistance training using the hybrid system modeling technology and the estimated patient's bio-impedance changes. A new intelligent control framework based on hybrid system theory is developed, to automatically generate the desired resistive force and to make accommodating emergency behavior, when monitoring the changes of the impaired limb's muscle strength or the unpredictable safety-related occurrences during the execution of the training task. The impaired limb's muscle strength progress is online evaluated using its bio-damping and bio-stiffness estimation results. The proposed method is verified with a custom constructed therapeutic robot system featuring a Barrett WAM™ compliant manipulator. A typical inpatient stroke subject was recruited and enrolled in a ten-week resistance training program. Preliminary results show that the proposed therapeutic strategy can enhance the impaired limb's muscle strength and has practicability for robot-aided rehabilitation training.

Bilateral robots for upper-limb stroke rehabilitation: State of the art and future prospects

Robot-assisted bilateral upper-limb training grows abundantly for stroke rehabilitation in recent years and an increasing number of devices and robots have been developed. This paper aims to provide a systematic overview and evaluation of existing bilateral upper-limb rehabilitation devices and robots based on their mechanisms and clinical-outcomes. Most of the articles studied here were searched from nine online databases and the China National Knowledge Infrastructure (CNKI) from year 1993 to 2015. Devices and robots were categorized as end-effectors, exoskeletons and industrial robots. Totally ten end-effectors, one exoskeleton and one industrial robot were evaluated in terms of their mechanical characteristics, degrees of freedom (DOF), supported control modes, clinical applicability and outcomes. Preliminary clinical results of these studies showed that all participants could gain certain improvements in terms of range of motion, strength or physical function after training. Only four studies supported that bilateral training was better than unilateral training. However, most of clinical results cannot definitely verify the effectiveness of mechanisms and clinical protocols used in robotic therapies. To explore the actual value of these robots and devices, further research on ingenious mechanisms, dose-matched clinical protocols and universal evaluation criteria should be conducted in the future.

Sensorimotor control of tracking movements at various speeds for stroke patients as well as age-matched and young healthy subjects

There are aging- and stroke-induced changes on sensorimotor control in daily activities, but their mechanisms have not been well investigated. This study explored speed-, aging-, and stroke-induced changes on sensorimotor control. Eleven stroke patients (affected sides and unaffected sides) and 20 control subjects (10 young and 10 age-matched individuals) were enrolled to perform elbow tracking tasks using sinusoidal trajectories, which included 6 target speeds (15.7, 31.4, 47.1, 62.8, 78.5, and 94.2 deg/s). The actual elbow angle was recorded and displayed on a screen as visual feedback, and three indicators, the root mean square error (RMSE), normalized integrated jerk (NIJ) and integral of the power spectrum density of normalized speed (IPNS), were used to investigate the strategy of sensorimotor control. Both NIJ and IPNS had significant differences among the four groups (P<0.01), and the values were ranked in the following order: young controls < age-matched controls Collapse

Key Words Collapse

MESH Headings

• Adult
• Case-Control Studies
• Elbow/physiopathology
• Female
• Humans
• Male
• Middle Aged
• Movement/physiology
• Psychomotor Performance/physiology
• Stroke/physiopathology
• Young Adult

Collapse

Grants Collapse

Affiliation(s)

Di Ao School of Engineering, Sun Yat-sen University, Guangzhou, Guang Dong, P. R. China Key Laboratory of Sensing Technology and Biomedical Instrument of GuangDong province, Guangzhou, Guang Dong, P. R. China
Rong Song School of Engineering, Sun Yat-sen University, Guangzhou, Guang Dong, P. R. China Key Laboratory of Sensing Technology and Biomedical Instrument of GuangDong province, Guangzhou, Guang Dong, P. R. China
Kai-yu Tong Division of Biomedical Engineering, Department of Electronic Engineering, the Chinese University of Hong Kong, Hong Kong, China

Collapse

Assessment-driven selection and adaptation of exercise difficulty in robot-assisted therapy: a pilot study with a hand rehabilitation robot

Background

Selecting and maintaining an engaging and challenging training difficulty level in robot-assisted stroke rehabilitation remains an open challenge. Despite the ability of robotic systems to provide objective and accurate measures of function and performance, the selection and adaptation of exercise difficulty levels is typically left to the experience of the supervising therapist.

Methods

We introduce a patient-tailored and adaptive robot-assisted therapy concept to optimally challenge patients from the very first session and throughout therapy progress. The concept is evaluated within a four-week pilot study in six subacute stroke patients performing robot-assisted rehabilitation of hand function. Robotic assessments of both motor and sensory impairments of hand function conducted prior to the therapy are used to adjust exercise parameters and customize difficulty levels. During therapy progression, an automated routine adapts difficulty levels from session to session to maintain patients’ performance around a target level of 70%, to optimally balance motivation and challenge.

Results

Robotic assessments suggested large differences in patients’ sensorimotor abilities that are not captured by clinical assessments. Exercise customization based on these assessments resulted in an average initial exercise performance around 70% (62% ± 20%, mean ± std), which was maintained throughout the course of the therapy (64% ± 21%). Patients showed reduction in both motor and sensory impairments compared to baseline as measured by clinical and robotic assessments. The progress in difficulty levels correlated with improvements in a clinical impairment scale (Fugl-Meyer Assessment) (r _s = 0.70), suggesting that the proposed therapy was effective at reducing sensorimotor impairment.

Conclusions

Initial robotic assessments combined with progressive difficulty adaptation have the potential to automatically tailor robot-assisted rehabilitation to the individual patient. This results in optimal challenge and engagement of the patient, may facilitate sensorimotor recovery after neurological injury, and has implications for unsupervised robot-assisted therapy in the clinic and home environment.

Trial registration: ClinicalTrials.gov, NCT02096445

Electronic supplementary material

The online version of this article (doi:10.1186/1743-0003-11-154) contains supplementary material, which is available to authorized users.

Machine learning-based assessment tool for imbalance and vestibular dysfunction with virtual reality rehabilitation system

BACKGROUND AND OBJECTIVE

Dizziness is a major consequence of imbalance and vestibular dysfunction. Compared to surgery and drug treatments, balance training is non-invasive and more desired. However, training exercises are usually tedious and the assessment tool is insufficient to diagnose patient's severity rapidly.

METHODS

An interactive virtual reality (VR) game-based rehabilitation program that adopted Cawthorne-Cooksey exercises, and a sensor-based measuring system were introduced. To verify the therapeutic effect, a clinical experiment with 48 patients and 36 normal subjects was conducted. Quantified balance indices were measured and analyzed by statistical tools and a Support Vector Machine (SVM) classifier.

RESULTS

In terms of balance indices, patients who completed the training process are progressed and the difference between normal subjects and patients is obvious.

CONCLUSIONS

Further analysis by SVM classifier show that the accuracy of recognizing the differences between patients and normal subject is feasible, and these results can be used to evaluate patients' severity and make rapid assessment.

Robotic/virtual reality intervention program individualized to meet the specific sensorimotor impairments of an individual patient: a case study

A majority of studies examining repetitive task practice facilitated by robots for the treatment of upper extremity paresis utilize standardized protocols applied to large groups. This study will describe a virtually simulated, robot-based intervention customized to match the goals and clinical presentation of a gentleman with upper extremity hemiparesis secondary to stroke. MP, the subject of this case, is an 85-year-old man with left hemiparesis secondary to an intracerebral hemorrhage 5 years prior to examination. Outcomes were measured before and after a 1-month period of home therapy and after a 1-month virtually simulated, robotic intervention. The intervention was designed to address specific impairments identified during his PT examination. When necessary, activities were modified based on MP's response to his first week of treatment. MP's home training program produced a 3-s decline in Wolf Motor Function Test (WMFT) time and a 5-s improvement in Jebsen Test of Hand Function (JTHF) time. He demonstrated an additional 35-s improvement in JTHF and an additional 44-s improvement in WMFT subsequent to the robotic training intervention. A 24-h activity measurement and the Hand and Activities of Daily Living scales of the Stroke Impact Scale improved following the robotic intervention. Based on his responses to training we feel that we have established that a customized program of virtually simulated, robotically facilitated rehabilitation was feasible and resulted in larger improvements than an intensive home training program in several measurements of upper extremity function in our patient with chronic hemiparesis.

Comparing integrated training of the hand and arm with isolated training of the same effectors in persons with stroke using haptically rendered virtual environments, a randomized clinical trial

Background

Robotically facilitated therapeutic activities, performed in virtual environments have emerged as one approach to upper extremity rehabilitation after stroke. Body function level improvements have been demonstrated for robotically facilitated training of the arm. A smaller group of studies have demonstrated modest activity level improvements by training the hand or by integrated training of the hand and arm. The purpose of this study was to compare a training program of complex hand and finger tasks without arm movement paired with a separate set of reaching activities performed without hand movement, to training the entire upper extremity simultaneously, utilizing integrated activities.

Methods

Forty individuals with chronic stroke recruited in the community, participated in a randomized, blinded, controlled trial of two interventions. Subjects were required to have residual hand function for inclusion. The first, hand and arm separate (HAS) training (n = 21), included activities controlled by finger movement only, and activities controlled by arm movement only, the second, hand and arm together (HAT) training (n = 20) used simulations controlled by a simultaneous use of arm and fingers.

Results

No adverse reactions occurred. The entire sample demonstrated mean improvements in Wolf Motor Function Test scores (21%) and Jebsen Test of Hand Function scores (15%), with large effect sizes (partial r² = .81 and r² = .67, respectively). There were no differences in improvement between HAS and HAT training immediately after the study. Subjects in the HAT group retained Wolf Motor Function Test gains better than in the HAS group measured three months after the therapy but the size of this interaction effect was small (partial r² = .17).

Conclusions

Short term changes in upper extremity motor function were comparable when training the upper extremity with integrated activities or a balanced program of isolated activities. Further study of the retention period is indicated.

Trial registration

NCT01072461.

Electronic supplementary material

The online version of this article (doi:10.1186/1743-0003-11-126) contains supplementary material, which is available to authorized users.

A survey on robotic devices for upper limb rehabilitation

The existing shortage of therapists and caregivers assisting physically disabled individuals at home is expected to increase and become serious problem in the near future. The patient population needing physical rehabilitation of the upper extremity is also constantly increasing. Robotic devices have the potential to address this problem as noted by the results of recent research studies. However, the availability of these devices in clinical settings is limited, leaving plenty of room for improvement. The purpose of this paper is to document a review of robotic devices for upper limb rehabilitation including those in developing phase in order to provide a comprehensive reference about existing solutions and facilitate the development of new and improved devices. In particular the following issues are discussed: application field, target group, type of assistance, mechanical design, control strategy and clinical evaluation. This paper also includes a comprehensive, tabulated comparison of technical solutions implemented in various systems.

Correlations between statistical models of robotically collected kinematics and clinical measures of upper extremity function

One of the obstacles in the development of rehabilitation robotics has been inadequacy in the measurement of treatment effects due to interventions. A measurement tool that will efficiently produce a large reliable sample of measurements collected during a single session that can also produce a rich set of data which reflects a subject's ability to perform meaningful functional activities has not been developed. This paper presents three linear regression models generated from seven kinematic measures collected during the performance of virtually simulated rehabilitation activities that were integrated with haptic robots by 19 persons with upper extremity hemiparesis due to chronic stroke. One of these models demonstrated a statistically significant correlation with the subjects' scores on the Jebsen Test of Hand Function (JTHF), a battery of six standardized upper extremity functional activities. The second and third models demonstrated a statistically significant correlation with the subjects' change scores on the JTHF.

Robots integrated with virtual reality simulations for customized motor training in a person with upper extremity hemiparesis: a case study

BACKGROUND AND PURPOSE

A majority of studies examining repetitive task practice facilitated by robots for the treatment of upper extremity paresis utilize standardized protocols applied to large groups. Others utilize interventions tailored to patients but do not describe the clinical decision-making process utilized to develop and modify interventions. This case study describes a robot-based intervention customized to match the goals and clinical presentation of person with upper extremity hemiparesis secondary to stroke.

METHODS

The patient, P.M., was an 85-year-old man with left hemiparesis secondary to an intracerebral hemorrhage 5 years prior to examination. Outcomes were measured before and after a 1-month period of home therapy and after a 1-month robotic intervention. The intervention was designed to address specific impairments identified during his physical therapy examination. When necessary, activities were modified on the basis of response to the first week of treatment.

OUTCOMES

P.M. trained in 12 sessions, using six virtually simulated activities. Modifications to original configurations of these activities resulted in performance improvements in five of these activities. P.M. demonstrated a 35-second improvement in Jebsen Test of Hand Function time and a 44-second improvement in Wolf Motor Function Test time subsequent to the robotic training intervention. Reaching kinematics, 24-hour activity measurement, and scores on the Hand and Activities of Daily Living scales of the Stroke Impact Scale all improved as well.

DISCUSSION

A customized program of robotically facilitated rehabilitation was associated with short-term improvements in several measurements of upper extremity function in a patient with chronic hemiparesis.

A fully immersive set-up for remote interaction and neurorehabilitation based on virtual body ownership

Although telerehabilitation systems represent one of the most technologically appealing clinical solutions for the immediate future, they still present limitations that prevent their standardization. Here we propose an integrated approach that includes three key and novel factors: (a) fully immersive virtual environments, including virtual body representation and ownership; (b) multimodal interaction with remote people and virtual objects including haptic interaction; and (c) a physical representation of the patient at the hospital through embodiment agents (e.g., as a physical robot). The importance of secure and rapid communication between the nodes is also stressed and an example implemented solution is described. Finally, we discuss the proposed approach with reference to the existing literature and systems.

Augmenting sensory-motor conflict promotes adaptation of postural behaviors in a virtual environment

We present results from a series of studies that investigated how multimodal mismatches in a virtual environment modified postural response organization. Adaptation of motor commands to functional circumstances is driven directly by error signals. Thus, motor relearning should increase when performing in environments containing sensory mismatch. We hypothesized that kinematics of the response would be linked to specific characteristics of the sensory array. Sensory weighting was varied by: 1) rotating the visual field about the talo-crural joint or the interaural axis, 2) adding stochastic vibrations at the sole of the foot, and 3) combining galvanic vestibular stimulation with rotations of the visual field. Results indicated that postural responses are shaped by the location of a sensory disturbance and also by the processing demands of the environmental array. Sensory-motor demands need to be structured when developing therapeutic interventions for patients with balance disorders.

Adaptive Hierarchical Control for the Muscle Strength Training of Stroke Survivors in Robot-Aided Upper-Limb Rehabilitation

Muscle strength training for stroke patients is of vital importance for helping survivors to progressively restore muscle strength and improve the performance of their activities in daily living (ADL). An adaptive hierarchical therapy control framework which integrates the patient's real biomechanical state estimation with task-performance quantitative evaluation is proposed. Firstly, a high-level progressive resistive supervisory controller is designed to determine the resistive force base for each training session based on the patient's online task-performance evaluation. Then, a low-level adaptive resistive force triggered controller is presented to further regulate the interactive resistive force corresponding to the patient's real-time biomechanical state – characterized by the patient's bio-damping and bio-stiffness in the course of one training session, so that the patient is challenged in a moderate but engaging and motivating way. Finally, a therapeutic robot system using a Barrett WAM™ compliant manipulator is set up. We recruited eighteen inpatient and outpatient stroke participants who were randomly allocated in experimental (robot-aided) and control (conventional physical therapy) groups and enrolled for sixteen weeks of progressive resistance training. The preliminary results show that the proposed therapy control strategies can enhance the recovery of strength and motor control ability.

What's new in new technologies for upper extremity rehabilitation?

PURPOSE OF REVIEW

The field of new technologies for upper-limb rehabilitation is exploding. The review presents new trends and studies of effectiveness from recent literature regarding robots, virtual reality and telerehabilitation for neurorehabilitation of the upper limb.

RECENT FINDINGS

There appears to be a greater focus on technological developments than on clinical trials or studies to evaluate the mechanisms behind the effectiveness of these systems. Developments are most abundant in the field of robotics. However, the first well designed and powered randomized-controlled trial on robot rehabilitation has appeared, confirming that the effectiveness of robot therapy lies in the number of repetitions provided. There is a move towards studies in populations other than stroke, particularly cerebral palsy with a few studies on multiple sclerosis and traumatic brain injury. There is also an increasing trend for the use of robotic devices as evaluation tools.

SUMMARY

Despite the fact that new technologies are based on knowledge from motor control and learning literature and that they provide an exciting potential for varied rehabilitation, recent evidence suggests that the only contribution to clinical practice currently is the provision of intensive, repetitive movements.

Design and control of a cable-controlled haptic motion simulator

In this work, we discuss the design, construction, and testing of a cable-controlled motion simulator for a Virtual Reality (VR) hang gliding environment. The system comprises a cable-controlled motion simulator, a joystick, a Lego™ direction sensor, and a VR environment. The motion simulator and joystick are built out of motors, pulleys, cables, and aluminum beams. The VR environment and motion simulator interact haptically with each other to give a realistic feel to the operator. A dynamic analysis is performed on the simulator to show the effect of gravity and the directional motion on the operator. A series of experiments are then performed to test the effectiveness of the cable-controlled simulator, and the results were very encouraging despite minor glitches with high-speed maneuvers.

Robotically facilitated virtual rehabilitation of arm transport integrated with finger movement in persons with hemiparesis

BACKGROUND

Recovery of upper extremity function is particularly recalcitrant to successful rehabilitation. Robotic-assisted arm training devices integrated with virtual targets or complex virtual reality gaming simulations are being developed to deal with this problem. Neural control mechanisms indicate that reaching and hand-object manipulation are interdependent, suggesting that training on tasks requiring coordinated effort of both the upper arm and hand may be a more effective method for improving recovery of real world function. However, most robotic therapies have focused on training the proximal, rather than distal effectors of the upper extremity. This paper describes the effects of robotically-assisted, integrated upper extremity training.

METHODS

Twelve subjects post-stroke were trained for eight days on four upper extremity gaming simulations using adaptive robots during 2-3 hour sessions.

RESULTS

The subjects demonstrated improved proximal stability, smoothness and efficiency of the movement path. This was in concert with improvement in the distal kinematic measures of finger individuation and improved speed. Importantly, these changes were accompanied by a robust 16-second decrease in overall time in the Wolf Motor Function Test and a 24-second decrease in the Jebsen Test of Hand Function.

CONCLUSIONS

Complex gaming simulations interfaced with adaptive robots requiring integrated control of shoulder, elbow, forearm, wrist and finger movements appear to have a substantial effect on improving hemiparetic hand function. We believe that the magnitude of the changes and the stability of the patient's function prior to training, along with maintenance of several aspects of the gains demonstrated at retention make a compelling argument for this approach to training.

Learning in a virtual environment using haptic systems for movement re-education: can this medium be used for remodeling other behaviors and actions?

Robotic systems that are interfaced with virtual reality gaming and task simulations are increasingly being developed to provide repetitive intensive practice to promote increased compliance and facilitate better outcomes in rehabilitation post-stroke. A major development in the use of virtual environments (VEs) has been to incorporate tactile information and interaction forces into what was previously an essentially visual experience. Robots of varying complexity are being interfaced with more traditional virtual presentations to provide haptic feedback that enriches the sensory experience and adds physical task parameters. This provides forces that produce biomechanical and neuromuscular interactions with the VE that approximate real-world movement more accurately than visual-only VEs, simulating the weight and force found in upper extremity tasks. The purpose of this article is to present an overview of several systems that are commercially available for ambulation training and for training movement of the upper extremity. We will also report on the system that we have developed (NJIT-RAVR system) that incorporates motivating and challenging haptic feedback effects into VE simulations to facilitate motor recovery of the upper extremity post-stroke. The NJIT-RAVR system trains both the upper arm and the hand. The robotic arm acts as an interface between the participants and the VEs, enabling multiplanar movements against gravity in a three-dimensional workspace. The ultimate question is whether this medium can provide a motivating, challenging, gaming experience with dramatically decreased physical difficulty levels, which would allow for participation by an obese person and facilitate greater adherence to exercise regimes.

Integrated versus isolated training of the hemiparetic upper extremity in haptically rendered virtual environments

This paper describes the preliminary results of an ongoing study of the effects of two training approaches on motor function and learning in persons with hemi paresis due to cerebrovascular accidents. Eighteen subjects with chronic stroke performed eight, three-hour sessions of sensorimotor training in haptically renedered environments. Eleven subjects performed training activities that integrated hand and arm movement while another seven subjects performed activities that trained the hand and arm with separately. As a whole, the eighteen subjects made statistically significant improvements in motor function as evidenced by robust improvements in Wolf Motor Function Test times and corresponding improvements in Jebsen Test of Hand Function times. There were no significant between group effects for these tests. However, the two training approaches elicited different patterns and magnitudes of performance improvement that suggest that they may elicit different types of change in motor learning and or control.

Remapping in the ipsilesional motor cortex after VR-based training: a pilot fMRI study

In a single case longitudinal study, a 70 year old female subject who has had a subcortical stroke 8 years prior, was tested three times in fMRI using an interactive MRI-compatible VR environment. The subject performed sequential finger movements with her right (unaffected) hand. Her hand motion (recorded with the data glove) animated either the ipsilateral (corresponding) or contralateral (mirrored) virtual hand model. In a visual feedback control condition, the virtual hand models were replaced with ellipsoids. In between the second and third session, the patient participated in an intensive, two-week long VR-based training of her affected upper extremity. When comparing activation in the mirrored versus the non-mirrored virtual visual feedback condition, no significant activation was noted in motor or premotor areas in the baseline 1 or baseline 2 sessions. However, increased activation in the ipsilesional motor cortex occurred as a result of training, despite the absence of active involvement of the ipsilesional motor cortex in this condition. The left motor cortex was also recruited in this condition (though weaker) despite the subtracted out ellipsoid condition (in which subjects also moved their hand). Thus, the contralateral (mirrored) visual feedback may have had a facilitory effect bilaterally. These findings might have some important implications for the development of novel therapies in the acute phase, when paresis and the potential for neural remapping are greatest.

Interfacing a haptic robotic system with complex virtual environments to treat impaired upper extremity motor function in children with cerebral palsy

OBJECTIVE

To investigate the ability of the New Jersey Institute of Technology Robot Assisted Virtual Rehabilitation (NJIT-RAVR) system training to elicit changes in upper extremity (UE) function in children with hemiplegia secondary to cerebral palsy.

METHODS

Nine children (mean age 9 years, three males) participated in three pilots. Subjects trained 1 hour, 3 days a week for 3 weeks. Two groups performed this protocol as their only intervention. The third group also performed 5-6 hours of constraint-induced movement therapy.

RESULTS

All subjects participated in a short programme of nine, 60-minute training sessions without adverse effects. As a group, subjects demonstrated statistically significant improvements in Melbourne Assessment of Unilateral Upper Limb Function Test, a composite of three timed UE tasks and several measurements of reaching kinematics. Several subjects demonstrated clinically significant improvements in active shoulder abduction and flexion as well as forearm supination.

CONCLUSION

Three small pilots of NJIT-RAVR training demonstrated measurable benefit with no complications, warranting further examination.

Coordination changes demonstrated by subjects with hemiparesis performing hand-arm training using the NJIT-RAVR robotically assisted virtual rehabilitation system

Various authors have described pre and post testing improvements in upper limb coordination as a result of intensive upper limb interventions. While the ability to alter coordination patterns as a result of repetitive hand-arm movement is established, patterns of change in the relationship between proximal and distal effectors of the UE over the course of multiple sessions of training have not been described in the rehabilitation literature. In this study eight subjects (5 male, 3 female) with a mean age of 56.4 years (SD=14.2) and a mean time since CVA of 54.7 months post-stroke (SD=51.7) were trained for eight, 2-3 hour sessions on four robotically facilitated virtual rehabilitation activities. This paper will present 1) Functional performance and pre and post testing kinematic analysis for the eight subjects 2) More extensive analysis of the change in hand and arm coordination over the course of the eight session intervention demonstrated by one of the subjects from this sample 3) Kinematic analysis of another subject from this sample performing an un-trained reaching and grasping activity, before and after training.

The New Jersey Institute of Technology Robot-Assisted Virtual Rehabilitation (NJIT-RAVR) system for children with cerebral palsy: a feasibility study

BACKGROUND

We hypothesize that the integration of virtual reality (VR) with robot assisted rehabilitation could be successful if applied to children with hemiparetic CP. The combined benefits of increased attention provided by VR and the larger training stimulus afforded by adaptive robotics may increase the beneficial effects of these two approaches synergistically. This paper will describe the NJIT-RAVR system, which combines adaptive robotics with complex VR simulations for the rehabilitation of upper extremity impairments and function in children with CP and examine the feasibility of this system in the context of a two subject training study.

METHODS

The NJIT-RAVR system consists of the Haptic Master, a 6 degrees of freedom, admittance controlled robot and a suite of rehabilitation simulations that provide adaptive algorithms for the Haptic Master, allowing the user to interact with rich virtual environments. Two children, a ten year old boy and a seven year old girl, both with spastic hemiplegia secondary to Cerebral Palsy were recruited from the outpatient center of a comprehensive pediatric rehabilitation facility. Subjects performed a battery of clinical testing and kinematic measurements of reaching collected by the NJIT-RAVR system. Subjects trained with the NJIT-RAVR System for one hour, 3 days a week for three weeks. The subjects played a combination of four or five simulations depending on their therapeutic goals, tolerances and preferences. Games were modified to increase difficulty in order to challenge the subjects as their performance improved. The testing battery was repeated following the training period.

RESULTS

Both participants completed 9 hours of training in 3 weeks. No untoward events occurred and no adverse responses to treatment or complaints of cyber sickness were reported. One participant showed improvements in overall performance on the functional aspects of the testing battery. The second subject made improvements in upper extremity active range of motion and in kinematic measures of reaching movements.

CONCLUSION

We feel that this study establishes the feasibility of integrating robotics and rich virtual environments to address functional limitations and decreased motor performance in children with mild to moderate cerebral palsy.

A virtual reality-based system integrated with fmri to study neural mechanisms of action observation-execution: a proof of concept study

PURPOSE

Emerging evidence shows that interactive virtual environments (VEs) may be a promising tool for studying sensorimotor processes and for rehabilitation. However, the potential of VEs to recruit action observation-execution neural networks is largely unknown. For the first time, a functional MRI-compatible virtual reality system (VR) has been developed to provide a window into studying brain-behavior interactions. This system is capable of measuring the complex span of hand-finger movements and simultaneously streaming this kinematic data to control the motion of representations of human hands in virtual reality.

METHODS

In a blocked fMRI design, thirteen healthy subjects observed, with the intent to imitate (OTI), finger sequences performed by the virtual hand avatar seen in 1st person perspective and animated by pre-recorded kinematic data. Following this, subjects imitated the observed sequence while viewing the virtual hand avatar animated by their own movement in real-time. These blocks were interleaved with rest periods during which subjects viewed static virtual hand avatars and control trials in which the avatars were replaced with moving non-anthropomorphic objects.

RESULTS

We show three main findings. First, both observation with intent to imitate and imitation with real-time virtual avatar feedback, were associated with activation in a distributed frontoparietal network typically recruited for observation and execution of real-world actions. Second, we noted a time-variant increase in activation in the left insular cortex for observation with intent to imitate actions performed by the virtual avatar. Third, imitation with virtual avatar feedback (relative to the control condition) was associated with a localized recruitment of the angular gyrus, precuneus, and extrastriate body area, regions which are (along with insular cortex) associated with the sense of agency.

CONCLUSIONS

Our data suggest that the virtual hand avatars may have served as disembodied training tools in the observation condition and as embodied "extensions" of the subject's own body (pseudo-tools) in the imitation. These data advance our understanding of the brain-behavior interactions when performing actions in VE and have implications in the development of observation- and imitation-based VR rehabilitation paradigms.

Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms

Stroke patients report hand function as the most disabling motor deficit. Current evidence shows that learning new motor skills is essential for inducing functional neuroplasticity and functional recovery. Adaptive training paradigms that continually and interactively move a motor outcome closer to the targeted skill are important to motor recovery. Computerized virtual reality simulations when interfaced with robots, movement tracking and sensing glove systems, are particularly adaptable, allowing for online and offline modifications of task based activities using the participant's current performance and success rate. We have developed a second generation system that can exercise the hand and the arm together or in isolation and provide for both unilateral and bilateral hand and arm activities in three-dimensional space. We demonstrate that by providing haptic assistance for the hand and arm and adaptive anti-gravity support, the system can accommodate patients with lower level impairments. We hypothesize that combining training in virtual environments (VE) with observation of motor actions can bring additional benefits. We present a proof of concept of a novel system that integrates interactive VE with functional neuroimaging to address this issue. Three components of this system are synchronized, the presentation of the visual display of the virtual hands, the collection of fMRI images and the collection of hand joint angles from the instrumented gloves. We show that interactive VEs can facilitate activation of brain areas during training by providing appropriately modified visual feedback. We predict that visual augmentation can become a tool to facilitate functional neuroplasticity.

Sensorimotor training in virtual reality: a review

Recent experimental evidence suggests that rapid advancement of virtual reality (VR) technologies has great potential for the development of novel strategies for sensorimotor training in neurorehabilitation. We discuss what the adaptive and engaging virtual environments can provide for massive and intensive sensorimotor stimulation needed to induce brain reorganization.Second, discrepancies between the veridical and virtual feedback can be introduced in VR to facilitate activation of targeted brain networks, which in turn can potentially speed up the recovery process. Here we review the existing experimental evidence regarding the beneficial effects of training in virtual environments on the recovery of function in the areas of gait,upper extremity function and balance, in various patient populations. We also discuss possible mechanisms underlying these effects. We feel that future research in the area of virtual rehabilitation should follow several important paths. Imaging studies to evaluate the effects of sensory manipulation on brain activation patterns and the effect of various training parameters on long term changes in brain function are needed to guide future clinical inquiry. Larger clinical studies are also needed to establish the efficacy of sensorimotor rehabilitation using VR in various clinical populations and most importantly, to identify VR training parameters that are associated with optimal transfer to real-world functional improvements.