Haptic Error Modulation Outperforms Visual Error Amplification When Learning a Modified Gait Pattern

Designing for usability: development and evaluation of a portable minimally-actuated haptic hand and forearm trainer for unsupervised stroke rehabilitation

In stroke rehabilitation, simple robotic devices hold the potential to increase the training dosage in group therapies and to enable continued therapy at home after hospital discharge. However, we identified a lack of portable and cost-effective devices that not only focus on improving motor functions but also address sensory deficits. Thus, we designed a minimally-actuated hand training device that incorporates active grasping movements and passive pronosupination, complemented by a rehabilitative game with meaningful haptic feedback. Following a human-centered design approach, we conducted a usability study with 13 healthy participants, including three therapists. In a simulated unsupervised environment, the naive participants had to set up and use the device based on written instructions. Our mixed-methods approach included quantitative data from performance metrics, standardized questionnaires, and eye tracking, alongside qualitative feedback from semi-structured interviews. The study results highlighted the device's overall ease of setup and use, as well as its realistic haptic feedback. The eye-tracking analysis further suggested that participants felt safe during usage. Moreover, the study provided crucial insights for future improvements such as a more intuitive and comfortable wrist fixation, more natural pronosupination movements, and easier-to-follow instructions. Our research underscores the importance of continuous testing in the development process and offers significant contributions to the design of user-friendly, unsupervised neurorehabilitation technologies to improve sensorimotor stroke rehabilitation.

Light-Weight Wearable Gyroscopic Actuators Can Modulate Balance Performance and Gait Characteristics: A Proof-of-Concept Study

Falling is a major cause of morbidity, and is often caused by a decrease in postural stability. A key component of postural stability is whole-body centroidal angular momentum, which can be influenced by control moment gyroscopes. In this proof-of-concept study, we explore the influence of our wearable robotic gyroscopic actuator "GyroPack" on the balance performance and gait characteristics of non-impaired individuals (seven female/eight male, 30 ± 7 years, 68.8 ± 8.4 kg). Participants performed a series of balance and walking tasks with and without wearing the GyroPack. The device displayed various control modes, which were hypothesised to positively, negatively, or neutrally impact postural control. When configured as a damper, the GyroPack increased mediolateral standing time and walking distance, on a balance beam, and decreased trunk angular velocity variability, while walking on a treadmill. When configured as a negative damper, both peak trunk angular rate and trunk angular velocity variability increased during treadmill walking. This exploratory study shows that gyroscopic actuators can influence balance and gait kinematics. Our results mirror the findings of our earlier studies; though, with more than 50% mass reduction of the device, practical and clinical applicability now appears within reach.

Virtual Physical Coupling of Two Lower-Limb Exoskeletons

Physical interaction between individuals plays an important role in human motor learning and performance during shared tasks. Using robotic devices, researchers have studied the effects of dyadic haptic interaction mostly focusing on the upper-limb. Developing infrastructure that enables physical interactions between multiple individuals' lower limbs can extend the previous work and facilitate investigation of new dyadic lower-limb rehabilitation schemes. We designed a system to render haptic interactions between two users while they walk in multi-joint lower-limb exoskeletons. Specifically, we developed an infrastructure where desired interaction torques are commanded to the individual lower-limb exoskeletons based on the users' kinematics and the properties of the virtual coupling. In this pilot study, we demonstrated the capacity of the platform to render different haptic properties (e.g., soft and hard), different haptic connection types (e.g., bidirectional and unidirectional), and connections expressed in joint space and in task space. With haptic connection, dyads generated synchronized movement, and the difference between joint angles decreased as the virtual stiffness increased. This is the first study where multi-joint dyadic haptic interactions are created between lower-limb exoskeletons. This platform will be used to investigate effects of haptic interaction on motor learning and task performance during walking, a complex and meaningful task for gait rehabilitation.

Effect of immersive visualization technologies on cognitive load, motivation, usability, and embodiment

Virtual reality (VR) is a promising tool to promote motor (re)learning in healthy users and brain-injured patients. However, in current VR-based motor training, movements of the users performed in a three-dimensional space are usually visualized on computer screens, televisions, or projection systems, which lack depth cues (2D screen), and thus, display information using only monocular depth cues. The reduced depth cues and the visuospatial transformation from the movements performed in a three-dimensional space to their two-dimensional indirect visualization on the 2D screen may add cognitive load, reducing VR usability, especially in users suffering from cognitive impairments. These 2D screens might further reduce the learning outcomes if they limit users' motivation and embodiment, factors previously associated with better motor performance. The goal of this study was to evaluate the potential benefits of more immersive technologies using head-mounted displays (HMDs). As a first step towards potential clinical implementation, we ran an experiment with 20 healthy participants who simultaneously performed a 3D motor reaching and a cognitive counting task using: (1) (immersive) VR (IVR) HMD, (2) augmented reality (AR) HMD, and (3) computer screen (2D screen). In a previous analysis, we reported improved movement quality when movements were visualized with IVR than with a 2D screen. Here, we present results from the analysis of questionnaires to evaluate whether the visualization technology impacted users' cognitive load, motivation, technology usability, and embodiment. Reports on cognitive load did not differ across visualization technologies. However, IVR was more motivating and usable than AR and the 2D screen. Both IVR and AR rea ched higher embodiment level than the 2D screen. Our results support our previous finding that IVR HMDs seem to be more suitable than the common 2D screens employed in VR-based therapy when training 3D movements. For AR, it is still unknown whether the absence of benefit over the 2D screen is due to the visualization technology per se or to technical limitations specific to the device.

Towards functional robotic training: motor learning of dynamic tasks is enhanced by haptic rendering but hampered by arm weight support

Background

Current robot-aided training allows for high-intensity training but might hamper the transfer of learned skills to real daily tasks. Many of these tasks, e.g., carrying a cup of coffee, require manipulating objects with complex dynamics. Thus, the absence of somatosensory information regarding the interaction with virtual objects during robot-aided training might be limiting the potential benefits of robotic training on motor (re)learning. We hypothesize that providing somatosensory information through the haptic rendering of virtual environments might enhance motor learning and skill transfer. Furthermore, the inclusion of haptic rendering might increase the task realism, enhancing participants’ agency and motivation. Providing arm weight support during training might also enhance learning by limiting participants’ fatigue.

Methods

We conducted a study with 40 healthy participants to evaluate how haptic rendering and arm weight support affect motor learning and skill transfer of a dynamic task. The task consisted of inverting a virtual pendulum whose dynamics were haptically rendered on an exoskeleton robot designed for upper limb neurorehabilitation. Participants trained with or without haptic rendering and with or without weight support. Participants’ task performance, movement strategy, effort, motivation, and agency were evaluated during baseline, short- and long-term retention. We also evaluated if the skills acquired during training transferred to a similar task with a shorter pendulum.

Results

We found that haptic rendering significantly increases participants’ movement variability during training and the ability to synchronize their movements with the pendulum, which is correlated with better performance. Weight support also enhances participants’ movement variability during training and reduces participants’ physical effort. Importantly, we found that training with haptic rendering enhances motor learning and skill transfer, while training with weight support hampers learning compared to training without weight support. We did not observe any significant differences between training modalities regarding agency and motivation during training and retention tests.

Conclusion

Haptic rendering is a promising tool to boost robot-aided motor learning and skill transfer to tasks with similar dynamics. However, further work is needed to find how to simultaneously provide robotic assistance and haptic rendering without hampering motor learning, especially in brain-injured patients.

Trial registrationhttps://clinicaltrials.gov/show/NCT04759976

Supplementary Information

The online version contains supplementary material available at 10.1186/s12984-022-00993-w.

Hiding Assistive Robots During Training in Immersive VR Does not Affect Users' Motivation, Presence, Embodiment, Performance, nor Visual Attention

Combining immersive virtual reality (VR) using head-mounted displays (HMDs) with assisting robotic devices might be a promising procedure to enhance neurorehabilitation. However, it is still an open question how immersive virtual environments (VE) should be designed when interacting with rehabilitation robots. In conventional training, the robot is usually not visually represented in the VE, resulting in a visuo-haptic sensory conflict between what users see and feel. This study aimed to investigate how motivation, embodiment, and presence are affected by this visuo-haptic sensory conflict. Using an HMD and a rehabilitation robot, 28 healthy participants performed a path-tracing task, while the robot was either visually reproduced in the VE or not and while the robot either assisted the movements or not. Participants' performance and visual attention were measured during the tasks, and after each visibility/assistance condition, they reported their motivation, presence, and embodiment with questionnaires. We found that, independently of the assistance, the robot visibility did not affect participants' motivation, presence, embodiment, nor task performance. We only found a greater effort/importance reported when the robot was visible. The visual attention was also slightly affected by the robot's visibility. Importantly, we found that the robotic assistance hampered presence and embodiment, but improved motivation. Our results indicate no disadvantage of not reproducing robotic devices in VEs when using HMDs. However, caution must be put when developing assisting controllers, as they might hamper users' affect.

Haptic Training: Which Types Facilitate (re)Learning of Which Motor Task and for Whom? Answers by a Review

The use of robots has attracted researchers to design numerous haptic training methods to support motor learning. However, investigations of new methods yielded inconclusive results regarding their effectiveness to enhance learning due to the diversity of tasks, haptic designs, participants' skill level, and study protocols. In this review, we developed a taxonomy to identify generalizable findings out of publications on haptic training. In the taxonomy, we grouped the results of studies on healthy learners based on participants' skill level and tasks' characteristics. Our inspection of included studies revealed that: i) Performance-enhancing haptic methods were beneficial for novices, ii) Training with haptics was as effective as training with other feedback modalities, and iii) Performance-enhancing and performance-degrading haptic methods were useful for the learning of temporal and spatial aspects, respectively. We also observed that these findings are in line with results from robot-aided neurorehabilitation studies on patients. Our review suggests that haptic training can be effective to foster learning, especially when the information cannot be provided with other feedback modalities. We believe the findings from the taxonomy constitute a general guide, which can assist researchers when designing studies to investigate the effectiveness of haptics on learning different tasks.

Promoting Motor Variability During Robotic Assistance Enhances Motor Learning of Dynamic Tasks

Despite recent advances in robot-assisted training, the benefits of haptic guidance on motor (re)learning are still limited. While haptic guidance may increase task performance during training, it may also decrease participants' effort and interfere with the perception of the environment dynamics, hindering somatosensory information crucial for motor learning. Importantly, haptic guidance limits motor variability, a factor considered essential for learning. We propose that Model Predictive Controllers (MPC) might be good alternatives to haptic guidance since they minimize the assisting forces and promote motor variability during training. We conducted a study with 40 healthy participants to investigate the effectiveness of MPCs on learning a dynamic task. The task consisted of swinging a virtual pendulum to hit incoming targets with the pendulum ball. The environment was haptically rendered using a Delta robot. We designed two MPCs: the first MPC-end-effector MPC-applied the optimal assisting forces on the end-effector. A second MPC-ball MPC-applied its forces on the virtual pendulum ball to further reduce the assisting forces. The participants' performance during training and learning at short- and long-term retention tests were compared to a control group who trained without assistance, and a group that trained with conventional haptic guidance. We hypothesized that the end-effector MPC would promote motor variability and minimize the assisting forces during training, and thus, promote learning. Moreover, we hypothesized that the ball MPC would enhance the performance and motivation during training but limit the motor variability and sense of agency (i.e., the feeling of having control over their movements), and therefore, limit learning. We found that the MPCs reduce the assisting forces compared to haptic guidance. Training with the end-effector MPC increases the movement variability and does not hinder the pendulum swing variability during training, ultimately enhancing the learning of the task dynamics compared to the other groups. Finally, we observed that increases in the sense of agency seemed to be associated with learning when training with the end-effector MPC. In conclusion, training with MPCs enhances motor learning of tasks with complex dynamics and are promising strategies to improve robotic training outcomes in neurological patients.

A Review of Robot-Assisted Lower-Limb Stroke Therapy: Unexplored Paths and Future Directions in Gait Rehabilitation

Stroke affects one out of every six people on Earth. Approximately 90% of stroke survivors have some functional disability with mobility being a major impairment, which not only affects important daily activities but also increases the likelihood of falling. Originally intended to supplement traditional post-stroke gait rehabilitation, robotic systems have gained remarkable attention in recent years as a tool to decrease the strain on physical therapists while increasing the precision and repeatability of the therapy. While some of the current methods for robot-assisted rehabilitation have had many positive and promising outcomes, there is moderate evidence of improvement in walking and motor recovery using robotic devices compared to traditional practice. In order to better understand how and where robot-assisted rehabilitation has been effective, it is imperative to identify the main schools of thought that have prevailed. This review intends to observe those perspectives through three different lenses: the goal and type of interaction, the physical implementation, and the sensorimotor pathways targeted by robotic devices. The ways that researchers approach the problem of restoring gait function are grouped together in an intuitive way. Seeing robot-assisted rehabilitation in this unique light can naturally provoke the development of new directions to potentially fill the current research gaps and eventually discover more effective ways to provide therapy. In particular, the idea of utilizing the human inter-limb coordination mechanisms is brought up as an especially promising area for rehabilitation and is extensively discussed.

Varied movement errors drive learning of dynamic balance control during walking in people with incomplete spinal cord injury: a pilot study

The purpose of this study was to determine whether the application of a varied pelvis perturbation force would improve dynamic balance control and gait stability of people with incomplete spinal cord injury (iSCI). Fourteen participants with iSCI completed the test in two conditions, i.e., walking paired with pelvis perturbation force and treadmill walking only, with 1-week interval in between. The order of the testing condition was randomized across participants. For the pelvis pertubation condition, subjects walked on a treadmill with no force for 1 min, with a varied pelvis perturbation force that was bilaterally applied in the medial-lateral direction for 10 min, without force for 1 min, and then with the perturbation for another 10 min after a sitting break. For the treadmill only condition, a protocol that was similar to the perturbation condition was used but no force was applied. Margin of stability (MoS), weight shifting, and other spatiotemporal gait parameters were calculated. Compared to treadmill training only, participants showed significant smaller MoS and double-leg support time after treadmill walking with pelvis perturbation. In addition, participants showed significantly greater improvements in overground walking speed after treadmill walking with pelvis perturbation than treadmill only (p = 0.021). Results from this study suggest that applying a varied pelvis perturbation force during treadmill walking could improve dynamic balance control in people with iSCI, which could be transferred to overground walking. These findings may be used to develop a new intervention to improve balance and walking function in people with iSCI.

Multi-purpose Robotic Training Strategies for Neurorehabilitation with Model Predictive Controllers

One of the main challenges in robotic neuroreha-bilitation is to understand how robots should physically interact with trainees to optimize motor leaning. There is evidence that motor exploration (i.e., the active exploration of new motor tasks) is crucial to boost motor learning. Furthermore, effectiveness of a robotic training strategy depends on several factors, such as task type and trainee's skill level. We propose that Model Predictive Controllers (MPC) can satisfy many training/trainee's needs simultaneously, while providing a safe environment without restricting trainees to a fixed trajectory. We designed two nonlinear MPCs to support training of a rich dynamic task (a pendulum task) with a delta robot. These MPCs differ from each other in terms of the application point of the intervention force: (i) to the virtual pendulum mass, and (ii) the virtual rod holding point, which corresponds to the robot end-effector. The effect of the MPCs on task performance, physical effort, motivation and sense of agency was evaluated in fourteen healthy participants. We found that the location of the applied controller force affects the task performance -i.e., the MPC that actuates on the pendulum mass significantly reduced performance errors and sense of agency during training, while the other MPC did not, probably due to low force saturation limits and slow optimization speed of the solver. Participants applied significantly more forces when training with the MPC that actuates on the pendulum holding point, probably because they reacted against the robotic assistance. Although MPCs look very promising for neurorehabilitation, further steps have to be taken to improve their technical limitations. Moreover, the effects of MPCs on motor learning should be evaluated.

Providing low-dimensional feedback of a high-dimensional movement allows for improved performance of a skilled walking task

Learning a skilled movement often requires changing multiple dimensions of movement in a coordinated manner. Serial training is one common approach to learning a new movement pattern, where each feature is learned in isolation from the others. Once one feature is learned, we move on to the next. However, when learning a complex movement pattern, serial training is not only laborious but can also be ineffective. Often, movement features are linked such that they cannot simply be added together as we progress through training. Thus, the ability to learn multiple features in parallel could make training faster and more effective. When using visual feedback as the tool for changing movement, however, such parallel training may increase the attentional load of training and impair performance. Here, we developed a novel visual feedback system that uses principal component analysis to weight four features of movement to create a simple one-dimensional 'summary' of performance. We used this feedback to teach healthy, young participants a modified walking pattern and compared their performance to those who received four concurrent streams of visual information to learn the same goal walking pattern. We demonstrated that those who used the principal component-based visual feedback improved their performance faster and to a greater extent compared to those who received concurrent feedback of all features. These results suggest that our novel principal component-based visual feedback provides a method for altering multiple features of movement toward a prescribed goal in an intuitive, low-dimensional manner.

Individualized feedback to change multiple gait deficits in chronic stroke

Background

Walking deficits in people post-stroke are often multiple and idiosyncratic in nature. Limited patient and therapist resources necessitate prioritization of deficits such that some may be left unaddressed. More efficient delivery of therapy may alleviate this challenge. Here, we look to determine the utility of a novel principal component-based visual feedback system that targets multiple, patient-specific features of gait in people post-stroke.

Methods

Ten individuals with stroke received two sessions of visual feedback to attain a walking goal. This goal consisted of bilateral knee and hip joint angles of a typical ‘healthy’ walking pattern. The feedback system uses principal component analysis (PCA) to algorithmically weight each of the input features so that participants received one stream of performance feedback. In the first session, participants had to explore different patterns to achieve the goal, and in the second session they were informed of the goal walking pattern. Ten healthy, age-matched individuals received the same paradigm, but with a hemiparetic goal (i.e. to produce the pattern of an exemplar stroke participant). This was to distinguish the extent to which performance limitations in stroke were due neurological injury or the PCA based visual feedback itself.

Results

Principal component-based visual feedback can differentially bias multiple features of walking toward a prescribed goal. On average, individuals with stroke typically improved performance via increased paretic knee and hip flexion, and did not perform better with explicit instruction. In contrast, healthy people performed better (i.e. could produce the desired exemplar stroke pattern) in both sessions, and were best with explicit instruction. Importantly, the feedback for stroke participants accommodated a heterogeneous set of walking deficits by individually weighting each feature based on baseline walking.

Conclusions

People with and without stroke are able to use this novel visual feedback to train multiple, specific features of gait. Important for stroke, the PCA feedback allowed for targeting of patient-specific deficits. This feedback is flexible to any feature of walking in any plane of movement, thus providing a potential tool for therapists to simultaneously target multiple aberrant features of gait.

Learning and transfer of complex motor skills in virtual reality: a perspective review

The development of more effective rehabilitative interventions requires a better understanding of how humans learn and transfer motor skills in real-world contexts. Presently, clinicians design interventions to promote skill learning by relying on evidence from experimental paradigms involving simple tasks, such as reaching for a target. While these tasks facilitate stringent hypothesis testing in laboratory settings, the results may not shed light on performance of more complex real-world skills. In this perspective, we argue that virtual environments (VEs) are flexible, novel platforms to evaluate learning and transfer of complex skills without sacrificing experimental control. Specifically, VEs use models of real-life tasks that afford controlled experimental manipulations to measure and guide behavior with a precision that exceeds the capabilities of physical environments. This paper reviews recent insights from VE paradigms on motor learning into two pressing challenges in rehabilitation research: 1) Which training strategies in VEs promote complex skill learning? and 2) How can transfer of learning from virtual to real environments be enhanced? Defining complex skills by having nested redundancies, we outline findings on the role of movement variability in complex skill acquisition and discuss how VEs can provide novel forms of guidance to enhance learning. We review the evidence for skill transfer from virtual to real environments in typically developing and neurologically-impaired populations with a view to understanding how differences in sensory-motor information may influence learning strategies. We provide actionable suggestions for practicing clinicians and outline broad areas where more research is required. Finally, we conclude that VEs present distinctive experimental platforms to understand complex skill learning that should enable transfer from therapeutic practice to the real world.

Rowing Simulator Modulates Water Density to Foster Motor Learning

Although robot-assisted training is present in various fields such as sports engineering and rehabilitation, provision of training strategies that optimally support individual motor learning remains as a challenge. Literature has shown that guidance strategies are useful for beginners, while skilled trainees should benefit from challenging conditions. The Challenge Point Theory also supports this in a way that learning is dependent on the available information, which serves as a challenge to the learner. So, learning can be fostered when the optimal amount of information is given according to the trainee's skill. Even though the framework explains the importance of difficulty modulation, there are no practical guidelines for complex dynamic tasks on how to match the difficulty to the trainee's skill progress. Therefore, the goal of this study was to determine the impact on learning of a complex motor task by a modulated task difficulty scheme during the training sessions, without distorting the nature of task. In this 3-day protocol study, we compared two groups of naïve participants for learning a sweep rowing task in a highly sophisticated rowing simulator. During trainings, groups received concurrent visual feedback displaying the requested oar movement. Control group performed the task under constant difficulty in the training sessions. Experimental group's task difficulty was modulated by changing the virtual water density that generated different heaviness of the simulated water-oar interaction, which yielded practice variability. Learning was assessed in terms of spatial and velocity magnitude errors and the variability for these metrics. Results of final day tests revealed that both groups reduced their error and variability for the chosen metrics. Notably, in addition to the provision of a very well established visual feedback and knowledge of results, experimental group's variable training protocol with modulated difficulty showed a potential to be advantageous for the spatial consistency and velocity accuracy. The outcomes of training and test runs indicate that we could successfully alter the performance of the trainees by changing the density value of the virtual water. Therefore, a follow-up study is necessary to investigate how to match different density values to the skill and performance improvement of the participants.