Eye-Hand Coordination during Visuomotor Adaptation with Different Rotation Angles: Effects of Terminal Visual Feedback

Implicit audiomotor adaptation

Sensorimotor adaptation alters mappings between motor commands and their predicted outcomes. Such remapping has been extensively studied in the visual domain, but the degree to which it occurs in modalities other than vision remains less well understood. Here, we manipulated the modality of reach target presentation to compare sensorimotor adaptation in response to perturbations of visual and auditory feedback location. We compared the extent of adaptation to perturbed sensory feedback for visual and auditory sensory modalities, and the magnitude of reach-direction aftereffects when the perturbation was removed. To isolate the contribution of implicit sensorimotor recalibration to adaptation in reach direction, we held sensory prediction errors and task-performance errors constant via a task-irrelevant clamp of sensory feedback. Seventy-two participants performed one of three experiments in which target location information and endpoint reach direction feedback were presented by loudspeakers (n = 24), headphones (n = 24), or a visual display (n = 24). Presentation durations for target stimuli (500 ms) and (non-veridical) endpoint feedback of reach direction (100 ms) were matched for visual and auditory modalities. For all three groups, when endpoint feedback was perturbed, adaptation was evident: reach-directions increased significantly in the direction opposite the clamped feedback, and a significant aftereffect persisted after participants were instructed that the perturbation had been removed. This study provides new evidence that implicit sensorimotor adaptation occurs in response to perturbed auditory feedback of reach direction, suggesting that an implicit neural process to recalibrate sensory to motor maps in response to sensory prediction errors may be ubiquitous across sensory modalities.

Concurrent Implicit Adaptation to Multiple Opposite Perturbations

Simultaneous adaptation to opposite visuomotor perturbations is known to be difficult. It has been shown to be possible only in situations where the two tasks are associated with different contexts, being either a different colored background, a different area of workspace, or a different follow-through movement. However, many of these elements evoke explicit mechanisms that could contribute to storing separate (modular) memories. It remains to be shown whether simultaneous adaptation to multiple perturbations is possible when they are introduced in a fully implicit manner. Here, we sought to test this possibility using a visuomotor perturbation small enough to eliminate explicit awareness. Participants (N = 25) performed center-out reaching movements with a joystick to five targets located 72° apart. Depending on the target, visual feedback of cursor position was either veridical (one target) or could be rotated by +5 or -5° (two targets each). After 300 trials of adaptation (60 to each target), results revealed that participants were able to fully compensate for each of the imposed rotations. Moreover, when veridical visual feedback was restored, participants exhibited after-effects that were consistent with the rotations applied at each target. Questionnaires collected immediately after the experiment confirmed that none of the participants were aware of the perturbations. These results speak for the existence of implicit processes that can smoothly handle small and opposite visual perturbations when these are associated with distinct target locations.

Age-related decline of online visuomotor adaptation: a combined effect of deteriorations of motor anticipation and execution

The literature has established that the capability of visuomotor adaptation decreases with aging. However, the underlying mechanisms of this decline are yet to be fully understood. The current study addressed this issue by examining how aging affected visuomotor adaptation in a continuous manual tracking task with delayed visual feedback. To distinguish separate contributions of the declined capability of motor anticipation and deterioration of motor execution to this age-related decline, we recorded and analyzed participants' manual tracking performances and their eye movements during tracking. Twenty-nine older people and twenty-three young adults (control group) participated in this experiment. The results showed that the age-related decline of visuomotor adaptation was strongly linked to degraded performance in predictive pursuit eye movement, indicating that declined capability motor anticipation with aging had critical influences on the age-related decline of visuomotor adaptation. Additionally, deterioration of motor execution, measured by random error after controlling for the lag between target and cursor, was found to have an independent contribution to the decline of visuomotor adaptation. Taking these findings together, we see a picture that the age-related decline of visuomotor adaptation is a joint effect of the declined capability of motor anticipation and the deterioration of motor execution with aging.

Reduced feedback barely slows down proprioceptive recalibration

Introducing altered visual feedback of the hand produces quick adaptation of reaching movements. Our lab has shown that the associated shifts in estimates of the felt position of the hand saturate within a few training trials. The current study investigates whether the rapid changes in felt hand position that occur during classic visuomotor adaptation are diminished or slowed when training feedback is reduced. We reduced feedback by either providing visual feedback only at the end of the reach (terminal feedback) or constraining hand movements to reduce motor adaptation-related error signals such as sensory prediction errors and task errors (exposure). We measured changes as participants completed reaches with a 30° rotation, a -30° rotation, and clamped visual feedback, with these two "impoverished" training conditions, along with classic visuomotor adaptation training, while continuously estimating their felt hand position. Training with terminal feedback slightly reduced the initial rate of change in overall adaptation. However, the rate of change in hand localization, as well as the asymptote of hand localization shifts in both the terminal feedback group and the exposure training group was not noticeably different from those in the classic training group. Taken together, shifts in felt hand position are rapid and robust responses to sensory mismatches and are at best slightly modulated when feedback is reduced. This suggests that given the speed and invariance to the quality of feedback of proprioceptive recalibration, it could immediately contribute to all kinds of reach adaptation.NEW & NOTEWORTHY Reaching to targets with altered visual feedback about hand position leads to adaptation of movements as well as shifts in estimates of felt hand position. Felt hand position can shift in as little as one trial, and here we show that there is no noticeable reduction in speed when the feedback about movements is impoverished, indicating the robustness of the process of recalibrating felt hand position.

Potential Benefits of Daytime Naps on Consecutive Days for Motor Adaptation Learning

Daytime napping offers benefits for motor memory learning and is used as a habitual countermeasure to improve daytime functioning. A single nap has been shown to ameliorate motor memory learning, although the effect of consecutive napping on motor memory consolidation remains unclear. This study aimed to explore the effect of daytime napping over multiple days on motor memory learning. Twenty university students were divided into a napping group and no-nap (awake) group. The napping group performed motor adaption tasks before and after napping for three consecutive days, whereas the no-nap group performed the task on a similar time schedule as the napping group. A subsequent retest was conducted one week after the end of the intervention. Significant differences were observed only for speed at 30 degrees to complete the retention task, which was significantly faster in the napping group than in the awake group. No significant consolidation effects over the three consecutive nap intervention periods were confirmed. Due to the limitations of the different experimental environments of the napping and the control group, the current results warrant further investigation to assess whether consecutive napping may benefit motor memory learning, which is specific to speed.

Asymmetrical transfer of adaptation between reaching and tracking: implications for feedforward and feedback processes

Reaching and manual tracking are two very common tasks for studying human sensorimotor processes. Although these motor tasks rely both on feedforward and feedback processes, emphasis is more on feedforward processes for reaching, and more on feedback processes for tracking. The extent to which feedforward and feedback processes are interrelated when being updated is not settled yet. Here, using reaching and tracking as proxies, we examined the bidirectional relationship between the update of feedforward and feedback processes. Forty right-handed participants were asked to move a joystick so as to either track a target moving rather unpredictably (pursuit tracking) or to make fast pointing movements toward a static target (center-out reaching task). Visuomotor adaptation was elicited by introducing a 45° rotation between the joystick motion and the cursor motion. Half of the participants adapted to rotation first via reaching movements, and then with pursuit tracking, while the other half performed both tasks in opposite order. Group comparisons revealed a strong asymmetrical transfer of adaptation between tasks. Namely, although nearly complete transfer of adaptation was observed from reaching to tracking, only modest transfer was found from tracking to reaching. A control experiment (N=10) revealed that making target motion fully predictable did not impact the latter finding. One possible interpretation is that the update of feedforward processes contributes directly to feedback processes, but the update of feedback processes engaged in tracking can be performed in isolation. These results suggest that reaching movements are supported by broader (i.e. more universal) mechanisms than tracking ones.

Delay of gaze fixation during reaching movement with the non-dominant hand to a distant target

The present study examined the effects of hand and task difficulty on eye-hand coordination related to gaze fixation behavior (i.e., fixating a gaze to the target until reach completion) in single reaching movements. Twenty right-handed young adults made reaches on a digitizer, while looking at a visual target and feedback of hand movements on a computer monitor. Task difficulty was altered by having three target distances. In a small portion of trials, visual feedback was randomly removed at the target presentation. The effect of a moderate amount of practice was also examined using a randomized trial schedule across target-distance and visual-feedback conditions in each hand. The results showed that the gaze distances covered during the early reaching phase were reduced, and the gaze fixation to the target was delayed when reaches were performed with the left hand and when the target distance increased. These results suggest that when the use of the non-dominant hand or an increased task difficulty reduces the predictability of hand movements and its sensory consequences, eye-hand coordination is modified to enhance visual monitoring of the reach progress prior to gaze fixation. The randomized practice facilitated this process. Nevertheless, variability of reach trajectory was more increased without visual feedback for right-hand reaches, indicating that control of the dominant arm integrates more visual feedback information during reaches. These results together suggest that the earlier gaze fixation and greater integration of visual feedback during right-hand reaches contribute to the faster and more accurate performance in the final reaching phase.

Assessment of the Impact of the Tipstim® Device Application and the Study Position on Motor Coordination and Grip Strength of the Affected Upper Limb Post-Ischemic Stroke—A Randomized Parallel Crossover Trial

In the acute phase of stroke, most patients have reduced efficiency of the upper limb and in the chronic phase more than half of these patients still have a deficit in the mobility of the upper limb. The aim of this study was to investigate the effect of using the tipstim® device and the tested position of the body and affected upper limb on parameters of motor coordination and grip strength in patients after an ischemic stroke. A randomized, parallel crossover study was conducted in the Rehabilitation Department. The study included 29 people aged 68 ± 9.2 years, 5–7 weeks after ischemic stroke. Patients were randomly assigned to two parallel groups (A/B = 15 people and B/A = 14 people). In each of them, the patient received both experimental (A = tipstim®) and control (B = placebo effect) treatment in a specific order. The HandTutor was used to measure the parameters of motor coordination (maximum range of motion and frequency of motion). We also used an electronic dynamometer to measure the handgrip strength. The patients were examined in two positions: sitting (unstable) and lying with the trunk and affected upper limb stabilized. Results: The analysis showed smaller differences between the measurements in the A/B group than in the B/A group, both without stabilization and with stabilization (wrist Hz = p ˂ 0.001; fingers 2–5 Hz = p ˂ 0.001; handgrip strength = p ˂ 0.049 and p ˂ 0.003). When comparing the influence of the tested position on the results of motor coordination and the handgrip strength, statistically significant differences were found in the placebo group in a stable position (Hz wrist p = 0.007, MaxROM wrist = 0.038, HzF5 = 0.039, MaxROM F4 = 0.035, HzF3 = 0.035, MaxROM F3 = 0.010, HzF2 = 0.049). Conclusions: Repeated use of the tipstim® device did not improve the tested parameters. A significant improvement in the results of coordination of movements and grip strength is possible in a stable position, lying down.

Motor coordination and grip strength assessed after the break and in various positions of the upper limb in patients after stroke in relation to healthy subjects. An observational study

BACKGROUND

Stroke patients often have weakness of the shoulder (scapular) stabilizers, which may contribute to motor impairment of the hand and wrist.

AIM

of the study was to analyze the effect of stabilization of the affected upper limb and the break in the examination on hand motor coordination and grip strength in patients after stroke in relation to healthy subjects.

DESIGN

An observational study.

SETTING

A hospital Rehabilitation Department.

POPULATION

Eighty post-stroke patients mean, 62 ± 17 years, and 77 healthy individuals mean, 25,7 ± 6,5 years.

METHODS

A Hand Tutor device and manual dynamometer were used to measure hand motor coordination parameters. Subjects were assessed in two positions: supine with the tested upper extremity extended perpendicularly to the vertical axis of the body (i.e., passive stabilization of the trunk; no stabilization of the shoulder), and supine with the tested upper extremity held close to the body (i.e., passive stabilization of the trunk and shoulder).

RESULTS

Stabilization of the shoulder improved the motor coordination parameters of the fingers and the wrist, and resulted in greater grip strength in post-stroke patients and healthy subjects (P ˂ .001). Local stabilization of the shoulder was particularly beneficial for improving hand motor coordination in females and non-dominant hands.

CONCLUSIONS

A stable position of the upper extremity can improve motor coordination and grip strength during stroke rehabilitation.

CLINICAL REHABILITATION IMPACT

Placing subjects in a supine position and stabilizing their affected upper limb may help restore motor coordination of the hand and wrist following stroke.

Influence of the Passive Stabilization of the Trunk and Upper Limb on Selected Parameters of the Hand Motor Coordination, Grip Strength and Muscle Tension, in Post-Stroke Patients

Objective: Assessment of the influence of a stable trunk and the affected upper limb (dominant or non-dominant) on the parameters of the wrist and hand motor coordination, grip strength and muscle tension in patients in the subacute post-stroke stage compared to healthy subjects. Design: An observational study. Setting: Stroke Rehabilitation Department. Subjects: Thirty-four subjects after ischemic cerebral stroke and control group-32 subjects without neurological deficits, age and body mass/ height matched were included. Main measures: The tone of the multifidus, transverse abdominal and supraspinatus muscles were assessed by Luna EMG device. A HandTutor device were used to measure motor coordination parameters (e.g., range of movement, frequency of movement), and a manual dynamometer for measuring the strength of a hand grip. Subjects were examined in two positions: sitting without back support (non-stabilized) and lying with stabilization of the trunk and the upper limb. Results: Passive stabilization of the trunk and the upper extremity caused a significant improvement in motor coordination of the fingers (p ˂ 0.001) and the wrist (p < 0.001) in patients after stroke. Improved motor coordination of the upper extremity was associated with an increased tone of the supraspinatus muscle. Conclusions: Passive stabilization of the trunk and the upper limb improved the hand and wrist coordination in patients following a stroke. Placing patients in a supine position with the stability of the affected upper limb during rehabilitation exercises may help them to access latent movement patterns lost due to neurological impairment after a stroke.

Functional Use of Eye Movements for an Acting System

Movements of the eyes assist vision and support hand and body movements in a cooperative way. Despite their strong functional coupling, different types of movements are usually studied independently. We integrate knowledge from behavioral, neurophysiological, and clinical studies on how eye movements are coordinated with goal-directed hand movements and how they facilitate motor learning. Understanding the coordinated control of eye and hand movements can provide important insights into brain functions that are essential for performing or learning daily tasks in health and disease. This knowledge can also inform applications such as robotic manipulation and clinical rehabilitation.

Spatial action-effect binding depends on type of action-effect transformation

Spatial action-effect binding denotes the mutual attraction between the perceived position of an effector (e.g., one's own hand) and a distal object that is controlled by this effector. Such spatial binding can be construed as an implicit measure of object ownership, thus the belonging of a controlled object to the own body. The current study investigated how different transformations of hand movements (body-internal action component) into movements of a visual object (body-external action component) affect spatial action-effect binding, and thus implicit object ownership. In brief, participants had to bring a cursor on the computer screen into a predefined target position by moving their occluded hand on a tablet and had to estimate their final hand position. In Experiment 1, we found a significantly lower drift of the proprioceptive position of the hand towards the visual object when hand movements were transformed into laterally inverted cursor movements, rather than cursor movements in the same direction. Experiment 2 showed that this reduction reflected an elimination of spatial action-effect binding in the inverted condition. The results are discussed with respect to the prerequisites for an experience of ownership over artificial, noncorporeal objects. Our results show that predictability of an object movement alone is not a sufficient condition for ownership because, depending on the type of transformation, integration of the effector and a distal object can be fully abolished even under conditions of full controllability.

Eye Movements during Visuomotor Adaptation Represent Only Part of the Explicit Learning

Visuomotor rotations are learned through a combination of explicit strategy and implicit recalibration. However, measuring the relative contribution of each remains a challenge and the possibility of multiple explicit and implicit components complicates the issue. Recent interest has focused on the possibility that eye movements reflects explicit strategy. Here we compared eye movements during adaptation to two accepted measures of explicit learning: verbal report and the exclusion test. We found that while reporting, all subjects showed a match among all three measures. However, when subjects did not report their intention, the eye movements of some subjects suggested less explicit adaptation than what was measured in an exclusion test. Interestingly, subjects whose eye movements did match their exclusion could be clustered into the following two subgroups: fully implicit learners showing no evidence of explicit adaptation and explicit learners with little implicit adaptation. Subjects showing a mix of both explicit and implicit adaptation were also those where eye movements showed less explicit adaptation than did exclusion. Thus, our results support the idea of multiple components of explicit learning as only part of the explicit learning is reflected in the eye movements. Individual subjects may use explicit components that are reflected in the eyes or those that are not or some mixture of the two. Analysis of reaction times suggests that the explicit components reflected in the eye movements involve longer reaction times. This component, according to recent literature, may be related to mental rotation.

Eye movements do not play an important role in the adaptation of hand tracking to a visuomotor rotation

Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior. Although eye movements are known to assist hand movement control, how eye movements might contribute to the adaptation of hand movements remains largely unexplored. To determine to what extent eye movements contribute to visuomotor adaptation of hand tracking, participants were asked to track a visual target that followed an unpredictable trajectory with a cursor using a joystick. During blocks of trials, participants were either allowed to look wherever they liked or required to fixate a cross at the center of the screen. Eye movements were tracked to ensure gaze fixation as well as to examine free gaze behavior. The cursor initially responded normally to the joystick, but after several trials, the direction in which it responded was rotated by 90°. Although fixating the eyes had a detrimental influence on hand tracking performance, participants exhibited a rather similar time course of adaptation to rotated visual feedback in the gaze-fixed and gaze-free conditions. More importantly, there was extensive transfer of adaptation between the gaze-fixed and gaze-free conditions. We conclude that although eye movements are relevant for the online control of hand tracking, they do not play an important role in the visuomotor adaptation of such tracking. These results suggest that participants do not adapt by changing the mapping between eye and hand movements, but rather by changing the mapping between hand movements and the cursor’s motion independently of eye movements.

NEW & NOTEWORTHY Eye movements assist hand movements in everyday activities, but their contribution to visuomotor adaptation remains largely unknown. We compared adaptation of hand tracking under free gaze and fixed gaze. Although our results confirm that following the target with the eyes increases the accuracy of hand movements, they unexpectedly demonstrate that gaze fixation does not hinder adaptation. These results suggest that eye movements have distinct contributions for online control and visuomotor adaptation of hand movements.

Using gaze behavior to parcellate the explicit and implicit contributions to visuomotor learning

Successful motor performance relies on our ability to adapt to changes in the environment by learning novel mappings between motor commands and sensory outcomes. Such adaptation is thought to involve two distinct mechanisms: an implicit, error-based component linked to slow learning and an explicit, strategic component linked to fast learning and savings (i.e., faster relearning). Because behavior, at any given moment, is the resultant combination of these two processes, it has remained a challenge to parcellate their relative contributions to performance. The explicit component to visuomotor rotation (VMR) learning has recently been measured by having participants verbally report their aiming strategy used to counteract the rotation. However, this procedure has been shown to magnify the explicit component. Here we tested whether task-specific eye movements, a natural component of reach planning, but poorly studied in motor learning tasks, can provide a direct readout of the state of the explicit component during VMR learning. We show, by placing targets on a visible ring and including a delay between target presentation and reach onset, that individual differences in gaze patterns during sensorimotor learning are linked to participants' rates of learning and their expression of savings. Specifically, we find that participants who, during reach planning, naturally fixate an aimpoint rotated away from the target location, show faster initial adaptation and readaptation 24 h later. Our results demonstrate that gaze behavior cannot only uniquely identify individuals who implement cognitive strategies during learning but also how their implementation is linked to differences in learning. NEW & NOTEWORTHY Although it is increasingly well appreciated that sensorimotor learning is driven by two separate components, an error-based process and a strategic process, it has remained a challenge to identify their relative contributions to performance. Here we demonstrate that task-specific eye movements provide a direct read-out of explicit strategies during sensorimotor learning in the presence of visual landmarks. We further show that individual differences in gaze behavior are linked to learning rate and savings.

Contribution of explicit processes to reinforcement-based motor learning

Despite increasing interest in the role of reward in motor learning, the underlying mechanisms remain ill defined. In particular, the contribution of explicit processes to reward-based motor learning is unclear. To address this, we examined subjects' ( n = 30) ability to learn to compensate for a gradually introduced 25° visuomotor rotation with only reward-based feedback (binary success/failure). Only two-thirds of subjects ( n = 20) were successful at the maximum angle. The remaining subjects initially followed the rotation but after a variable number of trials began to reach at an insufficiently large angle and subsequently returned to near-baseline performance ( n = 10). Furthermore, those who were successful accomplished this via a large explicit component, evidenced by a reduction in reach angle when they were asked to remove any strategy they employed. However, both groups displayed a small degree of remaining retention even after the removal of this explicit component. All subjects made greater and more variable changes in reach angle after incorrect (unrewarded) trials. However, subjects who failed to learn showed decreased sensitivity to errors, even in the initial period in which they followed the rotation, a pattern previously found in parkinsonian patients. In a second experiment, the addition of a secondary mental rotation task completely abolished learning ( n = 10), while a control group replicated the results of the first experiment ( n = 10). These results emphasize a pivotal role of explicit processes during reinforcement-based motor learning, and the susceptibility of this form of learning to disruption has important implications for its potential therapeutic benefits. NEW & NOTEWORTHY We demonstrate that learning a visuomotor rotation with only reward-based feedback is principally accomplished via the development of a large explicit component. Furthermore, this form of learning is susceptible to disruption with a secondary task. The results suggest that future experiments utilizing reward-based feedback should aim to dissect the roles of implicit and explicit reinforcement learning systems. Therapeutic motor learning approaches based on reward should be aware of the sensitivity to disruption.

Context-dependent concurrent adaptation to static and moving targets

Is the neural control of movements towards moving targets independent to that of static targets? In the following experiments, we used a visuomotor rotation adaptation paradigm to examine the extent to which adapting arm movements to static targets generalize to that of moving targets (i.e. pursuit or tracking). In the first and second experiments, we showed that adaptation to perturbed tracking movements generalizes to reaching movements; reach aftereffects following perturbed tracking were about half the size (≈9°) of those produced following reach training (≈ 19°). Given these findings, in the final experiment we associated opposing perturbations (-30° and +30°) with either reaching or tracking movements and presented them within the same experimental block to determine whether these contexts allow for dual adaptation. We found that the group that experienced opposing perturbations was able to reduce both reaching and tracking errors, as well as produce reach aftereffects following dual training of ≈7°, which were substantially smaller than those produced when reach training was not concurrent with tracking training. This reduction in reach aftereffects is consistent with the extent of the interference from tracking training as measured by the reach aftereffects produced when only that condition was performed. These results suggest partial, but not complete, overlap in the learning processes involved in the acquisition of tracking and reaching movements.

Eye-hand coordination during visuomotor adaptation: effects of hemispace and joint coordination

We previously examined adaptive changes of eye-hand coordination during learning of a visuomotor rotation. Gazes during reaching movements were initially directed to a feedback cursor in early practice, but were gradually shifted toward the target with more practice, indicating an emerging gaze anchoring behavior. This adaptive pattern reflected a functional change of gaze control from exploring the cursor-hand relation to guiding the hand to the task goal. The present study further examined the effects of hemispace and joint coordination associated with target directions on this behavior. Young adults performed center-out reaching movements to four targets with their right hand on a horizontal digitizer, while looking at a rotated visual feedback cursor on a computer monitor. To examine the effect of hemispace related to visual stimuli, two out of the four targets were located in the ipsilateral workspace relative to the hand used, the other two in the contralateral workspace. To examine the effect of hemispace related to manual actions, two among the four targets were related to reaches made in the ipsilateral workspace, the other two to reaches made in the contralateral workspace. Furthermore, to examine the effect of the complexity of joint coordination, two among the four targets were reaches involving a direct path from the start to the target involving elbow movements (simple), whereas the other two targets were reaches involving both shoulder and elbow movements (complex). The results showed that the gaze anchoring behavior gradually emerged during practice for reaches made in all target directions. The speed of this change was affected mainly by the hemispace related to manual actions, whereas the other two effects were minimal. The gaze anchoring occurred faster for the ipsilateral reaches than for the contralateral reaches; gazes prior to the gaze anchoring were also directed less at the cursor vicinity but more at the mid-area between the starting point and the target. These results suggest that ipsilateral reaches result in a better predictability of the cursor-hand relation under the visuomotor rotation, thereby prompting an earlier functional change of gaze control through practice from a reactive to a predictive control.