Using gaze behavior to parcellate the explicit and implicit contributions to visuomotor learning

Minimal impact of chronic proprioceptive loss on implicit sensorimotor adaptation and perceived movement outcome

Implicit sensorimotor adaptation keeps our movements well calibrated amid changes in the body and environment. We have recently postulated that implicit adaptation is driven by a perceptual error: the difference between the desired and perceived movement outcome. According to this perceptual realignment model, implicit adaptation ceases when the perceived movement outcome-a multimodal percept determined by a prior belief conveying the intended action, the motor command, and feedback from proprioception and vision-is aligned with the desired movement outcome. Here, we examined the role of proprioception in implicit motor adaptation and perceived movement outcome by examining individuals who experience deafferentation (i.e., individuals with impaired proprioception and touch). We used a modified visuomotor rotation task designed to isolate implicit adaptation and probe perceived movement outcomes throughout the experiment. Surprisingly, both implicit adaptation and perceived movement outcome were minimally impacted by chronic deafferentation, posing a challenge to the perceptual realignment model of implicit adaptation.NEW & NOTEWORTHY We tested six individuals with chronic somatosensory deafferentation on a novel task that isolates implicit sensorimotor adaptation and probes perceived movement outcome. Strikingly, both implicit motor adaptation and perceptual movement outcome were not significantly impacted by chronic deafferentation, posing a challenge for theoretical models of adaptation that involve proprioception.

Fundamental processes in sensorimotor learning: Reasoning, refinement, and retrieval

Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development of sophisticated models designed to elucidate the mechanisms of implicit sensorimotor learning. In this review, we argue for a broader perspective, emphasizing the contribution of explicit strategies to sensorimotor learning tasks. Furthermore, we propose a theoretical framework for motor learning that consists of three fundamental processes: reasoning, the process of understanding action-outcome relationships; refinement, the process of optimizing sensorimotor and cognitive parameters to achieve motor goals; and retrieval, the process of inferring the context and recalling a control policy. We anticipate that this '3R' framework for understanding how complex movements are learned will open exciting avenues for future research at the intersection between cognition and action.

Perceptual error based on Bayesian cue combination drives implicit motor adaptation

The sensorimotor system can recalibrate itself without our conscious awareness, a type of procedural learning whose computational mechanism remains undefined. Recent findings on implicit motor adaptation, such as over-learning from small perturbations and fast saturation for increasing perturbation size, challenge existing theories based on sensory errors. We argue that perceptual error, arising from the optimal combination of movement-related cues, is the primary driver of implicit adaptation. Central to our theory is the increasing sensory uncertainty of visual cues with increasing perturbations, which was validated through perceptual psychophysics (Experiment 1). Our theory predicts the learning dynamics of implicit adaptation across a spectrum of perturbation sizes on a trial-by-trial basis (Experiment 2). It explains proprioception changes and their relation to visual perturbation (Experiment 3). By modulating visual uncertainty in perturbation, we induced unique adaptation responses in line with our model predictions (Experiment 4). Overall, our perceptual error framework outperforms existing models based on sensory errors, suggesting that perceptual error in locating one's effector, supported by Bayesian cue integration, underpins the sensorimotor system's implicit adaptation.

Reconfigurations of cortical manifold structure during reward-based motor learning

Adaptive motor behavior depends on the coordinated activity of multiple neural systems distributed across the brain. While the role of sensorimotor cortex in motor learning has been well established, how higher-order brain systems interact with sensorimotor cortex to guide learning is less well understood. Using functional MRI, we examined human brain activity during a reward-based motor task where subjects learned to shape their hand trajectories through reinforcement feedback. We projected patterns of cortical and striatal functional connectivity onto a low-dimensional manifold space and examined how regions expanded and contracted along the manifold during learning. During early learning, we found that several sensorimotor areas in the dorsal attention network exhibited increased covariance with areas of the salience/ventral attention network and reduced covariance with areas of the default mode network (DMN). During late learning, these effects reversed, with sensorimotor areas now exhibiting increased covariance with DMN areas. However, areas in posteromedial cortex showed the opposite pattern across learning phases, with its connectivity suggesting a role in coordinating activity across different networks over time. Our results establish the neural changes that support reward-based motor learning and identify distinct transitions in the functional coupling of sensorimotor to transmodal cortex when adapting behavior.

Imprecise perception of hand position during early motor adaptation

Localizing one's body parts is important for movement control and motor learning. Recent studies have shown that the precision with which people localize their hand places constraints on motor adaptation. Although these studies have assumed that hand localization remains equally precise across learning, we show that precision decreases rapidly during early motor learning. In three experiments, healthy young participants (n = 92) repeatedly adapted to a 45° visuomotor rotation for a cycle of two to four reaches, followed by a cycle of two to four reaches with veridical feedback. Participants either used an aiming strategy that fully compensated for the rotation (experiment 1), or always aimed directly at the target, so that adaptation was implicit (experiment 2). We omitted visual feedback for the last reach of each cycle, after which participants localized their unseen hand. We observed an increase in the variability of angular localization errors when subjects used a strategy to counter the visuomotor rotation (experiment 1). This decrease in precision was less pronounced in the absence of reaiming (experiment 2), and when subjects knew that they would have to localize their hand on the upcoming trial, and could thus focus on hand position (experiment 3). We propose that strategic reaiming decreases the precision of perceived hand position, possibly due to attention to vision rather than proprioception. We discuss how these dynamics in precision during early motor learning could impact on motor control and shape the interplay between implicit and strategy-based motor adaptation.NEW & NOTEWORTHY Recent studies indicate that the precision with which people localize their hand limits implicit visuomotor learning. We found that localization precision is not static, but decreases early during learning. This decrease is pronounced when people apply a reaiming strategy to compensate for a visuomotor perturbation and is partly resistant to allocation of attention to the hand. We propose that these dynamics in position sense during learning may influence how implicit and strategy-based motor adaption interact.

Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds

From a baby's babbling to a songbird practising a new tune, exploration is critical to motor learning. A hallmark of exploration is the emergence of random walk behaviour along solution manifolds, where successive motor actions are not independent but rather become serially dependent. Such exploratory random walk behaviour is ubiquitous across species' neural firing, gait patterns and reaching behaviour. The past work has suggested that exploratory random walk behaviour arises from an accumulation of movement variability and a lack of error-based corrections. Here, we test a fundamentally different idea-that reinforcement-based processes regulate random walk behaviour to promote continual motor exploration to maximize success. Across three human reaching experiments, we manipulated the size of both the visually displayed target and an unseen reward zone, as well as the probability of reinforcement feedback. Our empirical and modelling results parsimoniously support the notion that exploratory random walk behaviour emerges by utilizing knowledge of movement variability to update intended reach aim towards recently reinforced motor actions. This mechanism leads to active and continuous exploration of the solution manifold, currently thought by prominent theories to arise passively. The ability to continually explore muscle, joint and task redundant solution manifolds is beneficial while acting in uncertain environments, during motor development or when recovering from a neurological disorder to discover and learn new motor actions.

Strategy-based motor learning decreases the post-movement β power

Motor learning depends on the joint contribution of several processes including cognitive strategies aiming at goal achievement and prediction error-driven implicit adaptation. Understanding this functional interplay and its clinical implications requires insight into the individual learning processes, including at a neural level. Here, we set out to examine the impact of learning a cognitive strategy, over and above implicit adaptation, on the oscillatory post-movement β rebound (PMBR), which typically decreases in power following (visuo)motor perturbations. Healthy participants performed reaching movements towards a target, with online visual feedback replacing the view of their moving hand. The feedback was sometimes rotated, either relative to their movements (visuomotor rotation) or invariant to their movements (and relative to the target; clamped feedback), always for two consecutive trials interspersed between non-rotated trials. In both conditions, the first trial with a rotation was unpredictable. On the second trial, the task was either to re-aim, and thereby compensate for the rotation experienced in the first trial (visuomotor rotation; Compensate condition), or to ignore the rotation and keep on aiming at the target (clamped feedback; Ignore condition). After-effects did not differ between conditions, indicating that the amount of implicit learning was similar, while large differences in movement direction in the second rotated trial between conditions indicated that participants successfully acquired re-aiming strategies. Importantly, PMBR power following the first rotated trial was modulated differently in the two conditions. Specifically, it decreased in both conditions, but this effect was larger when participants had to acquire a cognitive strategy and prepare to re-aim. Our results therefore suggest that the PMBR is modulated by cognitive demands of motor learning, possibly reflecting the evaluation of a behaviourally significant goal achievement error.

Age-related decline of online visuomotor adaptation: a combined effect of deteriorations of motor anticipation and execution

The literature has established that the capability of visuomotor adaptation decreases with aging. However, the underlying mechanisms of this decline are yet to be fully understood. The current study addressed this issue by examining how aging affected visuomotor adaptation in a continuous manual tracking task with delayed visual feedback. To distinguish separate contributions of the declined capability of motor anticipation and deterioration of motor execution to this age-related decline, we recorded and analyzed participants' manual tracking performances and their eye movements during tracking. Twenty-nine older people and twenty-three young adults (control group) participated in this experiment. The results showed that the age-related decline of visuomotor adaptation was strongly linked to degraded performance in predictive pursuit eye movement, indicating that declined capability motor anticipation with aging had critical influences on the age-related decline of visuomotor adaptation. Additionally, deterioration of motor execution, measured by random error after controlling for the lag between target and cursor, was found to have an independent contribution to the decline of visuomotor adaptation. Taking these findings together, we see a picture that the age-related decline of visuomotor adaptation is a joint effect of the declined capability of motor anticipation and the deterioration of motor execution with aging.

Whole-brain dynamics of human sensorimotor adaptation

Humans vary greatly in their motor learning abilities, yet little is known about the neural processes that underlie this variability. We identified distinct profiles of human sensorimotor adaptation that emerged across 2 days of learning, linking these profiles to the dynamics of whole-brain functional networks early on the first day when cognitive strategies toward sensorimotor adaptation are believed to be most prominent. During early learning, greater recruitment of a network of higher-order brain regions, involving prefrontal and anterior temporal cortex, was associated with faster learning. At the same time, greater integration of this "cognitive network" with a sensorimotor network was associated with slower learning, consistent with the notion that cognitive strategies toward adaptation operate in parallel with implicit learning processes of the sensorimotor system. On the second day, greater recruitment of a network that included the hippocampus was associated with faster learning, consistent with the notion that declarative memory systems are involved with fast relearning of sensorimotor mappings. Together, these findings provide novel evidence for the role of higher-order brain systems in driving variability in adaptation.

Distinct patterns of cortical manifold expansion and contraction underlie human sensorimotor adaptation

Sensorimotor learning is a dynamic, systems-level process that involves the combined action of multiple neural systems distributed across the brain. Although much is known about the specialized cortical systems that support specific components of action (such as reaching), we know less about how cortical systems function in a coordinated manner to facilitate adaptive behavior. To address this gap, our study measured human brain activity using functional MRI (fMRI) while participants performed a classic sensorimotor adaptation task and used a manifold learning approach to describe how behavioral changes during adaptation relate to changes in the landscape of cortical activity. During early adaptation, areas in the parietal and premotor cortices exhibited significant contraction along the cortical manifold, which was associated with their increased covariance with regions in the higher-order association cortex, including both the default mode and fronto-parietal networks. By contrast, during Late adaptation, when visuomotor errors had been largely reduced, a significant expansion of the visual cortex along the cortical manifold was associated with its reduced covariance with the association cortex and its increased intraconnectivity. Lastly, individuals who learned more rapidly exhibited greater covariance between regions in the sensorimotor and association cortices during early adaptation. These findings are consistent with a view that sensorimotor adaptation depends on changes in the integration and segregation of neural activity across more specialized regions of the unimodal cortex with regions in the association cortex implicated in higher-order processes. More generally, they lend support to an emerging line of evidence implicating regions of the default mode network (DMN) in task-based performance.

Neural excursions from manifold structure explain patterns of learning during human sensorimotor adaptation

Humans vary greatly in their motor learning abilities, yet little is known about the neural mechanisms that underlie this variability. Recent neuroimaging and electrophysiological studies demonstrate that large-scale neural dynamics inhabit a low-dimensional subspace or manifold, and that learning is constrained by this intrinsic manifold architecture. Here, we asked, using functional MRI, whether subject-level differences in neural excursion from manifold structure can explain differences in learning across participants. We had subjects perform a sensorimotor adaptation task in the MRI scanner on 2 consecutive days, allowing us to assess their learning performance across days, as well as continuously measure brain activity. We find that the overall neural excursion from manifold activity in both cognitive and sensorimotor brain networks is associated with differences in subjects' patterns of learning and relearning across days. These findings suggest that off-manifold activity provides an index of the relative engagement of different neural systems during learning, and that subject differences in patterns of learning and relearning are related to reconfiguration processes occurring in cognitive and sensorimotor networks.

Delay of gaze fixation during reaching movement with the non-dominant hand to a distant target

The present study examined the effects of hand and task difficulty on eye-hand coordination related to gaze fixation behavior (i.e., fixating a gaze to the target until reach completion) in single reaching movements. Twenty right-handed young adults made reaches on a digitizer, while looking at a visual target and feedback of hand movements on a computer monitor. Task difficulty was altered by having three target distances. In a small portion of trials, visual feedback was randomly removed at the target presentation. The effect of a moderate amount of practice was also examined using a randomized trial schedule across target-distance and visual-feedback conditions in each hand. The results showed that the gaze distances covered during the early reaching phase were reduced, and the gaze fixation to the target was delayed when reaches were performed with the left hand and when the target distance increased. These results suggest that when the use of the non-dominant hand or an increased task difficulty reduces the predictability of hand movements and its sensory consequences, eye-hand coordination is modified to enhance visual monitoring of the reach progress prior to gaze fixation. The randomized practice facilitated this process. Nevertheless, variability of reach trajectory was more increased without visual feedback for right-hand reaches, indicating that control of the dominant arm integrates more visual feedback information during reaches. These results together suggest that the earlier gaze fixation and greater integration of visual feedback during right-hand reaches contribute to the faster and more accurate performance in the final reaching phase.

Competition between parallel sensorimotor learning systems

Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system's contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system's response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.

Human Variation in Error-Based and Reinforcement Motor Learning Is Associated With Entorhinal Volume

Error-based and reward-based processes are critical for motor learning and are thought to be mediated via distinct neural pathways. However, recent behavioral work in humans suggests that both learning processes can be bolstered by the use of cognitive strategies, which may mediate individual differences in motor learning ability. It has been speculated that medial temporal lobe regions, which have been shown to support motor sequence learning, also support the use of cognitive strategies in error-based and reinforcement motor learning. However, direct evidence in support of this idea remains sparse. Here we first show that better overall learning during error-based visuomotor adaptation is associated with better overall learning during the reward-based shaping of reaching movements. Given the cognitive contribution to learning in both of these tasks, these results support the notion that strategic processes, associated with better performance, drive intersubject variation in both error-based and reinforcement motor learning. Furthermore, we show that entorhinal cortex volume is larger in better learning individuals-characterized across both motor learning tasks-compared with their poorer learning counterparts. These results suggest that individual differences in learning performance during error and reinforcement learning are related to neuroanatomical differences in entorhinal cortex.

Normal Aging Affects the Short-Term Temporal Stability of Implicit, But Not Explicit, Motor Learning following Visuomotor Adaptation

Normal aging is associated with a decline in memory and motor learning ability. However, the exact form of these impairments (e.g., the short-term temporal stability and affected learning mechanisms) is largely unknown. Here, we used a sensorimotor adaptation task to examine changes in the temporal stability of two forms of learning (explicit and implicit) because of normal aging. Healthy young subjects (age range, 19–28 years; 20 individuals) and older human subjects (age range, 63–85 years; 19 individuals) made reaching movements in response to altered visual feedback. On each trial, subjects turned a rotation dial to select an explicit aiming direction. Once selected, the display was removed and subjects moved the cursor from the start position to the target. After initial training with the rotational feedback perturbation, subjects completed a series of probe trials at different delay periods to systematically assess the short-term retention of learning. For both groups, the explicit aiming showed no significant decrease over 1.5 min. However, this was not the case for implicit learning; the decay pattern was markedly different between groups. Older subjects showed a linear decrease of the implicit component of adaptation over time, while young subjects showed an exponential decay over the same period (time constant, 25.61 s). Although older subjects adapted at a similar rate, these results suggest natural aging selectively impacts the short-term (seconds to minutes) temporal stability of implicit motor learning mechanisms. This understanding may provide a means to dissociate natural aging memory impairments from deficits caused by brain disorders that progress with aging.

Sensitivity to error during visuomotor adaptation is similarly modulated by abrupt, gradual and random perturbation schedules

It has been suggested that sensorimotor adaptation involves at least two processes (i.e., fast and slow) that differ in retention and error sensitivity. Previous work has shown that repeated exposure to an abrupt force field perturbation results in greater error sensitivity for both the fast and slow processes. While this implies that the faster relearning is associated with increased error sensitivity, it remains unclear what aspects of prior experience modulate error sensitivity. In the present study, we manipulated the initial training using different perturbation schedules, thought to differentially affect fast and slow learning processes based on error magnitude, and then observed what effect prior learning had on subsequent adaptation. During initial training of a visuomotor rotation task, we exposed three groups of participants to either an abrupt, a gradual, or a random perturbation schedule. During a testing session, all three groups were subsequently exposed to an abrupt perturbation schedule. Comparing the two sessions of the control group who experienced repetition of the same perturbation, we found an increased error sensitivity for both processes. We found that the error sensitivity was increased for both the fast and slow processes, with no reliable changes in the retention, for both the gradual and structural learning groups when compared to the first session of the control group. We discuss the findings in the context of how fast and slow learning processes respond to a history of errors.

Taking aim at the perceptual side of motor learning: exploring how explicit and implicit learning encode perceptual error information through depth vision

Motor learning in visuomotor adaptation tasks results from both explicit and implicit processes, each responding differently to an error signal. Although the motor output side of these processes has been extensively studied, the visual input side is relatively unknown. We investigated if and how depth perception affects the computation of error information by explicit and implicit motor learning. Two groups of participants made reaching movements to bring a virtual cursor to a target in the frontoparallel plane. The Delayed group was allowed to reaim and their feedback was delayed to emphasize explicit learning, whereas the camped group received task-irrelevant clamped cursor feedback and continued to aim straight at the target to emphasize implicit adaptation. Both groups played this game in a highly detailed virtual environment (depth condition), leveraging a cover task of playing darts in a virtual tavern, and in an empty environment (no-depth condition). The delayed group showed an increase in error sensitivity under depth relative to no-depth. In contrast, the clamped group adapted to the same degree under both conditions. The movement kinematics of the delayed participants also changed under the depth condition, consistent with the target appearing more distant, unlike the Clamped group. A comparison of the delayed behavioral data with a perceptual task from the same individuals showed that the greater reaiming in the depth condition was consistent with an increase in the scaling of the error distance and size. These findings suggest that explicit and implicit learning processes may rely on different sources of perceptual information.NEW & NOTEWORTHY We leveraged a classic sensorimotor adaptation task to perform a first systematic assessment of the role of perceptual cues in the estimation of an error signal in the 3-D space during motor learning. We crossed two conditions presenting different amounts of depth information, with two manipulations emphasizing explicit and implicit learning processes. Explicit learning responded to the visual conditions, consistent with perceptual reports, whereas implicit learning appeared to be independent of them.

Assessing and defining explicit processes in visuomotor adaptation

The Process Dissociation Procedure (PDP) and Verbal Report Framework (VRF) reveal that both explicit (conscious) and implicit (unconscious) processes contribute to visuomotor adaptation. We looked to determine whether these two assessment methods establish similar processes underlying visuomotor adaptation by comparing the magnitude of explicit and implicit adaptation over time between the two assessments and to post-experiment assessments of awareness of the visuomotor distortion. Three groups of participants (PDP, VRF, VRF No-Cursor) completed three blocks of reach training in a virtual environment with a cursor rotated 40° clockwise relative to hand motion. Explicit and implicit adaptations were assessed immediately following each block, and again 5 min later. The VRF No-Cursor group completed the same assessment trials as the VRF group, but no visual feedback was presented during explicit and implicit assessment. Finally, participants completed a post-experiment questionnaire and a drawing task to assess their awareness of the visuomotor rotation and changes in reaches at the end of the experiment, respectively. We found that all groups adapted their reaches to the rotation. Averaged across participants, the magnitude and retention of explicit and implicit adaptations were similar between the PDP group and VRF group, with the VRF group demonstrating greater implicit adaptation than the VRF No-Cursor group. Furthermore, the magnitude of explicit adaptation established in the VRF group was not related to participant's post-experiment awareness of the visuomotor distortion nor how they had changed their reaches, as observed in the PDP group and VRF No-Cursor group. Together, these results indicate that, explicit adaptation established via typical VRF methods does not reflect one's awareness of the visuomotor distortion at the end of the experiment, and hence the established processes underlying visuomotor adaptation are dependent on method of assessment (i.e., PDP versus VRF).

Did We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based Learning

The human motor system can rapidly adapt its motor output in response to errors. The prevailing theory of this process posits that the motor system adapts an internal forward model that predicts the consequences of outgoing motor commands and uses this forward model to plan future movements. However, despite clear evidence that adaptive forward models exist and are used to help track the state of the body, there is no definitive evidence that such models are used in movement planning. An alternative to the forward-model-based theory of adaptation is that movements are generated based on a learned policy that is adjusted over time by movement errors directly ("direct policy learning"). This learning mechanism could act in parallel with, but independent of, any updates to a predictive forward model. Forward-model-based learning and direct policy learning generate very similar predictions about behavior in conventional adaptation paradigms. However, across three experiments with human participants (N = 47, 26 female), we show that these mechanisms can be dissociated based on the properties of implicit adaptation under mirror-reversed visual feedback. Although mirror reversal is an extreme perturbation, it still elicits implicit adaptation; however, this adaptation acts to amplify rather than to reduce errors. We show that the pattern of this adaptation over time and across targets is consistent with direct policy learning but not forward-model-based learning. Our findings suggest that the forward-model-based theory of adaptation needs to be re-examined and that direct policy learning provides a more plausible explanation of implicit adaptation.SIGNIFICANCE STATEMENT The ability of our brain to adapt movements in response to error is one of the most widely studied phenomena in motor learning. Yet, we still do not know the process by which errors eventually result in adaptation. It is known that the brain maintains and updates an internal forward model, which predicts the consequences of motor commands, and the prevailing theory of motor adaptation posits that this updated forward model is responsible for trial-by-trial adaptive changes. Here, we question this view and show instead that adaptation is better explained by a simpler process whereby motor output is directly adjusted by task errors. Our findings cast doubt on long-held beliefs about adaptation.

Intermanual transfer and retention of visuomotor adaptation to a large visuomotor distortion are driven by explicit processes

Reaching with a visuomotor distortion in a virtual environment leads to reach adaptation in the trained hand, and in the untrained hand. In the current study we asked if reach adaptation in the untrained (right) hand is due to transfer of explicit adaptation (EA; strategic changes in reaches) and/or implicit adaptation (IA; unconscious changes in reaches) from the trained (left) hand, and if this transfer changes depending on instructions provided. We further asked if EA and IA are retained in both the trained and untrained hands. Participants (n = 60) were divided into 3 groups (Instructed (provided with instructions on how to counteract the visuomotor distortion), Non-Instructed (no instructions provided), and Control (EA not assessed)). EA and IA were assessed in both the trained and untrained hands immediately following rotated reach training with a 40° visuomotor distortion, and again 24 hours later by having participants reach in the absence of cursor feedback. Participants were to reach (1) so that the cursor landed on the target (EA + IA), and (2) so that their hand landed on the target (IA). Results revealed that, while initial EA observed in the trained hand was greater for the Instructed versus Non-Instructed group, the full extent of EA transferred between hands for both groups and was retained across days. IA observed in the trained hand was greatest in the Non-Instructed group. However, IA did not significantly transfer between hands for any of the three groups. Limited retention of IA was observed in the trained hand. Together, these results suggest that while initial EA and IA in the trained hand are dependent on instructions provided, transfer and retention of visuomotor adaptation to a large visuomotor distortion are driven almost exclusively by EA.

Functional Use of Eye Movements for an Acting System

Movements of the eyes assist vision and support hand and body movements in a cooperative way. Despite their strong functional coupling, different types of movements are usually studied independently. We integrate knowledge from behavioral, neurophysiological, and clinical studies on how eye movements are coordinated with goal-directed hand movements and how they facilitate motor learning. Understanding the coordinated control of eye and hand movements can provide important insights into brain functions that are essential for performing or learning daily tasks in health and disease. This knowledge can also inform applications such as robotic manipulation and clinical rehabilitation.

External error attribution dampens efferent-based predictions but not proprioceptive changes in hand localization

In learning and adapting movements in changing conditions, people attribute the errors they experience to a combined weighting of internal or external sources. As such, error attribution that places more weight on external sources should lead to decreased updates in our internal models for movement of the limb or estimating the position of the effector, i.e. there should be reduced implicit learning. However, measures of implicit learning are the same whether or not we induce explicit adaptation with instructions about the nature of the perturbation. Here we evoke clearly external errors by either demonstrating the rotation on every trial, or showing the hand itself throughout training. Implicit reach aftereffects persist, but are reduced in both groups. Only for the group viewing the hand, changes in hand position estimates suggest that predicted sensory consequences are not updated, but only rely on recalibrated proprioception. Our results show that estimating the position of the hand incorporates source attribution during motor learning, but recalibrated proprioception is an implicit process unaffected by external error attribution.

Savings in sensorimotor adaptation without an explicit strategy

The hallmark of long-term retention of sensorimotor adaptation is a faster relearning when similar perturbations are encountered again. However, what processes underlie this saving effect is in debate. Though motor adaptation is traditionally viewed as a type of procedural learning, its savings has been recently shown to be solely based on a quick recall of explicit adaptation strategy. Here, we showed that adaptation to a novel error-invariant perturbation without an explicit strategy could enable subsequent savings. We further showed that adaptation to gradual perturbations could enable savings, which was supported by enhanced implicit learning. Our study provides supporting evidence that long-term retention of motor adaptation is possible without forming or recalling a cognitive strategy, and the interplay between implicit and explicit learning critically depends on the specifics of learning protocol and available sensory feedback.

NEW & NOTEWORTHY Savings in motor learning sometimes refers to faster learning when one encounters the same perturbation again. Previous studies assert that forming a cognitive strategy for countering perturbations is necessary for savings. We used novel experimental techniques to prevent the formation of a cognitive strategy during initial adaptation and found that savings still existed during relearning. Our findings suggest that savings in sensorimotor adaptation do not exclusively depend on forming and recalling an explicit strategy.

Human decision making anticipates future performance in motor learning

It is well-established that people can factor into account the distribution of their errors in motor performance so as to optimize reward. Here we asked whether, in the context of motor learning where errors decrease across trials, people take into account their future, improved performance so as to make optimal decisions to maximize reward. One group of participants performed a virtual throwing task in which, periodically, they were given the opportunity to select from a set of smaller targets of increasing value. A second group of participants performed a reaching task under a visuomotor rotation in which, after performing a initial set of trials, they selected a reward structure (ratio of points for target hits and misses) for different exploitation horizons (i.e., numbers of trials they might be asked to perform). Because movement errors decreased exponentially across trials in both learning tasks, optimal target selection (task 1) and optimal reward structure selection (task 2) required taking into account future performance. The results from both tasks indicate that people anticipate their future motor performance so as to make decisions that will improve their expected future reward.

Task Errors Drive Memories That Improve Sensorimotor Adaptation

Traditional views of sensorimotor adaptation (i.e., adaptation of movements to perturbed sensory feedback) emphasize the role of automatic, implicit correction of sensory prediction errors. However, latent memories formed during sensorimotor adaptation, manifest as improved relearning (e.g., savings), have recently been attributed to strategic corrections of task errors (failures to achieve task goals). To dissociate contributions of task errors and sensory prediction errors to latent sensorimotor memories, we perturbed target locations to remove or enforce task errors during learning and/or test, with male/female human participants. Adaptation improved after learning in all conditions where participants were permitted to correct task errors, and did not improve whenever we prevented correction of task errors. Thus, previous correction of task errors was both necessary and sufficient to improve adaptation. In contrast, a history of sensory prediction errors was neither sufficient nor obligatory for improved adaptation. Limiting movement preparation time showed that the latent memories driven by learning to correct task errors take at least two forms: a time-consuming but flexible component, and a rapidly expressible, inflexible component. The results provide strong support for the idea that movement corrections driven by a failure to successfully achieve movement goals underpin motor memories that manifest as savings. Such persistent memories are not exclusively mediated by time-consuming strategic processes but also comprise a rapidly expressible but inflexible component. The distinct characteristics of these putative processes suggest dissociable underlying mechanisms, and imply that identification of the neural basis for adaptation and savings will require methods that allow such dissociations.SIGNIFICANCE STATEMENT Latent motor memories formed during sensorimotor adaptation manifest as improved adaptation when sensorimotor perturbations are reencountered. Conflicting theories suggest that this "savings" is underpinned by different mechanisms, including a memory of successful actions, a memory of errors, or an aiming strategy to correct task errors. Here we show that learning to correct task errors is sufficient to show improved subsequent adaptation with respect to naive performance, even when tested in the absence of task errors. In contrast, a history of sensory prediction errors is neither sufficient nor obligatory for improved adaptation. Finally, we show that latent sensorimotor memories driven by task errors comprise at least two distinct components: a time-consuming, flexible component, and a rapidly expressible, inflexible component.

Eye Movements during Visuomotor Adaptation Represent Only Part of the Explicit Learning

Visuomotor rotations are learned through a combination of explicit strategy and implicit recalibration. However, measuring the relative contribution of each remains a challenge and the possibility of multiple explicit and implicit components complicates the issue. Recent interest has focused on the possibility that eye movements reflects explicit strategy. Here we compared eye movements during adaptation to two accepted measures of explicit learning: verbal report and the exclusion test. We found that while reporting, all subjects showed a match among all three measures. However, when subjects did not report their intention, the eye movements of some subjects suggested less explicit adaptation than what was measured in an exclusion test. Interestingly, subjects whose eye movements did match their exclusion could be clustered into the following two subgroups: fully implicit learners showing no evidence of explicit adaptation and explicit learners with little implicit adaptation. Subjects showing a mix of both explicit and implicit adaptation were also those where eye movements showed less explicit adaptation than did exclusion. Thus, our results support the idea of multiple components of explicit learning as only part of the explicit learning is reflected in the eye movements. Individual subjects may use explicit components that are reflected in the eyes or those that are not or some mixture of the two. Analysis of reaction times suggests that the explicit components reflected in the eye movements involve longer reaction times. This component, according to recent literature, may be related to mental rotation.

Gaze behavior during visuomotor tracking with complex hand-cursor dynamics

The ability to track a moving target with the hand has been extensively studied, but few studies have characterized gaze behavior during this task. Here we investigate gaze behavior when participants learn a new mapping between hand and cursor motion, such that the cursor represented the position of a virtual mass attached to the grasped handle via a virtual spring. Depending on the experimental condition, haptic feedback consistent with mass-spring dynamics could also be provided. For comparison a simple one-to-one hand-cursor mapping was also tested. We hypothesized that gaze would be drawn, at times, to the cursor in the mass-spring conditions, especially in the absence of haptic feedback. As expected hand tracking performance was less accurate under the spring mapping, but gaze behavior was virtually unaffected by the spring mapping, regardless of whether haptic feedback was provided. Specifically, relative gaze position between target and cursor, rate of saccades, and gain of smooth pursuit were similar under both mappings and both haptic feedback conditions. We conclude that even when participants are exposed to a challenging hand-cursor mapping, gaze is primarily concerned about ongoing target motion suggesting that peripheral vision is sufficient to monitor cursor position and to update hand movement control.

Ipsilateral eye contributions to online visuomotor control of right upper-limb movements

A limb's initial position is often biased to the right of the midline during activities of daily living. Given this specific initial limb position, visual cues of the limb become first available to the ipsilateral eye relative to the contralateral eye. The current study investigated online control of the dominant limb as a function of having visual cues available to the ipsilateral or contralateral eye, in relation to the initial start position of the limb. Participants began each trial with their right limb on a home position to the left or right of the midline. After movement onset, a brief visual sample was provided to the ipsilateral or contralateral eye. On one third of the trials, an imperceptible 3 cm target jump was introduced. If visual information from the eye ipsilateral to the limb is preferentially used to control ongoing movements of the dominant limb, corrections for the target jump should be observed when movements began from the right of the body's midline and vision was available to the ipsilateral eye. As expected, limb trajectory corrections for the target jump were only observed when participants started from the right home position and visual information was provided to the ipsilateral eye. We purport that such visuomotor asymmetry specialization emerges via neurophysiological developments, which may arise from naturalistic and probabilistic limb trajectory asymmetries.

Eye movements do not play an important role in the adaptation of hand tracking to a visuomotor rotation

Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior. Although eye movements are known to assist hand movement control, how eye movements might contribute to the adaptation of hand movements remains largely unexplored. To determine to what extent eye movements contribute to visuomotor adaptation of hand tracking, participants were asked to track a visual target that followed an unpredictable trajectory with a cursor using a joystick. During blocks of trials, participants were either allowed to look wherever they liked or required to fixate a cross at the center of the screen. Eye movements were tracked to ensure gaze fixation as well as to examine free gaze behavior. The cursor initially responded normally to the joystick, but after several trials, the direction in which it responded was rotated by 90°. Although fixating the eyes had a detrimental influence on hand tracking performance, participants exhibited a rather similar time course of adaptation to rotated visual feedback in the gaze-fixed and gaze-free conditions. More importantly, there was extensive transfer of adaptation between the gaze-fixed and gaze-free conditions. We conclude that although eye movements are relevant for the online control of hand tracking, they do not play an important role in the visuomotor adaptation of such tracking. These results suggest that participants do not adapt by changing the mapping between eye and hand movements, but rather by changing the mapping between hand movements and the cursor’s motion independently of eye movements.

NEW & NOTEWORTHY Eye movements assist hand movements in everyday activities, but their contribution to visuomotor adaptation remains largely unknown. We compared adaptation of hand tracking under free gaze and fixed gaze. Although our results confirm that following the target with the eyes increases the accuracy of hand movements, they unexpectedly demonstrate that gaze fixation does not hinder adaptation. These results suggest that eye movements have distinct contributions for online control and visuomotor adaptation of hand movements.

Dissociable cognitive strategies for sensorimotor learning

Computations underlying cognitive strategies in human motor learning are poorly understood. Here we investigate such strategies in a common sensorimotor transformation task. We show that strategies assume two forms, likely reflecting distinct working memory representations: discrete caching of stimulus-response contingencies, and time-consuming parametric computations. Reaction times and errors suggest that both strategies are employed during learning, and trade off based on task complexity. Experiments using pressured preparation time further support dissociable strategies: In response caching, time pressure elicits multi-modal distributions of movements; during parametric computations, time pressure elicits a shifting distribution of movements between visual targets and distal goals, consistent with analog re-computing of a movement plan. A generalization experiment reveals that discrete and parametric strategies produce, respectively, more localized or more global transfer effects. These results describe how qualitatively distinct cognitive representations are leveraged for motor learning and produce downstream consequences for behavioral flexibility.

A rapid visuomotor response on the human upper limb is selectively influenced by implicit motor learning

How do humans learn to adapt their motor actions to achieve task success? Recent behavioral and patient studies have challenged the classic notion that motor learning arises solely from the errors produced during a task, suggesting instead that explicit cognitive strategies can act in concert with the implicit, error-based, motor learning component. In this study, we show that the earliest wave of directionally tuned neuromuscular activity that begins within ~100 ms of peripheral visual stimulus onset is selectively influenced by the implicit component of motor learning. In contrast, the voluntary neuromuscular activity associated with reach initiation, which evolves ~100-200 ms later, is influenced by both the implicit and explicit components of motor learning. The selective influence of the implicit, but not explicit, component of motor learning on the directional tuning of the earliest cascade of neuromuscular activity supports the notion that these components of motor learning can differentially influence descending motor pathways. NEW & NOTEWORTHY Motor learning can be driven both by an implicit error-based component and an explicit strategic component, but the influence of these components on the descending pathways that contribute to motor control is unknown. In this study, we show that the implicit component selectively influences a reflexive circuit that rapidly generates a visuomotor response on the human upper limb. Our results show that the substrates mediating implicit and explicit motor learning exert distinct influences on descending motor pathways.