Implications of plan-based generalization in sensorimotor adaptation

Audiomotor prediction errors drive speech adaptation even in the absence of overt movement

Observed outcomes of our movements sometimes differ from our expectations. These sensory prediction errors recalibrate the brain's internal models for motor control, reflected in alterations to subsequent movements that counteract these errors (motor adaptation). While leading theories suggest that all forms of motor adaptation are driven by learning from sensory prediction errors, dominant models of speech adaptation argue that adaptation results from integrating time-advanced copies of corrective feedback commands into feedforward motor programs. Here, we tested these competing theories of speech adaptation by inducing planned, but not executed, speech. Human speakers (male and female) were prompted to speak a word and, on a subset of trials, were rapidly cued to withhold the prompted speech. On standard trials, speakers were exposed to real-time playback of their own speech with an auditory perturbation of the first formant to induce single-trial speech adaptation. Speakers experienced a similar sensory error on movement cancelation trials, hearing a perturbation applied to a recording of their speech from a previous trial at the time they would have spoken. Speakers adapted to auditory prediction errors in both contexts, altering the spectral content of spoken vowels to counteract formant perturbations even when no actual movement coincided with the perturbed feedback. These results build upon recent findings in reaching, and suggest that prediction errors, rather than corrective motor commands, drive adaptation in speech.

Fundamental processes in sensorimotor learning: Reasoning, refinement, and retrieval

Motor learning is often viewed as a unitary process that operates outside of conscious awareness. This perspective has led to the development of sophisticated models designed to elucidate the mechanisms of implicit sensorimotor learning. In this review, we argue for a broader perspective, emphasizing the contribution of explicit strategies to sensorimotor learning tasks. Furthermore, we propose a theoretical framework for motor learning that consists of three fundamental processes: reasoning, the process of understanding action-outcome relationships; refinement, the process of optimizing sensorimotor and cognitive parameters to achieve motor goals; and retrieval, the process of inferring the context and recalling a control policy. We anticipate that this '3R' framework for understanding how complex movements are learned will open exciting avenues for future research at the intersection between cognition and action.

Understanding mechanisms of generalization following locomotor adaptation

Our nervous system has the remarkable ability to adapt our gait to accommodate changes in our body or surroundings. However, our adapted walking patterns often generalize only partially (or not at all) between different contexts. Here, we sought to understand how the nervous system generalizes adapted gait patterns from one context to another. Through a series of split-belt treadmill walking experiments, we evaluated different mechanistic hypotheses to explain the partial generalization of adapted gait patterns from split-belt treadmill to overground walking. In support of the credit assignment hypothesis, our experiments revealed the central finding that adaptation involves recalibration of two distinct forward models. Recalibration of the first model generalizes to overground walking, suggesting that the model represents the general movement dynamics of our body. On the other hand, recalibration of the second model does not generalize to overground walking, suggesting the model represents dynamics specific to treadmill walking. These findings reveal that there is a predefined portion of forward model recalibration that generalizes across context, leading to overall partial generalization of walking adaptation.

Differential Aging Effects on Implicit and Explicit Sensorimotor Learning

Deterioration in motor control is a hallmark of aging, significantly contributing to a decline in quality of life. More controversial is the question of whether and how aging impacts sensorimotor learning. We hypothesized that the inconsistent picture observed in the current literature can be attributed to at least two factors. First, aging studies tend to be underpowered. Second, the learning assays used in these experiments tend to reflect, to varying degrees, the operation of multiple learning processes, making it difficult to make inferences across studies. We took a two-pronged approach to address these issues. We first performed a meta-analysis of the sensorimotor adaptation literature focusing on outcome measures that provide estimates of explicit and implicit components of adaptation. We then conducted two well-powered experiments to re-examine the effect of aging on sensorimotor adaptation, using behavioral tasks designed to isolate explicit and implicit processes. Convergently, both approaches revealed a striking dissociation: Older individuals exhibited a marked impairment in their ability to discover an explicit strategy to counteract a visuomotor perturbation. However, they exhibited enhanced implicit recalibration. We hypothesize that the effect of aging on explicit learning reflects an age-related decline in reasoning and problem solving, and the effect of aging on implicit learning reflects age-related changes in multisensory integration. Taken together, these findings deepen our understanding of the impact of aging on sensorimotor learning.

Interference underlies attenuation upon relearning in sensorimotor adaptation

Savings refers to the gain in performance upon relearning a task. In sensorimotor adaptation, savings is tested by having participants adapt to perturbed feedback and, following a washout block during which the system resets to baseline, presenting the same perturbation again. While savings has been observed with these tasks, we have shown that the contribution from implicit sensorimotor adaptation, a process that uses sensory prediction errors to recalibrate the sensorimotor map, is actually attenuated upon relearning (Avraham et al., 2021). In the present study, we test the hypothesis that this attenuation is due to interference arising from the washout block, and more generally, from experience with a different relationship between the movement and the feedback. In standard adaptation studies, removing the perturbation at the start of the washout block results in a salient error signal in the opposite direction to that observed during learning. As a starting point, we replicated the finding that implicit adaptation is attenuated following a washout period in which the feedback now signals a salient opposite error. When we eliminated visual feedback during washout, implicit adaptation was no longer attenuated upon relearning, consistent with the interference hypothesis. Next, we eliminated the salient error during washout by gradually decreasing the perturbation, creating a scenario in which the perceived errors fell within the range associated with motor noise. Nonetheless, attenuation was still prominent. Inspired by this observation, we tested participants with an extended experience with veridical feedback during an initial baseline phase and found that this was sufficient to cause robust attenuation of implicit adaptation during the first exposure to the perturbation. This effect was context-specific: It did not generalize to movements that were not associated with the interfering feedback. Taken together, these results show that the implicit sensorimotor adaptation system is highly sensitive to memory interference from a recent experience with a discrepant action-outcome contingency.

Subtle Visual Latency Can Profoundly Impair Implicit Sensorimotor Learning

Short sub-100ms visual feedback latencies are common in many types of human-computer interactions yet are known to markedly reduce performance in a wide variety of motor tasks from simple pointing to operating surgical robotics. These latencies are also present in the computer-based experiments used to study the sensorimotor learning that underlies the acquisition of motor performance. Inspired by neurophysiological findings showing that cerebellar LTD and cortical LTP would both be disrupted by sub-100ms latencies, we hypothesized that implicit sensorimotor learning may be particularly sensitive to these short latencies. Remarkably, we find that improving latency by just 60ms, from 85 to 25ms in latency-optimized experiments, increases implicit learning by 50% and proportionally decreases explicit learning, resulting in a dramatic reorganization of sensorimotor memory. We go on to show that implicit sensorimotor learning is considerably more sensitive to latencies in the sub-100ms range than at higher latencies, in line with the latency-specific neural plasticity that has been observed. This suggests a clear benefit for latency reduction in computer-based training that involves implicit sensorimotor learning and that across-study differences in implicit motor learning might often be explained by disparities in feedback latency.

Large-scale citizen science reveals predictors of sensorimotor adaptation

Sensorimotor adaptation is essential for keeping our movements well calibrated in response to changes in the body and environment. For over a century, researchers have studied sensorimotor adaptation in laboratory settings that typically involve small sample sizes. While this approach has proved useful for characterizing different learning processes, laboratory studies are not well suited for exploring the myriad of factors that may modulate human performance. Here, using a citizen science website, we collected over 2,000 sessions of data on a visuomotor rotation task. This unique dataset has allowed us to replicate, reconcile and challenge classic findings in the learning and memory literature, as well as discover unappreciated demographic constraints associated with implicit and explicit processes that support sensorimotor adaptation. More generally, this study exemplifies how a large-scale exploratory approach can complement traditional hypothesis-driven laboratory research in advancing sensorimotor neuroscience.

Motion state-dependent motor learning based on explicit visual feedback has limited spatiotemporal properties compared with adaptation to physical perturbations

We recently showed that subjects can learn motion state-dependent changes to motor output (temporal force patterns) based on explicit visual feedback of the equivalent force field (i.e., without the physical perturbation). Here, we examined the spatiotemporal properties of this learning compared with learning based on physical perturbations. There were two human subject groups and two experimental paradigms. One group (n = 40) experienced physical perturbations (i.e., a velocity-dependent force field, vFF), whereas the second (n = 40) was given explicit visual feedback (EVF) of the force-velocity relationship. In the latter, subjects moved in force channels and we provided visual feedback of the lateral force exerted during the movement, as well as the required force pattern based on movement velocity. In the first paradigm (spatial generalization), following vFF or EVF training, generalization of learning was tested by requiring subjects to move to 14 untrained target locations (0° to ±135° around the trained location). In the second paradigm (temporal stability), following training, we examined the decay of learning over eight delay periods (0 to 90 s). Results showed that learning based on EVF did not generalize to untrained directions, whereas the generalization for the vFF was significant for targets ≤ 45° away. In addition, the decay of learning for the EVF group was significantly faster than the FF group (a time constant of 2.72 ± 1.74 s vs. 12.53 ± 11.83 s). Collectively, our results suggest that recalibrating motor output based on explicit motion state information, in contrast to physical disturbances, uses learning mechanisms with limited spatiotemporal properties.NEW & NOTEWORTHY Adjustment of motor output based on limb motion state information can be achieved based on explicit information or from physical perturbations. Here, we investigated the spatiotemporal characteristics of short-term motor learning to determine the properties of the respective learning mechanisms. Our results suggest that adjustments based on physical perturbations are more temporally stable and applied over a greater spatial range than the learning based on explicit visual feedback, suggesting largely separate learning mechanisms.

A software tool for at-home measurement of sensorimotor adaptation

Sensorimotor adaptation is traditionally studied in well-controlled laboratory settings with specialized equipment. However, recent public health concerns such as the COVID-19 pandemic, as well as a desire to recruit a more diverse study population, have led the motor control community to consider at-home study designs. At-home motor control experiments are still rare because of the requirement to write software that can be easily used by anyone on any platform. To this end, we developed software that runs locally on a personal computer. The software provides audiovisual instructions and measures the ability of the subject to control the cursor in the context of visuomotor perturbations. We tested the software on a group of at-home participants and asked whether the adaptation principles inferred from in-lab measurements were reproducible in the at-home setting. For example, we manipulated the perturbations to test whether there were changes in adaptation rates (savings and interference), whether adaptation was associated with multiple timescales of memory (spontaneous recovery), and whether we could selectively suppress subconscious learning (delayed feedback, perturbation variability) or explicit strategies (limited reaction time). We found remarkable similarity between in-lab and at-home behaviors across these experimental conditions. Thus, we developed a software tool that can be used by research teams with little or no programming experience to study mechanisms of adaptation in an at-home setting.

Contribution of implicit memory to adaptation of movement extent during reaching against unpredictable spring-like loads: insensitivity to intentional suppression of kinematic performance

We examined the extent to which intentionally underperforming a goal-directed reaching task impacts how memories of recent performance contribute to sensorimotor adaptation. Healthy human subjects performed computerized cognition testing and an assessment of sensorimotor adaptation, wherein they grasped the handle of a horizontal planar robot while making goal-directed out-and-back reaching movements. The robot exerted forces that resisted hand motion with a spring-like load that changed unpredictably between movements. The robotic test assessed how implicit and explicit memories of sensorimotor performance contribute to the compensation for the unpredictable changes in the hand-held load. After each movement, subjects were to recall and report how far the hand moved on the previous trial (peak extent of the out-and-back movement). Subjects performed the tests under two counter-balanced conditions: one where they performed with their best effort, and one where they intentionally sabotaged (i.e., suppressed) kinematic performance. Results from the computerized cognition tests confirmed that subjects understood and complied with task instructions. When suppressing performance during the robotic assessment, subjects demonstrated marked changes in reach precision, time to capture the target, and reaction time. We fit a set of limited memory models to the data to identify how subjects used implicit and explicit memories of recent performance to compensate for the changing loads. In both sessions, subjects used implicit, but not explicit, memories from the most recent trial to adapt reaches to unpredictable spring-like loads. Subjects did not "give up" on large errors, nor did they discount small errors deemed "good enough". Although subjects clearly suppressed kinematic performance (response timing, movement variability, and self-reporting of reach error), the relative contributions of sensorimotor memories to trial-by-trial variations in task performance did not differ significantly between the two testing conditions. We conclude that intentional performance suppression had minimal impact on how implicit sensorimotor memories contribute to adaptation of unpredictable mechanical loads applied to the hand.

Age-specific walking speed during locomotor adaptation leads to more generalization across contexts

Previous work has shown that compared with young adults, older adults generalize their walking patterns more across environments that impose different motor demands (i.e., split-belt treadmill vs. overground). However, in this previous study, all participants walked at a speed that was more comfortable for older adults than young participants, which leads to the question of whether young adults would generalize more their walking patterns than older adults when exposed to faster speeds that are more comfortable for them. To address this question, we examined the interaction between healthy aging and walking speed on the generalization of a pattern learned on a split-belt treadmill (i.e., legs moving at different speeds) to overground. We hypothesized that walking speed during split-belt walking regulates the generalization of walking patterns in an age-specific manner. To this end, groups of young (<30 y/o) and older (65+ y/o) adults adapted their gait on a split-belt treadmill at either slower or faster walking speeds. We assessed the generalization of movements between the groups by quantifying their aftereffects during overground walking, where larger overground aftereffects represent more generalization, and zero aftereffects represent no generalization. We found an interaction between age and walking speed in the generalization of walking patterns. More specifically, older adults generalized more when adapted at slower speeds, whereas younger adults did so when adapted at faster speeds. These results suggest that comfortable walking speeds lead to more generalization of newly acquired motor patterns beyond the training contexts.

Concurrent Implicit Adaptation to Multiple Opposite Perturbations

Simultaneous adaptation to opposite visuomotor perturbations is known to be difficult. It has been shown to be possible only in situations where the two tasks are associated with different contexts, being either a different colored background, a different area of workspace, or a different follow-through movement. However, many of these elements evoke explicit mechanisms that could contribute to storing separate (modular) memories. It remains to be shown whether simultaneous adaptation to multiple perturbations is possible when they are introduced in a fully implicit manner. Here, we sought to test this possibility using a visuomotor perturbation small enough to eliminate explicit awareness. Participants (N = 25) performed center-out reaching movements with a joystick to five targets located 72° apart. Depending on the target, visual feedback of cursor position was either veridical (one target) or could be rotated by +5 or -5° (two targets each). After 300 trials of adaptation (60 to each target), results revealed that participants were able to fully compensate for each of the imposed rotations. Moreover, when veridical visual feedback was restored, participants exhibited after-effects that were consistent with the rotations applied at each target. Questionnaires collected immediately after the experiment confirmed that none of the participants were aware of the perturbations. These results speak for the existence of implicit processes that can smoothly handle small and opposite visual perturbations when these are associated with distinct target locations.

Short-term effects of visuomotor discrepancies on multisensory integration, proprioceptive recalibration, and motor adaptation

Information about the position of our hand is provided by multisensory signals that are often not perfectly aligned. Discrepancies between the seen and felt hand position or its movement trajectory engage the processes of 1) multisensory integration, 2) sensory recalibration, and 3) motor adaptation, which adjust perception and behavioral responses to apparently discrepant signals. To foster our understanding of the coemergence of these three processes, we probed their short-term dependence on multisensory discrepancies in a visuomotor task that has served as a model for multisensory perception and motor control previously. We found that the well-established integration of discrepant visual and proprioceptive signals is tied to the immediate discrepancy and independent of the outcome of the integration of discrepant signals in immediately preceding trials. However, the strength of integration was context dependent, being stronger in an experiment featuring stimuli that covered a smaller range of visuomotor discrepancies (±15°) compared with one covering a larger range (±30°). Both sensory recalibration and motor adaptation for nonrepeated movement directions were absent after two bimodal trials with same or opposite visuomotor discrepancies. Hence our results suggest that short-term sensory recalibration and motor adaptation are not an obligatory consequence of the integration of preceding discrepant multisensory signals.NEW & NOTEWORTHY The functional relation between multisensory integration and recalibration remains debated. We here refute the notion that they coemerge in an obligatory manner and support the hypothesis that they serve distinct goals of perception.

Contextual effects in sensorimotor adaptation adhere to associative learning rules

Traditional associative learning tasks focus on the formation of associations between salient events and arbitrary stimuli that predict those events. This is exemplified in cerebellar-dependent delay eyeblink conditioning, where arbitrary cues such as a tone or light act as conditioned stimuli (CSs) that predict aversive sensations at the cornea (unconditioned stimulus [US]). Here, we ask if a similar framework could be applied to another type of cerebellar-dependent sensorimotor learning - sensorimotor adaptation. Models of sensorimotor adaptation posit that the introduction of an environmental perturbation results in an error signal that is used to update an internal model of a sensorimotor map for motor planning. Here, we take a step toward an integrative account of these two forms of cerebellar-dependent learning, examining the relevance of core concepts from associative learning for sensorimotor adaptation. Using a visuomotor adaptation reaching task, we paired movement-related feedback (US) with neutral auditory or visual contextual cues that served as CSs. Trial-by-trial changes in feedforward movement kinematics exhibited three key signatures of associative learning: differential conditioning, sensitivity to the CS-US interval, and compound conditioning. Moreover, after compound conditioning, a robust negative correlation was observed between responses to the two elemental CSs of the compound (i.e. overshadowing), consistent with the additivity principle posited by theories of associative learning. The existence of associative learning effects in sensorimotor adaptation provides a proof-of-concept for linking cerebellar-dependent learning paradigms within a common theoretical framework.

Understanding implicit sensorimotor adaptation as a process of proprioceptive re-alignment

Multiple learning processes contribute to successful goal-directed actions in the face of changing physiological states, biomechanical constraints, and environmental contexts. Amongst these processes, implicit sensorimotor adaptation is of primary importance, ensuring that movements remain well-calibrated and accurate. A large body of work on reaching movements has emphasized how adaptation centers on an iterative process designed to minimize visual errors. The role of proprioception has been largely neglected, thought to play a passive role in which proprioception is affected by the visual error but does not directly contribute to adaptation. Here, we present an alternative to this visuo-centric framework, outlining a model in which implicit adaptation acts to minimize a proprioceptive error, the distance between the perceived hand position and its intended goal. This proprioceptive re-alignment model (PReMo) is consistent with many phenomena that have previously been interpreted in terms of learning from visual errors, and offers a parsimonious account of numerous unexplained phenomena. Cognizant that the evidence for PReMo rests on correlational studies, we highlight core predictions to be tested in future experiments, as well as note potential challenges for a proprioceptive-based perspective on implicit adaptation.

Competition between parallel sensorimotor learning systems

Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system's contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system's response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.

Separation of multiple motor memories through implicit and explicit processes

Acquisition of multiple motor skills without interference is a remarkable ability in daily life. During adaptation to opposing perturbations, a common paradigm to study this ability, each perturbation can be successfully learned when a contextual follow-through movement is associated with the direction of the perturbation. It is still unclear, however, to what extent this learning engages the cognitive explicit process and the implicit process. Here, we untangled the individual contributions of the explicit and implicit components while participants learned opposing visuomotor perturbations, with a second unperturbed follow-through movement. In Exp. 1 we replicated previous adaptation results and showed that follow-through movements also allow learning for opposing visuomotor rotations. For one group of participants in Exp. 2 we isolated strategic explicit learning, while for another group we isolated the implicit component. Our data showed that opposing perturbations could be fully learned by explicit strategies; but when strategy was restricted, distinct implicit processes contributed to learning. In Exp.3, we examined whether learning is influenced by the disparity between the follow-through contexts. We found that the location of follow-through targets had little effect on total learning, yet it led to more instances in which participants failed to learn the task. In Exp. 4, we explored the generalization capability to untrained targets. Participants showed near-flat generalization of the implicit and explicit processes. Overall, our results indicate that follow-through contextual cues might activate, in part, top-down cognitive factors that influence not only the dynamics of the explicit learning, but also the implicit process.

Implicit adaptation to mirror reversal is in the correct coordinate system but the wrong direction

Learning in visuomotor adaptation tasks is the result of both explicit and implicit processes. Explicit processes, operationalized as reaiming an intended movement to a new goal, account for a significant proportion of learning. However, implicit processes, operationalized as error-dependent learning that gives rise to aftereffects, appear to be highly constrained. The limitations of implicit learning are highlighted in the mirror-reversal task, where implicit corrections act in opposition to performance. This is surprising given the mirror-reversal task has been viewed as emblematic of implicit learning. One potential issue not being considered in these studies is that both explicit and implicit processes were allowed to operate concurrently, which may interact, potentially in opposition. Therefore, we sought to further characterize implicit learning in a mirror-reversal task with a clamp design to isolate implicit learning from explicit strategies. We confirmed that implicit adaptation is in the wrong direction for mirror reversal and operates as if the perturbation were a rotation and only showed a moderate attenuation after 3 days of training. This result raised the question of whether implicit adaptation blindly operates as though perturbations were a rotation. In a separate experiment, which directly compared a mirror reversal and a rotation, we found that implicit adaptation operates in a proper coordinate system for different perturbations: adaptation to a mirror reversal and rotational perturbation is more consistent with Cartesian and polar coordinate systems, respectively. It remains an open question why implicit process would be flexible to the coordinate system of a perturbation but continue to be directed inappropriately.NEW & NOTEWORTHY Recent studies have found that implicit learning may operate inappropriately in some motor tasks, requiring explicit strategies to improve performance. However, this inappropriate adaptation could be attributable to competitive interactions between explicit and implicit processes. After isolating implicit processes, we found that implicit adaptation remained in the wrong direction for a mirror reversal, acting as if it were a rotation. Interestingly, however, the implicit system is sensitive to a particular coordinate system, treating mirror reversal and rotation differently.

Implicit Visuomotor Adaptation Remains Limited after Several Days of Training

Learning in sensorimotor adaptation tasks has been viewed as an implicit learning phenomenon. The implicit process affords recalibration of existing motor skills so that the system can adjust to changes in the body or environment without relearning from scratch. However, recent findings suggest that the implicit process is heavily constrained, calling into question its utility in motor learning and the theoretical framework of sensorimotor adaptation paradigms. These inferences have been based mainly on results from single bouts of training, where explicit compensation strategies, such as explicitly re-aiming the intended movement direction, contribute a significant proportion of adaptive learning. It is possible, however, that the implicit process supersedes explicit compensation strategies over repeated practice sessions. We tested this by dissociating the contributions of explicit re-aiming strategies and the implicit process in human participants over five consecutive days of training. Despite a substantially longer duration of training, the implicit process still plateaued at a value far short of complete learning and, as has been observed in previous studies, was inappropriate for a mirror-reversal task. Notably, we find significant between subject differences that call into question traditional interpretation of these group-level results.

Measures of explicit and implicit in motor learning: what we know and what we don't

Adaptation tasks are a key tool in characterizing the contribution of explicit and implicit processes to sensorimotor learning. However, different assumptions and ideas underlie methods used to measure these processes, leading to inconsistencies between studies. For instance, it is still unclear explicit and implicit combine additively. Cognitive studies of explicit and implicit processes show how non-additivity and bias in measurement can distort results. We argue that to understand explicit and implicit processes in visuomotor adaptation, we need a stronger characterization of the phenomenology and a richer set of models to test it on.

Did We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based Learning

The human motor system can rapidly adapt its motor output in response to errors. The prevailing theory of this process posits that the motor system adapts an internal forward model that predicts the consequences of outgoing motor commands and uses this forward model to plan future movements. However, despite clear evidence that adaptive forward models exist and are used to help track the state of the body, there is no definitive evidence that such models are used in movement planning. An alternative to the forward-model-based theory of adaptation is that movements are generated based on a learned policy that is adjusted over time by movement errors directly ("direct policy learning"). This learning mechanism could act in parallel with, but independent of, any updates to a predictive forward model. Forward-model-based learning and direct policy learning generate very similar predictions about behavior in conventional adaptation paradigms. However, across three experiments with human participants (N = 47, 26 female), we show that these mechanisms can be dissociated based on the properties of implicit adaptation under mirror-reversed visual feedback. Although mirror reversal is an extreme perturbation, it still elicits implicit adaptation; however, this adaptation acts to amplify rather than to reduce errors. We show that the pattern of this adaptation over time and across targets is consistent with direct policy learning but not forward-model-based learning. Our findings suggest that the forward-model-based theory of adaptation needs to be re-examined and that direct policy learning provides a more plausible explanation of implicit adaptation.SIGNIFICANCE STATEMENT The ability of our brain to adapt movements in response to error is one of the most widely studied phenomena in motor learning. Yet, we still do not know the process by which errors eventually result in adaptation. It is known that the brain maintains and updates an internal forward model, which predicts the consequences of motor commands, and the prevailing theory of motor adaptation posits that this updated forward model is responsible for trial-by-trial adaptive changes. Here, we question this view and show instead that adaptation is better explained by a simpler process whereby motor output is directly adjusted by task errors. Our findings cast doubt on long-held beliefs about adaptation.

Reexposure to a sensorimotor perturbation produces opposite effects on explicit and implicit learning processes

The motor system demonstrates an exquisite ability to adapt to changes in the environment and to quickly reset when these changes prove transient. If similar environmental changes are encountered in the future, learning may be faster, a phenomenon known as savings. In studies of sensorimotor learning, a central component of savings is attributed to the explicit recall of the task structure and appropriate compensatory strategies. Whether implicit adaptation also contributes to savings remains subject to debate. We tackled this question by measuring, in parallel, explicit and implicit adaptive responses in a visuomotor rotation task, employing a protocol that typically elicits savings. While the initial rate of learning was faster in the second exposure to the perturbation, an analysis decomposing the 2 processes showed the benefit to be solely associated with explicit re-aiming. Surprisingly, we found a significant decrease after relearning in aftereffect magnitudes during no-feedback trials, a direct measure of implicit adaptation. In a second experiment, we isolated implicit adaptation using clamped visual feedback, a method known to eliminate the contribution of explicit learning processes. Consistent with the results of the first experiment, participants exhibited a marked reduction in the adaptation function, as well as an attenuated aftereffect when relearning from the clamped feedback. Motivated by these results, we reanalyzed data from prior studies and observed a consistent, yet unappreciated pattern of attenuation of implicit adaptation during relearning. These results indicate that explicit and implicit sensorimotor processes exhibit opposite effects upon relearning: Explicit learning shows savings, while implicit adaptation becomes attenuated.

Intelligent action guidance and the use of mixed representational formats

My topic is the intelligent guidance of action. In this paper I offer an empirically grounded case for four ideas: that [a] cognitive processes of practical reasoning play a key role in the intelligent guidance of action, [b] these processes could not do so without significant enabling work done by both perception and the motor system, [c] the work done by perceptual and motor systems can be characterized as the generation of information (often conceptually structured information) specialized for action guidance, which in turn suggests that [d] the cognitive processes of practical reasoning that play a key role in the guidance of intelligent action are not the abstract, syllogistic ones philosophers often treat as the paradigm of practical reasoning. Rather, these cognitive processes are constrained by, and work well with, the specialized concepts outputted by perception and the feedback outputted by sensorimotor processes.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

Methods matter: Your measures of explicit and implicit processes in visuomotor adaptation affect your results

Visuomotor rotations are frequently used to study the different processes underlying motor adaptation. Explicit aiming strategies and implicit recalibration are two of these processes. Various methods, which differ in their underlying assumptions, have been used to dissociate the two processes. Direct methods, such as verbal reports, assume explicit knowledge to be verbalizable, where indirect methods, such as the exclusion, assume that explicit knowledge is controllable. The goal of this study was thus to directly compare verbal reporting with exclusion in two different conditions: during consistent reporting and during intermittent reporting. Our results show that our two conditions lead to a dissociation between the measures. In the consistent reporting group, all measures showed similar results. However, in the intermittent reporting group, verbal reporting showed more explicit re-aiming and less implicit adaptation than exclusion. Curiously, when exclusion was measured again, after the end of learning, the differences were no longer apparent. We suspect this may reflect selective decay in implicit adaptation, as has been reported previously. All told, our results clearly indicate that methods of measurement can affect the amount of explicit re-aiming and implicit adaptation that is measured. Since it has been previously shown that both explicit re-aiming and implicit adaptation have multiple components, discrepancies between these different methods may arise because different measures reflect different components.

Altering attention to split-belt walking increases the generalization of motor memories across walking contexts

Little is known about the impact of attention during motor adaptation tasks on how movements adapted in one context generalize to another. We investigated this by manipulating subjects' attention to their movements while exposing them to split-belt walking (i.e., legs moving at different speeds), which is known to induce locomotor adaptation. We hypothesized that reducing subjects' attention to their movements by distracting them as they adapted their walking pattern would facilitate the generalization of recalibrated movements beyond the training environment. We reasoned that awareness of the novel split-belt condition could be used to consciously contextualize movements to that particular situation. To test this hypothesis, young adults adapted their gait on a split-belt treadmill while they observed visual information that either distracted them or made them aware of the belt's speed difference. We assessed adaptation and aftereffects of spatial and temporal gait features known to adapt and generalize differently in different environments. We found that all groups adapted similarly by reaching the same steady-state values for all gait parameters at the end of the adaptation period. In contrast, both groups with altered attention to the split-belts environment (distraction and awareness groups) generalized their movements from the treadmill to overground more than controls, who walked without altered attention. This was specifically observed in the generalization of step time (temporal gait feature), which might be less susceptible to online corrections during walking overground. These results suggest that altering attention to one's movements during sensorimotor adaptation facilitates the generalization of movement recalibration.NEW & NOTEWORTHY Little is known about how attention affects the generalization of motor recalibration induced by sensorimotor adaptation paradigms. We showed that altering attention to movements on a split-belt treadmill led to greater adaptation effects in subjects walking overground. Thus our results suggest that altering patients' attention to their actions during sensorimotor adaptation protocols could lead to greater generalization of corrected movements when moving without the training device.

Assessing explicit strategies in force field adaptation

In recent years, it has become increasingly clear that a number of learning processes are at play in visuomotor adaptation tasks. In addition to implicitly adapting to a perturbation, learners can develop explicit knowledge allowing them to select better actions in responding to it. Advances in visuomotor rotation experiments have underscored the important role of such "explicit learning" in shaping adaptation to kinematic perturbations. Yet, in adaptation to dynamic perturbations, its contribution has been largely overlooked. We therefore sought to approach the assessment of explicit learning in adaptation to dynamic perturbations, by developing two novel modifications of a force field experiment. First, we asked learners to abandon any cognitive strategy before selected force channel trials to expose consciously accessible parts of overall learning. Here, learners indeed reduced compensatory force compared with standard Catch channels. Second, we instructed a group of learners to mimic their right hand's adaptation by moving with their naïve left hand. While a control group displayed negligible left hand force compensation, the mimicking group reported forces that approximated right hand adaptation but appeared to under-report the velocity component of the force field in favor of a more position-based component. Our results highlight the viability of explicit learning as a potential contributor to force field adaptation, though the fraction of learning under participants' deliberate control on average remained considerably smaller than that of implicit learning, despite task conditions favoring explicit learning. The methods we employed provide a starting point for investigating the contribution of explicit strategies to force field adaptation.NEW & NOTEWORTHY While the contribution of explicit learning has been increasingly studied in visuomotor adaptation, its contribution to force field adaptation has not been studied extensively. We employed two novel methods to assay explicit learning in a force field adaptation task and found that learners can voluntarily control aspects of compensatory force production and manually report it with their untrained limb. This supports the general viability of the contribution of explicit learning also in force field adaptation.

Modeling Expected Reaching Error and Behaviors for Motor Adaptation

Motor adaptation studies can provide insight into how the brain handles ascending and descending neural signals during motor tasks, revealing how neural pathologies affect the capacity to learn and adapt to movement errors. Such studies often involve reaches towards prompted target locations, with adaptation and learning quantified according to Euclidean distance between reach endpoint and target location. This paper describes methods to calculate steady-state error using knowledge of the distribution of univariate, bivariate, and multivariate steady-state reaches. Additionally, in cases where steady-state error is known or estimated, it does not fully describe underlying reach distributions that could be observed at steady-state. Thus, this paper also investigates methods to describe univariate, bivariate, and multivariate steady-state reaching behavior using knowledge of the estimated steady-state error. These methods may yield a clearer understanding of adaptation and steady-state reaching behavior, allowing greater opportunities for inter-study comparison and modeling.

Challenging balance during sensorimotor adaptation increases generalization

From reaching to walking, real-life experience suggests that people can generalize between motor behaviors. One possible explanation for this generalization is that real-life behaviors often challenge our balance. We propose that the exacerbated body motions associated with balance-challenged whole body movements increase the value to the nervous system of using a comprehensive internal model to control the task. Because it is less customized to a specific task, a more comprehensive model is also a more generalizable model. Here we tested the hypothesis that challenging balance during adaptation would increase generalization of a newly learned internal model. We encouraged participants to learn a new internal model using prism lenses that created a new visuomotor mapping. Four groups of participants adapted to prisms while performing either a standing-based reaching or precision walking task, with or without a manipulation that challenged balance. To assess generalization after the adaptation phase, participants performed a single trial of each of the other groups' tasks without prisms. We found that both the reaching and walking balance-challenged groups showed significantly greater generalization to the equivalent, nonadapted task than the balance-unchallenged groups. Additionally, we found some evidence that all groups generalized across tasks, for example, from walking to reaching and vice versa, regardless of balance manipulation. Overall, our results demonstrate that challenging balance increases the degree to which a newly learned internal model generalizes to untrained movements.NEW & NOTEWORTHY Real-life experience indicates that people can generalize between motor behaviors. Here we show that challenging balance during the learning of a new internal model increases the degree of generalization to untrained movements for both reaching and walking tasks. These results suggest that the effects of challenging balance are not specific to the task but instead apply to motor learning more broadly.

How different effectors and action effects modulate the formation of separate motor memories

Humans can operate a variety of modern tools, which are often associated with different visuomotor transformations. Studies investigating this ability have shown that separate motor memories can be acquired implicitly when different sensorimotor transformations are associated with distinct (intended) postures or explicitly when abstract contextual cues are leveraged by aiming strategies. It still remains unclear how different transformations are remembered implicitly when postures are similar. We investigated whether features of planning to manipulate a visual tool, such as its visual identity or the environmental effect intended by its use (i.e. action effect) would enable implicit learning of opposing visuomotor rotations. Results show that neither contextual cue led to distinct implicit motor memories, but that cues only affected implicit adaptation indirectly through generalization around explicit strategies. In contrast, a control experiment where participants practiced opposing transformations with different hands did result in contextualized aftereffects differing between hands across generalization targets. It appears that different (intended) body states are necessary for separate aftereffects to emerge, suggesting that the role of sensory prediction error-based adaptation may be limited to the recalibration of a body model, whereas establishing separate tool models may proceed along a different route.

Reduced transfer of visuomotor adaptation is associated with aberrant sense of agency in schizophrenia

One deficit associated with schizophrenia (SZ) is the reduced ability to distinguish self-caused sensations from those due to external sources. This reduced sense of agency (SoA, subjective awareness of control over one's actions) is hypothesized to result from a diminished utilization of internal monitoring signals of self-movement (i.e., efference copy) which subsequently impairs forming and utilizing sensory prediction errors (differences between the predicted and actual sensory consequences resulting from movement). Another important function of these internal monitoring signals is the facilitation of higher-order mechanisms related to motor learning and control. Current predictive-coding models of adaptation postulate that the sensory consequences of motor commands are predicted based on internal action-related information, and that ownership and control of motor behavior is modified in various contexts based on predictive processing. Here, we investigated the connections between SoA and motor adaptation. Schizophrenia patients (SZP, N=30) and non-psychiatric control subjects (HC, N=31) adapted to altered movement visual feedback and applied the motor recalibration to untested contexts (i.e., the spatial generalization). Although adaptation was similar for SZP and controls, the extent of generalization was significantly less for SZP; movement trajectories made by patients to the furthest untrained target (135^o) before and after adaptation were largely indistinguishable. Interestingly, deficits in generalization were correlated with positive symptoms of psychosis in SZP (e.g., hallucinations). Generalization was also associated with measures of SoA across both SZP and HC, emphasizing the role action awareness plays in motor behavior, and suggesting that misattributing agency, even in HC, manifests in abnormal motor performance.

Generalization via superposition: combined effects of mixed reference frame representations for explicit and implicit learning in a visuomotor adaptation task

Studies on generalization of learned visuomotor perturbations have generally focused on whether learning is coded in extrinsic or intrinsic reference frames. This dichotomy, however, is challenged by recent findings showing that learning is represented in a mixed reference frame. Overlooked in this framework is how learning appears to consist of multiple processes, such as explicit reaiming and implicit motor adaptation. Therefore, the proposed mixed representation may simply reflect the superposition of explicit and implicit generalization functions, each represented in different reference frames. Here we characterized the individual generalization functions of explicit and implicit learning in relative isolation to determine whether their combination could predict the overall generalization function when both processes are in operation. We modified the form of feedback in a visuomotor rotation task in an attempt to isolate explicit and implicit learning and tested generalization across new limb postures to dissociate the extrinsic/intrinsic representations. We found that the amplitude of explicit generalization was reduced with postural change and was only marginally shifted, resembling an extrinsic representation. In contrast, implicit generalization maintained its amplitude but was significantly shifted, resembling a mixed representation. A linear combination of individual explicit and implicit generalization functions accounted for nearly 85% of the variance associated with the generalization function in a typical visuomotor rotation task, where both processes are in operation. This suggests that each form of learning results from a mixed representation with distinct extrinsic and intrinsic contributions and the combination of these features shapes the generalization pattern observed at novel limb postures. NEW & NOTEWORTHY Generalization following learning in visuomotor adaptation tasks can reflect how the brain represents what it learns. In this study, we isolated explicit and implicit forms of learning and showed that they are derived from a mixed reference frame representation with distinct extrinsic and intrinsic contributions. Furthermore, we showed that the overall generalization pattern at novel workspaces is due to the superposition of independent generalization effects developed by explicit and implicit learning processes.

Dissociable cognitive strategies for sensorimotor learning

Computations underlying cognitive strategies in human motor learning are poorly understood. Here we investigate such strategies in a common sensorimotor transformation task. We show that strategies assume two forms, likely reflecting distinct working memory representations: discrete caching of stimulus-response contingencies, and time-consuming parametric computations. Reaction times and errors suggest that both strategies are employed during learning, and trade off based on task complexity. Experiments using pressured preparation time further support dissociable strategies: In response caching, time pressure elicits multi-modal distributions of movements; during parametric computations, time pressure elicits a shifting distribution of movements between visual targets and distal goals, consistent with analog re-computing of a movement plan. A generalization experiment reveals that discrete and parametric strategies produce, respectively, more localized or more global transfer effects. These results describe how qualitatively distinct cognitive representations are leveraged for motor learning and produce downstream consequences for behavioral flexibility.

Adaptive coupling influences generalization of sensorimotor learning

Sensorimotor learning typically shows generalization from one context to another. Models of sensorimotor learning characterize this with a fixed generalization function that couples learning between contexts. Here we examine whether such coupling is indeed fixed or changes with experience. We examine the interaction between motor memories for novel dynamics during reciprocating, back and forth reaching movements. Subjects first experienced a force field for one movement direction and we used channel trials to assess generalization on the reciprocal movements. This showed minimal coupling such that errors experienced for one movement direction did not lead to adaptation for the other. However, after subjects had experienced a force field for both movement directions concurrently, a coupling developed between the corresponding motor memories. That is, on re-exposure for one direction there was a significant adaptation for movements in the other direction. The coupling was specific to the errors experienced, with minimal coupling when the errors had the opposite sign to those experienced during adaptation. We developed a state-space model in which the states for the two movement directions are represented by separate, yet potentially coupled learning processes. The coupling in the model controlled the extent to which each learning process was updated by the errors experienced on the other movement direction. We show that the coupling relies on a memory trace of the consecutive errors experienced for both movement directions. Our results suggest that the generalization of motor learning is an adaptive process, reflecting the relation between errors experienced across different movements.

Plan-based generalization shapes local implicit adaptation to opposing visuomotor transformations

The human ability to use different tools demonstrates our capability of forming and maintaining multiple, context-specific motor memories. Experimentally, this has been investigated in dual adaptation, where participants adjust their reaching movements to opposing visuomotor transformations. Adaptation in these paradigms occurs by distinct processes, such as strategies for each transformation or the implicit acquisition of distinct visuomotor mappings. Although distinct, transformation-dependent aftereffects have been interpreted as support for the latter, they could reflect adaptation of a single visuomotor map, which is locally adjusted in different regions of the workspace. Indeed, recent studies suggest that explicit aiming strategies direct where in the workspace implicit adaptation occurs, thus potentially serving as a cue to enable dual adaptation. Disentangling these possibilities is critical to understanding how humans acquire and maintain motor memories for different skills and tools. We therefore investigated generalization of explicit and implicit adaptation to untrained movement directions after participants practiced two opposing cursor rotations, which were associated with the visual display being presented in the left or right half of the screen. Whereas participants learned to compensate for opposing rotations by explicit strategies specific to this visual workspace cue, aftereffects were not cue sensitive. Instead, aftereffects displayed bimodal generalization patterns that appeared to reflect locally limited learning of both transformations. By varying target arrangements and instructions, we show that these patterns are consistent with implicit adaptation that generalizes locally around movement plans associated with opposing visuomotor transformations. Our findings show that strategies can shape implicit adaptation in a complex manner. NEW & NOTEWORTHY Visuomotor dual adaptation experiments have identified contextual cues that enable learning of separate visuomotor mappings, but the underlying representations of learning are unclear. We report that visual workspace separation as a contextual cue enables the compensation of opposing cursor rotations by a combination of explicit and implicit processes: Learners developed context-dependent explicit aiming strategies, whereas an implicit visuomotor map represented dual adaptation independent from arbitrary context cues by local adaptation around the explicit movement plan.

The influence of awareness on explicit and implicit contributions to visuomotor adaptation over time

Explicit (strategic) and implicit (unconscious) processes play a role in visuomotor adaptation (Bond and Taylor, J Neurophysiol 113:3836-3849, https://doi.org/10.1152/jn.00009.2015 , 2015; Werner et al., PLoS ONE 10:1-18, https://doi.org/10.1371/journal.pone.0123321 , 2015). We investigated the contributions of explicit and implicit processes to visuomotor adaptation when awareness was manipulated directly vs. indirectly, and asked how these contributions changed over time. Participants were assigned to a Strategy or No-Strategy group. Those in the Strategy group were made aware of the visuomotor distortion directly. Participants were further subdivided into groups to train with a large (60°), medium (40°) or small (20°) visuomotor distortion, providing the potential for awareness to develop indirectly. Participants reached with their respective distorted cursor, followed by a series of no-cursor reaches to assess the contributions of explicit and implicit processes to visuomotor adaptation after every 30 reach training trials. Within the no-cursor reaching trials, participants reached (1) with any strategies they had gained during training (explicit + implicit processes), and (2) as accurately to the target as possible (implicit processes). Results showed that implicit contributions were greatest in the No-Strategy group, took time to develop, and were transient, as partial decay was seen following a 5-min rest. As well, implicit contributions were similar (i.e., plateaued), regardless of the rotation size participants trained with. In contrast, explicit contributions were greatest in the Strategy group, increased with rotation size, and remained consistent over time. Taken together, results reveal that there are notable differences in the stability of explicit and implicit processes and their potential to contribute to visuomotor adaptation depending on if awareness is provided directly.

Enhancing Generalization of Visuomotor Adaptation by Inducing Use-dependent Learning

Learning a motor task in one condition typically generalizes to another, although it is unclear why it generalizes substantially in certain situations, but only partially in other situations (e.g., across movement directions and motor effectors). Here, we demonstrate that generalization of motor learning across directions and effectors can be enhanced substantially by inducing use-dependent learning, that is, by having subjects experience motor actions associated with a desired trajectory repeatedly during reaching movements. In Experiments 1 and 2, healthy human adults adapted to a visuomotor rotation while concurrently experiencing repetitive passive movements guided by a robot. This manipulation increased the extent of generalization across movement directions (Expt. 1) and across the arms (Expt. 2) by up to 50% and 42%, respectively, indicating crucial contribution of use-dependent learning to motor generalization. In Experiment 3, we applied repetitive transcranial magnetic stimulation (rTMS) to the left primary motor cortex (M1) of the human subjects prior to passive training with the right arm to increase cortical excitability. This intervention resulted in increased motor-evoked potentials (MEPs) and decreased short-interval intracortical inhibition (SICI) in the rTMS group, but not in the sham group. These changes observed in the rTMS group were accompanied by enhanced generalization of visuomotor adaptation across the arms, which was not the case in the sham group. Collectively, these findings confirm the involvement of M1 in use-dependent learning, and suggest that use-dependent learning can contribute not only to motor learning, but also to motor generalization.

The temporal stability of visuomotor adaptation generalization

Movement adaptation in response to systematic motor perturbations exhibits distinct spatial and temporal properties. These characteristics are typically studied in isolation, leaving the interaction largely unknown. Here we examined how the temporal decay of visuomotor adaptation influences the spatial generalization of the motor recalibration. First, we quantified the extent to which adaptation decayed over time. Subjects reached to a peripheral target, and a rotation was applied to the visual feedback of the unseen motion. The retention of this adaptation over different delays (0-120 s) 1) decreased by 29.0 ± 6.8% at the longest delay and 2) was represented by a simple exponential, with a time constant of 22.5 ± 5.6 s. On the basis of this relationship we simulated how the spatial generalization of adaptation would change with delay. To test this directly, we trained additional subjects with the same perturbation and assessed transfer to 19 different locations (spaced 15° apart, symmetric around the trained location) and examined three delays (~4, 12, and 25 s). Consistent with the simulation, we found that generalization around the trained direction (±15°) significantly decreased with delay and distance, while locations >60° displayed near-constant spatiotemporal transfer. Intermediate distances (30° and 45°) showed a difference in transfer across space, but this amount was approximately constant across time. Interestingly, the decay at the trained direction was faster than that based purely on time, suggesting that the spatial transfer of adaptation is modified by concurrent passive (time dependent) and active (movement dependent) processes.NEW & NOTEWORTHY Short-term motor adaptation exhibits distinct spatial and temporal characteristics. Here we investigated the interaction of these features, utilizing a simple motor adaptation paradigm (recalibration of reaching arm movements in response to rotated visual feedback). We examined the changes in the spatial generalization of motor adaptation for different temporal manipulations and report that the spatiotemporal generalization of motor adaptation is generally local and is influenced by both passive (time dependent) and active (movement dependent) learning processes.