Adaptive control of saccades via internal feedback

Modeling kinematic variability reveals displacement and velocity based dual control of saccadic eye movements

Noise is a ubiquitous component of motor systems that leads to behavioral variability of all types of movements. Nonetheless, systems-based models investigating human movements are generally deterministic and explain only the central tendencies like mean trajectories. In this paper, a novel approach to modeling kinematic variability of movements is presented and tested on the oculomotor system. This approach reconciles the two prominent philosophies of saccade control: displacement-based control versus velocity-based control. This was achieved by quantifying the variability in saccadic eye movements and developing a stochastic model of its control. The proposed stochastic dual model generated significantly better fits of inter-trial variances of the saccade trajectories compared to existing models. These results suggest that the saccadic system can flexibly use the information of both desired displacement and velocity for its control. This study presents a potential framework for investigating computational principles of motor control in the presence of noise utilizing stochastic modeling of kinematic variability.

Oculomotor behavior can be adjusted on the basis of artificial feedback signals indicating externally caused errors

Whether a saccade is accurate and has reached the target cannot be evaluated during its execution, but relies on post-saccadic feedback. If the eye has missed the target object, a secondary corrective saccade has to be made to align the fovea with the target. If a systematic post-saccadic error occurs, adaptive changes to the oculomotor behavior are made, such as shortening or lengthening the saccade amplitude. Systematic post-saccadic errors are typically attributed internally to erroneous motor commands. The corresponding adaptive changes to the motor command reduce the error and the need for secondary corrective saccades, and, in doing so, restore accuracy and efficiency. However, adaptive changes to the oculomotor behavior also occur if a change in saccade amplitude is beneficial for task performance, or if it is rewarded. Oculomotor learning thus is more complex than reducing a post-saccadic position error. In the current study, we used a novel oculomotor learning paradigm and investigated whether human participants are able to adapt their oculomotor behavior to improve task performance even when they attribute the error externally. The task was to indicate the intended target object among several objects to a simulated human-machine interface by making eye movements. The participants were informed that the system itself could make errors. The decoding process depended on a distorted landing point of the saccade, resulting in decoding errors. Two different types of visual feedback were added to the post-saccadic scene and we compared how participants used the different feedback types to adjust their oculomotor behavior to avoid errors. We found that task performance improved over time, regardless of the type of feedback. Thus, error feedback from the simulated human-machine interface was used for post-saccadic error evaluation. This indicates that 1) artificial visual feedback signals and 2) externally caused errors might drive adaptive changes to oculomotor behavior.

Impairments of saccadic and reaching adaptation in essential tremor are linked to movement execution

Essential tremor (ET) is a neurological disorder characterized by involuntary oscillations of the limbs. Previous studies have hypothesized that ET is a cerebellar disorder and reported impairments in motor adaptation. However, recent advances have highlighted that motor adaptation involves several components linked to anticipation and control, all dependent on cerebellum. We studied the contribution of both components in adaptation to better understand the adaptation impairments observed in ET from a behavioral perspective. To address this question, we investigated behavioral markers of adaptation in ET patients (n = 20) and age-matched neurologically intact volunteers (n = 20) in saccadic and upper limb adaptation tasks, probing compensation for target jumps and for velocity-dependent force fields, respectively. We found that both groups adapted their movements to the novel contexts; however, ET patients adapted to a lesser extent compared with neurologically intact volunteers. Importantly, components of the movement linked to anticipation were preserved in the ET group, whereas components linked to movement execution appeared responsible for the adaptation deficit in this group. Altogether, our results suggest that execution deficits may be a specific functional consequence of the alteration of neural pathways associated with ET.NEW & NOTEWORTHY We tested essential tremor patients' adaptation abilities in classical tasks including saccadic adaptation to target jumps and reaching adaptation to force field disturbances. Patients' adaptation was present but impaired in both tasks. Interestingly, the deficits were mainly present during movement execution, whereas the anticipatory components of movements were similar to neurologically intact volunteers. These findings reinforce the hypothesis of a cerebellar origin for essential tremor and detail the motor adaptation impairments previously found in this disorder.

Altered oculomotor flexibility is linked to high autistic traits

Autism is a multifaced disorder comprising sensory abnormalities and a general inflexibility in the motor domain. The sensorimotor system is continuously challenged to answer whether motion-contingent errors result from own movements or whether they are due to external motion. Disturbances in this decision could lead to the perception of motion when there is none and to an inflexibility with regard to motor learning. Here, we test the hypothesis that altered processing of gaze-contingent sensations are responsible for both the motor inflexibility and the sensory overload in autism. We measured motor flexibility by testing how strong participants adapted in a classical saccade adaptation task. We asked healthy participants, scored for autistic traits, to make saccades to a target that was displaced either in inward or in outward direction during saccade execution. The amount of saccade adaptation, that requires to shift the internal target representation, varied with the autistic symptom severity. The higher participants scored for autistic traits, the less they adapted. In order to test for visual stability, we asked participants to localize the position of the saccade target after they completed their saccade. We found the often-reported saccade-induced mis-localization in low Autistic Quotient (AQ) participants. However, we also found mislocalization in high AQ participants despite the absence of saccade adaptation. Our data suggest that high autistic traits are associated with an oculomotor inflexibility that might produce altered processing of trans-saccadic vision which might increase the perceptual overstimulation that is experienced in autism spectrum disorders (ASD).

A triple distinction of cerebellar function for oculomotor learning and fatigue compensation

The cerebellum implements error-based motor learning via synaptic gain adaptation of an inverse model, i.e. the mapping of a spatial movement goal onto a motor command. Recently, we modeled the motor and perceptual changes during learning of saccadic eye movements, showing that learning is actually a threefold process. Besides motor recalibration of (1) the inverse model, learning also comprises perceptual recalibration of (2) the visuospatial target map and (3) of a forward dynamics model that estimates the saccade size from corollary discharge. Yet, the site of perceptual recalibration remains unclear. Here we dissociate cerebellar contributions to the three stages of learning by modeling the learning data of eight cerebellar patients and eight healthy controls. Results showed that cerebellar pathology restrains short-term recalibration of the inverse model while the forward dynamics model is well informed about the reduced saccade change. Adaptation of the visuospatial target map trended in learning direction only in control subjects, yet without reaching significance. Moreover, some patients showed a tendency for uncompensated oculomotor fatigue caused by insufficient upregulation of saccade duration. According to our model, this could induce long-term perceptual compensation, consistent with the overestimation of target eccentricity found in the patients' baseline data. We conclude that the cerebellum mediates short-term adaptation of the inverse model, especially by control of saccade duration, while the forward dynamics model was not affected by cerebellar pathology.

Adaptive changes to saccade amplitude and target localization do not require pre-saccadic target visibility

The accuracy of saccadic eye movements is maintained by saccadic adaptation, a learning mechanism that is proposed to rely on visual prediction error, i.e., a mismatch between the pre-saccadically predicted and post-saccadically experienced position of the saccade target. However, recent research indicates that saccadic adaptation might be driven by postdictive motor error, i.e., a retrospective estimation of the pre-saccadic target position based on the post-saccadic image. We investigated whether oculomotor behavior can be adapted based on post-saccadic target information alone. We measured eye movements and localization judgements as participants aimed saccades at an initially invisible target, which was always shown only after the saccade. Each such trial was followed by either a pre- or a post-saccadic localization trial. The target position was fixed for the first 100 trials of the experiment and, during the following 200 trials, successively shifted inward or outward. Saccade amplitude and the pre- and post-saccadic localization judgements adjusted to the changing target position. Our results suggest that post-saccadic information is sufficient to induce error-reducing adaptive changes in saccade amplitude and target localization, possibly reflecting continuous updating of the estimated pre-saccadic target location driven by postdictive motor error.

Abrupt, but not gradual, motor adaptation biases saccadic target selection

Motor costs influence movement selection. These costs could change when movements are adapted in response to errors. When the motor system attributes the encountered errors to an external cause, appropriate movement selection requires an update of the movement goal, which prompts the selection of a different control policy. However, when errors are attributed to an internal cause, the initially selected control policy could remain unchanged, but the internal forward model of the body needs to be updated, resulting in an online correction of the movement. We hypothesized that external attribution of errors leads to the selection of a different control policy, and thus to a change in the expected cost of movements. This should also affect subsequent motor decisions. Conversely, internal attribution of errors may (initially) only evoke online corrections, and thus is expected to leave the motor decision process unchanged. We tested this hypothesis using a saccadic adaptation paradigm, designed to change the relative motor cost of two targets. Motor decisions were measured using a target selection task between the two saccadic targets before and after adaptation. Adaptation was induced by either abrupt or gradual perturbation schedules, which are thought to induce more external or internal attribution of errors, respectively. By taking individual variability into account, our results show that saccadic decisions shift toward the least costly target after adaptation, but only when the perturbation is abruptly, and not gradually, introduced. We suggest that credit assignment of errors not only influences motor adaptation but also subsequent motor decisions.NEW & NOTEWORTHY Decisions between potential motor actions are influenced by their costs, but costs change when movements are adapted. Using a saccadic target selection task, we show that target preference shifts after abrupt, but not after gradual adaptation. We suggest that this difference emerges because abrupt adaptation results in target remapping, and thus directly influences cost calculations, whereas gradual adaptation is mainly driven by corrections to a forward model that is not involved in cost calculations.

Interaction of dynamic error signals in saccade adaptation

Motor adaptation maintains movement accuracy. To evaluate movement accuracy, motor adaptation relies on an error signal, generated by the movement target, while suppressing error signals from irrelevant objects in the vicinity. Previous work used static testing environments, where all information required to evaluate movement accuracy was available simultaneously. Using saccadic eye movements as a model for motor adaptation, we tested how movement accuracy is maintained in dynamic environments, where the availability of conflicting error signals varied over time. Participants made a vertical saccade toward a target (either a small square or a large ring). Upon saccade detection, two candidate stimuli were shown left and right of the target, and participants were instructed to discriminate a feature on one of the candidates. Critically, candidate stimuli were presented sequentially, and saccade adaptation, thus, had to resolve a conflict between a task-relevant and a task-irrelevant error signal that were separated in space and time. We found that the saccade target influenced several aspects of oculomotor learning. In presence of a small target, saccade adaptation evaluated movement accuracy based on the first available error signal after the saccade, irrespective of its task relevance. However, a large target not only allowed for greater flexibility when evaluating movement accuracy, but it also promoted a stronger contribution of strategic behavior when compensating inaccurate saccades. Our results demonstrate how motor adaptation maintains movement accuracy in dynamic environments, and how properties of the visual environment modulate the relative contribution of different learning processes.NEW & NOTEWORTHY Motor adaptation is typically studied in static environments, where all information that is required to evaluate movement accuracy is available simultaneously. Here, using saccadic eye movements as a model, we studied motor adaptation in a dynamic environment, where the availability of conflicting information about movement accuracy varied over time. We demonstrate that properties of the visual environment determine how dynamic movement errors are corrected.

Sensorimotor feedback loops are selectively sensitive to reward

Although it is well established that motivational factors such as earning more money for performing well improve motor performance, how the motor system implements this improvement remains unclear. For instance, feedback-based control, which uses sensory feedback from the body to correct for errors in movement, improves with greater reward. But feedback control encompasses many feedback loops with diverse characteristics such as the brain regions involved and their response time. Which specific loops drive these performance improvements with reward is unknown, even though their diversity makes it unlikely that they are contributing uniformly. We systematically tested the effect of reward on the latency (how long for a corrective response to arise?) and gain (how large is the corrective response?) of seven distinct sensorimotor feedback loops in humans. Only the fastest feedback loops were insensitive to reward, and the earliest reward-driven changes were consistently an increase in feedback gains, not a reduction in latency. Rather, a reduction of response latencies only tended to occur in slower feedback loops. These observations were similar across sensory modalities (vision and proprioception). Our results may have implications regarding feedback control performance in athletic coaching. For instance, coaching methodologies that rely on reinforcement or 'reward shaping' may need to specifically target aspects of movement that rely on reward-sensitive feedback responses.

Dual STDP processes at Purkinje cells contribute to distinct improvements in accuracy and speed of saccadic eye movements

Saccadic eye-movements play a crucial role in visuo-motor control by allowing rapid foveation onto new targets. However, the neural processes governing saccades adaptation are not fully understood. Saccades, due to the short-time of execution (20-100 ms) and the absence of sensory information for online feedback control, must be controlled in a ballistic manner. Incomplete measurements of the movement trajectory, such as the visual endpoint error, are supposedly used to form internal predictions about the movement kinematics resulting in predictive control. In order to characterize the synaptic and neural circuit mechanisms underlying predictive saccadic control, we have reconstructed the saccadic system in a digital controller embedding a spiking neural network of the cerebellum with spike timing-dependent plasticity (STDP) rules driving parallel fiber-Purkinje cell long-term potentiation and depression (LTP and LTD). This model implements a control policy based on a dual plasticity mechanism, resulting in the identification of the roles of LTP and LTD in regulating the overall quality of saccade kinematics: it turns out that LTD increases the accuracy by decreasing visual error and LTP increases the peak speed. The control policy also required cerebellar PCs to be divided into two subpopulations, characterized by burst or pause responses. To our knowledge, this is the first model that explains in mechanistic terms the visual error and peak speed regulation of ballistic eye movements in forward mode exploiting spike-timing to regulate firing in different populations of the neuronal network. This elementary model of saccades could be extended and applied to other more complex cases in which single jerks are concatenated to compose articulated and coordinated movements.

The otolith vermis: A systems neuroscience theory of the Nodulus and Uvula

The Nodulus and Uvula (NU) (lobules X and IX of the cerebellar vermis) form a prominent center of vestibular information processing. Over decades, fundamental and clinical research on the NU has uncovered many aspects of its function. Those include the resolution of a sensory ambiguity inherent to inertial sensors in the inner ear, the otolith organs; the use of gravity signals to sense head rotations; and the differential processing of self-generated and externally imposed head motion. Here, I review these works in the context of a theoretical framework of information processing called the internal model hypothesis. I propose that the NU implements a forward internal model to predict the activation of the otoliths, and outputs sensory predictions errors to correct internal estimates of self-motion or to drive learning. I show that a Kalman filter based on this framework accounts for various functions of the NU, neurophysiological findings, as well as the clinical consequences of NU lesions. This highlights the role of the NU in processing information from the otoliths and supports its denomination as the "otolith" vermis.

Seeing the future: Predictive control in neural models of ocular accommodation

Ocular accommodation is the process of adjusting the eye's crystalline lens so as to bring the retinal image into sharp focus. The major stimulus to accommodation is therefore retinal defocus, and in essence, the job of accommodative control is to send a signal to the ciliary muscle which will minimize the magnitude of defocus. In this article, we first provide a tutorial introduction to control theory to aid vision scientists without this background. We then present a unified model of accommodative control that explains properties of the accommodative response for a wide range of accommodative stimuli. Following previous work, we conclude that most aspects of accommodation are well explained by dual integral control, with a “fast” or “phasic” integrator enabling response to rapid changes in demand, which hands over control to a “slow” or “tonic” integrator which maintains the response to steady demand. Control is complicated by the sensorimotor latencies within the system, which delay both information about defocus and the accommodation changes made in response, and by the sluggish response of the motor plant. These can be overcome by incorporating a Smith predictor, whereby the system predicts the delayed sensory consequences of its own motor actions. For the first time, we show that critically-damped dual integral control with a Smith predictor accounts for adaptation effects as well as for the gain and phase for sinusoidal oscillations in demand. In addition, we propose a novel proportional-control signal to account for the power spectrum of accommodative microfluctuations during steady fixation, which may be important in hunting for optimal focus, and for the nonlinear resonance observed for low-amplitude, high-frequency input. Complete Matlab/Simulink code implementing the model is provided at https://doi.org/10.25405/data.ncl.14945550.

The Impact of Command-Following Task on Human-in-the-Loop Control Behavior

This article presents results from an experiment in which 44 human subjects interact with a dynamic system 40 times over a one-week period. The subjects are divided into four groups. All groups interact with the same dynamic system, but each group performs a different sequence of command-following tasks. All reference commands have frequency content between 0 and 0.5 Hz. We use a subsystem identification algorithm to estimate the control strategy (feedback and feedforward) that each subject uses on each trial. The experimental and identification results are used to examine the impact of the command-following tasks on the subjects' performance and the control strategies that the subjects learn. Results demonstrate that certain reference commands (e.g., a sum of sinusoids) are more difficult for subjects to learn to follow than others (e.g., a chirp), and the difference in difficulty is related to the subjects' ability to match the phase of the reference command. In addition, the identification results show that differences in command-following performance for different tasks can be attributed to three aspects of the subjects' identified controllers: 1) compensating for time delay in feedforward; 2) using a comparatively accurate approximation of the inverse dynamics in feedforward; and 3) using a feedback controller with comparatively high gain. Results also demonstrate that subjects generalize their control strategy when the command changes. Specifically, when the command changes, subjects maintain relatively high gain in feedback and retain their feedforward internal model of the inverse dynamics. Finally, we provide evidence that subjects use prediction of the command (if possible) to improve performance but that subjects can learn to improve performance without prediction. Specifically, subjects learn to use feedback controllers with comparatively high gain to improve performance even though the command is unpredictable.

The Impact of Nonminimum-Phase Zeros on Human-in-the-Loop Control Systems

We present results from an experiment in which 33 human subjects interact with a dynamic system 40 times over a one-week period. The subjects are divided into three groups. For each interaction, a subject performs a command-following task, where the reference command is the same for all trials and all subjects. However, each group interacts with a different dynamic system, which is represented by a transfer function. The transfer functions have the same poles but different zeros. One has a minimum-phase zero , another has a nonminimum-phase zero , and the last has a slower (i.e., closer to the imaginary axis) nonminimum-phase zero z_sn ∈ (0,z_n) . The experimental results show that nonminimum-phase zeros tend to make dynamic systems more difficult for humans to learn to control. We use a subsystem identification algorithm to identify the control strategy that each subject uses on each trial. The identification results show that the identified feedforward controllers approximate the inverse dynamics of the system with which the subjects interact better on the last trial than on the first trial. However, the subjects interacting with the minimum-phase system are able to approximate the inverse dynamics in feedforward more accurately than the subjects interacting with the nonminimum-phase system. This observation suggests that nonminimum-phase zeros are an impediment to approximating inverse dynamics in feedforward. Finally, we provide evidence that humans rely on feedforward-step-like-control strategies with systems (e.g., nonminimum-phase systems) for which it is difficult to approximate the inverse dynamics in feedforward.

Synchronous spiking of cerebellar Purkinje cells during control of movements

SignificanceThe information that one region of the brain transmits to another is usually viewed through the lens of firing rates. However, if the output neurons could vary the timing of their spikes, then, through synchronization, they would spotlight information that may be critical for control of behavior. Here we report that, in the cerebellum, Purkinje cell populations that share a preference for error convey, to the nucleus, when to decelerate the movement, by reducing their firing rates and temporally synchronizing the remaining spikes.

Cerebellar Signals Drive Motor Adjustments and Visual Perceptual Changes during Forward and Backward Adaptation of Reactive Saccades

Saccadic adaptation ($SA$) is a cerebellar-dependent learning of motor commands ($MC$), which aims at preserving saccade accuracy. Since $SA$ alters visual localization during fixation and even more so across saccades, it could also involve changes of target and/or saccade visuospatial representations, the latter ($CDv$) resulting from a motor-to-visual transformation (forward dynamics model) of the corollary discharge of the $MC$. In the present study, we investigated if, in addition to its established role in adaptive adjustment of $MC$, the cerebellum could contribute to the adaptation-associated perceptual changes. Transfer of backward and forward adaptation to spatial perceptual performance (during ocular fixation and trans-saccadically) was assessed in eight cerebellar patients and eight healthy volunteers. In healthy participants, both types of $SA$ altered $MC$ as well as internal representations of the saccade target and of the saccadic eye displacement. In patients, adaptation-related adjustments of $MC$ and adaptation transfer to localization were strongly reduced relative to healthy participants, unraveling abnormal adaptation-related changes of target and $CDv$. Importantly, the estimated changes of $CDv$ were totally abolished following forward session but mainly preserved in backward session, suggesting that an internal model ensuring trans-saccadic localization could be located in the adaptation-related cerebellar networks or in downstream networks, respectively.

Motor skill training without online visual feedback enhances feedforward control

Motor skill learning involves improvement in feedforward control, the ability to execute a motor plan more reliably, and feedback control, the ability to adjust the motor plan on the fly. The dependence between these control components and the association between training conditions and their improvement have not been directly examined. This study characterizes the contribution of feedforward and feedback control components to motor skill learning using the arc-pointing task (APT), a drawing task that requires high motor acuity. In experiment 1, the performance of three groups of subjects was tested before and after training with online visual feedback (OF group), with knowledge of performance feedback that was presented after movement completion (KP group), and with both online and KP feedback (KP + OF group). Although the improvement of the OF group was not different from the improvement of the KP + OF group, comparison of the KP and KP + OF groups revealed an advantage to the KP group in the fast test speed, suggesting that training without online feedback leads to a greater improvement in feedforward control. In experiment 2, subject's improvement was examined using test probes for estimating feedback and feedforward control. Both KP + OF and KP groups showed improvement in feedforward and feedback conditions with a trend toward a greater improvement of the KP group. Our results suggest that online visual feedback suppresses improvement in feedforward control during motor skill learning.NEW & NOTEWORTHY Becoming a skillful player requires both executing reliable movements and being able to efficiently control them online. We study here how training with and without online visual feedback affects feedforward and feedback control improvement in a drawing task that requires high precision. We show that training with online feedback suppresses improvement in feedforward control and leads to inferior performance in fast movements.

The cost of correcting for error during sensorimotor adaptation

Learning from error is often a slow process. In machine learning, the learning rate depends on a loss function that specifies a cost for error. Here, we hypothesized that during motor learning, error carries an implicit cost for the brain because the act of correcting for error consumes time and energy. Thus, if this implicit cost could be increased, it may robustly alter how the brain learns from error. To vary the implicit cost of error, we designed a task that combined saccade adaptation with motion discrimination: movement errors resulted in corrective saccades, but those corrections took time away from acquiring information in the discrimination task. We then modulated error cost using coherence of the discrimination task and found that when error cost was large, pupil diameter increased and the brain learned more from error. However, when error cost was small, the pupil constricted and the brain learned less from the same error. Thus, during sensorimotor adaptation, the act of correcting for error carries an implicit cost for the brain. Modulating this cost affects how much the brain learns from error.

Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements

Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets' luminance but also crucially on high-level factors like the expected reward or a targets' relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.

Sensorimotor serial dependencies in head movements

On average, we redirect our gaze with a frequency at about 3 Hz. In real life, gaze shifts consist of eye and head movements. Much research has focused on how the accuracy of eye movements is monitored and calibrated. By contrast, little is known about how head movements remain accurate. I wondered whether serial dependencies between artificially induced errors in head movement targeting and the immediately following head movement might recalibrate movement accuracy. I also asked whether head movement targeting errors would influence visual localization. To this end, participants wore a head mounted display and performed head movements to targets, which were displaced as soon as the start of the head movement was detected. I found that target displacements influenced head movement amplitudes in the same trial, indicating that participants could adjust their movement online to reach the new target location. However, I also found serial dependencies between the target displacement in trial n-1 and head movements amplitudes in the following trial n. I did not find serial dependencies between target displacements and visuomotor localization. The results reveal that serial dependencies recalibrate head movement accuracy.

Adaptive control of movement deceleration during saccades

As you read this text, your eyes make saccades that guide your fovea from one word to the next. Accuracy of these movements require the brain to monitor and learn from visual errors. A current model suggests that learning is supported by two different adaptive processes, one fast (high error sensitivity, low retention), and the other slow (low error sensitivity, high retention). Here, we searched for signatures of these hypothesized processes and found that following experience of a visual error, there was an adaptive change in the motor commands of the subsequent saccade. Surprisingly, this adaptation was not uniformly expressed throughout the movement. Rather, after experience of a single error, the adaptive response in the subsequent trial was limited to the deceleration period. After repeated exposure to the same error, the acceleration period commands also adapted, and exhibited resistance to forgetting during set-breaks. In contrast, the deceleration period commands adapted more rapidly, but suffered from poor retention during these same breaks. State-space models suggested that acceleration and deceleration periods were supported by a shared adaptive state which re-aimed the saccade, as well as two separate processes which resembled a two-state model: one that learned slowly and contributed primarily via acceleration period commands, and another that learned rapidly but contributed primarily via deceleration period commands.

Trans-saccadic adaptation of perceived size independent of saccadic adaptation

Systematic shortening or lengthening of target objects during saccades modifies saccade amplitudes and perceived size of the objects. These two events are concomitant when size change during the saccade occurs asymmetrically, thereby shifting the center of mass of the object. In the present study, we asked whether or not the two are necessarily linked. We tested human participants in symmetrical systematic shortening and lengthening of a vertical bar during a horizontal saccade, aiming to not modify the saccade amplitude. Before and after a phase of trans-saccadic changes of the target bar, participants manually indicated the sizes of various vertically oriented bars by open-loop grip aperture. We evaluated the effect of trans-saccadic changes of bar length on manual perceptual reports and whether this change depended on saccade amplitude. As expected, we did not induce any change in horizontal or vertical components of saccade amplitude, but we found a significant difference in perceived size after the lengthening experiment compared to after the shortening experiment. Moreover, after the lengthening experiment, perceived size differed significantly from pre-lengthening baseline. These findings suggest that a change of size perception can be induced trans-saccadically, and its mechanism does not depend on saccadic amplitude change.

Visuomotor learning from postdictive motor error

Sensorimotor learning adapts motor output to maintain movement accuracy. For saccadic eye movements, learning also alters space perception, suggesting a dissociation between the performed saccade and its internal representation derived from corollary discharge (CD). This is critical since learning is commonly believed to be driven by CD-based visual prediction error. We estimate the internal saccade representation through pre- and trans-saccadic target localization, showing that it decouples from the actual saccade during learning. We present a model that explains motor and perceptual changes by collective plasticity of spatial target percept, motor command, and a forward dynamics model that transforms CD from motor into visuospatial coordinates. We show that learning does not follow visual prediction error but instead a postdictive update of space after saccade landing. We conclude that trans-saccadic space perception guides motor learning via CD-based postdiction of motor error under the assumption of a stable world.

Modeling inter-trial variability of pointing movements during visuomotor adaptation

Trial-to-trial variability during visuomotor adaptation is usually explained as the result of two different sources, planning noise and execution noise. The estimation of the underlying variance parameters from observations involving varying feedback conditions cannot be achieved by standard techniques (Kalman filter) because they do not account for recursive noise propagation in a closed-loop system. We therefore developed a method to compute the exact likelihood of the output of a time-discrete and linear adaptation system as has been used to model visuomotor adaptation (Smith et al. in PLoS Biol 4(6):e179, 2006), observed under closed-loop and error-clamp conditions. We identified the variance parameters by maximizing this likelihood and compared the model prediction of the time course of variance and autocovariance with empiric data. The observed increase in variability during the early training phase could not be explained by planning noise and execution noise with constant variances. Extending the model by signal-dependent components of either execution noise or planning noise showed that the observed temporal changes of the trial-to-trial variability can be modeled by signal-dependent planning noise rather than signal-dependent execution noise. Comparing the variance time course between different training schedules showed that the signal-dependent increase of planning variance was specific for the fast adapting mechanism, whereas the assumption of constant planning variance was sufficient for the slow adapting mechanisms.

The Motor Representation of Sensory Experience

How do we estimate the position of an object in the world around us? Naturally, we would direct our gaze to that object. Accordingly, neural motor coordinates entail the distance of external objects and thus might be used to derive perceptual estimates. Several general frameworks in the history of perceptual science have offered such a view.^1-4 However, a mechanism showing how motor and visual processes communicate remains elusive. Here, we report that every post-saccadic error biases visual localization in a serially dependent manner. In order to simulate a realignment of visual space through motor coordinates, we induced an artificial de-alignment between visual and motor space. We found that when performing saccades under this distortion, post-saccadic error information clearly realigned visual and motor space, again in a serially dependent manner. These results demonstrate that the consequences of every saccade directly influence where we see objects in the world. On a neural basis, this requires that motor signals, which generate close to the saccade production machinery, are reported to cortical areas and arrange visual space. This view is consistent with recent electrophysiological findings of post-saccadic error processing in posterior parietal cortex.⁵.

Cerebellar adaptive mechanisms explain the optimal control of saccadic eye movements

Cerebellar synaptic plasticity is vital for adaptability and fine tuning of goal-directed movements. The perceived sensory errors between desired and actual movement outcomes are commonly considered to induce plasticity in the cerebellar synapses, with an objective to improve desirability of the executed movements. In rapid goal-directed eye movements called saccades, the only available sensory feedback is the direction of reaching error information received only at end of the movement. Moreover, this sensory error dependent plasticity can only improve the accuracy of the movements, while ignoring other essential characteristics such as reaching in minimum-time. In this work we propose a rate based, cerebellum inspired adaptive filter model to address refinement of both accuracy and movement-time of saccades. We use optimal control approach in conjunction with information constraints posed by the cerebellum to derive bio-plausible supervised plasticity rules. We implement and validate this bio-inspired scheme on a humanoid robot. We found out that, separate plasticity mechanisms in the model cerebellum separately control accuracy and movement-time. These plasticity mechanisms ensure that optimal saccades are produced by just receiving the direction of end reaching error as an evaluative signal. Furthermore, the model emulates encoding in the cerebellum of movement kinematics as observed in biological experiments.

Perception of saccadic reaction time

That saccadic reaction times (SRTs) may depend on reinforcement contingencies has been repeatedly demonstrated. It follows that one must be able to discriminate one's latencies to adequately assign credit to one's actions, which is to connect behaviour to its consequence. To quantify the ability to perceive one's SRT, we used an adaptive procedure to train sixteen participants in a stepping visual target saccade paradigm. Subsequently, we measured their RTs perceptual threshold at 75% in a conventional constant stimuli procedure. For each trial, observers had to saccade to a stepping target. Then, in a 2-AFC task, they had to choose one value representing the actual SRT, while the other value proportionally differed from the actual SRT. The relative difference between the two alternatives was computed by either adding or subtracting from the actual SRT a percent-difference value randomly chosen among a fixed set. Feedback signalling the correct choice was provided after each response. Overall, our results showed that the 75% SRT perceptual threshold averaged 23% (about 40 ms). The ability to discriminate small SRT differences provides support for the possibility that the credit assignment problem may be solved even for short reaction times.

Lessons learned from the syndrome of oculopalatal tremor

The syndrome of oculopalatal tremor (OPT) featuring the olivo-cerebellar hypersychrony leads to disabling pendular nystagmus and palatal myoclonus. This rare disorder provides valuable information about the motor physiology and offers insights into the mechanistic underpinning of common movement disorders. This focused review summarizes the last decade of OPT research from our laboratory and addresses three critical questions: 1) How the disease of inferior olive affects the physiology of motor learning? We discovered that our brain's ability to compensate for the impaired motor command and implement errors to correct future movements could be affected if the cerebellum is occupied in receiving and transmitting the meaningless signal. A complete failure of OPT patients to adapt to change in rapid eye movements (saccades) provided proof of this principle. 2) Whether maladaptive olivo-cerebellar circuit offers insight into the mechanistic underpinning of the common movement disorder, dystonia, characterized by abnormal twisting and turning of the body part. We discovered that the subgroup of patients who had OPT also had dystonia affecting the neck, trunk, limbs, and face. We also found that the subjects who had tremor predominant neck dystonia (without OPT) also had impaired motor learning on a long and short timescale, just like those with OPT. Altogether, our studies focused on dystonia suggested the evidence for the maladaptive olive-cerebellar system. 3) We discovered that the OPT subjects had difficulty in perceiving the direction of their linear forward motion, i.e., heading, suggesting that olivo-cerebellar hypersynchrony also affects perception.

Competition between salience and informational value for saccade adaptation

What we see is influenced by where we look. When confronted with multiple relevant targets, inaccurate saccade target selection can impair perceptual performance. Here we ask whether endpoint selection can be optimized by the mechanism maintaining saccade accuracy: saccade adaptation. Therefore, we introduce a double-target adaptation task, where a presaccadic peripheral stimulus (plaid) splits vertically into its two components (Gabor patches) during horizontal saccades. While both targets were task-relevant, one of them provided more information for the perceptual task, because it could only be identified after the saccade with near-foveal vision. The other target was highly salient and could also be identified in the presaccadic plaid using peripheral vision. This double-target paradigm induced saccade adaptation: Without a perceptual task, participants adapted to the salient target. When both targets were judged sequentially, participants mostly adapted to the target they had to judge first. When targets were judged simultaneously, endpoints were biased toward the informative target but showed no gradual learning and fell short of optimality. We observed gradual adaptation when targets shifted randomly such that a strategic adjustment of endpoints was not possible. Overall, these findings show that when multiple targets compete, our oculomotor system can learn to adjust endpoints in order to maximize information for perception. Yet individual variability and other factors affecting target priority play a crucial role.

Reward-Based Improvements in Motor Control Are Driven by Multiple Error-Reducing Mechanisms

Reward has a remarkable ability to invigorate motor behavior, enabling individuals to select and execute actions with greater precision and speed. However, if reward is to be exploited in applied settings, such as rehabilitation, a thorough understanding of its underlying mechanisms is required. In a series of experiments, we first demonstrate that reward simultaneously improves the selection and execution components of a reaching movement. Specifically, reward promoted the selection of the correct action in the presence of distractors, while also improving execution through increased speed and maintenance of accuracy. These results led to a shift in the speed-accuracy functions for both selection and execution. In addition, punishment had a similar impact on action selection and execution, although it enhanced execution performance across all trials within a block, that is, its impact was noncontingent to trial value. Although the reward-driven enhancement of movement execution has been proposed to occur through enhanced feedback control, an untested possibility is that it is also driven by increased arm stiffness, an energy-consuming process that enhances limb stability. Computational analysis revealed that reward led to both an increase in feedback correction in the middle of the movement and a reduction in motor noise near the target. In line with our hypothesis, we provide novel evidence that this noise reduction is driven by a reward-dependent increase in arm stiffness. Therefore, reward drives multiple error-reduction mechanisms which enable individuals to invigorate motor performance without compromising accuracy.SIGNIFICANCE STATEMENT While reward is well-known for enhancing motor performance, how the nervous system generates these improvements is unclear. Despite recent work indicating that reward leads to enhanced feedback control, an untested possibility is that it also increases arm stiffness. We demonstrate that reward simultaneously improves the selection and execution components of a reaching movement. Furthermore, we show that punishment has a similar positive impact on performance. Importantly, by combining computational and biomechanical approaches, we show that reward leads to both improved feedback correction and an increase in stiffness. Therefore, reward drives multiple error-reduction mechanisms which enable individuals to invigorate performance without compromising accuracy. This work suggests that stiffness control plays a vital, and underappreciated, role in the reward-based imporvemenets in motor control.

Motorized Shoes Induce Robust Sensorimotor Adaptation in Walking

The motor system has the flexibility to update motor plans according to systematic changes in the environment or the body. This capacity is studied in the laboratory through sensorimotor adaptation paradigms imposing sustained and predictable motor demands specific to the task at hand. However, these studies are tied to the laboratory setting. Thus, we asked if a portable device could be used to elicit locomotor adaptation outside the laboratory. To this end, we tested the extent to which a pair of motorized shoes could induce similar locomotor adaptation to split-belt walking, which is a well-established sensorimotor adaptation paradigm in locomotion. We specifically compared the adaptation effects (i.e. after-effects) between two groups of young, healthy participants walking with the legs moving at different speeds by either a split-belt treadmill or a pair of motorized shoes. The speeds at which the legs moved in the split-belt group was set by the belt speed under each foot, whereas in the motorized shoes group were set by the combined effect of the actuated shoes and the belts' moving at the same speed. We found that the adaptation of joint motions and measures of spatial and temporal asymmetry, which are commonly used to quantify sensorimotor adaptation in locomotion, were indistinguishable between groups. We only found small differences in the joint angle kinematics during baseline walking between the groups - potentially due to the weight and height of the motorized shoes. Our results indicate that robust sensorimotor adaptation in walking can be induced with a paired of motorized shoes, opening the exciting possibility to study sensorimotor adaptation during more realistic situations outside the laboratory.

Simple spike dynamics of Purkinje cells in the macaque vestibulo-cerebellum during passive whole-body self-motion

Theories of cerebellar functions posit that the cerebellum implements internal models for online correction of motor actions and sensory estimation. As an example of such computations, an internal model resolves a sensory ambiguity where the peripheral otolith organs in the inner ear sense both head tilts and translations. Here we exploit the response dynamics of two functionally coupled Purkinje cell types in the vestibular part of the caudal vermis (lobules IX and X) to understand their role in this computation. We find that one population encodes tilt velocity, whereas the other, translation-selective, population encodes linear acceleration. We predict that an intermediate neuronal type should temporally integrate the output of tilt-selective cells into a tilt position signal.

Memories of motor adaptation do not necessarily decay with behavioral unlearning

Motor adaptation reshapes behaviors to habituate novel predictable demands caused by dramatic changes in our body (or environment). In the absence of error signals, behaviors rapidly return to the manner before adaptation. It is still in debate whether this behavioral unlearning is due to memory decay. Recent studies suggested that unlearning may be related to the detection of a context change between adaptation phase and error-absent phase. This context-dependent idea is extended in the present study, which examined the motor adaptation in a ball-tossing task. To facilitate the manipulation of the task and the measurement of the behavior, this tossing task was conducted in a virtual environment. Experiment 1 found that unlearning was more likely to occur when the context in the adaptation phase was less similar to that in the error-absent phase. Experiment 2 further demonstrated that the memory of motor adaptation can bias behavior even after behavioral unlearning. Experiment 3 confirmed that the results in Experiment 1 and 2 were not artifacts. These findings indicate that memories of adaptation are independent of behavioral unlearning, and the contextual similarity between adaptation and error-absent phase determines the unlearning rate.

Postsaccadic eye position contributes to oculomotor error estimation in saccadic adaptation

We investigated whether the proprioceptive eye position signal after the execution of a saccadic eye movement is used to estimate the accuracy of the movement. If so, saccadic adaptation, the mechanism that maintains saccade accuracy, could use this signal in a similar way as it uses visual feedback after the saccade. To manipulate the availability of the proprioceptive eye position signal we utilized the finding that proprioceptive eye position information builds up gradually after a saccade over a time interval comparable to typical saccade latencies. We confined the retention time of gaze at the saccade landing point by asking participants to make fast return saccades to the fixation point that preempt the usability of proprioceptive eye position signals. In five experimental conditions we measured the influence of the visual and proprioceptive feedback, together and separately, on the development of adaptation. We found that the adaptation of the previously shortened saccades in the case of visual feedback being unavailable after the saccade was significantly weaker when the use of proprioceptive eye position information was impaired by fast return saccades. We conclude that adaptation can be driven by proprioceptive eye position feedback.NEW & NOTEWORTHY We show that proprioceptive eye position information is used after a saccade to estimate motor error and adapt saccade control. Previous studies on saccadic adaptation focused on visual feedback about saccade accuracy. A multimodal error signal combining visual and proprioceptive information is likely more robust. Moreover, combining proprioceptive and visual measures of saccade performance can be helpful to keep vision, proprioception, and motor control in alignment and produce a coherent representation of space.

Disrupted Corollary Discharge in Schizophrenia: Evidence From the Oculomotor System

Corollary discharge (CD) signals are motor-related signals that exert an influence on sensory processing. They allow mobile organisms to predict the sensory consequences of their imminent actions. Among the many functions of CD is to provide a means by which we can distinguish sensory experiences caused by our own actions from those with external causes. In this way, they contribute to a subjective sense of agency. A disruption in the sense of agency is central to many of the clinical symptoms of schizophrenia, and abnormalities in CD signaling have been theorized to underpin particularly those agency-related psychotic symptoms of the illness. Characterizing abnormal CD associated with eye movements in schizophrenia and their resulting influence on visual processing and subsequent action plans may have advantages over other sensory and motor systems. That is because the most robust psychophysiological and neurophysiological data regarding the dynamics and influence of CD as well as the neural circuitry implicated in CD generation and transmission comes from the study of eye movements in humans and nonhuman primates. We review studies of oculomotor CD signaling in the schizophrenia spectrum and possible neurobiological correlates of CD disturbances. We conclude by speculating on the ways in which oculomotor CD dysfunction, specifically, may invoke specific experiences, clinical symptoms, and cognitive impairments. These speculations lay the groundwork for empirical study, and we conclude by outlining potentially fruitful research directions.

A generative learning model for saccade adaptation

Plasticity in the oculomotor system ensures that saccadic eye movements reliably meet their visual goals-to bring regions of interest into foveal, high-acuity vision. Here, we present a comprehensive description of sensorimotor learning in saccades. We induced continuous adaptation of saccade amplitudes using a double-step paradigm, in which participants saccade to a peripheral target stimulus, which then undergoes a surreptitious, intra-saccadic shift (ISS) as the eyes are in flight. In our experiments, the ISS followed a systematic variation, increasing or decreasing from one saccade to the next as a sinusoidal function of the trial number. Over a large range of frequencies, we confirm that adaptation gain shows (1) a periodic response, reflecting the frequency of the ISS with a delay of a number of trials, and (2) a simultaneous drift towards lower saccade gains. We then show that state-space-based linear time-invariant systems (LTIS) represent suitable generative models for this evolution of saccade gain over time. This state-equation algorithm computes the prediction of an internal (or hidden state-) variable by learning from recent feedback errors, and it can be compared to experimentally observed adaptation gain. The algorithm also includes a forgetting rate that quantifies per-trial leaks in the adaptation gain, as well as a systematic, non-error-based bias. Finally, we study how the parameters of the generative models depend on features of the ISS. Driven by a sinusoidal disturbance, the state-equation admits an exact analytical solution that expresses the parameters of the phenomenological description as functions of those of the generative model. Together with statistical model selection criteria, we use these correspondences to characterize and refine the structure of compatible state-equation models. We discuss the relation of these findings to established results and suggest that they may guide further design of experimental research across domains of sensorimotor adaptation.

Saccade variability in healthy subjects and cerebellar patients

In a previous study we developed a model for the inter-trial variance of saccade trajectories in the rhesus macaque. The analysis of that model showed that signal-dependent noise results in different effector variabilities depending on whether the noise is propagated feedforward through the system (accumulating noise) or whether the noise originates from inside of a premotor feedback loop (feedback noise). This allowed the gain of the premotor feedback loop to be estimated directly from behavioral data. In the present study, we applied the model in healthy human subjects and in patients with chronic isolated cerebellar lesions due to ischemic stroke. Humans showed smaller noise coefficients of variation for both accumulating noise and feedback noise and smaller feedback gain than the monkeys. Despite these differences in the model parameters, the qualitative differences between the two noise types were similar in both species. Cerebellar patients showed larger inter-trial variance of saccade amplitude compared to controls, but saccade metrics and dynamics were well compensated. The parameters of the noise model did not differ significantly between groups. The variance of the saccade amplitude correlated highly (r=0.95) with the coefficient of variation of accumulating noise but not with the other model parameters. The results suggest that the cerebellum plays a role not only in premotor feedback but also in feedforward saccade control and that the latter is responsible for increased endpoint variance in cerebellar patients.

Role of the Vermal Cerebellum in Visually Guided Eye Movements and Visual Motion Perception

The cerebellar cortex is a crystal-like structure consisting of an almost endless repetition of a canonical microcircuit that applies the same computational principle to different inputs. The output of this transformation is broadcasted to extracerebellar structures by way of the deep cerebellar nuclei. Visually guided eye movements are accommodated by different parts of the cerebellum. This review primarily discusses the role of the oculomotor part of the vermal cerebellum [the oculomotor vermis (OMV)] in the control of visually guided saccades and smooth-pursuit eye movements. Both types of eye movements require the mapping of retinal information onto motor vectors, a transformation that is optimized by the OMV, considering information on past performance. Unlike the role of the OMV in the guidance of eye movements, the contribution of the adjoining vermal cortex to visual motion perception is nonmotor and involves a cerebellar influence on information processing in the cerebral cortex.

The cerebellum improves the precision of antisaccades by a latency-duration trade-off

The cerebellum adapts motor responses by controlling the gain of a movement, preserving its accuracy and by learning from endpoint errors. Adaptive behavior likely acts not only in the motor but also in the sensory, behavioral, and cognitive domains, thus supporting a role of cerebellum in monitoring complex brain performances. Here, we analyzed the relationship between saccade latency, duration and endpoint error of antisaccades in a group of 10 idiopathic cerebellar atrophy (ICA) patients compared to controls. The latency distribution was decomposed in a decision time and a residual time. Both groups showed a trade-off between duration and decision time, with a peak of entropy within the range of this trade-off where the information flow was maximized. In cerebellar patients, greater reductions of duration as the time of decision increased, were associated with a lower probability for a saccade to fall near the target, with a constant low entropy outside the optimal time window. We suggest a modulation of saccade duration, depending on the latency-related decision time (accumulation of sensory and motor evidences in favor of a goal-directed movement), normally adopted to perform efficient trajectories in goal-directed saccades. This process is impaired in cerebellar patients suggesting a role for the cerebellum in monitoring voluntary motor performance by controlling the movement onset until the ambiguity of planning is resolved.

Inter-individual variability and consistency of saccade adaptation in oblique saccades: Amplitude increase and decrease in the horizontal or vertical saccade component

Despite changes in the physical structures controlling the eyes, saccades, the rapid eye movements used to explore the visual environment, remain accurate throughout the lifetime. The process underlying this sensorimotor adaptation is studied using a double step paradigm: an intra-saccadic target displacement introduces a systematic position error which triggers changes in saccadic amplitude or direction across trials. Numerous researches on this saccade adaptation have been conducted, but the level of inter-individual variability and consistency in saccade gain change and how it relates to increase- or decrease-amplitude paradigms is not fully described. We conducted experiments in four groups of 25 participants with 800 trials per participant, including 200 baseline trials and 200 recovery trials. We used four distinct double-step paradigms that differed by the intra-saccadic target-step leading to either a horizontal (Backward or Forward) or vertical (Upward or Downward) gain modulation. Across experiments 95% of the participants exhibited adaptation, revealing the consistency of this phenomenon. We observed strong inter-individual differences, both in the extent and rate of adaptation, which were not correlated with the individual baseline saccades characteristics. As previously reported, the rates of adaptation were higher for gain decrease than for gain increase experiments but the final extent of adaptation were similar. Our results also support the view that adaptation of oblique saccades occurs where the saccade command is represented as a vector. Finally, at the individual level, we did not observe systematic changes in the saccade metrics in relation to adaptation.

Modeling the Encoding of Saccade Kinematic Metrics in the Purkinje Cell Layer of the Cerebellar Vermis

Recent electrophysiological observations related to saccadic eye movements in rhesus monkeys, suggest a prediction of the sensory consequences of movement in the Purkinje cell layer of the cerebellar oculomotor vermis (OMV). A definite encoding of real-time motion of the eye has been observed in simple-spike responses of the combined burst-pause Purkinje cell populations, organized based upon their complex-spike directional tuning. However, the underlying control mechanisms that could lead to such action encoding are still unclear. We propose a saccade control model, with emphasis on the structure of the OMV and its interaction with the extra-cerebellar components. In the simulated bilateral organization of the OMV, each caudal fastigial nucleus is arranged to receive incoming projections from combined burst-pause Purkinje cell populations. The OMV, through the caudal fastigial nuclei, interacts with the brainstem to provide adaptive saccade gain corrections that minimize the visual error in reaching a given target location. The simulation results corroborate the experimental Purkinje cell population activity patterns and their relation with saccade kinematic metrics. The Purkinje layer activity that emerges from the proposed organization, precisely predicted the speed of the eye at different target eccentricities. Simulated granular layer activity suggests no separate dynamics with respect to shaping the bilateral Purkine layer activity. We further examine the validity of the simulated OMV in maintaining the accuracy of saccadic eye movements in the presence of signal dependent variabilities, that can occur in extra-cerebellar pathways.

Implicit and explicit learning in reactive and voluntary saccade adaptation

Saccades can either be elicited automatically by salient peripheral stimuli or can additionally depend on explicit cognitive goals. Similarly, it is thought that motor adaptation is driven by the combination of a more automatic, implicit process and a more explicit, cognitive process. However, the degree to which such implicit and explicit learning contribute to the adaptation of more reactive and voluntary saccades remains elusive. To study this question, we employed a global saccadic adaptation paradigm with both increasing and decreasing saccade amplitudes. We assessed the resulting adaptation using a dual state model of motor adaptation. This model decomposes learning into a fast and slow process, which are thought to constitute explicit and implicit learning, respectively. Our results show that adaptation of reactive saccades is equally driven by fast and slow learning, while fast learning is nearly absent when adapting voluntary (i.e. scanning) saccades. This pattern of results was present both when saccade gain was increased or decreased. Our results suggest that the increased cognitive demands associated with voluntary compared to reactive saccade planning interfere specifically with explicit learning.

Cortico-cerebellar network involved in saccade adaptation

Saccade adaptation is the learning process that ensures that vision and saccades remain calibrated. The central nervous system network involved in these adaptive processes remains unclear because of difficulties in isolating the learning process from the correlated visual and motor processes. Here we imaged the human brain during a novel saccade adaptation paradigm that allowed us to isolate neural signals involved in learning independent of the changes in the amplitude of corrective saccades usually correlated with adaptation. We show that the changes in activation in the ipsiversive cerebellar vermis that track adaptation are not driven by the changes in corrective saccades and thus provide critical supporting evidence for previous findings. Similarly, we find that activation in the dorsomedial wall of the contraversive precuneus mirrors the pattern found in the cerebellum. Finally, we identify dorsolateral and dorsomedial cortical areas in the frontal and parietal lobes that encode the retinal errors following inaccurate saccades used to drive recalibration. Together, these data identify a distributed network of cerebellar and cortical areas and their specific roles in oculomotor learning. NEW & NOTEWORTHY The central nervous system constantly learns from errors and adapts to keep visual targets and saccades in registration. We imaged the human brain while the gain of saccades adapted to a visual target that was displaced while the eye was in motion, inducing retinal error. Activity in the cerebellum and precuneus tracked learning, whereas parts of the dorsolateral and dorsomedial frontal and parietal cortex encoded the retinal error used to drive learning.

Weighted integration of short-term memory and sensory signals in the oculomotor system

Oculomotor behaviors integrate sensory and prior information to overcome sensory-motor delays and noise. After much debate about this process, reliability-based integration has recently been proposed and several models of smooth pursuit now include recurrent Bayesian integration or Kalman filtering. However, there is a lack of behavioral evidence in humans supporting these theoretical predictions. Here, we independently manipulated the reliability of visual and prior information in a smooth pursuit task. Our results show that both smooth pursuit eye velocity and catch-up saccade amplitude were modulated by visual and prior information reliability. We interpret these findings as the continuous reliability-based integration of a short-term memory of target motion with visual information, which support modeling work. Furthermore, we suggest that saccadic and pursuit systems share this short-term memory. We propose that this short-term memory of target motion is quickly built and continuously updated, and constitutes a general building block present in all sensorimotor systems.

Motivation dynamically increases noise resistance by internal feedback during movement

Motivation improves performance, pushing us beyond our normal limits. One general explanation for this is that the effects of neural noise can be reduced, at a cost. If this were possible, reward would promote investment in resisting noise. But how could the effects of noise be attenuated, and why should this be costly? Negative feedback may be employed to compensate for disturbances in a neural representation. Such feedback would increase the robustness of neural representations to internal signal fluctuations, producing a stable attractor. We propose that encoding this negative feedback in neural signals would incur additional costs proportional to the strength of the feedback signal. We use eye movements to test the hypothesis that motivation by reward improves precision by increasing the strength of internal negative feedback. We find that reward simultaneously increases the amplitude, velocity and endpoint precision of saccades, indicating true improvement in oculomotor performance. Analysis of trajectories demonstrates that variation in the eye position during the course of saccades is predictive of the variation of endpoints, but this relation is reduced by reward. This indicates that motivation permits more aggressive correction of errors during the saccade, so that they no longer affect the endpoint. We suggest that such increases in internal negative feedback allow attractor stability, albeit at a cost, and therefore may explain how motivation improves cognitive as well as motor precision.

•

Motivation can increase speed and reduce behavioural variability.

•

This requires stabilising neural representations so they are robust to noise.

•

Stable representations or attractors in neural systems may come at the cost of stronger negative feedback.

•

Examination of trajectory correlations demonstrates that reward increases negative feedback.

•

We propose that the cost of stabilising signals explain why effort is expensive.

Movement vigor as a traitlike attribute of individuality

A common aspect of individuality is our subjective preferences in evaluation of reward and effort. The neural circuits that evaluate these commodities influence circuits that control our movements, raising the possibility that vigor differences between individuals may also be a trait of individuality, reflecting a willingness to expend effort. In contrast, classic theories in motor control suggest that vigor differences reflect a speed-accuracy trade-off, predicting that those who move fast are sacrificing accuracy for speed. Here we tested these contrasting hypotheses. We measured motion of the eyes, head, and arm in healthy humans during various elementary movements (saccades, head-free gaze shifts, and reaching). For each person we characterized their vigor, i.e., the speed with which they moved a body part (peak velocity) with respect to the population mean. Some moved with low vigor, while others moved with high vigor. Those with high vigor tended to react sooner to a visual stimulus, moving both their eyes and arm with a shorter reaction time. Arm and head vigor were tightly linked: individuals who moved their head with high vigor also moved their arm with high vigor. However, eye vigor did not correspond strongly with arm or head vigor. In all modalities, vigor had no impact on end-point accuracy, demonstrating that differences in vigor were not due to a speed-accuracy trade-off. Our results suggest that movement vigor may be a trait of individuality, not reflecting a willingness to accept inaccuracy but demonstrating a propensity to expend effort. NEW & NOTEWORTHY A common aspect of individuality is how we evaluate economic variables like reward and effort. This valuation affects not only decision making but also motor control, raising the possibility that vigor may be distinct between individuals but conserved across movements within an individual. Here we report conservation of vigor across elementary skeletal movements, but not eye movements, raising the possibility that the individuality of our movements may be driven by a common neural mechanism of effort evaluation across modalities of skeletal motor control.

Anti-Saccades in Cerebellar Ataxias Reveal a Contribution of the Cerebellum in Executive Functions

OBJECTIVE

Increasing evidence suggests a cerebellar contribution to modulate cognitive aspects of motor behavior and executive functions. Supporting findings come from studies on patients with neurodegenerative diseases, in which however, given the extent of the disease, the specific role of the cerebellum, could not be clearly isolated. Anti-saccades are considered a sensitive tool to test executive functions. The anti-saccade underlying neural network, consisting of different cortical areas and their downstream connections including the lateral cerebellum, has been largely clarified. To separate the role of the cerebellum with respect to other cortical structures in executive control, we compared the anti-saccade performances in two distinct cohorts of patients with cerebellar disorders (with and without cerebral cortical involvement).

METHODS

Eye movements during the execution of anti-saccades were recorded in 12 patients with spinocerebellar ataxia type 2 (a cortical-subcortical neurodegenerative disease), 10 patients with late onset cerebellar ataxia (an isolated cerebellar atrophy), and 34 matched controls.

RESULTS

In the anti-saccade task, besides dynamic changes already demonstrated in the pro-saccades of these patients, we found in both groups of cerebellar patients prolonged latency with larger variability than normal and increased directional error rate. Errors, however, were corrected by cerebellar patients as frequently as normal. No significant differences were found in patients with and without cortical involvement.

CONCLUSION

Our results indicate, in a large cohort of cerebellar patients, that the cerebellum plays a critical role in the regulation of executive motor control not only, as well known, by controlling the end of a movement, but also modulating its initiation and reducing reflexive responses that would perturb voluntary actions.

Vigor of reaching movements: reward discounts the cost of effort

Making a movement may be thought of as an economic decision in which one spends effort to acquire reward. Time discounts reward, which predicts that the magnitude of reward should affect movement vigor: we should move faster, spending greater effort, when there is greater reward at stake. Indeed, saccade peak velocities are greater and reaction-times shorter when a target is paired with reward. In this study, we focused on human reaching and asked whether movement kinematics were affected by expectation of reward. Participants made out-and-back reaching movements to one of four quadrants of a 14-cm circle. During various periods of the experiment only one of the four quadrants was paired with reward, and the transition from reward to nonreward status of a quadrant occurred randomly. Our experiment design minimized dependence of reward on accuracy, granting the subjects wide latitude in self-selecting their movement speed, amplitude, and variability. When a quadrant was paired with reward, reaching movements had a shorter reaction time, higher peak velocity, and greater amplitude. Despite this greater vigor, movements toward the rewarded quadrant suffered from less variability: both reaction times and reach kinematics were less variable when there was expectation of reward. Importantly, the effect of reward on vigor was specific to the movement component that preceded the time of reward (outward reach), not the movement component that followed it (return reach). Our results suggest that expectation of reward not only increases vigor of human reaching but also decreases its variability. NEW & NOTEWORTHY Movements may be thought of as an economic transaction where the vigor of the movement represents the effort that the brain is willing to expend to acquire a rewarding state. We show that in reaching, reward discounts the cost of effort, producing movements with shorter reaction time, higher velocity, greater amplitude, and reduced reaction-time variability. These results complement earlier observations in saccades, suggesting a common principle of economics across modalities of motor control.