Effects of saccadic adaptation on visual localization before and during saccades

Cerebellar Signals Drive Motor Adjustments and Visual Perceptual Changes during Forward and Backward Adaptation of Reactive Saccades

Saccadic adaptation ($SA$) is a cerebellar-dependent learning of motor commands ($MC$), which aims at preserving saccade accuracy. Since $SA$ alters visual localization during fixation and even more so across saccades, it could also involve changes of target and/or saccade visuospatial representations, the latter ($CDv$) resulting from a motor-to-visual transformation (forward dynamics model) of the corollary discharge of the $MC$. In the present study, we investigated if, in addition to its established role in adaptive adjustment of $MC$, the cerebellum could contribute to the adaptation-associated perceptual changes. Transfer of backward and forward adaptation to spatial perceptual performance (during ocular fixation and trans-saccadically) was assessed in eight cerebellar patients and eight healthy volunteers. In healthy participants, both types of $SA$ altered $MC$ as well as internal representations of the saccade target and of the saccadic eye displacement. In patients, adaptation-related adjustments of $MC$ and adaptation transfer to localization were strongly reduced relative to healthy participants, unraveling abnormal adaptation-related changes of target and $CDv$. Importantly, the estimated changes of $CDv$ were totally abolished following forward session but mainly preserved in backward session, suggesting that an internal model ensuring trans-saccadic localization could be located in the adaptation-related cerebellar networks or in downstream networks, respectively.

Visuomotor learning from postdictive motor error

Sensorimotor learning adapts motor output to maintain movement accuracy. For saccadic eye movements, learning also alters space perception, suggesting a dissociation between the performed saccade and its internal representation derived from corollary discharge (CD). This is critical since learning is commonly believed to be driven by CD-based visual prediction error. We estimate the internal saccade representation through pre- and trans-saccadic target localization, showing that it decouples from the actual saccade during learning. We present a model that explains motor and perceptual changes by collective plasticity of spatial target percept, motor command, and a forward dynamics model that transforms CD from motor into visuospatial coordinates. We show that learning does not follow visual prediction error but instead a postdictive update of space after saccade landing. We conclude that trans-saccadic space perception guides motor learning via CD-based postdiction of motor error under the assumption of a stable world.

Perceptual effects of unequal saccadic adaptation produced by a dichoptic step

The binocular coordination of eye movements in a three-dimensional environment involves a combination of saccade and vergence movements. To maintain binocular accuracy and control in the face of sensory and motor changes (that occur with e.g., normal aging, surgery, corrective lenses), the oculomotor system must adapt in response to manifest visual errors. This may be achieved through a combination of binocular and monocular mechanisms, including the recalibration of saccade and vergence amplitudes in response to different visual errors induced in each eye (Maiello, Harrison, & Bex, 2016). This work has used a double-step paradigm to recalibrate eye movements in response to visual errors produced by dichoptic target steps (e.g., leftward in the left eye and rightward in the right eye). Here, we evaluated the immediate perceptual effects of this adaptation. Experiment 1 measured localization errors following adaptation by comparing the apparent locations of pre- and postsaccadic probes. Consistent with previous work showing localization errors following saccadic adaptation, our results demonstrated that adaptation to a dichoptic step produces different localization errors in the two eyes. Furthermore, in Experiment 2, this effect was reduced for a vergence shift in the absence of a saccade, indicating that saccade programming is responsible for a large component of this illusory shift. Experiment 3 measured postsaccadic stereopsis thresholds and indicated that, unlike localization judgments, adaptation did not influence stereoacuity. Together, these results demonstrate novel dichoptic visual errors following oculomotor adaptation and point to monocular and binocular mechanisms involved in the maintenance of binocular coordination.

Motion Extrapolation for Eye Movements Predicts Perceived Motion-Induced Position Shifts

Transmission delays in the nervous system pose challenges for the accurate localization of moving objects as the brain must rely on outdated information to determine their position in space. Acting effectively in the present requires that the brain compensates not only for the time lost in the transmission and processing of sensory information, but also for the expected time that will be spent preparing and executing motor programs. Failure to account for these delays will result in the mislocalization and mistargeting of moving objects. In the visuomotor system, where sensory and motor processes are tightly coupled, this predicts that the perceived position of an object should be related to the latency of saccadic eye movements aimed at it. Here we use the flash-grab effect, a mislocalization of briefly flashed stimuli in the direction of a reversing moving background, to induce shifts of perceived visual position in human observers (male and female). We find a linear relationship between saccade latency and perceived position shift, challenging the classic dissociation between "vision for action" and "vision for perception" for tasks of this kind and showing that oculomotor position representations are either shared with or tightly coupled to perceptual position representations. Altogether, we show that the visual system uses both the spatial and temporal characteristics of an upcoming saccade to localize visual objects for both action and perception.SIGNIFICANCE STATEMENT Accurately localizing moving objects is a computational challenge for the brain due to the inevitable delays that result from neural transmission. To solve this, the brain might implement motion extrapolation, predicting where an object ought to be at the present moment. Here, we use the flash-grab effect to induce perceptual position shifts and show that the latency of imminent saccades predicts the perceived position of the objects they target. This counterintuitive finding is important because it not only shows that motion extrapolation mechanisms indeed work to reduce the behavioral impact of neural transmission delays in the human brain, but also that these mechanisms are closely matched in the perceptual and oculomotor systems.

Visual Space Constructed by Saccade Motor Maps

How visual space is represented in the brain is an open question in neuroscience. Embodiment theories propose that spatial perception is structured by neural motor maps. Especially, maps which code the targets for saccadic eye movements contain a precise representation of external space. In this review article, we examine how modifications in saccade maps are accompanied by changes in visual space perception. Saccade adaptation, a method which systematically modifies saccade amplitudes, alters the localization of visual objects in space. We illustrate how information about saccade amplitudes is transferred from the cerebellum (CB) to the frontal eye field (FEF). We argue that changes in visual localization after adaptation of saccade maps provide evidence for a shared representation of visual and motor space.

Impairment of saccade adaptation in a patient with a focal thalamic lesion

The frequent jumps of the eyeballs-called saccades-imply the need for a constant correction of motor errors. If systematic errors are detected in saccade landing, the saccade amplitude adapts to compensate for the error. In the laboratory, saccade adaptation can be studied by displacing the saccade target. Functional selectivity of adaptation for different saccade types suggests that adaptation occurs at multiple sites in the oculomotor system. Saccade motor learning might be the result of a comparison between a prediction of the saccade landing position and its actual postsaccadic location. To investigate whether a thalamic feedback pathway might carry such a prediction signal, we studied a patient with a lesion in the posterior ventrolateral thalamic nucleus. Saccade adaptation was tested for reactive saccades, which are performed to suddenly appearing targets, and for scanning saccades, which are performed to stationary targets. For reactive saccades, we found a clear impairment in adaptation retention ipsilateral to the lesioned side and a larger-than-normal adaptation on the contralesional side. For scanning saccades, adaptation was intact on both sides and not different from the control group. Our results provide the first lesion evidence that adaptation of reactive and scanning saccades relies on distinct feedback pathways from cerebellum to cortex. They further demonstrate that saccade adaptation in humans is not restricted to the cerebellum but also involves cortical areas. The paradoxically strong adaptation for outward target steps can be explained by stronger reliance on visual targeting errors when prediction error signaling is impaired.

Mislocalization of stationary and flashed bars after saccadic inward and outward adaptation of reactive saccades

Recent studies have shown that saccadic inward adaptation (i.e., the shortening of saccade amplitude) and saccadic outward adaptation (i.e., the lengthening of saccade amplitude) rely on partially different neuronal mechanisms. There is increasing evidence that these differences are based on differences at the target registration or planning stages since outward but not inward adaptation transfers to hand-pointing and perceptual localization of flashed targets. Furthermore, the transfer of reactive saccade adaptation to long-duration overlap and scanning saccades is stronger after saccadic outward adaptation than that after saccadic inward adaptation, suggesting that modulated target registration stages during outward adaptation are increasingly used in the execution of saccades when the saccade target is visually available for a longer time. The difference in target presentation duration between reactive and scanning saccades is also linked to a difference in perceptual localization of different targets. Flashed targets are mislocalized after inward adaptation of reactive and scanning saccades but targets that are presented for a longer time (stationary targets) are mislocalized stronger after scanning than after reactive saccades. This link between perceptual localization and adaptation specificity suggests that mislocalization of stationary bars should be higher after outward than that after inward adaptation of reactive saccades. In the present study we test this prediction. We show that the relative amount of mislocalization of stationary versus flashed bars is higher after outward than that after inward adaptation of reactive saccades. Furthermore, during fixation stationary and flashed bars were mislocalized after outward but not after inward adaptation. Thus, our results give further evidence for different adaptation mechanisms between inward and outward adaptation and harmonize some recent research.

Spatiotopic visual maps revealed by saccadic adaptation in humans

Saccadic adaptation [1] is a powerful experimental paradigm to probe the mechanisms of eye movement control and spatial vision, in which saccadic amplitudes change in response to false visual feedback. The adaptation occurs primarily in the motor system [2, 3], but there is also evidence for visual adaptation, depending on the size and the permanence of the postsaccadic error [4-7]. Here we confirm that adaptation has a strong visual component and show that the visual component of the adaptation is spatially selective in external, not retinal coordinates. Subjects performed a memory-guided, double-saccade, outward-adaptation task designed to maximize visual adaptation and to dissociate the visual and motor corrections. When the memorized saccadic target was in the same position (in external space) as that used in the adaptation training, saccade targeting was strongly influenced by adaptation (even if not matched in retinal or cranial position), but when in the same retinal or cranial but different external spatial position, targeting was unaffected by adaptation, demonstrating unequivocal spatiotopic selectivity. These results point to the existence of a spatiotopic neural representation for eye movement control that adapts in response to saccade error signals.

Computational models of spatial updating in peri-saccadic perception

Perceptual phenomena that occur around the time of a saccade, such as peri-saccadic mislocalization or saccadic suppression of displacement, have often been linked to mechanisms of spatial stability. These phenomena are usually regarded as errors in processes of trans-saccadic spatial transformations and they provide important tools to study these processes. However, a true understanding of the underlying brain processes that participate in the preparation for a saccade and in the transfer of information across it requires a closer, more quantitative approach that links different perceptual phenomena with each other and with the functional requirements of ensuring spatial stability. We review a number of computational models of peri-saccadic spatial perception that provide steps in that direction. Although most models are concerned with only specific phenomena, some generalization and interconnection between them can be obtained from a comparison. Our analysis shows how different perceptual effects can coherently be brought together and linked back to neuronal mechanisms on the way to explaining vision across saccades.

Distorted object perception following whole-field adaptation of saccadic eye movements

The adaptation of an observer's saccadic eye movements to artificial post-saccadic visual error can lead to perceptual mislocalization of individual, transient visual stimuli. In this study, we demonstrate that simultaneous saccadic adaptation to a consistent error pattern across a large number of saccade vectors is accompanied by corresponding spatial distortions in the perception of persistent objects. To induce this adaptation, we artificially introduced several post-saccadic error patterns, which led to a systematic distortion in participants' oculomotor space and a corresponding distortion in their perception of the relative dimensions of a cross-figure. The results indicate a tight coupling between the oculomotor and visual-perceptual spaces that is not limited to misperception of individual visual locations but also affects metrics in the visual-perceptual space. This coupling suggests that our visual perception is continuously recalibrated by the post-saccadic error signal.

Eye movement sequence generation in humans: Motor or goal updating?

Saccadic eye movements are often grouped in pre-programmed sequences. The mechanism underlying the generation of each saccade in a sequence is currently poorly understood. Broadly speaking, two alternative schemes are possible: first, after each saccade the retinotopic location of the next target could be estimated, and an appropriate saccade could be generated. We call this the goal updating hypothesis. Alternatively, multiple motor plans could be pre-computed, and they could then be updated after each movement. We call this the motor updating hypothesis. We used McLaughlin's intra-saccadic step paradigm to artificially create a condition under which these two hypotheses make discriminable predictions. We found that in human subjects, when sequences of two saccades are planned, the motor updating hypothesis predicts the landing position of the second saccade in two-saccade sequences much better than the goal updating hypothesis. This finding suggests that the human saccadic system is capable of executing sequences of saccades to multiple targets by planning multiple motor commands, which are then updated by serial subtraction of ongoing motor output.

Perceptual judgment and saccadic behavior in a spatial distortion with briefly presented stimuli

When observers are asked to localize the peripheral position of a small probe with respect to the mid-position of a spatially extended comparison stimulus, they tend to judge the probe as being more peripheral than the mid-position of the comparison stimulus. This relative mislocalization seems to emerge from differences in absolute localization, that is the comparison stimulus is localized more towards the fovea than the probe. The present study compared saccadic behaviour and relative localization judgements in three experiments and determined the quantitative relationship between both measures. The results showed corresponding effects in localization errors and saccadic behaviour. Moreover, it was possible to estimate the amount of the relative mislocalization by means of the saccadic amplitude.

Mislocalization of flashed and stationary visual stimuli after adaptation of reactive and scanning saccades

When we look around and register the location of visual objects, our oculomotor system continuously prepares targets for saccadic eye movements. The preparation of saccade targets may be directly involved in the perception of object location because modification of saccade amplitude by saccade adaptation leads to a distortion of the visual localization of briefly flashed spatial probes. Here, we investigated effects of adaptation on the localization of continuously visible objects. We compared adaptation-induced mislocalization of probes that were present for 20 ms during the saccade preparation period and of probes that were present for >1 s before saccade initiation. We studied the mislocalization of these probes for two different saccade types, reactive saccades to a suddenly appearing target and scanning saccades in the self-paced viewing of a stationary scene. Adaptation of reactive saccades induced mislocalization of flashed probes. Adaptation of scanning saccades induced in addition also mislocalization of stationary objects. The mislocalization occurred in the absence of visual landmarks and must therefore originate from the change in saccade motor parameters. After adaptation of one type of saccade, the saccade amplitude change and the mislocalization transferred only weakly to the other saccade type. Mislocalization of flashed and stationary probes thus followed the selectivity of saccade adaptation. Since the generation and adaptation of reactive and scanning saccades are known to involve partially different brain mechanisms, our results suggest that visual localization of objects in space is linked to saccade targeting at multiple sites in the brain.

Adaptation of reactive and voluntary saccades: different patterns of adaptation revealed in the antisaccade task

Sensorimotor adaptation restores and maintains the accuracy of goal-directed movements. It remains unclear whether these adaptive mechanisms modify actions by controlling peripheral premotor stages that send commands to the effectors and/or earlier processing stages involved in registration of target location. Here, we studied the effect of adaptation of saccadic eye movements, a well-established model of sensorimotor adaptation, in an antisaccade task. This task introduces a clear spatial dissociation between the actual target direction and the requested saccade direction because the correct movement direction is in the opposite direction from the target location. We used this requirement of a vector inversion to assess the level(s) of saccadic adaptation for two different types of adapted saccades. In two different experiments, we tested the transfer to antisaccades of the adaptation in one direction of reactive saccades to jumping targets and of scanning voluntary saccades within a target array. In the first experiment, we found that adaptation of reactive saccades transferred only to antisaccades in the adapted direction. In contrast, in the second experiment, adaptation of scanning voluntary saccades transferred to antisaccades in both the adapted and non-adapted directions. We conclude that adaptation of reactive saccades acts only downstream of the vector inversion required in the antisaccade task, whereas adaptation of voluntary saccades has a distributed influence, acting both upstream and downstream of vector inversion.