The use of egocentric and exocentric location cues in saccadic programming

Target Localization after Saccades and at Fixation: Nontargets both Facilitate and Bias Responses

The image on our retina changes every time we make an eye movement. To maintain visual stability after saccades, specifically to locate visual targets, we may use nontarget objects as "landmarks". In the current study, we compared how the presence of nontargets affects target localization after saccades and during sustained fixation. Participants fixated a target object, which either maintained its location on the screen (sustained-fixation trials), or displaced to trigger a saccade (saccade trials). After the target disappeared, participants reported the most recent target location with a mouse click. We found that the presence of nontargets decreased response error magnitude and variability. However, this nontarget facilitation effect was not larger for saccade trials than sustained-fixation trials, indicating that nontarget facilitation might be a general effect for target localization, rather than of particular importance to post-saccadic stability. Additionally, participants' responses were biased towards the nontarget locations, particularly when the nontarget-target relationships were preserved in relative coordinates across the saccade. This nontarget bias interacted with biases from other spatial references, e.g. eye movement paths, possibly in a way that emphasized non-redundant information. In summary, the presence of nontargets is one of several sources of reference that combine to influence (both facilitate and bias) target localization.

Cortical Activation during Landmark-Centered vs. Gaze-Centered Memory of Saccade Targets in the Human: An FMRI Study

A remembered saccade target could be encoded in egocentric coordinates such as gaze-centered, or relative to some external allocentric landmark that is independent of the target or gaze (landmark-centered). In comparison to egocentric mechanisms, very little is known about such a landmark-centered representation. Here, we used an event-related fMRI design to identify brain areas supporting these two types of spatial coding (i.e., landmark-centered vs. gaze-centered) for target memory during the Delay phase where only target location, not saccade direction, was specified. The paradigm included three tasks with identical display of visual stimuli but different auditory instructions: Landmark Saccade (remember target location relative to a visual landmark, independent of gaze), Control Saccade (remember original target location relative to gaze fixation, independent of the landmark), and a non-spatial control, Color Report (report target color). During the Delay phase, the Control and Landmark Saccade tasks activated overlapping areas in posterior parietal cortex (PPC) and frontal cortex as compared to the color control, but with higher activation in PPC for target coding in the Control Saccade task and higher activation in temporal and occipital cortex for target coding in Landmark Saccade task. Gaze-centered directional selectivity was observed in superior occipital gyrus and inferior occipital gyrus, whereas landmark-centered directional selectivity was observed in precuneus and midposterior intraparietal sulcus. During the Response phase after saccade direction was specified, the parietofrontal network in the left hemisphere showed higher activation for rightward than leftward saccades. Our results suggest that cortical activation for coding saccade target direction relative to a visual landmark differs from gaze-centered directional selectivity for target memory, from the mechanisms for other types of allocentric tasks, and from the directionally selective mechanisms for saccade planning and execution.

Asymmetric Mislocalization of a Visual Flash Ahead of and behind a Moving Object

When subjects localize a flash relative to another stationary stimulus, the flash appears displaced in the direction of nearby motion signals (position capture; Whitney and Cavanagh, 2000 Nature Neuroscience3 954–959). Our previous study had suggested that the position capture is larger for a flash presented ahead of a moving stimulus than for a flash behind it (Watanabe et al, 2003 Perception32 545–559). In the present study, I investigated the spatial asymmetry of position capture. Experiment 1 demonstrated that asymmetric position capture occurs primarily in a moving-object-centered coordinate. Experiment 2 showed evidence that the asymmetric position capture operates after individuation of single visual objects. Finally, experiment 3 demonstrated that, when attention was reduced with a dual-task procedure, the asymmetric position capture increased. These results suggest that the spatial asymmetry of position capture occurs without attention but the spatial bias can be reduced by attention. Therefore, the underlying mechanism for the asymmetric spatial bias may be different from attentive tracking (Cavanagh, 1992 Science257 1563–1565) and mislocalization during smooth pursuit (Brenner et al, 2001 Vision Research41 2253–2259).

A State Space Model for Spatial Updating of Remembered Visual Targets during Eye Movements

In the oculomotor system, spatial updating is the ability to aim a saccade toward a remembered visual target position despite intervening eye movements. Although this has been the subject of extensive experimental investigation, there is still no unifying theoretical framework to explain the neural mechanism for this phenomenon, and how it influences visual signals in the brain. Here, we propose a unified state-space model (SSM) to account for the dynamics of spatial updating during two types of eye movement; saccades and smooth pursuit. Our proposed model is a non-linear SSM and implemented through a recurrent radial-basis-function neural network in a dual Extended Kalman filter (EKF) structure. The model parameters and internal states (remembered target position) are estimated sequentially using the EKF method. The proposed model replicates two fundamental experimental observations: continuous gaze-centered updating of visual memory-related activity during smooth pursuit, and predictive remapping of visual memory activity before and during saccades. Moreover, our model makes the new prediction that, when uncertainty of input signals is incorporated in the model, neural population activity and receptive fields expand just before and during saccades. These results suggest that visual remapping and motor updating are part of a common visuomotor mechanism, and that subjective perceptual constancy arises in part from training the visual system on motor tasks.

Oculomotor Adaptation Elicited By Intra-Saccadic Visual Stimulation: Time-Course of Efficient Visual Target Perturbation

Perception of our visual environment strongly depends on saccadic eye movements, which in turn are calibrated by saccadic adaptation mechanisms elicited by systematic movement errors. Current models of saccadic adaptation assume that visual error signals are acquired only after saccade completion, because the high speed of saccade execution disturbs visual processing (saccadic "suppression" and "mislocalization"). Complementing a previous study from our group, here we report that visual information presented during saccades can drive adaptation mechanisms and we further determine the critical time window of such error processing. In 15 healthy volunteers, shortening adaptation of reactive saccades toward a ±8° visual target was induced by flashing the target for 2 ms less eccentrically than its initial location either near saccade peak velocity ("PV" condition) or peak deceleration ("PD") or saccade termination ("END"). Results showed that, as compared to the "CONTROL" condition (target flashed at its initial location upon saccade termination), saccade amplitude decreased all throughout the "PD" and "END" conditions, reaching significant levels in the second adaptation and post-adaptation blocks. The results of nine other subjects tested in a saccade lengthening adaptation paradigm with the target flashing near peak deceleration ("PD" and "CONTROL" conditions) revealed no significant change of gain, confirming that saccade shortening adaptation is easier to elicit. Also, together with this last result, the stable gain observed in the "CONTROL" conditions of both experiments suggests that mislocalization of the target flash is not responsible for the saccade shortening adaptation demonstrated in the first group. Altogether, these findings reveal that the visual "suppression" and "mislocalization" phenomena related to saccade execution do not prevent brief visual information delivered "in-flight" from being processed to elicit oculomotor adaptation.

Brain Activations Related to Saccadic Response Conflict are not Sensitive to Time on Task

Establishing a role of the dorsal medial frontal cortex in the performance monitoring and cognitive control has been a challenge to neuroscientists for the past decade. In light of recent findings, the conflict monitoring hypothesis has been elaborated to an action-outcome predictor theory. One of the findings that led to this re-evaluation was the fMRI study in which conflict-related brain activity was investigated in terms of the so-called time on task effect, i.e., a linear increase of the BOLD signal with longer response times. The aim of this study was to investigate brain regions involved in the processing of saccadic response conflict and to account for the time on task effect. A modified spatial cueing task was implemented in the event-related fMRI study with oculomotor responses. The results revealed several brain regions which show higher activity for incongruent trials in comparison to the congruent ones, including pre-supplementary motor area together with the frontal and parietal regions. Further analysis accounting for the effect of response time provided evidence that these brain activations were not sensitive to time on task but reflected purely the congruency effect.

Use of exocentric and egocentric representations in the concurrent planning of sequential saccades

The concurrent planning of sequential saccades offers a simple model to study the nature of visuomotor transformations since the second saccade vector needs to be remapped to foveate the second target following the first saccade. Remapping is thought to occur through egocentric mechanisms involving an efference copy of the first saccade that is available around the time of its onset. In contrast, an exocentric representation of the second target relative to the first target, if available, can be used to directly code the second saccade vector. While human volunteers performed a modified double-step task, we examined the role of exocentric encoding in concurrent saccade planning by shifting the first target location well before the efference copy could be used by the oculomotor system. The impact of the first target shift on concurrent processing was tested by examining the end-points of second saccades following a shift of the second target during the first saccade. The frequency of second saccades to the old versus new location of the second target, as well as the propagation of first saccade localization errors, both indices of concurrent processing, were found to be significantly reduced in trials with the first target shift compared to those without it. A similar decrease in concurrent processing was obtained when we shifted the first target but kept constant the second saccade vector. Overall, these results suggest that the brain can use relatively stable visual landmarks, independent of efference copy-based egocentric mechanisms, for concurrent planning of sequential saccades.

Spatial position information accumulates steadily over time

One of the more enduring mysteries of neuroscience is how the visual system constructs robust maps of the world that remain stable in the face of frequent eye movements. Here we show that encoding the position of objects in external space is a relatively slow process, building up over hundreds of milliseconds. We display targets to which human subjects saccade after a variable preview duration. As they saccade, the target is displaced leftwards or rightwards, and subjects report the displacement direction. When subjects saccade to targets without delay, sensitivity is poor; but if the target is viewed for 300-500 ms before saccading, sensitivity is similar to that during fixation with a strong visual mask to dampen transients. These results suggest that the poor displacement thresholds usually observed in the "saccadic suppression of displacement" paradigm are a result of the fact that the target has had insufficient time to be encoded in memory, and not a result of the action of special mechanisms conferring saccadic stability. Under more natural conditions, trans-saccadic displacement detection is as good as in fixation, when the displacement transients are masked.

Compression and suppression of shifting receptive field activity in frontal eye field neurons

Before each saccade, neurons in frontal eye field anticipate the impending eye movement by showing sensitivity to stimuli appearing where the neuron's receptive field will be at the end of the saccade, referred to as the future field (FF) of the neuron. We explored the time course of this anticipatory activity in monkeys by briefly flashing stimuli in the FF at different times before saccades. Different neurons showed substantial variation in FF time course, but two salient observations emerged. First, when we compared the time span of stimulus probes before the saccade to the time span of FF activity, we found a striking temporal compression of FF activity, similar to compression seen for perisaccadic stimuli in human psychophysics. Second, neurons with distinct FF activity also showed suppression at the time of the saccade. The increase in FF activity and the decrease with suppression were temporally independent, making the patterns of activity difficult to separate. We resolved this by constructing a simple model with values for the start, peak, and duration of FF activity and suppression for each neuron. The model revealed the different time courses of FF sensitivity and suppression, suggesting that information about the impending saccade triggering suppression reaches the frontal eye field through a different pathway, or a different mechanism, than that triggering FF activity. Recognition of the variations in the time course of anticipatory FF activity provides critical information on its function and its relation to human visual perception at the time of the saccade.

The need for speed: eye-position signal dynamics in the parietal cortex

Accurate eye-position signals are critically important for localizing targets in space when the eyes move. In this issue of Neuron, Xu et al. (2012) provide evidence that eye-position gain fields in area LIP remain spatially inaccurate for some time after a saccade, indicating they are not updated rapidly enough to play a role in the computation of target locations for upcoming saccades.

Egocentric and allocentric alignment tasks are affected by otolith input

Gravicentric visual alignments become less precise when the head is roll-tilted relative to gravity, which is most likely due to decreasing otolith sensitivity. To align a luminous line with the perceived gravity vector (gravicentric task) or the perceived body-longitudinal axis (egocentric task), the roll orientation of the line on the retina and the torsional position of the eyes relative to the head must be integrated to obtain the line orientation relative to the head. Whether otolith input contributes to egocentric tasks and whether the modulation of variability is restricted to vision-dependent paradigms is unknown. In nine subjects we compared precision and accuracy of gravicentric and egocentric alignments in various roll positions (upright, 45°, and 75° right-ear down) using a luminous line (visual paradigm) in darkness. Trial-to-trial variability doubled for both egocentric and gravicentric alignments when roll-tilted. Two mechanisms might explain the roll-angle–dependent modulation in egocentric tasks: 1) Modulating variability in estimated ocular torsion, which reflects the roll-dependent precision of otolith signals, affects the precision of estimating the line orientation relative to the head; this hypothesis predicts that variability modulation is restricted to vision-dependent alignments. 2) Estimated body-longitudinal reflects the roll-dependent variability of perceived earth-vertical. Gravicentric cues are thereby integrated regardless of the task's reference frame. To test the two hypotheses the visual paradigm was repeated using a rod instead (haptic paradigm). As with the visual paradigm, precision significantly decreased with increasing head roll for both tasks. These findings propose that the CNS integrates input coded in a gravicentric frame to solve egocentric tasks. In analogy to gravicentric tasks, where trial-to-trial variability is mainly influenced by the properties of the otolith afferents, egocentric tasks may also integrate otolith input. Such a shared mechanism for both paradigms and frames of reference is supported by the significantly correlated trial-to-trial variabilities.

Luminance contrast in the background makes flashes harder to detect during saccades

To explore a visual scene we make many fast eye movements (saccades) every second. During those saccades the image of the world shifts rapidly across our retina. These shifts are normally not detected, because perception is suppressed during saccades. In this paper we study the origin of this saccadic suppression by examining the influence of luminance borders in the background on the perception of flashes presented near the time of saccades in a normally illuminated room. We used different types of backgrounds: either with isoluminant red and green areas or with black and white areas. We found that the ability to perceive flashes that were presented during saccades was suppressed when there were luminance borders in the background, but not when there were isoluminant color borders in the background. Thus, masking by moving luminance borders plays an important role in saccadic suppression. The perceived positions of detected flashes were only influenced by the borders between the areas in the background when the flashes were presented before or after the saccades. Moreover, the influence did not depend on the kind of contrast forming the border. Thus, the masking effect of moving luminance borders does not appear to play an important role in the mislocalization of flashes that are presented near the time of saccades.

Eye movements: the past 25 years

This article reviews the past 25 years of research on eye movements (1986-2011). Emphasis is on three oculomotor behaviors: gaze control, smooth pursuit and saccades, and on their interactions with vision. Focus over the past 25 years has remained on the fundamental and classical questions: What are the mechanisms that keep gaze stable with either stationary or moving targets? How does the motion of the image on the retina affect vision? Where do we look - and why - when performing a complex task? How can the world appear clear and stable despite continual movements of the eyes? The past 25 years of investigation of these questions has seen progress and transformations at all levels due to new approaches (behavioral, neural and theoretical) aimed at studying how eye movements cope with real-world visual and cognitive demands. The work has led to a better understanding of how prediction, learning and attention work with sensory signals to contribute to the effective operation of eye movements in visually rich environments.

Computational models of spatial updating in peri-saccadic perception

Perceptual phenomena that occur around the time of a saccade, such as peri-saccadic mislocalization or saccadic suppression of displacement, have often been linked to mechanisms of spatial stability. These phenomena are usually regarded as errors in processes of trans-saccadic spatial transformations and they provide important tools to study these processes. However, a true understanding of the underlying brain processes that participate in the preparation for a saccade and in the transfer of information across it requires a closer, more quantitative approach that links different perceptual phenomena with each other and with the functional requirements of ensuring spatial stability. We review a number of computational models of peri-saccadic spatial perception that provide steps in that direction. Although most models are concerned with only specific phenomena, some generalization and interconnection between them can be obtained from a comparison. Our analysis shows how different perceptual effects can coherently be brought together and linked back to neuronal mechanisms on the way to explaining vision across saccades.

Multiple reference frames for saccadic planning in the human parietal cortex

We apply functional magnetic resonance imaging and multivariate analysis methods to study the coordinate frame in which saccades are represented in the human cortex. Subjects performed a memory-guided saccade task in which equal-amplitude eye movements were executed from several starting points to various directions. Response patterns during the memory period for same-vector saccades were correlated in the frontal eye fields and the intraparietal sulcus (IPS), indicating a retinotopic representation. Interestingly, response patterns in the middle aspect of the IPS were also correlated for saccades made to the same destination point, even when their movement vector was different. Thus, this region also contains information about saccade destination in (at least) a head-centered coordinate frame. This finding may explain behavioral and neuropsychological studies demonstrating that eye movements are also anchored to an egocentric or an allocentric representation of space rather than strictly to the retinal visual input and that parietal cortex is involved in maintaining these representations of space.

Peri-saccadic mislocalization is not influenced by the predictability of the saccade target location

Flashes presented around the time of a saccade are often mislocalized. The precise pattern of mislocalization is influenced by many factors. Here we study one such factor: the predictability of the saccade target's location. The experiment examines two conditions. In the first the subject makes the same horizontal rightward saccade to the same target location over and over again. In the second the subject makes saccades to a target that is jumping in unpredictable radial directions. A dot is flashed in the vicinity of the saccade target near the time of saccade onset. Subjects are asked to localize the flash by touching its location on the screen. Although various saccade parameters differed, the errors that subjects made were very similar in both conditions. We conclude that the pattern of mislocalization does not depend on the predictability of the location of the saccade target.

Neural control of visual search by frontal eye field: effects of unexpected target displacement on visual selection and saccade preparation

The dynamics of visual selection and saccade preparation by the frontal eye field was investigated in macaque monkeys performing a search-step task combining the classic double-step saccade task with visual search. Reward was earned for producing a saccade to a color singleton. On random trials the target and one distractor swapped locations before the saccade and monkeys were rewarded for shifting gaze to the new singleton location. A race model accounts for the probabilities and latencies of saccades to the initial and final singleton locations and provides a measure of the duration of a covert compensation process-target-step reaction time. When the target stepped out of a movement field, noncompensated saccades to the original location were produced when movement-related activity grew rapidly to a threshold. Compensated saccades to the final location were produced when the growth of the original movement-related activity was interrupted within target-step reaction time and was replaced by activation of other neurons producing the compensated saccade. When the target stepped into a receptive field, visual neurons selected the new target location regardless of the monkeys' response. When the target stepped out of a receptive field most visual neurons maintained the representation of the original target location, but a minority of visual neurons showed reduced activity. Chronometric analyses of the neural responses to the target step revealed that the modulation of visually responsive neurons and movement-related neurons occurred early enough to shift attention and saccade preparation from the old to the new target location. These findings indicate that visual activity in the frontal eye field signals the location of targets for orienting, whereas movement-related activity instantiates saccade preparation.

Spatial updating and the maintenance of visual constancy

Spatial updating is the means by which we keep track of the locations of objects in space even as we move. Four decades of research have shown that humans and non-human primates can take the amplitude and direction of intervening movements into account, including saccades (both head-fixed and head-free), pursuit, whole-body rotations and translations. At the neuronal level, spatial updating is thought to be maintained by receptive field locations that shift with changes in gaze, and evidence for such shifts has been shown in several cortical areas. These regions receive information about the intervening movement from several sources including motor efference copies when a voluntary movement is made and vestibular/somatosensory signals when the body is in motion. Many of these updating signals arise from brainstem regions that monitor our ongoing movements and subsequently transmit this information to the cortex via pathways that likely include the thalamus. Several issues of debate include (1) the relative contribution of extra-retinal sensory and efference copy signals to spatial updating, (2) the source of an updating signal for real life, three-dimensional motion that cannot arise from brain areas encoding only two-dimensional commands, and (3) the reference frames used by the brain to integrate updating signals from various sources. This review highlights the relevant spatial updating studies and provides a summary of the field today. We find that spatial constancy is maintained by a highly evolved neural mechanism that keeps track of our movements, transmits this information to relevant brain regions, and then uses this information to change the way in which single neurons respond. In this way, we are able to keep track of relevant objects in the outside world and interact with them in meaningful ways.

Gaze behavior when reaching to remembered targets

People naturally direct their gaze to visible hand movement goals. Doing so improves reach accuracy through use of signals related to gaze position and visual feedback of the hand. Here, we studied where people naturally look when acting on remembered target locations. Four targets were presented on a screen, in peripheral vision, while participants fixed a central cross (encoding phase). Four seconds later, participants used a pen to mark the remembered locations while free to look wherever they wished (recall phase). Visual references, including the screen and the cross, were present throughout. During recall, participants neither looked at the marked locations nor prevented eye movements. Instead, gaze behavior was erratic and was comprised of gaze shifts loosely coupled in time and space with hand movements. To examine whether eye and hand movements during encoding affected gaze behavior during recall, in additional encoding conditions, participants marked the visible targets with either free gaze or with central cross fixation or just looked at the targets. All encoding conditions yielded similar erratic gaze behavior during recall. Furthermore, encoding mode did not influence recall performance, suggesting that participants, during recall, did not exploit sensorimotor memories related to hand and gaze movements during encoding. Finally, we recorded a similar lose coupling between hand and eye movements during an object manipulation task performed in darkness after participants had viewed the task environment. We conclude that acting on remembered versus visible targets can engage fundamentally different control strategies, with gaze largely decoupled from movement goals during memory-guided actions.

Perisaccadic mislocalization of visual targets by head-free gaze shifts: visual or motor?

Such perisaccadic mislocalization is maximal in the direction of the saccade and varies systematically with the target-saccade onset delay. We have recently shown that under head-fixed conditions perisaccadic errors do not follow the quantitative predictions of current visuomotor models that explain these mislocalizations in terms of spatial updating. These models all assume sluggish eye-movement feedback and therefore predict that errors should vary systematically with the amplitude and kinematics of the intervening saccade. Instead, we reported that errors depend only weakly on the saccade amplitude. An alternative explanation for the data is that around the saccade the perceived target location undergoes a uniform transient shift in the saccade direction, but that the oculomotor feedback is, on average, accurate. This "visual shift" hypothesis predicts that errors will also remain insensitive to kinematic variability within much larger head-free gaze shifts. Here we test this prediction by presenting a brief visual probe near the onset of gaze saccades between 40 and 70 degrees amplitude. According to models with inaccurate gaze-motor feedback, the expected perisaccadic errors for such gaze shifts should be as large as 30 degrees and depend heavily on the kinematics of the gaze shift. In contrast, we found that the actual peak errors were similar to those reported for much smaller saccadic eye movements, i.e., on average about 10 degrees, and that neither gaze-shift amplitude nor kinematics plays a systematic role. Our data further corroborate the visual origin of perisaccadic mislocalization under open-loop conditions and strengthen the idea that efferent feedback signals in the gaze-control system are fast and accurate.

Expansion of visual space during optokinetic afternystagmus (OKAN)

The mechanisms underlying visual perceptual stability are usually investigated using voluntary eye movements. In such studies, errors in perceptual stability during saccades and pursuit are commonly interpreted as mismatches between actual eye position and eye-position signals in the brain. The generality of this interpretation could in principle be tested by investigating spatial localization during reflexive eye movements whose kinematics are very similar to those of voluntary eye movements. Accordingly, in this study, we determined mislocalization of flashed visual targets during optokinetic afternystagmus (OKAN). These eye movements are quite unique in that they occur in complete darkness and are generated by subcortical control mechanisms. We found that during horizontal OKAN slow phases, subjects mislocalize targets away from the fovea in the horizontal direction. This corresponds to a perceived expansion of visual space and is unlike mislocalization found for any other voluntary or reflexive eye movement. Around the OKAN fast phases, we found a bias in the direction of the fast phase prior to its onset and opposite to the fast-phase direction thereafter. Such a biphasic modulation has also been reported in the temporal vicinity of saccades and during optokinetic nystagmus (OKN). A direct comparison, however, showed that the modulation during OKAN was much larger and occurred earlier relative to fast-phase onset than during OKN. A simple mismatch between the current eye position and the eye-position signal in the brain is unlikely to explain such disparate results across similar eye movements. Instead, these data support the view that mislocalization arises from errors in eye-centered position information.

Shape distortion produced by isolated mismatch between vision and proprioception

To investigate the nature of the visuomotor transformation, previous studies have used pointing tasks and examined how adaptation to a spatially localized mismatch between vision and proprioception generalizes across the workspace. Whereas some studies found extensive spatial generalization of single-point remapping, consistent with the hypothesis of a global realignment of visual and proprioceptive spaces, other studies reported limited transfer associated with variations in initial limb posture. Here, we investigated the effects of spatially localized remapping in the context of a visuomanual tracking task. Subjects tracked a visual target tracing a simple two-dimensional geometrical form without visual feedback except at a single point, where the visual display of the hand was shifted relative to its actual position. After adaptation, hand paths exhibited distortions relative to the visual templates that were inconsistent with the idea of a global realignment of visual and proprioceptive spaces. Results of a visuoproprioceptive matching task showed that these distortions were not limited to active movements but also affected perception of passive limb movements.

A model of the mechanism for the perceived location of a single flash and two successive flashes presented around the time of a saccade

According to current accounts, the perceived location of a target flash presented in the dark around the time of a saccade comes largely from an extraretinal signal that begins to change before, and continues to change during and following the saccade. Opposed to this view, this study offers a model suggesting that the perception of a single flash or two successive flashes in association with a saccade is the result of the combined effects of flash retinal signal persistence and an extraretinal signal that begins concurrent with or shortly after the saccade. For a single flash, the retinal signal persistence interacting with the extraretinal signal is responsible for the perceived location of the flash. In the case of two flashes with a short inter-flash-interval, the temporal overlap of the first flash persistence with the second flash persistence is a major factor in determining the perceived location of both of the flashes, and as a consequence, the perceived separation between them.

Perisaccadic compression correlates with saccadic peak velocity: differential association of eye movement dynamics with perceptual mislocalization patterns

Objects flashed around the onset of a saccadic eye movement are grossly mislocalized. Perisaccadic mislocalization has been related to a spatiotemporal misalignment of an extraretinal eye position signal with the corresponding saccade. Two phenomena have been observed: a systematic shift of perceived positions in saccade direction and an additional compression toward the saccade target. At present, it is unclear whether these two components of mislocalization are mediated by distinct mechanisms and how extraretinal signals may contribute to either of them. Moreover, the pattern and strength of perisaccadic mislocalization varies considerably across studies and even between subjects tested under identical conditions. Here, we investigated whether interindividual differences in saccade parameters are related to differences in mislocalization. We found that the individual strength of perceptual compression selectively correlates with the peak velocity of corresponding saccades. Other saccade parameters did not correlate with compression. No correlation was found between the shift component of perisaccadic mislocalization and any saccade parameter. This dissociation suggests that shift and compression components are, at least partially, mediated by distinct mechanisms. Because neuronal activity in the superior colliculus and downstream oculomotor areas has been shown to correlate with saccadic peak velocity, our findings support the notion that a reafferent extraretinal signal associated with saccadic motor commands may contribute to perisaccadic compression of perceived positions.

Computing vector differences using a gain field-like mechanism in monkey frontal eye field

Signals related to eye position are essential for visual perception and eye movements, and are powerful modulators of sensory responses in many regions of the visual and oculomotor systems. We show that visual and pre-saccadic responses of frontal eye field (FEF) neurons are modulated by initial eye position in a way suggestive of a multiplicative mechanism (gain field). Furthermore the slope of the eye position sensitivity tends to be negatively correlated with preferred retinal position across the population. A model with Gaussian visual receptive fields and linear-rectified eye position gain fields accounts for a large portion of the variance in the recorded data. Using physiologically derived parameters, this model is able to subtract the gaze shift from the vector representing the retinal location of the target. This computation might be used to maintain a memory of target location in space during ongoing eye movements. This updated spatial memory can be read directly from the locus of the peak of activity across the retinotopic map of FEF and it is the result of a vector subtraction between retinal target location when flashed and subsequent eye displacement in the dark.

Rhesus monkeys mislocalize saccade targets flashed for 100ms around the time of a saccade

Humans and monkeys mislocalize targets flashed around the time of a saccade. Here, we present data from three monkeys on a double-step task with a 100ms target duration. All three subjects mislocalized targets that were flashed around the time of the first saccade, in spite of long intersaccadic intervals. The error was consistently in the direction opposite that of the saccade, and occurred in some cases when the target presentation was entirely presaccadic. This is inconsistent with a theory invoking a damped representation of eye position, but it is consistent with the hypothesis that it is due to an error in peri-saccadic remapping.

Post-saccadic updating of visual space in the posterior parietal cortex in humans

Updating of visual space takes place in the posterior parietal cortex to guarantee spatial constancy across eye movements. However, the timing of updating with respect to saccadic eye movements remains a matter of debate. In the present study, event-related potentials (ERPs) were recorded in 15 volunteers during a saccadic double-step task to elucidate the time course of the updating process. In the experimental condition updating of visual space was required, because both saccade targets had already disappeared before the first saccade was executed. A similar task without updating requirements served as control condition. ERP analysis revealed a significantly larger slow positive wave in the retino-spatial dissonance condition compared to the control condition, starting between 150 and 200 ms after first saccade onset. Source analysis showed an asymmetry with respect to the direction of the first saccade. Whereas the source was restricted to the right PPC in trials with leftward first saccades, left and right PPC were involved in rightward trials. The results of the present study suggest that updating of visual space in a saccadic double-step task occurs not earlier than 150 ms after the onset of the first saccade. We conclude that extraretinal information about the first saccade is integrated with motor information about the second saccade in the inter-saccade interval.

Gaze orienting in dynamic visual double steps

Visual stimuli are initially represented in a retinotopic reference frame. To maintain spatial accuracy of gaze (i.e., eye in space) despite intervening eye and head movements, the visual input could be combined with dynamic feedback about ongoing gaze shifts. Alternatively, target coordinates could be updated in advance by using the preprogrammed gaze-motor command ("predictive remapping"). So far, previous experiments have not dissociated these possibilities. Here we study whether the visuomotor system accounts for saccadic eye-head movements that occur during target presentation. In this case, the system has to deal with fast dynamic changes of the retinal input and with highly variable changes in relative eye and head movements that cannot be preprogrammed by the gaze control system. We performed visual-visual double-step experiments in which a brief (50-ms) stimulus was presented during a saccadic eye-head gaze shift toward a previously flashed visual target. Our results show that gaze shifts remain accurate under these dynamic conditions, even for stimuli presented near saccade onset, and that eyes and head are driven in oculocentric and craniocentric coordinates, respectively. These results cannot be explained by a predictive remapping scheme. We propose that the visuomotor system adequately processes dynamic changes in visual input that result from self-initiated gaze shifts, to construct a stable representation of visual targets in an absolute, supraretinal (e.g., world) reference frame. Predictive remapping may subserve transsaccadic integration, thus enabling perception of a stable visual scene despite eye movements, whereas dynamic feedback ensures accurate actions (e.g., eye-head orienting) to a selected goal.

Visuospatial Memory Computations During Whole-Body Rotations in Roll

We used a memory-saccade task to test whether the location of a target, briefly presented before a whole-body rotation in roll, is stored in egocentric or in allocentric coordinates. To make this distinction, we exploited the fact that subjects, when tilted sideways in darkness, make systematic errors when indicating the direction of gravity (an allocentric task) even though they have a veridical percept of their self-orientation in space. We hypothesized that if spatial memory is coded allocentrically, these distortions affect the coding of remembered targets and their readout after a body rotation. Alternatively, if coding is egocentric, updating for body rotation becomes essential and errors in performance should be related to the amount of intervening rotation. Subjects ( n = 6) were tested making saccades to remembered world-fixed targets after passive body tilts. Initial and final tilt angle ranged between −120° CCW and 120° CW. The results showed that subjects made large systematic directional errors in their saccades (up to 90°). These errors did not occur in the absence of intervening body rotation, ruling out a memory degradation effect. Regression analysis showed that the errors were closely related to the amount of subjective allocentric distortion at both the initial and final tilt angle, rather than to the amount of intervening rotation. We conclude that the brain uses an allocentric reference frame, possibly gravity-based, to code visuospatial memories during whole-body tilts. This supports the notion that the brain can define information in multiple frames of reference, depending on sensory inputs and task demands.

Dynamic circuitry for updating spatial representations. I. Behavioral evidence for interhemispheric transfer in the split-brain macaque

Internal representations of the sensory world must be constantly adjusted to take movements into account. In the visual system, spatial updating provides a mechanism for maintaining a coherent map of salient locations as the eyes move. Little is known, however, about the pathways that produce updated spatial representations. In the present study, we asked whether direct cortico-cortical links are required for spatial updating. We addressed this question by investigating whether the forebrain commissures-the direct path between the two cortical hemispheres-are necessary for updating visual representations from one hemifield to the other. We assessed spatial updating in two split-brain monkeys using the double-step task, which involves saccades to two sequentially appearing targets. Accurate performance requires that the representation of the second target be updated to take the first saccade into account. We made two central discoveries regarding the pathways that underlie spatial updating. First, we found that split-brain monkeys exhibited a selective initial impairment on double-step sequences that required updating across visual hemifields. Second, and most surprisingly, these impairments were neither universal nor permanent: the monkeys were ultimately able to perform the across-hemifield sequences and, in some cases, this ability emerged rapidly. These findings indicate that direct cortical links provide the main substrate for updating visual representations, but they are not the sole substrate. Rather, a unified and stable representation of visual space is supported by a redundant cortico-subcortical network with a striking capacity for reorganization.

Dynamic sound localization during rapid eye-head gaze shifts

Human sound localization relies on implicit head-centered acoustic cues. However, to create a stable and accurate representation of sounds despite intervening head movements, the acoustic input should be continuously combined with feedback signals about changes in head orientation. Alternatively, the auditory target coordinates could be updated in advance by using either the preprogrammed gaze-motor command or the sensory target coordinates to which the intervening gaze shift is made ("predictive remapping"). So far, previous experiments cannot dissociate these alternatives. Here, we study whether the auditory system compensates for ongoing saccadic eye and head movements in two dimensions that occur during target presentation. In this case, the system has to deal with dynamic changes of the acoustic cues as well as with rapid changes in relative eye and head orientation that cannot be preprogrammed by the audiomotor system. We performed visual-auditory double-step experiments in two dimensions in which a brief sound burst was presented while subjects made a saccadic eye-head gaze shift toward a previously flashed visual target. Our results show that localization responses under these dynamic conditions remain accurate. Multiple linear regression analysis revealed that the intervening eye and head movements are fully accounted for. Moreover, elevation response components were more accurate for longer-duration sounds (50 msec) than for extremely brief sounds (3 msec), for all localization conditions. Taken together, these results cannot be explained by a predictive remapping scheme. Rather, we conclude that the human auditory system adequately processes dynamically varying acoustic cues that result from self-initiated rapid head movements to construct a stable representation of the target in world coordinates. This signal is subsequently used to program accurate eye and head localization responses.

Effect of saccadic adaptation on localization of visual targets

Objects flashed briefly around the time of a saccadic eye movement are grossly mislocalized by human subjects, so they appear to be compressed toward the endpoint of the saccade. In this study, we investigate spatial localization during saccadic adaptation to examine whether the focus of compression tends toward the intended saccadic target or at the endpoint of the actual (adapted) movement. We report two major results. First, that peri-saccadic focus of the compression did not occur at the site of the initial saccadic target, but tended toward the actual landing site of the saccade. Second, and more surprisingly, we observed a large long-term perceptual distortion of space, lasting for hundreds of milliseconds. This distortion did not occur over the whole visual field but was limited to a local region of visual space around the saccade target, suggesting that saccadic adaptation induces a visuo-topic remapping of space. The results imply that the mechanisms controlling saccadic adaptation also affect perception of space and point to a strong perceptual plasticity coordinated with the well-documented plasticity of the motor system.

Perisaccadic perception of continuous flickers

To realize perceptual space constancy, the visual system compensates for the retinal displacement caused by eye movements. It has been reported that the compensation process does not function perfectly around the time of a saccade--a perisaccadic flash is systematically mislocalized. However, observations made with transient flash stimuli do not necessarily indicate a general perisaccadic failure of space constancy. To investigate how the visual system realizes perisaccadic space constancy for continuous stimuli, we examined the time course of localization for a perisaccadic 500 Hz flicker with systematic variation of the onset timing, the offset timing and the duration. If each flash in the flicker is localized individually in the same way as a single flash, the apparent position and length of the flicker should be predicted from the time course of mislocalization of a perisaccadic flash. However, the results did not support this prediction in many respects. A dot array (of half the length of the retinal image) was perceived when the flicker was presented during a saccade, while only a single dot was perceived when the flicker was presented only before or after the saccade. A flash in a flicker was localized at a different position, depending on the onset timing, the offset timing and the duration of the flicker, even if the flash was presented at the same timing to the saccade. In general, our results support a two-stage localization in which the local geometrical configuration is first generated primarily based on the retinal information, and then localized as a whole in the egocentric or exocentric space. The localization is based on the eye position signal sampled at a time temporally distant from the saccade, which enables precise localization and space constancy for continuous stimuli.

Vestibular memory-contingent whole-body return: brave exocentered dancers

A whole-body, self-driven return from passive rotation (90 degrees to 270 degrees ) test was executed by male and female subjects, and by professional female ballet dancers. To accomplish the return task, subjects were free to use the egocentered reference frame (inversion) or the exocentered one (completion). The results show that with inversion all kinetic parameters were reproduced, whereas the completion performance was highly variable. Although inversion was the default strategy, female subjects used more completions than male subjects, and female dancers still more, although not more accurately. The high variability noted in completion shows a deficiency in integrating vestibular signals for updating the egocentric representation of an external target during passive body rotations, even in dancers. Furthermore, with completions after 180 degrees stimuli, the results suggest that both ego- and exocentered reference frames cannot be used simultaneously.

Contrast dependency of sacadic compression and suppression

In the occurrence of a saccadic eye movement vision becomes suppressed. Supra-threshold visual stimuli that are briefly presented at that time become perceptually compressed towards the saccade target (saccadic compression) and shifted in saccade direction (saccadic shift). We show that the strength of saccadic compression, like the strength of saccadic suppression, varies with stimulus contrast. Low contrast stimuli lead to stronger compression than high contrast stimuli. The similarity of contrast dependence and time course suggests that saccadic compression is related to saccadic suppression. Because the saccadic shift did not depend on contrast we suggest that shift and compression are different effects.

Perception, action, and Roelofs effect: a mere illusion of dissociation

A prominent and influential hypothesis of vision suggests the existence of two separate visual systems within the brain, one creating our perception of the world and another guiding our actions within it. The induced Roelofs effect has been described as providing strong evidence for this perception/action dissociation: When a small visual target is surrounded by a large frame positioned so that the frame's center is offset from the observer's midline, the perceived location of the target is shifted in the direction opposite the frame's offset. In spite of this perceptual mislocalization, however, the observer can accurately guide movements to the target location. Thus, perception is prone to the illusion while actions seem immune. Here we demonstrate that the Roelofs illusion is caused by a frame-induced transient distortion of the observer's apparent midline. We further demonstrate that actions guided to targets within this same distorted egocentric reference frame are fully expected to be accurate, since the errors of target localization will exactly cancel the errors of motor guidance. These findings provide a mechanistic explanation for the various perceptual and motor effects of the induced Roelofs illusion without requiring the existence of separate neural systems for perception and action. Given this, the behavioral dissociation that accompanies the Roelofs effect cannot be considered evidence of a dissociation of perception and action. This indicates a general need to re-evaluate the broad class of evidence purported to support this hypothesized dissociation.

Paul Dassonville and Jagdeep Bala challenge a prominent hypothesis that proposes the existence of two separate visual systems within the brain, one creating perception and the other guiding action

Programming of double-step saccade sequences: modulation by cognitive control

The capacity to detect and correct errors is thought to engage cognitive control. To probe the nature of such control in relation to eye movements, subjects performed a double-step task under different instructions: to FOLLOW the appearance of successive targets; or to cancel the initial saccade and REDIRECT gaze to the final target location. Saccade sequences occurred in the FOLLOW and REDIRECT conditions where they represented correct and corrective behaviour, respectively. We observed that corrective responses were faster than correct responses, and concurrent preparation of saccades was facilitated during error correction. These results are consistent with psychological theories that posit supervisory cognitive control over action during error correction.

Extrinsic cues suppress the encoding of intrinsic cues

Remembering where objects are in space is fundamental to adaptive behavior. Little is known about how intact humans combine information from intrinsic (egocentric) and extrinsic (exocentric, allocentric, or landmark-based) coordinate systems to locate objects. Using a simple location estimation paradigm, this study finds that we mostly remember position in extrinsic coordinates. Intrinsic-coordinate-based mapping of space is less precise in the presence of landmarks or extrinsic cues than in their absence. Thus, not only do extrinsic frames of reference dominate internal representations of space, they suppress intrinsic-based representations as well. We speculate that this dominance-suppression hierarchy undercuts intersystem conflicts and underlies a single, undissociated spatial map in intact humans.

Perception of visual space at the time of pro- and anti-saccades

The localization of peri-saccadically flashed objects shows two types of errors: first, a uniform shift in saccade direction, and second, a compression of visual space around the saccade target. Whereas the uniform shift occurs when the experiment is performed in complete darkness compression occurs when additional visual references are available. Thus peri-saccadic mislocalization contains motor and visual components. To distinguish between both factors we compared peri-saccadic localization errors during pro- and anti-saccades. In the case of anti-saccades, the visual cue that elicits the saccade and the actual eye movement are in opposite directions. We asked whether peri-saccadic compression can be observed with anti-saccades, and if so, whether the compression is directed toward the visual cue or follows the actual eye movement. In blocked trials, subjects performed saccades either toward a visual cue (pro-saccade) or to the mirrored position opposite to a visual cue (anti-saccade). Peri-saccadically, we flashed a thin vertical bar at one of four possible locations. Subjects had to indicate the perceived position of the bar with a mouse pointer about 500 ms after the saccade. Experiments were performed in complete darkness and with visual references. Peri-saccadic mislocalizations occurred during anti-saccades. The mislocalizations were very similar for pro- and anti-saccades in magnitude and direction. For both, pro- and anti-saccades, mislocalizations were directed toward the actual eye movement and not the visual cue.

Brain representation of object-centered space in monkeys and humans

Visuospatial cognition requires taking into account where things are relative to each other and not just relative to the viewer. Consequently it would make sense for the brain to form an explicit representation of object-centered and not just of ego-centered space. Evidence bearing on the presence and nature of neural maps of object-centered space has come from two sources: single-neuron recording in behaving monkeys and assessment of the visual abilities of human patients with hemispatial neglect. Studies of the supplementary eye field of the monkey have revealed that it contains neurons with object-centered spatial selectivity. These neurons fire when the monkey has selected, as target for an eye movement or attention, a particular location defined relative to a reference object. Studies of neglect have revealed that in some patients the condition is expressed with respect to an object-centered and object-aligned reference frame. These patients neglect one side of an object, as defined relative to its intrinsic midline, regardless of its location and orientation relative to the viewer. The two sets of observations are complementary in the sense that the loss of neurons, such as observed in the monkey, could explain the spatial distribution of neglect in these patients.

Spatial localization precedes temporal determination in visual perception

The temporal order of two spots of light successively appearing in the dark, just before a saccade, influences their perceived spatial relation. Both spots are mislocalized in the saccade direction--the second more so than the first--because mislocalization grows as time elapses from stimulus to saccade onset. On the other hand, the perceived order of the two spots may be altered if the second spot is at the focus of spatial attention. How would these illusory perceptions of space and time interact when they are brought to play together? Could they be independent or could one perception depend on the other? Here we show that perceived location of stimuli is not affected by illusory temporal order, whereas perceived temporal order is affected by misperceived location. The results suggest that the brain processes spatial location of visual stimuli before processing their temporal order.

The time course of perisaccadic receptive field shifts in the lateral intraparietal area of the monkey

Neurons in the lateral intraparietal area of the monkey (LIP) have visual receptive fields in retinotopic coordinates when studied in a fixation task. However, in the period immediately surrounding a saccade these receptive fields often shift, so that a briefly flashed stimulus outside the receptive field will drive the neurons if the eye movement will bring the spatial location of that vanished stimulus into the receptive field. This is equivalent to a transient shift of the retinal receptive field. The process enables the monkey brain to process a stimulus in a spatially accurate manner after a saccade, even though the stimulus appeared only before the saccade. We studied the time course of this receptive field shift by flashing a task-irrelevant stimulus for 100 ms before, during, or after a saccade. The stimulus could appear in receptive field as defined by the fixation before the saccade (the current receptive field) or the receptive field as defined by the fixation after the saccade (the future receptive field). We recorded the activity of 48 visually responsive neurons in LIP of three hemispheres of two rhesus monkeys. We studied 45 neurons in the current receptive field task, in which the saccade removed the stimulus from the receptive field. Of these neurons 29/45 (64%) showed a significant decrement of response when the stimulus appeared 250 ms or less before the saccade, as compared with their activity during fixation. The average response decrement was 38% for those cells showing a significant (P < 0.05 by t-test) decrement. We studied 39 neurons in the future receptive field task, in which the saccade brought the spatial location of a recently vanished stimulus into the receptive field. Of these 32/39 (82%) had a significant response to stimuli flashed for 100 ms in the future receptive field, even 400 ms before the saccade. Neurons never responded to stimuli moved by the saccade from a point outside the receptive field to another point outside the receptive field. Neurons did not necessarily show any saccadic suppression for stimuli moved from one part of the receptive field to another by the saccade. Stimuli flashed <250 ms before the saccade-evoked responses in both the presaccadic and the postsaccadic receptive fields, resulting in an increase in the effective receptive field size, an effect that we suggest is responsible for perisaccadic perceptual inaccuracies.

Reference frames in reading: evidence from visually and memory-guided saccades

In order to examine the frames of reference used for the planning of inter- and intra-word saccades, subjects were required to execute a two-saccade sequence toward one or two words. The first saccade was visually guided while the second saccade was visually or memory-guided. Results demonstrate that readers hold an internal representation of the target word in at least two different reference frames that are specific to the action to be performed: to aim for a new target word or to read it over with a second fixation. When a word is selected as a target for the next saccade, the spatial location of the second word is stored in memory. Then, the second saccade is updated with respect to the current eye position in the first word in order to aim a functional target location in the second word that is the word's center. When the second saccade is directed within the fixated word, the saccadic system uses the intrinsic features of the word to code a fixed-motor vector relative to the word's length. Our present results demonstrate that readers hold an internal representation of the saccade target in different reference frames specific to the action performed on the word.

Through the eye, slowly: delays and localization errors in the visual system

Reviews on the visual system generally praise its amazing performance. Here we deal with its biggest weakness: sluggishness. Inherent delays lead to mislocalization when things move or, more generally, when things change. Errors in time translate into spatial errors when we pursue a moving object, when we try to localize a target that appears just before a gaze shift, or when we compare the position of a flashed target with the instantaneous position of a continuously moving one (or one that appears to be moving even though no change occurs in the retinal image). Studying such diverse errors might rekindle our thinking about how the brain copes with real-time changes in the world.

Effects of inter-stimulus interval on perceived locations of successively flashed perisaccadic stimuli

We investigated the perceived locations of two stimuli flashed successively near the time of saccade execution in a dark room. The inter-stimulus interval (ISI) between the flashes ranged from 80 to 240 ms. The results show that when the ISI was 120 ms or shorter, perceived locations of the flashes interacted with each other so that the perceived distance between them was equal to the distance between these flashes on the retina. When the ISI was 240 ms, this interaction was weak. These results suggest two hypotheses. Firstly, the relation of retinal locations of flashes is a strong cue for perceiving the flash locations when the ISI is shorter than about 120 ms.Secondly, the process of perceiving or memorizing a flash location requires some time. Therefore, the perceived location of the succeeding flash affects that of the preceding flash when the ISI as shorter than about 120 ms.

Apparent size of an object remains uncompressed during presaccadic compression of visual space

It is well known that compression of visual space occurs near the saccade goal when visual stimuli are briefly flashed at various locations on a visual reference just before a saccade. We investigated how presaccadic compression of visual space affected the apparent size of an object. In the first experiment, subjects were instructed to report the apparent number of multiple bars briefly presented around the time of saccade onset. The reported number of four bars began to decline at the 50 ms mark before a saccade and reached a minimum near the saccade onset. This confirms that the compression of visual space occurs just before saccades. In the second experiment, subjects judged the apparent width of a rectangle (a single element) or four bars (four elements) presented just before saccades. The apparent width of the four-bar stimulus was compressed just before saccades, but that of the rectangle stimulus was not compressed. Experiment 3 shows that the width compression of the four-bar stimulus is consistent with the width change predicted by compression of position. These findings indicate that the shape of a single object is not distorted at the saccade goal during presaccadic compression of visual space. In addition, experiment 4 indicates that the apparent width of a flashed stimulus just before saccades depends on the processing of global shape. This extends the definition of a visual object during presaccadic compression of visual space to not only a solid element but also a constellation of multiple elements. Furthermore, the results from these experiments suggest that presaccadic compression of visual space does not prevent object recognition underlying an attentional mechanism in generating saccadic eye movements.

Eye-hand coordination in object manipulation

We analyzed the coordination between gaze behavior, fingertip movements, and movements of the manipulated object when subjects reached for and grasped a bar and moved it to press a target-switch. Subjects almost exclusively fixated certain landmarks critical for the control of the task. Landmarks at which contact events took place were obligatory gaze targets. These included the grasp site on the bar, the target, and the support surface where the bar was returned after target contact. Any obstacle in the direct movement path and the tip of the bar were optional landmarks. Subjects never fixated the hand or the moving bar. Gaze and hand/bar movements were linked concerning landmarks, with gaze leading. The instant that gaze exited a given landmark coincided with a kinematic event at that landmark in a manner suggesting that subjects monitored critical kinematic events for phasic verification of task progress and subgoal completion. For both the obstacle and target, subjects directed saccades and fixations to sites that were offset from the physical extension of the objects. Fixations related to an obstacle appeared to specify a location around which the extending tip of the bar should travel. We conclude that gaze supports hand movement planning by marking key positions to which the fingertips or grasped object are subsequently directed. The salience of gaze targets arises from the functional sensorimotor requirements of the task. We further suggest that gaze control contributes to the development and maintenance of sensorimotor correlation matrices that support predictive motor control in manipulation.