Saccadic modulation of neural responses: possible roles in saccadic suppression, enhancement, and time compression

Oculomotor behavior can be adjusted on the basis of artificial feedback signals indicating externally caused errors

Whether a saccade is accurate and has reached the target cannot be evaluated during its execution, but relies on post-saccadic feedback. If the eye has missed the target object, a secondary corrective saccade has to be made to align the fovea with the target. If a systematic post-saccadic error occurs, adaptive changes to the oculomotor behavior are made, such as shortening or lengthening the saccade amplitude. Systematic post-saccadic errors are typically attributed internally to erroneous motor commands. The corresponding adaptive changes to the motor command reduce the error and the need for secondary corrective saccades, and, in doing so, restore accuracy and efficiency. However, adaptive changes to the oculomotor behavior also occur if a change in saccade amplitude is beneficial for task performance, or if it is rewarded. Oculomotor learning thus is more complex than reducing a post-saccadic position error. In the current study, we used a novel oculomotor learning paradigm and investigated whether human participants are able to adapt their oculomotor behavior to improve task performance even when they attribute the error externally. The task was to indicate the intended target object among several objects to a simulated human-machine interface by making eye movements. The participants were informed that the system itself could make errors. The decoding process depended on a distorted landing point of the saccade, resulting in decoding errors. Two different types of visual feedback were added to the post-saccadic scene and we compared how participants used the different feedback types to adjust their oculomotor behavior to avoid errors. We found that task performance improved over time, regardless of the type of feedback. Thus, error feedback from the simulated human-machine interface was used for post-saccadic error evaluation. This indicates that 1) artificial visual feedback signals and 2) externally caused errors might drive adaptive changes to oculomotor behavior.

Saccadic modulation of neural excitability in auditory areas of the neocortex

In natural "active" vision, humans and other primates use eye movements (saccades) to sample bits of information from visual scenes. In the visual cortex, non-retinal signals linked to saccades shift visual cortical neurons into a high excitability state as each saccade ends. The extent of this saccadic modulation outside of the visual system is unknown. Here, we show that during natural viewing, saccades modulate excitability in numerous auditory cortical areas with a temporal pattern complementary to that seen in visual areas. Control somatosensory cortical recordings indicate that the temporal pattern is unique to auditory areas. Bidirectional functional connectivity patterns suggest that these effects may arise from regions involved in saccade generation. We propose that by using saccadic signals to yoke excitability states in auditory areas to those in visual areas, the brain can improve information processing in complex natural settings.

Suppression without inhibition: how retinal computation contributes to saccadic suppression

Visual perception remains stable across saccadic eye movements, despite the concurrent strongly disruptive visual flow. This stability is partially associated with a reduction in visual sensitivity, known as saccadic suppression, which already starts in the retina with reduced ganglion cell sensitivity. However, the retinal circuit mechanisms giving rise to such suppression remain unknown. Here, we describe these mechanisms using electrophysiology in mouse, pig, and macaque retina, 2-photon calcium imaging, computational modeling, and human psychophysics. We find that sequential stimuli, like those that naturally occur during saccades, trigger three independent suppressive mechanisms in the retina. The main mechanism is triggered by contrast-reversing sequential stimuli and originates within the receptive field center of ganglion cells. It does not involve inhibition or other known suppressive mechanisms like saturation or adaptation. Instead, it relies on temporal filtering of the inherently slow response of cone photoreceptors coupled with downstream nonlinearities. Two further mechanisms of suppression are present predominantly in ON ganglion cells and originate in the receptive field surround, highlighting another disparity between ON and OFF ganglion cells. The mechanisms uncovered here likely play a role in shaping the retinal output following eye movements and other natural viewing conditions where sequential stimulation is ubiquitous.

Motor-related signals support localization invariance for stable visual perception

Our ability to perceive a stable visual world in the presence of continuous movements of the body, head, and eyes has puzzled researchers in the neuroscience field for a long time. We reformulated this problem in the context of hierarchical convolutional neural networks (CNNs)-whose architectures have been inspired by the hierarchical signal processing of the mammalian visual system-and examined perceptual stability as an optimization process that identifies image-defining features for accurate image classification in the presence of movements. Movement signals, multiplexed with visual inputs along overlapping convolutional layers, aided classification invariance of shifted images by making the classification faster to learn and more robust relative to input noise. Classification invariance was reflected in activity manifolds associated with image categories emerging in late CNN layers and with network units acquiring movement-associated activity modulations as observed experimentally during saccadic eye movements. Our findings provide a computational framework that unifies a multitude of biological observations on perceptual stability under optimality principles for image classification in artificial neural networks.

A sensory memory to preserve visual representations across eye movements

Saccadic eye movements (saccades) disrupt the continuous flow of visual information, yet our perception of the visual world remains uninterrupted. Here we assess the representation of the visual scene across saccades from single-trial spike trains of extrastriate visual areas, using a combined electrophysiology and statistical modeling approach. Using a model-based decoder we generate a high temporal resolution readout of visual information, and identify the specific changes in neurons' spatiotemporal sensitivity that underly an integrated perisaccadic representation of visual space. Our results show that by maintaining a memory of the visual scene, extrastriate neurons produce an uninterrupted representation of the visual world. Extrastriate neurons exhibit a late response enhancement close to the time of saccade onset, which preserves the latest pre-saccadic information until the post-saccadic flow of retinal information resumes. These results show how our brain exploits available information to maintain a representation of the scene while visual inputs are disrupted.

During natural viewing, neural processing of visual targets continues throughout saccades

Relatively little is known about visual processing during free-viewing visual search in realistic dynamic environments. Free-viewing is characterized by frequent saccades. During saccades, visual processing is thought to be suppressed, yet we know that the presaccadic visual content can modulate postsaccadic processing. To better understand these processes in a realistic setting, we study here saccades and neural responses elicited by the appearance of visual targets in a realistic virtual environment. While subjects were being driven through a 3D virtual town, they were asked to discriminate between targets that appear on the road. Using a system identification approach, we separated overlapping and correlated activity evoked by visual targets, saccades, and button presses. We found that the presence of a target enhances early occipital as well as late frontocentral saccade-related responses. The earlier potential, shortly after 125 ms post-saccade onset, was enhanced for targets that appeared in the peripheral vision as compared to the central vision, suggesting that fast peripheral processing initiated before saccade onset. The later potential, at 195 ms post-saccade onset, was strongly modulated by the visibility of the target. Together these results suggest that, during natural viewing, neural processing of the presaccadic visual stimulus continues throughout the saccade, apparently unencumbered by saccadic suppression.

Selective postsaccadic enhancement of motion perception

Saccadic eye movements can drastically affect motion perception: during saccades, the stationary surround is swept rapidly across the retina and contrast sensitivity is suppressed. However, after saccades, contrast sensitivity is enhanced for color and high-spatial frequency stimuli and reflexive tracking movements known as ocular following responses (OFR) are enhanced in response to large field motion. Additionally, OFR and postsaccadic enhancement of neural activity in primate motion processing areas are well correlated. It is not yet known how this postsaccadic enhancement arises. Therefore, we tested if the enhancement can be explained by changes in the balance of centre-surround antagonism in motion processing, where spatial summation is favoured at low contrasts and surround suppression is favoured at high contrasts. We found motion perception was selectively enhanced immediately after saccades for high spatial frequency stimuli, consistent with previously reported selective postsaccadic enhancement of contrast sensitivity for flashed high spatial frequency stimuli. The observed enhancement was also associated with changes in spatial summation and suppression, as well as contrast facilitation and inhibition, suggesting that motion processing is augmented to maximise visual perception immediately after saccades. The results highlight that spatial and contrast properties of underlying neural mechanisms for motion processing can be affected by an antecedent saccade for highly detailed stimuli and are in line with studies that show behavioural and neuronal enhancement of motion processing in non-human primates.

Intrasaccadic motion streaks jump-start gaze correction

Rapid eye movements (saccades) incessantly shift objects across the retina. To establish object correspondence, the visual system is thought to match surface features of objects across saccades. Here, we show that an object's intrasaccadic retinal trace-a signal previously considered unavailable to visual processing-facilitates this match making. Human observers made saccades to a cued target in a circular stimulus array. Using high-speed visual projection, we swiftly rotated this array during the eyes' flight, displaying continuous intrasaccadic target motion. Observers' saccades landed between the target and a distractor, prompting secondary saccades. Independently of the availability of object features, which we controlled tightly, target motion increased the rate and reduced the latency of gaze-correcting saccades to the initial presaccadic target, in particular when the target's stimulus features incidentally gave rise to efficient motion streaks. These results suggest that intrasaccadic visual information informs the establishment of object correspondence and jump-starts gaze correction.

Perisaccadic encoding of temporal information in macaque area V4

The accurate processing of temporal information is of critical importance in everyday life. Yet, psychophysical studies in humans have shown that the perception of time is distorted around saccadic eye movements. The neural correlates of this misperception are still poorly understood. Behavioral and neural evidence suggest that it is tightly linked to other known perisaccadic modulations of visual perception. To further our understanding of how temporal processing is affected by saccades, we studied the representations of brief visual time intervals during fixation and saccades in area V4 of two awake macaques. We presented random sequences of vertical bar stimuli and extracted neural responses to double-pulse stimulation at varying interstimulus intervals. Our results show that temporal information about very brief intervals of as brief as 20 ms is reliably represented in the multiunit activity in area V4. Response latencies were not systematically modulated by the saccade. However, a general increase in perisaccadic activity altered the ratio of response amplitudes within stimulus pairs compared with fixation. In line with previous studies showing that the perception of brief time intervals is partly based on response levels, this may be seen as a possible correlate of the perisaccadic misperception of time.NEW & NOTEWORTHY We investigated for the first time how temporal information on very brief timescales is represented in area V4 around the time of saccadic eye movements. Overall, the responses showed an unexpectedly precise representation of time intervals. Our finding of a perisaccadic modulation of relative response amplitudes introduces a new possible correlate of saccade-related perceptual distortions of time.

CorrNet: Fine-Grained Emotion Recognition for Video Watching Using Wearable Physiological Sensors

Recognizing user emotions while they watch short-form videos anytime and anywhere is essential for facilitating video content customization and personalization. However, most works either classify a single emotion per video stimuli, or are restricted to static, desktop environments. To address this, we propose a correlation-based emotion recognition algorithm (CorrNet) to recognize the valence and arousal (V-A) of each instance (fine-grained segment of signals) using only wearable, physiological signals (e.g., electrodermal activity, heart rate). CorrNet takes advantage of features both inside each instance (intra-modality features) and between different instances for the same video stimuli (correlation-based features). We first test our approach on an indoor-desktop affect dataset (CASE), and thereafter on an outdoor-mobile affect dataset (MERCA) which we collected using a smart wristband and wearable eyetracker. Results show that for subject-independent binary classification (high-low), CorrNet yields promising recognition accuracies: 76.37% and 74.03% for V-A on CASE, and 70.29% and 68.15% for V-A on MERCA. Our findings show: (1) instance segment lengths between 1–4 s result in highest recognition accuracies (2) accuracies between laboratory-grade and wearable sensors are comparable, even under low sampling rates (≤64 Hz) (3) large amounts of neutral V-A labels, an artifact of continuous affect annotation, result in varied recognition performance.

Action-induced changes in the perceived temporal features of visual events

Perceived duration can be subject to deviations around the time of a voluntary action. Whether the mechanisms underlying action-induced visual duration effects are effector-specific or require a more generalized action-linked multimodal calibration with the transient visual system, however, is a question yet to be answered. Here, we investigate this using dynamic visual stimuli presented as contingent upon the execution of an arbitrarily associated voluntary manual response. Our results demonstrate that the duration of intervals with arbitrarily associated keypress-visual event pair is perceived as shorter than the duration in a pure visual condition, where the same stimuli are rather passively observed without the execution of a concurrent action. Whereas the control experiments show that motor memory and attention cannot explain the action-induced changes in perceived temporal features, action-induced changes in perceived speed are dissociated from those in perceived duration, and that the duration compression disappears using isoluminant or static stimuli, which together provide evidence that these two effects can be modulated in the motion-processing units, although via separate neural mechanisms.

Visual feature tuning of superior colliculus neural reafferent responses after fixational microsaccades

The primate superior colliculus (SC) is causally involved in microsaccade generation. Moreover, visually responsive SC neurons across this structure's topographic map, even at peripheral eccentricities much larger than the tiny microsaccade amplitudes, exhibit significant modulations of evoked response sensitivity when stimuli appear perimicrosaccadically. However, during natural viewing, visual stimuli are normally stably present in the environment and are only shifted on the retina by eye movements. Here we investigated this scenario for the case of microsaccades, asking whether and how SC neurons respond to microsaccade-induced image jitter. We recorded neural activity from two male rhesus macaque monkeys. Within the response field (RF) of a neuron, there was a stable stimulus consisting of a grating of one of three possible spatial frequencies. The grating was stable on the display, but microsaccades periodically jittered the retinotopic RF location over it. We observed clear short-latency visual reafferent responses after microsaccades. These responses were weaker, but earlier (relative to new fixation onset after microsaccade end), than responses to sudden stimulus onsets without microsaccades. The reafferent responses clearly depended on microsaccade amplitude as well as microsaccade direction relative to grating orientation. Our results indicate that one way for microsaccades to influence vision is through modulating how the spatio-temporal landscape of SC visual neural activity represents stable stimuli in the environment. Such representation depends on the specific pattern of temporal luminance modulations expected from the relative relationship between eye movement vector (size and direction) on one hand and spatial visual pattern layout on the other.NEW & NOTEWORTHY Despite being diminutive, microsaccades still jitter retinal images. We investigated how such jitter affects superior colliculus (SC) activity. We found that SC neurons exhibit short-latency visual reafferent bursts after microsaccades. These bursts reflect not only the spatial luminance profiles of visual patterns but also how such profiles are shifted by eye movement size and direction. These results indicate that the SC continuously represents visual patterns, even as they are jittered by the smallest possible saccades.

Perceptual saccadic suppression starts in the retina

Visual sensitivity, probed through perceptual detectability of very brief visual stimuli, is strongly impaired around the time of rapid eye movements. This robust perceptual phenomenon, called saccadic suppression, is frequently attributed to active suppressive signals that are directly derived from eye movement commands. Here we show instead that visual-only mechanisms, activated by saccade-induced image shifts, can account for all perceptual properties of saccadic suppression that we have investigated. Such mechanisms start at, but are not necessarily exclusive to, the very first stage of visual processing in the brain, the retina. Critically, neural suppression originating in the retina outlasts perceptual suppression around the time of saccades, suggesting that extra-retinal movement-related signals, rather than causing suppression, may instead act to shorten it. Our results demonstrate a far-reaching contribution of visual processing mechanisms to perceptual saccadic suppression, starting in the retina, without the need to invoke explicit motor-based suppression commands.

Saccadic suppression is frequently attributed to active suppressive signals derived from eye movement commands. Here, the authors show that visual-only mechanisms starting in the retina can account for perceptual saccadic suppression properties without the need for motor-based suppression commands.

Saccades and driving

Driving is not only a physical task, but is also a mental task. Visual inputs are indispensable in scanning the road, communicating with other road users and monitoring in-vehicle devices. The probability to detect an object while driving (conspicuity) is very important for assessment of driving effectiveness, and correct choice of information relevant to the safety of driving determines the efficiency of a driver. Accordingly, eye fixation and eye movements are essential for attention and choice in decision making. Saccades are the most used and effective means of maintaining a correct fixation while driving. In order to identify the features of the most predisposed subjects at high driving performances and those of the high-level sportsmen, we used a special tool called Visual Exploration Training System. We evaluated by saccade and attentional tests various groups of ordinary drivers, past professional racing drivers, professional truck drivers and professional athletes. Males have faster reaction time compared to females and an age below 30 seems to guarantee better precision of performance and accuracy in achieving all visual targets. The effect on physical activity and sports is confirmed. The performances of the Ferrari Driver Academy (FDA) selected students who were significantly better than those of a group of aspiring students and amateur racing drivers probably thanks to individual predisposition, training and so-called ‘neural efficiency’.

Neuronal Representation of the Saccadic Timing Signals in Macaque Lateral Intraparietal Area

Primates frequently make saccades direct fovea on interesting objects to receive acute visual information. However, saccade displaces the images on retina and disrupts the visual constancy. One possible mechanism to retain visual constancy is by integrating the presaccadic and postsaccadic visual information right at the time of saccade, which makes the timing of saccade crucial. So far, the saccadic timing signals have been found only in the subcortical regions, for example, the cerebellum and superior colliculus, but not in the neocortex. Here we report 2 types of saccadic timing signals in macaque lateral intraparietal area (LIP). First, many presaccadic response neurons started to decline activity either right around the start (saccade-on-decay) or the end (saccade-off-decay) of saccades. Notably, the time difference between saccade-off-decay and saccade-on-decay was highly correlated with the mean duration of saccades but not with the individual ones, and both saccade-off-decay and saccade-on-decay were better aligned with saccade end than saccade start-reflecting prediction. Second, the peak activity plateau of a group of postsaccadic response neurons was highly correlated with the actual duration of saccade-reflecting reality. While the predicted timing signals might facilitate the integration of visual information across saccades in LIP, the actual duration signals might calibrate the prediction errors.

Characterizing and dissociating multiple time-varying modulatory computations influencing neuronal activity

In many brain areas, sensory responses are heavily modulated by factors including attentional state, context, reward history, motor preparation, learned associations, and other cognitive variables. Modelling the effect of these modulatory factors on sensory responses has proven challenging, mostly due to the time-varying and nonlinear nature of the underlying computations. Here we present a computational model capable of capturing and dissociating multiple time-varying modulatory effects on neuronal responses on the order of milliseconds. The model’s performance is tested on extrastriate perisaccadic visual responses in nonhuman primates. Visual neurons respond to stimuli presented around the time of saccades differently than during fixation. These perisaccadic changes include sensitivity to the stimuli presented at locations outside the neuron’s receptive field, which suggests a contribution of multiple sources to perisaccadic response generation. Current computational approaches cannot quantitatively characterize the contribution of each modulatory source in response generation, mainly due to the very short timescale on which the saccade takes place. In this study, we use a high spatiotemporal resolution experimental paradigm along with a novel extension of the generalized linear model framework (GLM), termed the sparse-variable GLM, to allow for time-varying model parameters representing the temporal evolution of the system with a resolution on the order of milliseconds. We used this model framework to precisely map the temporal evolution of the spatiotemporal receptive field of visual neurons in the middle temporal area during the execution of a saccade. Moreover, an extended model based on a factorization of the sparse-variable GLM allowed us to disassociate and quantify the contribution of individual sources to the perisaccadic response. Our results show that our novel framework can precisely capture the changes in sensitivity of neurons around the time of saccades, and provide a general framework to quantitatively track the role of multiple modulatory sources over time.

The sensory responses of neurons in many brain areas, particularly those in higher prefrontal or parietal areas, are strongly influenced by factors including task rules, attentional state, context, reward history, motor preparation, learned associations, and other cognitive variables. These modulations often occur in combination, or on fast timescales which present a challenge for both experimental and modelling approaches aiming to describe the underlying mechanisms or computations. Here we present a computational model capable of capturing and dissociating multiple time-varying modulatory effects on spiking responses on the order of milliseconds. The model’s performance is evaluated by testing its ability to reproduce and dissociate multiple changes in visual sensitivity occurring in extrastriate visual cortex around the time of rapid eye movements. No previous model is capable of capturing these changes with as fine a resolution as that presented here. Our model both provides specific insight into the nature and time course of changes in visual sensitivity around the time of eye movements, and offers a general framework applicable to a wide variety of contexts in which sensory processing is modulated dynamically by multiple time-varying cognitive or behavioral factors, to understand the neuronal computations underpinning these modulations and make predictions about the underlying mechanisms.

Modulation of local field potentials and neuronal activity in primate hippocampus during saccades

Primates use saccades to gather information about objects and their relative spatial arrangement, a process essential for visual perception and memory. It has been proposed that signals linked to saccades reset the phase of local field potential (LFP) oscillations in the hippocampus, providing a temporal window for visual signals to activate neurons in this region and influence memory formation. We investigated this issue by measuring hippocampal LFPs and spikes in two macaques performing different tasks with unconstrained eye movements. We found that LFP phase clustering (PC) in the alpha/beta (8-16 Hz) frequencies followed foveation onsets, while PC in frequencies lower than 8 Hz followed spontaneous saccades, even on a homogeneous background. Saccades to a solid grey background were not followed by increases in local neuronal firing, whereas saccades toward appearing visual stimuli were. Finally, saccade parameters correlated with LFPs phase and amplitude: saccade direction correlated with delta (≤4 Hz) phase, and saccade amplitude with theta (4-8 Hz) power. Our results suggest that signals linked to saccades reach the hippocampus, producing synchronization of delta/theta LFPs without a general activation of local neurons. Moreover, some visual inputs co-occurring with saccades produce LFP synchronization in the alpha/beta bands and elevated neuronal firing. Our findings support the hypothesis that saccade-related signals enact sensory input-dependent plasticity and therefore memory formation in the primate hippocampus.

Saccadic suppression measured by steady-state visual evoked potentials

Visual sensitivity is severely impaired during the execution of saccadic eye movements. This phenomenon has been extensively characterized in human psychophysics and nonhuman primate single-neuron studies, but a physiological characterization in humans is less established. Here, we used a method based on steady-state visually evoked potential (SSVEP), an oscillatory brain response to periodic visual stimulation, to examine how saccades affect visual sensitivity. Observers made horizontal saccades back and forth, while horizontal black-and-white gratings flickered at 5-30 Hz in the background. We analyzed EEG epochs with a length of 0.3 s either centered at saccade onset (saccade epochs) or centered at fixations half a second before the saccade (fixation epochs). Compared with fixation epochs, saccade epochs showed a broadband power increase, which most likely resulted from saccade-related EEG activity. The execution of saccades, however, led to an average reduction of 57% in the SSVEP amplitude at the stimulation frequency. This result provides additional evidence for an active saccadic suppression in the early visual cortex in humans. Compared with previous functional MRI and EEG studies, an advantage of this approach lies in its capability to trace the temporal dynamics of neural activity throughout the time course of a saccade. In contrast to previous electrophysiological studies in nonhuman primates, we did not find any evidence for postsaccadic enhancement, even though simulation results show that our method would have been able to detect it. We conclude that SSVEP is a useful technique to investigate the neural correlates of visual perception during saccadic eye movements in humans. NEW & NOTEWORTHY We make fast ballistic saccadic eye movements a few times every second. At the time of saccades, visual sensitivity is severely impaired. The present study uses steady-state visually evoked potentials to reveal a neural correlate of the fine temporal dynamics of these modulations at the time of saccades in humans. We observed a strong reduction (57%) of visually driven neural activity associated with saccades but did not find any evidence for postsaccadic enhancement.

Dynamic Changes in Cortical Effective Connectivity Underlie Transsaccadic Integration in Humans

Due to saccadic eye movements the retinal image is abruptly displaced 2-4 times a second, yet we experience a stable and continuous stream of vision. It is known that saccades modulate neural processing in various local brain areas, but the question of how saccades influence neural communication between different areas in the thalamo-cortical system has remained unanswered. By combining transcranial magnetic stimulation with electroencephalography, we found that saccades were accompanied by dynamic changes in causal communication between different brain areas in humans. These changes were anticipatory; they began before the actual eye movement. Compared with fixation, communication between posterior cortical areas was first briefly enhanced during saccades, but subsequently peri-saccadic information did not ignite sustained activity in fronto-parietal cortices. This suggests that the brain constructs a spatially stable and temporally continuous stream of conscious vision from discrete fixations by restricting the access of peri-saccadic visual information to sustained processing in fronto-parietal cortices.

Selective modulation of visual sensitivity during fixation

During periods of steady fixation, we make small-amplitude ocular movements, termed microsaccades, at a rate of 1–2 every second. Early studies provided evidence that visual sensitivity is reduced during microsaccades—akin to the well-established suppression associated with larger saccades. However, the results of more recent work suggest that microsaccades may alter retinal input in a manner that enhances visual sensitivity to some stimuli. Here we parametrically varied the spatial frequency of a stimulus during a detection task and tracked contrast sensitivity as a function of time relative to microsaccades. Our data reveal two distinct modulations of sensitivity: suppression during the eye movement itself and facilitation after the eye has stopped moving. The magnitude of suppression and facilitation of visual sensitivity is related to the spatial content of the stimulus: suppression is greatest for low spatial frequencies, while sensitivity is enhanced most for stimuli of 1–2 cycles/°, spatial frequencies at which we are already most sensitive in the absence of eye movements. We present a model in which the tuning of suppression and facilitation is explained by delayed lateral inhibition between spatial frequency channels. Our data show that eye movements actively modulate visual sensitivity even during fixation: the detectability of images at different spatial scales can be increased or decreased depending on when the image occurs relative to a microsaccade.

NEW & NOTEWORTHY Given the frequency with which we make microsaccades during periods of fixation, it is vital that we understand how they affect visual processing. We demonstrate two selective modulations of contrast sensitivity that are time-locked to the occurrence of a microsaccade: suppression of low spatial frequencies during each eye movement and enhancement of higher spatial frequencies after the eye has stopped moving. These complementary changes may arise naturally because of sluggish gain control between spatial channels.

Long-term sensorimotor adaptation in the ocular following system of primates

The sudden movement of a wide-field image leads to a reflexive eye tracking response referred to as short-latency ocular following. If the image motion occurs soon after a saccade the initial speed of the ocular following is enhanced, a phenomenon known as post-saccadic enhancement. We show in macaque monkeys that repeated exposure to the same stimulus regime over a period of months leads to progressive increases in the initial speeds of ocular following. The improvement in tracking speed occurs for ocular following with and without a prior saccade. As a result of the improvement in ocular following speeds, the influence of post-saccadic enhancement wanes with increasing levels of training. The improvement in ocular following speed following repeated exposure to the same oculomotor task represents a novel form of sensori-motor learning in the context of a reflexive movement.

Distinct fMRI Responses to Self-Induced versus Stimulus Motion during Free Viewing in the Macaque

Visual motion responses in the brain are shaped by two distinct sources: the physical movement of objects in the environment and motion resulting from one's own actions. The latter source, termed visual reafference, stems from movements of the head and body, and in primates from the frequent saccadic eye movements that mark natural vision. To study the relative contribution of reafferent and stimulus motion during natural vision, we measured fMRI activity in the brains of two macaques as they freely viewed >50 hours of naturalistic video footage depicting dynamic social interactions. We used eye movements obtained during scanning to estimate the level of reafferent retinal motion at each moment in time. We also estimated the net stimulus motion by analyzing the video content during the same time periods. Mapping the responses to these distinct sources of retinal motion, we found a striking dissociation in the distribution of visual responses throughout the brain. Reafferent motion drove fMRI activity in the early retinotopic areas V1, V2, V3, and V4, particularly in their central visual field representations, as well as lateral aspects of the caudal inferotemporal cortex (area TEO). However, stimulus motion dominated fMRI responses in the superior temporal sulcus, including areas MT, MST, and FST as well as more rostral areas. We discuss this pronounced separation of motion processing in the context of natural vision, saccadic suppression, and the brain's utilization of corollary discharge signals.

SIGNIFICANCE STATEMENT

Visual motion arises not only from events in the external world, but also from the movements of the observer. For example, even if objects are stationary in the world, the act of walking through a room or shifting one's eyes causes motion on the retina. This "reafferent" motion propagates into the brain as signals that must be interpreted in the context of real object motion. The delineation of whole-brain responses to stimulus versus self-generated retinal motion signals is critical for understanding visual perception and is of pragmatic importance given the increasing use of naturalistic viewing paradigms. The present study uses fMRI to demonstrate that the brain exhibits a fundamentally different pattern of responses to these two sources of retinal motion.

Mechanisms of Saccadic Suppression in Primate Cortical Area V4

Psychophysical studies have shown that subjects are often unaware of visual stimuli presented around the time of an eye movement. This saccadic suppression is thought to be a mechanism for maintaining perceptual stability. The brain might accomplish saccadic suppression by reducing the gain of visual responses to specific stimuli or by simply suppressing firing uniformly for all stimuli. Moreover, the suppression might be identical across the visual field or concentrated at specific points. To evaluate these possibilities, we recorded from individual neurons in cortical area V4 of nonhuman primates trained to execute saccadic eye movements. We found that both modes of suppression were evident in the visual responses of these neurons and that the two modes showed different spatial and temporal profiles: while gain changes started earlier and were more widely distributed across visual space, nonspecific suppression was found more often in the peripheral visual field, after the completion of the saccade. Peripheral suppression was also associated with increased noise correlations and stronger local field potential oscillations in the α frequency band. This pattern of results suggests that saccadic suppression shares some of the circuitry responsible for allocating voluntary attention.

SIGNIFICANCE STATEMENT

We explore our surroundings by looking at things, but each eye movement that we make causes an abrupt shift of the visual input. Why doesn't the world look like a film recorded on a shaky camera? The answer in part is a brain mechanism called saccadic suppression, which reduces the responses of visual neurons around the time of each eye movement. Here we reveal several new properties of the underlying mechanisms. First, the suppression operates differently in the central and peripheral visual fields. Second, it appears to be controlled by oscillations in the local field potentials at frequencies traditionally associated with attention. These results suggest that saccadic suppression shares the brain circuits responsible for actively ignoring irrelevant stimuli.

Veridical stimulus localization is linked to human area V5/MT+ activity

How the brain represents visual space is an unsolved mystery. Spatial localization becomes particularly challenging when visual information processing is briefly disrupted, as in the case of saccadic eye movements, blinks, or visual masks. As we have recently reported, a compression of visual space, illustrated by displacements of shortly flashed stimuli, can be observed in the temporal vicinity of masking stimuli during ocular fixation (Zimmermann et al., 2013). We here aimed at investigating the neural mechanisms underlying these displacements using functional magnetic resonance imaging. On the behavioral level, we detected significant stimulus displacement when visual masks were simultaneously presented. At the neural level, we observed decreased human motion complex V5/MT+ activation associated with these displacements: When comparing trials with a perceived stimulus shift in space to trials of veridical perception of stimulus localization, human V5/MT+ was significantly less activated although no differences in perceived motion can account for this. Data suggest an important role of human V5/MT+ in the process of spatial localization of briefly presented objects and thus extend current concepts of the functions of human V5/MT+.

Saccadic suppression as a perceptual consequence of efficient sensorimotor estimation

Humans perform saccadic eye movements two to three times per second. When doing so, the nervous system strongly suppresses sensory feedback for extended periods of time in comparison to movement time. Why does the brain discard so much visual information? Here we suggest that perceptual suppression may arise from efficient sensorimotor computations, assuming that perception and control are fundamentally linked. More precisely, we show theoretically that a Bayesian estimator should reduce the weight of sensory information around the time of saccades, as a result of signal dependent noise and of sensorimotor delays. Such reduction parallels the behavioral suppression occurring prior to and during saccades, and the reduction in neural responses to visual stimuli observed across the visual hierarchy. We suggest that saccadic suppression originates from efficient sensorimotor processing, indicating that the brain shares neural resources for perception and control.

Time compression of visual perception around microsaccades

Even during fixation, our eyes are in constant motion. For example, microsaccades are small (typically <1°) eye movements that occur 1~3 times/second. Despite their tiny and transient nature, our percept of visual space is compressed before microsaccades (Hafed ZM, Lovejoy LP, Krauzlis RJ. Eur J Neurosci 37: 1169-1181, 2013). As visual space and time are interconnected at both the physical and physiological levels, we asked whether microsaccades also affect the temporal aspects of visual perception. Here we demonstrate that the perceived interval between transient visual stimuli was compressed if accompanied by microsaccades. This temporal compression extended approximately ±200 ms from microsaccade occurrence, and depending on their particular pattern, multiple microsaccades further enhanced or counteracted this temporal compression. The compression of time surrounding microsaccades resembles that associated with more voluntary macrosaccades (Morrone MC, Ross J, Burr D. Nat Neurosci 8: 950-954, 2005). Our results suggest common neural processes underlying both saccade and microsaccade misperceptions, mediated, likely, through extraretinal mechanisms.NEW & NOTEWORTHY Here we show that humans perceive the duration of visual events as compressed if they are accompanied by microsaccades. Despite the tiny and transient nature of microsaccades, time compression extended more than ±200 ms from their occurrence. Moreover, the number, pattern, and temporal coincidence of microsaccades relative to visual events all contribute to this time misperception. Our results reveal a detailed picture of how our visual time percepts are altered by microsaccades.

Saccadic Suppression Is Embedded Within Extended Oscillatory Modulation of Sensitivity

Action and perception are intimately coupled systems. One clear case is saccadic suppression, the reduced visibility around the time of saccades, which is important in mediating visual stability; another is the oscillatory modulation of visibility synchronized with hand action. To suppress effectively the spurious retinal motion generated by the eye movements, it is crucial that saccadic suppression and saccadic onset be temporally synchronous. However, the mechanisms that determine this temporal synchrony are unknown. We investigated the effect of saccades on contrast discrimination sensitivity over a long period stretching over >1 s before and after saccade execution. Human subjects made horizontal saccades at will to two stationary saccadic targets separated by 20°. At a random interval, a brief Gabor patch was displayed between the two fixations in either the upper or lower visual field and the subject had to detect its location. Strong saccadic suppression was measured between -50 and 50 ms from saccadic onset. However, the suppression was systematically embedded in a trough of oscillations of contrast sensitivity that fluctuated rhythmically in the delta range (at ∼3 Hz), commencing ∼1 s before saccade execution and lasting for up to 1 s after the saccade. The results show that saccadic preparation and visual sensitivity oscillations are coupled and the coupling might be instrumental in temporally aligning the initiation of the saccade with the visual suppression.SIGNIFICANCE STATEMENT Saccades are known to produce a suppression of contrast sensitivity at saccadic onset and an enhancement after saccadic offset. Here, we show that these dynamics are systematically embedded in visual oscillations of contrast sensitivity that fluctuate rhythmically in the delta range (at ∼3 Hz), commencing ∼1 s before saccade execution and lasting for up to 1 s after the saccade. The results show that saccadic preparation and visual sensitivity oscillations are coupled and the coupling might be instrumental in aligning temporally the initiation of the saccade with the visual suppression.

A neural locus for spatial-frequency specific saccadic suppression in visual-motor neurons of the primate superior colliculus

Saccades cause rapid retinal-image shifts that go perceptually unnoticed several times per second. The mechanisms for saccadic suppression have been controversial, in part because of sparse understanding of neural substrates. In this study we uncovered an unexpectedly specific neural locus for spatial frequency-specific saccadic suppression in the superior colliculus (SC). We first developed a sensitive behavioral measure of suppression in two macaque monkeys, demonstrating selectivity to low spatial frequencies similar to that observed in earlier behavioral studies. We then investigated visual responses in either purely visual SC neurons or anatomically deeper visual motor neurons, which are also involved in saccade generation commands. Surprisingly, visual motor neurons showed the strongest visual suppression, and the suppression was dependent on spatial frequency, as in behavior. Most importantly, suppression selectivity for spatial frequency in visual motor neurons was highly predictive of behavioral suppression effects in each individual animal, with our recorded population explaining up to ~74% of behavioral variance even on completely different experimental sessions. Visual SC neurons had mild suppression, which was unselective for spatial frequency and thus only explained up to ~48% of behavioral variance. In terms of spatial frequency-specific saccadic suppression, our results run contrary to predictions that may be associated with a hypothesized SC saccadic suppression mechanism, in which a motor command in the visual motor and motor neurons is first relayed to the more superficial purely visual neurons, to suppress them and to then potentially be fed back to cortex. Instead, an extraretinal modulatory signal mediating spatial-frequency-specific suppression may already be established in visual motor neurons.NEW & NOTEWORTHY Saccades, which repeatedly realign the line of sight, introduce spurious signals in retinal images that normally go unnoticed. In part, this happens because of perisaccadic suppression of visual sensitivity, which is known to depend on spatial frequency. We discovered that a specific subtype of superior colliculus (SC) neurons demonstrates spatial-frequency-dependent suppression. Curiously, it is the neurons that help mediate the saccadic command itself that exhibit such suppression, and not the purely visual ones.

A circuit for saccadic suppression in the primate brain

Saccades should cause us to see a blur as the eyes sweep across a visual scene. Specific brain mechanisms prevent this by producing suppression during saccades. Neuronal correlates of such suppression were first established in the visual superficial layers of the superior colliculus (SC) and subsequently have been observed in cortical visual areas, including the middle temporal visual area (MT). In this study, we investigated suppression in a recently identified circuit linking visual SC (SCs) to MT through the inferior pulvinar (PI). We examined responses to visual stimuli presented just before saccades to reveal a neuronal correlate of suppression driven by a copy of the saccade command, referred to as a corollary discharge. We found that visual responses were similarly suppressed in SCs, PI, and MT. Within each region, suppression of visual responses occurred with saccades into both visual hemifields, but only in the contralateral hemifield did this suppression consistently begin before the saccade (~100 ms). The consistency of the signal along the circuit led us to hypothesize that the suppression in MT was influenced by input from the SC. We tested this hypothesis in one monkey by inactivating neurons within the SC and found evidence that suppression in MT depends on corollary discharge signals from motor SC (SCi). Combining these results with recent findings in rodents, we propose a complete circuit originating with corollary discharge signals in SCi that produces suppression in visual SCs, PI, and ultimately, MT cortex.NEW & NOTEWORTHY A fundamental puzzle in visual neuroscience is that we frequently make rapid eye movements (saccades) but seldom perceive the visual blur accompanying each movement. We investigated neuronal correlates of this saccadic suppression by recording from and perturbing a recently identified circuit from brainstem to cortex. We found suppression at each stage, with evidence that it was driven by an internally generated signal. We conclude that this circuit contributes to neuronal suppression of visual signals during eye movements.

Efficacy of electrical stimulation of retinal ganglion cells with temporal patterns resembling light-evoked spike trains

People with degenerative retinal diseases such as retinitis pigmentosa lose most of their photoreceptors but retain a significant proportion (~30%) of their retinal ganglion cells (RGCs). Microelectronic retinal prostheses aim to bypass the lost photoreceptors and restore vision by directly stimulating the surviving RGCs. Here we investigate the extent to which electrical stimulation of RGCs can evoke neural spike trains with statistics resembling those of normal visually-evoked responses. Whole-cell patch clamp recordings were made from individual cat RGCs in vitro. We first recorded the responses of each cell to short sequences of visual stimulation. These responses were converted to trains of electrical stimulation that we then presented to the same cell via an epiretinal stimulating electrode. We then quantified the efficacy of the electrical stimuli and the latency of the evoked spikes. In all cases, spikes were evoked with sub-millisecond latency (0.55 ms, median, ON cells, n = 8; 0.75 ms, median, OFF cells, n = 6) and efficacy ranged from 0.4-1.0 (0.79, median, ON cells; 0.97, median, OFF cells). These data demonstrate that meaningful spike trains, resembling normal responses of RGCs to visual stimulation, can be reliably evoked by epiretinal prostheses.

Superior Colliculus Responses to Attended, Unattended, and Remembered Saccade Targets during Smooth Pursuit Eye Movements

In realistic environments, keeping track of multiple visual targets during eye movements likely involves an interaction between vision, top-down spatial attention, memory, and self-motion information. Recently we found that the superior colliculus (SC) visual memory response is attention-sensitive and continuously updated relative to gaze direction. In that study, animals were trained to remember the location of a saccade target across an intervening smooth pursuit (SP) eye movement (Dash et al., 2015). Here, we modified this paradigm to directly compare the properties of visual and memory updating responses to attended and unattended targets. Our analysis shows that during SP, active SC visual vs. memory updating responses share similar gaze-centered spatio-temporal profiles (suggesting a common mechanism), but updating was weaker by ~25%, delayed by ~55 ms, and far more dependent on attention. Further, during SP the sum of passive visual responses (to distracter stimuli) and memory updating responses (to saccade targets) closely resembled the responses for active attentional tracking of visible saccade targets. These results suggest that SP updating signals provide a damped, delayed estimate of attended location that contributes to the gaze-centered tracking of both remembered and visible saccade targets.

An Attention-Sensitive Memory Trace in Macaque MT Following Saccadic Eye Movements

We experience a visually stable world despite frequent retinal image displacements induced by eye, head, and body movements. The neural mechanisms underlying this remain unclear. One mechanism that may contribute is transsaccadic remapping, in which the responses of some neurons in various attentional, oculomotor, and visual brain areas appear to anticipate the consequences of saccades. The functional role of transsaccadic remapping is actively debated, and many of its key properties remain unknown. Here, recording from two monkeys trained to make a saccade while directing attention to one of two spatial locations, we show that neurons in the middle temporal area (MT), a key locus in the motion-processing pathway of humans and macaques, show a form of transsaccadic remapping called a memory trace. The memory trace in MT neurons is enhanced by the allocation of top-down spatial attention. Our data provide the first demonstration, to our knowledge, of the influence of top-down attention on the memory trace anywhere in the brain. We find evidence only for a small and transient effect of motion direction on the memory trace (and in only one of two monkeys), arguing against a role for MT in the theoretically critical yet empirically contentious phenomenon of spatiotopic feature-comparison and adaptation transfer across saccades. Our data support the hypothesis that transsaccadic remapping represents the shift of attentional pointers in a retinotopic map, so that relevant locations can be tracked and rapidly processed across saccades. Our results resolve important issues concerning the perisaccadic representation of visual stimuli in the dorsal stream and demonstrate a significant role for top-down attention in modulating this representation.

How does the brain keep track of specific attended features after eye movements? A new study of the macaque brain implicates the middle temporal (MT) area in the remapping of attentional pointers across saccades.

Humans experience a visually stable world despite the fact that eye, head, and body movements cause frequent shifts of the image on the retina. Humans and monkeys are also able to keep track of visual stimuli across such movements. One mechanism that may contribute to these abilities is “transsaccadic remapping,” in which the responses of some neurons in various attentional, oculomotor, and visual brain areas appear to anticipate the consequences of saccades. A current hypothesis proposes that the brain maintains “attentional pointers” to the locations of relevant stimuli and that, via transsaccadic remapping, it rapidly relocates these pointers to compensate for intervening eye movements. Whether stimulus features are also remapped across saccades (along with their location) remains unclear. Here, we show the presence of transsaccadic remapping in a macaque monkey brain area critical for visual motion processing, the middle temporal area (MT). This remapped response is stronger for an attended stimulus. We find only weak evidence for motion-direction information in the remapped response. These results support the attentional pointer hypothesis and demonstrate for the first time, to our knowledge, the impact of top-down attention on transsaccadic remapping in the brain.

Sharp Wave Ripples during Visual Exploration in the Primate Hippocampus

Hippocampal sharp-wave ripples (SWRs) are highly synchronous oscillatory field potentials that are thought to facilitate memory consolidation. SWRs typically occur during quiescent states, when neural activity reflecting recent experience is replayed. In rodents, SWRs also occur during brief locomotor pauses in maze exploration, where they appear to support learning during experience. In this study, we detected SWRs that occurred during quiescent states, but also during goal-directed visual exploration in nonhuman primates (Macaca mulatta). The exploratory SWRs showed peak frequency bands similar to those of quiescent SWRs, and both types were inhibited at the onset of their respective behavioral epochs. In apparent contrast to rodent SWRs, these exploratory SWRs occurred during active periods of exploration, e.g., while animals searched for a target object in a scene. SWRs were associated with smaller saccades and longer fixations. Also, when they coincided with target-object fixations during search, detection was more likely than when these events were decoupled. Although we observed high gamma-band field potentials of similar frequency to SWRs, only the SWRs accompanied greater spiking synchrony in neural populations. These results reveal that SWRs are not limited to off-line states as conventionally defined; rather, they occur during active and informative performance windows. The exploratory SWR in primates is an infrequent occurrence associated with active, attentive performance, which may indicate a new, extended role of SWRs during exploration in primates.

SIGNIFICANCE STATEMENT

Sharp-wave ripples (SWRs) are high-frequency oscillations that generate highly synchronized activity in neural populations. Their prevalence in sleep and quiet wakefulness, and the memory deficits that result from their interruption, suggest that SWRs contribute to memory consolidation during rest. Here, we report that SWRs from the monkey hippocampus occur not only during behavioral inactivity but also during successful visual exploration. SWRs were associated with attentive, focal search and appeared to enhance perception of locations viewed around the time of their occurrence. SWRs occurring in rest are noteworthy for their relation to heightened neural population activity, temporally precise and widespread synchronization, and memory consolidation; therefore, the SWRs reported here may have a similar effect on neural populations, even as experiences unfold.

Visual Receptive Field Properties of Neurons in the Mouse Lateral Geniculate Nucleus

The lateral geniculate nucleus (LGN) is increasingly regarded as a "smart-gating" operator for processing visual information. Therefore, characterizing the response properties of LGN neurons will enable us to better understand how neurons encode and transfer visual signals. Efforts have been devoted to study its anatomical and functional features, and recent advances have highlighted the existence in rodents of complex features such as direction/orientation selectivity. However, unlike well-researched higher-order mammals such as primates, the full array of response characteristics vis-à-vis its morphological features have remained relatively unexplored in the mouse LGN. To address the issue, we recorded from mouse LGN neurons using multisite-electrode-arrays (MEAs) and analysed their discharge patterns in relation to their location under a series of visual stimulation paradigms. Several response properties paralleled results from earlier studies in the field and these include centre-surround organization, size of receptive field, spontaneous firing rate and linearity of spatial summation. However, our results also revealed "high-pass" and "low-pass" features in the temporal frequency tuning of some cells, and greater average contrast gain than reported by earlier studies. In addition, a small proportion of cells had direction/orientation selectivity. Both "high-pass" and "low-pass" cells, as well as direction and orientation selective cells, were found only in small numbers, supporting the notion that these properties emerge in the cortex. ON- and OFF-cells showed distinct contrast sensitivity and temporal frequency tuning properties, suggesting parallel projections from the retina. Incorporating a novel histological technique, we created a 3-D LGN volume model explicitly capturing the morphological features of mouse LGN and localising individual cells into anterior/middle/posterior LGN. Based on this categorization, we show that the ON/OFF, DS/OS and linear response properties are not regionally restricted. Our study confirms earlier findings of spatial pattern selectivity in the LGN, and builds on it to demonstrate that relatively elaborate features are computed early in the visual pathway.

Suppression and reversal of motion perception around the time of the saccade

We make fast, “saccadic” eye movements to capture finely resolved foveal snapshots of the world but these saccades cause motion artefacts. The artefacts go unnoticed, perhaps because the brain suppresses them through subcortical oculomotor signals feeding back into visual cortex. Opposing views, however, claim that passive mechanisms suffice: saccadic shearing forces might render the retina insensitive to the artefacts or post-saccadic snapshots might mask them before they enter consciousness. Crucially, only active suppression could explain perceptual changes that precede saccades but existing evidence for presaccadic misperception are ill-suited for addressing this issue: Previous studies have found misperceptions of space for objects briefly flashed before saccades, but perhaps only because observers confused the timing of flashes and saccades before they could be tested (“postdiction”), and presaccadic motion perception might have appeared to decline because motion stimuli persisted past eye movement onset. Here we addressed these concerns using briefly flashed two-frame animations (50 ms) to probe people’s motion sensitivity during and around saccades. We found that sensitivity declined before saccade onset, even when the probe appeared entirely outside the saccade, and this sensitivity decline was present for motion in every direction relative to saccade, ruling out problems with postdiction. Intriguingly, brief periods during the saccade produced negative sensitivity as if motion was reversed, arguably due to postsaccadic enhancement. These data suggest that motion perception is minimized during saccades through active suppression, complementing neurophysiological findings of colliculo-pulvinar projections that suppress the cortical middle temporal area around the time of the saccade.

Saccade-induced image motion cannot account for post-saccadic enhancement of visual processing in primate MST

Primates use saccadic eye movements to make gaze changes. In many visual areas, including the dorsal medial superior temporal area (MSTd) of macaques, neural responses to visual stimuli are reduced during saccades but enhanced afterwards. How does this enhancement arise-from an internal mechanism associated with saccade generation or through visual mechanisms activated by the saccade sweeping the image of the visual scene across the retina? Spontaneous activity in MSTd is elevated even after saccades made in darkness, suggesting a central mechanism for post-saccadic enhancement. However, based on the timing of this effect, it may arise from a different mechanism than occurs in normal vision. Like neural responses in MSTd, initial ocular following eye speed is enhanced after saccades, with evidence suggesting both internal and visually mediated mechanisms. Here we recorded from visual neurons in MSTd and measured responses to motion stimuli presented soon after saccades and soon after simulated saccades-saccade-like displacements of the background image during fixation. We found that neural responses in MSTd were enhanced when preceded by real saccades but not when preceded by simulated saccades. Furthermore, we also observed enhancement following real saccades made across a blank screen that generated no motion signal within the recorded neurons' receptive fields. We conclude that in MSTd the mechanism leading to post-saccadic enhancement has internal origins.

Spatial ranking strategy and enhanced peripheral vision discrimination optimize performance and efficiency of visual sequential search

Visual sequential search might use a peripheral spatial ranking of the scene to put the next target of the sequence in the correct order. This strategy, indeed, might enhance the discriminative capacity of the human peripheral vision and spare neural resources associated with foveation. However, it is not known how exactly the peripheral vision sustains sequential search and whether the sparing of neural resources has a cost in terms of performance. To elucidate these issues, we compared strategy and performance during an alpha-numeric sequential task where peripheral vision was modulated in three different conditions: normal, blurred, or obscured. If spatial ranking is applied to increase the peripheral discrimination, its use as a strategy in visual sequencing should differ according to the degree of discriminative information that can be obtained from the periphery. Moreover, if this strategy spares neural resources without impairing the performance, its use should be associated with better performance. We found that spatial ranking was applied when peripheral vision was fully available, reducing the number and time of explorative fixations. When the periphery was obscured, explorative fixations were numerous and sparse; when the periphery was blurred, explorative fixations were longer and often located close to the items. Performance was significantly improved by this strategy. Our results demonstrated that spatial ranking is an efficient strategy adopted by the brain in visual sequencing to highlight peripheral detection and discrimination; it reduces the neural cost by avoiding unnecessary foveations, and promotes sequential search by facilitating the onset of a new saccade.

The role of contrast adaptation in saccadic suppression in humans

The idea of retinal and ex-retinal sources of saccadic suppression has long been established in previous studies. However, how they are implemented in local circuit remains unknown. Researchers have suggested that saccadic suppression was probably achieved by contrast gain control, but this possibility has never been directly tested. In this study, we manipulated contrast gain control by contrast-adapting observers with sinusoidal gratings of different contrasts. Presaccadic and fixational contrast thresholds were measured and compared to give estimates of saccadic suppression at different adaptation states. Our results reconfirmed the selective saccadic suppression in achromatic condition, and further showed that, achromatic saccadic suppression diminished as contrast adaptation was accentuated, whereas no significant chromatic saccadic suppression was induced by greater contrast adaptation. Our data provided evidence for the involvement of contrast gain control in saccadic suppression in achromatic channel. We also discussed how the negative correlation between contrast adaptation and saccadic suppression could be interpreted with contrast gain control.

Saccades during visual exploration align hippocampal 3-8 Hz rhythms in human and non-human primates

Visual exploration in primates depends on saccadic eye movements (SEMs) that cause alternations of neural suppression and enhancement. This modulation extends beyond retinotopic areas, and is thought to facilitate perception; yet saccades may also influence brain regions critical for forming memories of these exploratory episodes. The hippocampus, for example, shows oscillatory activity that is generally associated with encoding of information. Whether or how hippocampal oscillations are influenced by eye movements is unknown. We recorded the neural activity in the human and macaque hippocampus during visual scene search. Across species, SEMs were associated with a time-limited alignment of a low-frequency (3–8 Hz) rhythm. The phase alignment depended on the task and not only on eye movements per se, and the frequency band was not a direct consequence of saccade rate. Hippocampal theta-frequency oscillations are produced by other mammals during repetitive exploratory behaviors, including whisking, sniffing, echolocation, and locomotion. The present results may reflect a similar yet distinct primate homologue supporting active perception during exploration.

Human occipital cortices differentially exert saccadic suppression: Intracranial recording in children

By repeating saccades unconsciously, humans explore the surrounding world every day. Saccades inevitably move external visual images across the retina at high velocity; nonetheless, healthy humans don't perceive transient blurring of the visual scene during saccades. This perceptual stability is referred to as saccadic suppression. Functional suppression is believed to take place transiently in the visual systems, but it remains unknown how commonly or differentially the human occipital lobe activities are suppressed at the large-scale cortical network level. We determined the spatial-temporal dynamics of intracranially-recorded gamma activity at 80-150 Hz around spontaneous saccades under no-task conditions during wakefulness and those in darkness during REM sleep. Regardless of wakefulness or REM sleep, a small degree of attenuation of gamma activity was noted in the occipital regions during saccades, most extensively in the polar and least in the medial portions. Longer saccades were associated with more intense gamma-attenuation. Gamma-attenuation was subsequently followed by gamma-augmentation most extensively involving the medial and least involving the polar occipital region. Such gamma-augmentation was more intense during wakefulness and temporally locked to the offset of saccades. The polarities of initial peaks of perisaccadic event-related potentials (ERPs) were frequently positive in the medial and negative in the polar occipital regions. The present study, for the first time, provided the electrophysiological evidence that human occipital cortices differentially exert perisaccadic modulation. Transiently suppressed sensitivity of the primary visual cortex in the polar region may be an important neural basis for saccadic suppression. Presence of occipital gamma-attenuation even during REM sleep suggests that saccadic suppression might be exerted even without external visual inputs. The primary visual cortex in the medial region, compared to the polar region, may be more sensitive to an upcoming visual scene provided at the offset of each saccade.

Postmicrosaccadic enhancement of slow eye movements

Active sensation poses unique challenges to sensory systems because moving the sensor necessarily alters the input sensory stream. Sensory input quality is additionally compromised if the sensor moves rapidly, as during rapid eye movements, making the period immediately after the movement critical for recovering reliable sensation. Here, we studied this immediate postmovement interval for the case of microsaccades during fixation, which rapidly jitter the "sensor" exactly when it is being voluntarily stabilized to maintain clear vision. We characterized retinal-image slip in monkeys immediately after microsaccades by analyzing postmovement ocular drifts. We observed enhanced ocular drifts by up to ~28% relative to premicrosaccade levels, and for up to ~50 ms after movement end. Moreover, we used a technique to trigger full-field image motion contingent on real-time microsaccade detection, and we used the initial ocular following response to this motion as a proxy for changes in early visual motion processing caused by microsaccades. When the full-field image motion started during microsaccades, ocular following was strongly suppressed, consistent with detrimental retinal effects of the movements. However, when the motion started after microsaccades, there was up to ~73% increase in ocular following speed, suggesting an enhanced motion sensitivity. These results suggest that the interface between even the smallest possible saccades and "fixation" includes a period of faster than usual image slip, as well as an enhanced responsiveness to image motion, and that both of these phenomena need to be considered when interpreting the pervasive neural and perceptual modulations frequently observed around the time of microsaccades.

Intrasaccadic suppression is dominated by reduced detector gain

Human vision requires fast eye movements (saccades). Each saccade causes a self-induced motion signal, but we are not aware of this potentially jarring visual input. Among the theorized causes of this phenomenon is a decrease in visual sensitivity before (presaccadic suppression) and during (intrasaccadic suppression) saccades. We investigated intrasaccadic suppression using a perceptual template model (PTM) relating visual detection to different signal-processing stages. One stage changes the gain on the detector's input; another increases uncertainty about the stimulus, allowing more noise into the detector; and other stages inject noise into the detector in a stimulus-dependent or -independent manner. By quantifying intrasaccadic suppression of flashed horizontal gratings at varying external noise levels, we obtained threshold-versus-noise (TVN) data, allowing us to fit the PTM. We tested if any of the PTM parameters changed significantly between the fixation and saccade models and could therefore account for intrasaccadic suppression. We found that the dominant contribution to intrasaccadic suppression was a reduction in the gain of the visual detector. We discuss how our study differs from previous ones that have pointed to uncertainty as an underlying cause of intrasaccadic suppression and how the equivalent noise approach provides a framework for comparing the disparate neural correlates of saccadic suppression.

Spatiotemporal structure of visual receptive fields in macaque superior colliculus

Saccades are useful for directing the high-acuity fovea to visual targets that are of behavioral relevance. The selection of visual targets for eye movements involves the superior colliculus (SC), where many neurons respond to visual stimuli. Many of these neurons are also activated before and during saccades of specific directions and amplitudes. Although the role of the SC in controlling eye movements has been thoroughly examined, far less is known about the nature of the visual responses in this area. We have, therefore, recorded from neurons in the intermediate layers of the macaque SC, while using a sparse-noise mapping procedure to obtain a detailed characterization of the spatiotemporal structure of visual receptive fields. We find that SC responses to flashed visual stimuli start roughly 50 ms after the onset of the stimulus and last for on average ∼70 ms. About 50% of these neurons are strongly suppressed by visual stimuli flashed at certain locations flanking the excitatory center, and the spatiotemporal pattern of suppression exerts a predictable influence on the timing of saccades. This suppression may, therefore, contribute to the filtering of distractor stimuli during target selection. We also find that saccades affect the processing of visual stimuli by SC neurons in a manner that is quite similar to the saccadic suppression and postsaccadic enhancement that has been observed in the cortex and in perception. However, in contrast to what has been observed in the cortex, decreased visual sensitivity was generally associated with increased firing rates, while increased sensitivity was associated with decreased firing rates. Overall, these results suggest that the processing of visual stimuli by SC receptive fields can influence oculomotor behavior and that oculomotor signals originating in the SC can shape perisaccadic visual perception.

The fixation and saccade P3

Although most instances of object recognition during natural viewing occur in the presence of saccades, the neural correlates of objection recognition have almost exclusively been examined during fixation. Recent studies have indicated that there are post-saccadic modulations of neural activity immediately following eye movement landing; however, whether post-saccadic modulations affect relatively late occurring cognitive components such as the P3 has not been explored. The P3 as conventionally measured at fixation is commonly used in brain computer interfaces, hence characterizing the post-saccadic P3 could aid in the development of improved brain computer interfaces that allow for eye movements. In this study, the P3 observed after saccadic landing was compared to the P3 measured at fixation. No significant differences in P3 start time, temporal persistence, or amplitude were found between fixation and saccade trials. Importantly, sensory neural responses canceled in the target minus distracter comparisons used to identify the P3. Our results indicate that relatively late occurring cognitive neural components such as the P3 are likely less sensitive to post saccadic modulations than sensory neural components and other neural activity occurring shortly after eye movement landing. Furthermore, due to the similarity of the fixation and saccade P3, we conclude that the P3 following saccadic landing could possibly be used as a viable signal in brain computer interfaces allowing for eye movements.

Eye movements modulate the spatiotemporal dynamics of word processing

Active reading requires coordination between frequent eye movements (saccades) and short fixations in text. Yet, the impact of saccades on word processing remains unknown, as neuroimaging studies typically employ constant eye fixation. Here we investigate eye-movement effects on word recognition processes in healthy human subjects using anatomically constrained magnetoencephalography, psychophysical measurements, and saccade detection in real time. Word recognition was slower and brain responses were reduced to words presented early versus late after saccades, suggesting an overall transient impairment of word processing after eye movements. Response reductions occurred early in visual cortices and later in language regions, where they colocalized with repetition priming effects. Qualitatively similar effects occurred when words appeared early versus late after background movement that mimicked saccades, suggesting that retinal motion contributes to postsaccadic inhibition. Further, differences in postsaccadic and background-movement effects suggest that central mechanisms also contribute to postsaccadic modulation. Together, these results suggest a complex interplay between visual and central saccadic mechanisms during reading.