Correlates of motor planning and postsaccadic fixation in the macaque monkey lateral geniculate nucleus

The execution of saccadic eye movements suppresses visual processing of both color and luminance in the early visual cortex of humans

Our eyes execute rapid, directional movements known as saccades, occurring several times per second, to focus on objects of interest in our environment. During these movements, visual sensitivity is temporarily reduced. Despite numerous studies on this topic, the underlying mechanism remains elusive, including a lingering debate on whether saccadic suppression affects the parvocellular visual pathway. To address this issue, we conducted a study employing steady-state visual evoked potentials (SSVEPs) elicited by chromatic and luminance stimuli while observers performed saccadic eye movements. We also employed an innovative analysis pipeline to enhance the signal-to-noise ratio, yielding superior results compared to the previous method. Our findings revealed a clear suppression effect on SSVEP signals during saccades compared to fixation periods. Notably, this suppression effect was comparable for both chromatic and luminance stimuli. We went further to measure the suppression effect across various contrast levels, which enabled us to model SSVEP responses with contrast response functions. The results suggest that saccades primarily reduce response gain without significantly affecting contrast gain and that this reduction applies uniformly to both chromatic and luminance pathways. In summary, our study provides robust evidence that saccades similarly suppress visual processing in both the parvocellular and magnocellular pathways within the human early visual cortex, as indicated by SSVEP responses. The observation that saccadic eye movements impact response gain rather than contrast gain implies that they influence visual processing through a multiplicative mechanism.NEW & NOTEWORTHY The present study demonstrates that saccadic eye movements reduce the processing of both luminance and chromatic stimuli in the early visual cortex of humans. By modeling the contrast response function, the study further shows that saccades affect visual processing by reducing the response gain rather than altering the contrast gain, suggesting that a multiplicative mechanism of visual attenuation affects both parvocellular and magnocellular pathways.

Laminar mechanisms of saccadic suppression in primate visual cortex

Saccadic eye movements are known to cause saccadic suppression, a temporary reduction in visual sensitivity and visual cortical firing rates. While saccadic suppression has been well characterized at the level of perception and single neurons, relatively little is known about the visual cortical networks governing this phenomenon. Here we examine the effects of saccadic suppression on distinct neural subpopulations within visual area V4. We find subpopulation-specific differences in the magnitude and timing of peri-saccadic modulation. Input-layer neurons show changes in firing rate and inter-neuronal correlations prior to saccade onset, and putative inhibitory interneurons in the input layer elevate their firing rate during saccades. A computational model of this circuit recapitulates our empirical observations and demonstrates that an input-layer-targeting pathway can initiate saccadic suppression by enhancing local inhibitory activity. Collectively, our results provide a mechanistic understanding of how eye movement signaling interacts with cortical circuitry to enforce visual stability.

Perceptual enhancement and suppression correlate with V1 neural activity during active sensing

Perception in multiple sensory modalities is an active process that involves exploratory behaviors. In humans and other primates, vision results from sensory sampling guided by saccadic eye movements. Saccades are known to modulate visual perception, and a corollary discharge signal associated with saccades appears to establish a sense of visual stability. Neural recordings have shown that saccades also modulate activity widely across the brain. To investigate the neural basis of saccadic effects on perception, simultaneous recordings from multiple neurons in area V1 were made as animals performed a contrast detection task. Perceptual and neural measures were compared when the animal made real saccades that brought a stimulus into V1 receptive fields and when simulated saccades were made (identical retinal stimulation but no eye movement). When real saccades were made and low spatial frequency stimuli were presented, we observed a reduction in both perceptual sensitivity and neural activity compared with simulated saccades; conversely, with higher spatial frequency stimuli, saccades increased visual sensitivity and neural activity. The performance of neural decoders, which used the activity of the population of simultaneously recorded neurons, showed saccade effects on sensitivity that mirrored the frequency-dependent perceptual changes, suggesting that the V1 population activity could support the perceptual effects. A minority of V1 neurons had significant choice probabilities, and the saccades decreased both average choice probability and pairwise noise correlations. Taken together, the findings suggest that a signal related to saccadic eye movements alters V1 spiking to increase the independence of spiking neurons and bias the system toward processing higher spatial frequencies, presumably to enhance object recognition. The effects of saccades on visual perception and noise correlations appear to parallel effects observed in other sensory modalities, suggesting a general principle of active sensory processing.

Neural activity in the human anterior thalamus during natural vision

In natural vision humans and other primates explore environment by active sensing, using saccadic eye movements to relocate the fovea and sample different bits of information multiple times per second. Saccades induce a phase reset of ongoing neuronal oscillations in primary and higher-order visual cortices and in the medial temporal lobe. As a result, neuron ensembles are shifted to a common state at the time visual input propagates through the system (i.e., just after fixation). The extent of the brain’s circuitry that is modulated by saccades is not yet known. Here, we evaluate the possibility that saccadic phase reset impacts the anterior nuclei of the thalamus (ANT). Using recordings in the human thalamus of three surgical patients during natural vision, we found that saccades and visual stimulus onset both modulate neural activity, but with distinct field potential morphologies. Specifically, we found that fixation-locked field potentials had a component that preceded saccade onset. It was followed by an early negativity around 50 ms after fixation onset which is significantly faster than any response to visual stimulus presentation. The timing of these events suggests that the ANT is predictively modulated before the saccadic eye movement. We also found oscillatory phase concentration, peaking at 3–4 Hz, coincident with suppression of Broadband High-frequency Activity (BHA; 80–180 Hz), both locked to fixation onset supporting the idea that neural oscillations in these nuclei are reorganized to a low excitability state right after fixation onset. These findings show that during real-world natural visual exploration neural dynamics in the human ANT is influenced by visual and oculomotor events, which supports the idea that ANT, apart from their contribution to episodic memory, also play a role in natural vision.

The extrafoveal preview paradigm as a measure of predictive, active sampling in visual perception

A key feature of visual processing in humans is the use of saccadic eye movements to look around the environment. Saccades are typically used to bring relevant information, which is glimpsed with extrafoveal vision, into the high-resolution fovea for further processing. With the exception of some unusual circumstances, such as the first fixation when walking into a room, our saccades are mainly guided based on this extrafoveal preview. In contrast, the majority of experimental studies in vision science have investigated "passive" behavioral and neural responses to suddenly appearing and often temporally or spatially unpredictable stimuli. As reviewed here, a growing number of studies have investigated visual processing of objects under more natural viewing conditions in which observers move their eyes to a stationary stimulus, visible previously in extrafoveal vision, during each trial. These studies demonstrate that the extrafoveal preview has a profound influence on visual processing of objects, both for behavior and neural activity. Starting from the preview effect in reading research we follow subsequent developments in vision research more generally and finally argue that taking such evidence seriously leads to a reconceptualization of the nature of human visual perception that incorporates the strong influence of prediction and action on sensory processing. We review theoretical perspectives on visual perception under naturalistic viewing conditions, including theories of active vision, active sensing, and sampling. Although the extrafoveal preview paradigm has already provided useful information about the timing of, and potential mechanisms for, the close interaction of the oculomotor and visual systems while reading and in natural scenes, the findings thus far also raise many new questions for future research.

Perceptual saccadic suppression starts in the retina

Visual sensitivity, probed through perceptual detectability of very brief visual stimuli, is strongly impaired around the time of rapid eye movements. This robust perceptual phenomenon, called saccadic suppression, is frequently attributed to active suppressive signals that are directly derived from eye movement commands. Here we show instead that visual-only mechanisms, activated by saccade-induced image shifts, can account for all perceptual properties of saccadic suppression that we have investigated. Such mechanisms start at, but are not necessarily exclusive to, the very first stage of visual processing in the brain, the retina. Critically, neural suppression originating in the retina outlasts perceptual suppression around the time of saccades, suggesting that extra-retinal movement-related signals, rather than causing suppression, may instead act to shorten it. Our results demonstrate a far-reaching contribution of visual processing mechanisms to perceptual saccadic suppression, starting in the retina, without the need to invoke explicit motor-based suppression commands.

Saccadic suppression is frequently attributed to active suppressive signals derived from eye movement commands. Here, the authors show that visual-only mechanisms starting in the retina can account for perceptual saccadic suppression properties without the need for motor-based suppression commands.

Spatial frequency sensitivity in macaque midbrain

Visual brain areas exhibit tuning characteristics well suited for image statistics present in our natural environment. However, visual sensation is an active process, and if there are any brain areas that ought to be particularly in tune with natural scene statistics, it would be sensory-motor areas critical for guiding behavior. Here we found that the rhesus macaque superior colliculus, a structure instrumental for rapid visual exploration with saccades, detects low spatial frequencies, which are the most prevalent in natural scenes, much more rapidly than high spatial frequencies. Importantly, this accelerated detection happens independently of whether a neuron is more or less sensitive to low spatial frequencies to begin with. At the population level, the superior colliculus additionally over-represents low spatial frequencies in neural response sensitivity, even at near-foveal eccentricities. Thus, the superior colliculus possesses both temporal and response gain mechanisms for efficient gaze realignment in low-spatial-frequency-dominated natural environments.

Selective modulation of visual sensitivity during fixation

During periods of steady fixation, we make small-amplitude ocular movements, termed microsaccades, at a rate of 1–2 every second. Early studies provided evidence that visual sensitivity is reduced during microsaccades—akin to the well-established suppression associated with larger saccades. However, the results of more recent work suggest that microsaccades may alter retinal input in a manner that enhances visual sensitivity to some stimuli. Here we parametrically varied the spatial frequency of a stimulus during a detection task and tracked contrast sensitivity as a function of time relative to microsaccades. Our data reveal two distinct modulations of sensitivity: suppression during the eye movement itself and facilitation after the eye has stopped moving. The magnitude of suppression and facilitation of visual sensitivity is related to the spatial content of the stimulus: suppression is greatest for low spatial frequencies, while sensitivity is enhanced most for stimuli of 1–2 cycles/°, spatial frequencies at which we are already most sensitive in the absence of eye movements. We present a model in which the tuning of suppression and facilitation is explained by delayed lateral inhibition between spatial frequency channels. Our data show that eye movements actively modulate visual sensitivity even during fixation: the detectability of images at different spatial scales can be increased or decreased depending on when the image occurs relative to a microsaccade.

NEW & NOTEWORTHY Given the frequency with which we make microsaccades during periods of fixation, it is vital that we understand how they affect visual processing. We demonstrate two selective modulations of contrast sensitivity that are time-locked to the occurrence of a microsaccade: suppression of low spatial frequencies during each eye movement and enhancement of higher spatial frequencies after the eye has stopped moving. These complementary changes may arise naturally because of sluggish gain control between spatial channels.

Developing a Nonstationary Computational Framework With Application to Modeling Dynamic Modulations in Neural Spiking Responses

OBJECTIVE

This paper aims to develop a computational model that incorporates the functional effects of modulatory covariates (such as context, task, or behavior), which dynamically alter the relationship between the stimulus and the neural response.

METHODS

We develop a general computational approach along with an efficient estimation procedure in the widely used generalized linear model (GLM) framework to characterize such nonstationary dynamics in spiking response and spatiotemporal characteristics of a neuron at the level of individual trials. The model employs a set of modulatory components, which nonlinearly interact with other stimulus-related signals to reproduce such nonstationary effects.

RESULTS

The model is tested for its ability to predict the responses of neurons in the middle temporal cortex of macaque monkeys during an eye movement task. The fitted model proves successful in capturing the fast temporal modulations in the response, reproducing the spike response temporal statistics, and accurately accounting for the neurons' dynamic spatiotemporal sensitivities, during eye movements.

CONCLUSION

The nonstationary GLM framework developed in this study can be used in cases where a time-varying behavioral or cognitive component makes GLM-based models insufficient to describe the dependencies of neural responses on the stimulus-related covariates.

SIGNIFICANCE

In addition to being quite powerful in encoding time-varying response modulations, this general framework also enables a readout of the neural code while dissociating the influence of other nonstimulus covariates. This framework will advance our ability to understand sensory processing in higher brain areas when modulated by several behavioral or cognitive variables.

Perception during double-step saccades

How the visual system achieves perceptual stability across saccadic eye movements is a long-standing question in neuroscience. It has been proposed that an efference copy informs vision about upcoming saccades, and this might lead to shifting spatial coordinates and suppressing image motion. Here we ask whether these two aspects of visual stability are interdependent or may be dissociated under special conditions. We study a memory-guided double-step saccade task, where two saccades are executed in quick succession. Previous studies have led to the hypothesis that in this paradigm the two saccades are planned in parallel, with a single efference copy signal generated at the start of the double-step sequence, i.e. before the first saccade. In line with this hypothesis, we find that visual stability is impaired during the second saccade, which is consistent with (accurate) efference copy information being unavailable during the second saccade. However, we find that saccadic suppression is normal during the second saccade. Thus, the second saccade of a double-step sequence instantiates a dissociation between visual stability and saccadic suppression: stability is impaired even though suppression is strong.

Mechanisms of Saccadic Suppression in Primate Cortical Area V4

Psychophysical studies have shown that subjects are often unaware of visual stimuli presented around the time of an eye movement. This saccadic suppression is thought to be a mechanism for maintaining perceptual stability. The brain might accomplish saccadic suppression by reducing the gain of visual responses to specific stimuli or by simply suppressing firing uniformly for all stimuli. Moreover, the suppression might be identical across the visual field or concentrated at specific points. To evaluate these possibilities, we recorded from individual neurons in cortical area V4 of nonhuman primates trained to execute saccadic eye movements. We found that both modes of suppression were evident in the visual responses of these neurons and that the two modes showed different spatial and temporal profiles: while gain changes started earlier and were more widely distributed across visual space, nonspecific suppression was found more often in the peripheral visual field, after the completion of the saccade. Peripheral suppression was also associated with increased noise correlations and stronger local field potential oscillations in the α frequency band. This pattern of results suggests that saccadic suppression shares some of the circuitry responsible for allocating voluntary attention.

SIGNIFICANCE STATEMENT

We explore our surroundings by looking at things, but each eye movement that we make causes an abrupt shift of the visual input. Why doesn't the world look like a film recorded on a shaky camera? The answer in part is a brain mechanism called saccadic suppression, which reduces the responses of visual neurons around the time of each eye movement. Here we reveal several new properties of the underlying mechanisms. First, the suppression operates differently in the central and peripheral visual fields. Second, it appears to be controlled by oscillations in the local field potentials at frequencies traditionally associated with attention. These results suggest that saccadic suppression shares the brain circuits responsible for actively ignoring irrelevant stimuli.

Saccadic Suppression Is Embedded Within Extended Oscillatory Modulation of Sensitivity

Action and perception are intimately coupled systems. One clear case is saccadic suppression, the reduced visibility around the time of saccades, which is important in mediating visual stability; another is the oscillatory modulation of visibility synchronized with hand action. To suppress effectively the spurious retinal motion generated by the eye movements, it is crucial that saccadic suppression and saccadic onset be temporally synchronous. However, the mechanisms that determine this temporal synchrony are unknown. We investigated the effect of saccades on contrast discrimination sensitivity over a long period stretching over >1 s before and after saccade execution. Human subjects made horizontal saccades at will to two stationary saccadic targets separated by 20°. At a random interval, a brief Gabor patch was displayed between the two fixations in either the upper or lower visual field and the subject had to detect its location. Strong saccadic suppression was measured between -50 and 50 ms from saccadic onset. However, the suppression was systematically embedded in a trough of oscillations of contrast sensitivity that fluctuated rhythmically in the delta range (at ∼3 Hz), commencing ∼1 s before saccade execution and lasting for up to 1 s after the saccade. The results show that saccadic preparation and visual sensitivity oscillations are coupled and the coupling might be instrumental in temporally aligning the initiation of the saccade with the visual suppression.SIGNIFICANCE STATEMENT Saccades are known to produce a suppression of contrast sensitivity at saccadic onset and an enhancement after saccadic offset. Here, we show that these dynamics are systematically embedded in visual oscillations of contrast sensitivity that fluctuate rhythmically in the delta range (at ∼3 Hz), commencing ∼1 s before saccade execution and lasting for up to 1 s after the saccade. The results show that saccadic preparation and visual sensitivity oscillations are coupled and the coupling might be instrumental in aligning temporally the initiation of the saccade with the visual suppression.

A neural locus for spatial-frequency specific saccadic suppression in visual-motor neurons of the primate superior colliculus

Saccades cause rapid retinal-image shifts that go perceptually unnoticed several times per second. The mechanisms for saccadic suppression have been controversial, in part because of sparse understanding of neural substrates. In this study we uncovered an unexpectedly specific neural locus for spatial frequency-specific saccadic suppression in the superior colliculus (SC). We first developed a sensitive behavioral measure of suppression in two macaque monkeys, demonstrating selectivity to low spatial frequencies similar to that observed in earlier behavioral studies. We then investigated visual responses in either purely visual SC neurons or anatomically deeper visual motor neurons, which are also involved in saccade generation commands. Surprisingly, visual motor neurons showed the strongest visual suppression, and the suppression was dependent on spatial frequency, as in behavior. Most importantly, suppression selectivity for spatial frequency in visual motor neurons was highly predictive of behavioral suppression effects in each individual animal, with our recorded population explaining up to ~74% of behavioral variance even on completely different experimental sessions. Visual SC neurons had mild suppression, which was unselective for spatial frequency and thus only explained up to ~48% of behavioral variance. In terms of spatial frequency-specific saccadic suppression, our results run contrary to predictions that may be associated with a hypothesized SC saccadic suppression mechanism, in which a motor command in the visual motor and motor neurons is first relayed to the more superficial purely visual neurons, to suppress them and to then potentially be fed back to cortex. Instead, an extraretinal modulatory signal mediating spatial-frequency-specific suppression may already be established in visual motor neurons.NEW & NOTEWORTHY Saccades, which repeatedly realign the line of sight, introduce spurious signals in retinal images that normally go unnoticed. In part, this happens because of perisaccadic suppression of visual sensitivity, which is known to depend on spatial frequency. We discovered that a specific subtype of superior colliculus (SC) neurons demonstrates spatial-frequency-dependent suppression. Curiously, it is the neurons that help mediate the saccadic command itself that exhibit such suppression, and not the purely visual ones.

A circuit for saccadic suppression in the primate brain

Saccades should cause us to see a blur as the eyes sweep across a visual scene. Specific brain mechanisms prevent this by producing suppression during saccades. Neuronal correlates of such suppression were first established in the visual superficial layers of the superior colliculus (SC) and subsequently have been observed in cortical visual areas, including the middle temporal visual area (MT). In this study, we investigated suppression in a recently identified circuit linking visual SC (SCs) to MT through the inferior pulvinar (PI). We examined responses to visual stimuli presented just before saccades to reveal a neuronal correlate of suppression driven by a copy of the saccade command, referred to as a corollary discharge. We found that visual responses were similarly suppressed in SCs, PI, and MT. Within each region, suppression of visual responses occurred with saccades into both visual hemifields, but only in the contralateral hemifield did this suppression consistently begin before the saccade (~100 ms). The consistency of the signal along the circuit led us to hypothesize that the suppression in MT was influenced by input from the SC. We tested this hypothesis in one monkey by inactivating neurons within the SC and found evidence that suppression in MT depends on corollary discharge signals from motor SC (SCi). Combining these results with recent findings in rodents, we propose a complete circuit originating with corollary discharge signals in SCi that produces suppression in visual SCs, PI, and ultimately, MT cortex.NEW & NOTEWORTHY A fundamental puzzle in visual neuroscience is that we frequently make rapid eye movements (saccades) but seldom perceive the visual blur accompanying each movement. We investigated neuronal correlates of this saccadic suppression by recording from and perturbing a recently identified circuit from brainstem to cortex. We found suppression at each stage, with evidence that it was driven by an internally generated signal. We conclude that this circuit contributes to neuronal suppression of visual signals during eye movements.

Visual sensitivity of frontal eye field neurons during the preparation of saccadic eye movements

Primate vision is continuously disrupted by saccadic eye movements, and yet this disruption goes unperceived. One mechanism thought to reduce perception of this self-generated movement is saccadic suppression, a global loss of visual sensitivity just before, during, and after saccadic eye movements. The frontal eye field (FEF) is a candidate source of neural correlates of saccadic suppression previously observed in visual cortex, because it contributes to the generation of visually guided saccades and modulates visual cortical responses. However, whether the FEF exhibits a perisaccadic reduction in visual sensitivity that could be transmitted to visual cortex is unknown. To determine whether the FEF exhibits a signature of saccadic suppression, we recorded the visual responses of FEF neurons to brief, full-field visual probe stimuli presented during fixation and before onset of saccades directed away from the receptive field in rhesus macaques (Macaca mulatta) We measured visual sensitivity during both epochs and found that it declines before saccade onset. Visual sensitivity was significantly reduced in visual but not visuomotor neurons. This reduced sensitivity was also present in visual neurons with no movement-related modulation during visually guided saccades and thus occurred independently from movement-related activity. Across the population of visual neurons, sensitivity began declining ∼80 ms before saccade onset. We also observed a similar presaccadic reduction in sensitivity to isoluminant, chromatic stimuli. Our results demonstrate that the signaling of visual information by FEF neurons is reduced during saccade preparation, and thus these neurons exhibit a signature of saccadic suppression.

A computational relationship between thalamic sensory neural responses and contrast perception

Uncovering the relationship between sensory neural responses and perceptual decisions remains a fundamental problem in neuroscience. Decades of experimental and modeling work in the sensory cortex have demonstrated that a perceptual decision pool is usually composed of tens to hundreds of neurons, the responses of which are significantly correlated not only with each other, but also with the behavioral choices of an animal. Few studies, however, have measured neural activity in the sensory thalamus of awake, behaving animals. Therefore, it remains unclear how many thalamic neurons are recruited and how the information from these neurons is pooled at subsequent cortical stages to form a perceptual decision. In a previous study we measured neural activity in the macaque lateral geniculate nucleus (LGN) during a two alternative forced choice (2AFC) contrast detection task, and found that single LGN neurons were significantly correlated with the monkeys’ behavioral choices, despite their relatively poor contrast sensitivity and a lack of overall interneuronal correlations. We have now computationally tested a number of specific hypotheses relating these measured LGN neural responses to the contrast detection behavior of the animals. We modeled the perceptual decisions with different numbers of neurons and using a variety of pooling/readout strategies, and found that the most successful model consisted of about 50–200 LGN neurons, with individual neurons weighted differentially according to their signal-to-noise ratios (quantified as d-primes). These results supported the hypothesis that in contrast detection the perceptual decision pool consists of multiple thalamic neurons, and that the response fluctuations in these neurons can influence contrast perception, with the more sensitive thalamic neurons likely to exert a greater influence.

Saccadic modulation of stimulus processing in primary visual cortex

Saccadic eye movements play a central role in primate vision. Yet, relatively little is known about their effects on the neural processing of visual inputs. Here we examine this question in primary visual cortex (V1) using receptive-field-based models, combined with an experimental design that leaves the retinal stimulus unaffected by saccades. This approach allows us to analyse V1 stimulus processing during saccades with unprecedented detail, revealing robust perisaccadic modulation. In particular, saccades produce biphasic firing rate changes that are composed of divisive gain suppression followed by an additive rate increase. Microsaccades produce similar, though smaller, modulations. We furthermore demonstrate that this modulation is likely inherited from the LGN, and is driven largely by extra-retinal signals. These results establish a foundation for integrating saccades into existing models of visual cortical stimulus processing, and highlight the importance of studying visual neuron function in the context of eye movements.

Primates acquire visual information through rapid saccadic eye movements, although little is known about their effects on neural processing of visual inputs. Here the authors demonstrate that saccades produce modulations of visual cortical processing that likely originate in the thalamus.

The functional asymmetry of ON and OFF channels in the perception of contrast

To fully understand the relationship between perception and single neural responses, one should take into consideration the early stages of sensory processing. Few studies, however, have directly examined the neural underpinning of visual perception in the lateral geniculate nucleus (LGN), only one synapse away from the retina. In this study we recorded from LGN parvocellular (P) ON-center and OFF-center neurons while monkeys either passively viewed or actively detected a full range of contrasts. We found that OFF neurons were more sensitive in detecting negative contrasts than ON neurons were in detecting positive contrasts. Also, OFF neurons had higher spontaneous activities, higher peak response amplitudes, and were more sustained than ON neurons in their contrast responses. Puzzlingly, OFF neurons failed to show any significant correlations with the monkeys' perceptual choices, despite their greater contrast sensitivities. If, however, choice probabilities were calculated from interspike intervals instead of spike counts (thus taking into account the higher firing rates of OFF neurons), OFF neurons but not ON neurons were significantly correlated with behavioral choices. Taken together, these results demonstrate in awake, behaving animals that: 1) the ON and OFF pathways do not simply mirror each other in their functionality but instead carry qualitatively different types of information, and 2) the responses of ON and OFF neurons can be correlated with perceptual choices even in the absence of physical stimuli and interneuronal correlations.

Saccade-induced image motion cannot account for post-saccadic enhancement of visual processing in primate MST

Primates use saccadic eye movements to make gaze changes. In many visual areas, including the dorsal medial superior temporal area (MSTd) of macaques, neural responses to visual stimuli are reduced during saccades but enhanced afterwards. How does this enhancement arise-from an internal mechanism associated with saccade generation or through visual mechanisms activated by the saccade sweeping the image of the visual scene across the retina? Spontaneous activity in MSTd is elevated even after saccades made in darkness, suggesting a central mechanism for post-saccadic enhancement. However, based on the timing of this effect, it may arise from a different mechanism than occurs in normal vision. Like neural responses in MSTd, initial ocular following eye speed is enhanced after saccades, with evidence suggesting both internal and visually mediated mechanisms. Here we recorded from visual neurons in MSTd and measured responses to motion stimuli presented soon after saccades and soon after simulated saccades-saccade-like displacements of the background image during fixation. We found that neural responses in MSTd were enhanced when preceded by real saccades but not when preceded by simulated saccades. Furthermore, we also observed enhancement following real saccades made across a blank screen that generated no motion signal within the recorded neurons' receptive fields. We conclude that in MSTd the mechanism leading to post-saccadic enhancement has internal origins.

Perceptual decision related activity in the lateral geniculate nucleus

Fundamental to neuroscience is the understanding of how the language of neurons relates to behavior. In the lateral geniculate nucleus (LGN), cells show distinct properties such as selectivity for particular wavelengths, increments or decrements in contrast, or preference for fine detail versus rapid motion. No studies, however, have measured how LGN cells respond when an animal is challenged to make a perceptual decision using information within the receptive fields of those LGN cells. In this study we measured neural activity in the macaque LGN during a two-alternative, forced-choice (2AFC) contrast detection task or during a passive fixation task and found that a small proportion (13.5%) of single LGN parvocellular (P) and magnocellular (M) neurons matched the psychophysical performance of the monkey. The majority of LGN neurons measured in both tasks were not as sensitive as the monkey. The covariation between neural response and behavior (quantified as choice probability) was significantly above chance during active detection, even when there was no external stimulus. Interneuronal correlations and task-related gain modulations were negligible under the same condition. A bottom-up pooling model that used sensory neural responses to compute perceptual choices in the absence of interneuronal correlations could fully explain these results at the level of the LGN, supporting the hypothesis that the perceptual decision pool consists of multiple sensory neurons and that response fluctuations in these neurons can influence perception.

A physiological perspective on fixational eye movements

For a behavioral neuroscientist, fixational eye movements are a double-edged sword. On one edge, they make control of visual stimuli difficult, but on the other edge they provide insight into the ways the visual system acquires information from the environment. We have studied macaque monkeys as models for human visual systems. Fixational eye movements of monkeys are similar to those of humans but they are more often vertically biased and spatially more dispersed. Eye movements scatter stimuli from their intended retinal locations, increase variability of neuronal responses, inflate estimates of receptive field size, and decrease measures of response amplitude. They also bias against successful stimulation of extremely selective cells. Compensating for eye movements reduced these errors and revealed a fine-grained motion pathway from V1 feeding the cortical ventral stream. Compensation is a useful tool for the experimenter, but rather than compensating for eye movements, the brain utilizes them as part of its input. The saccades and drifts that occur during fixation selectively activate different types of V1 neurons. Cells that prefer slower speeds respond during the drift periods with maintained discharges and tend to have smaller receptive fields that are selective for sign of contrast. They are well suited to code small details of the image and to enable our fine detailed vision. Cells that prefer higher speeds fire transient bursts of spikes when the receptive field leaves, crosses, or lands on a stimulus, but only the most transient ones (about one-third of our sample) failed to respond during drifts. Voluntary and fixational saccades had very similar effects, including the presence of a biphasic extraretinal modulation that interacted with stimulus-driven responses. Saccades evoke synchronous bursts that can enhance visibility but these bursts may also participate in the visual masking that contributes to saccadic suppression. Study of the small eye movements of fixation may illuminate some of the big problems in vision.

Production, control, and visual guidance of saccadic eye movements

Primate vision is served by rapid shifts of gaze called saccades. This review will survey current knowledge and particular problems concerning the neural control and guidance of gaze shifts.

Motor planning modulates sensory-motor control of collision avoidance behavior in the bullfrog, Rana catesbeiana

In this study, we examined the collision avoidance behavior of the frog, Rana catesbeiana to an approaching object in the upper visual field. The angular velocity of the frog's escape turn showed a significant positive correlation with the turn angle (r² = 0.5741, P<0.05). A similar mechanism of velocity control has been known in head movements of the owl and in human saccades. By analogy, this suggests that the frog planned its escape velocity in advance of executing the turn, to make the duration of the escape behavior relatively constant. For escape turns less than 60°, the positive correlation was very strong (r² = 0.7097, P<0.05). Thus, the frog controlled the angular velocity of small escape turns very accurately and completed the behavior within a constant time. On the other hand, for escape turns greater than 60°, the same correlation was not significant (r² = 0.065, P>0.05). Thus, the frog was not able to control the velocity of the large escape turns accurately and did not complete the behavior within a constant time. In the latter case, there was a small but significant positive correlation between the threshold angular size and the angular velocity (r² = 0.1459, P<0.05). This suggests that the threshold is controlled to compensate for the insufficient escape velocity achieved during large turn angles, and could explain a significant negative correlation between the turn angle and the threshold angular size (r² = 0.1145, P<0.05). Thus, it is likely that the threshold angular size is also controlled by the turn angle and is modulated by motor planning.

Eye movements modulate the spatiotemporal dynamics of word processing

Active reading requires coordination between frequent eye movements (saccades) and short fixations in text. Yet, the impact of saccades on word processing remains unknown, as neuroimaging studies typically employ constant eye fixation. Here we investigate eye-movement effects on word recognition processes in healthy human subjects using anatomically constrained magnetoencephalography, psychophysical measurements, and saccade detection in real time. Word recognition was slower and brain responses were reduced to words presented early versus late after saccades, suggesting an overall transient impairment of word processing after eye movements. Response reductions occurred early in visual cortices and later in language regions, where they colocalized with repetition priming effects. Qualitatively similar effects occurred when words appeared early versus late after background movement that mimicked saccades, suggesting that retinal motion contributes to postsaccadic inhibition. Further, differences in postsaccadic and background-movement effects suggest that central mechanisms also contribute to postsaccadic modulation. Together, these results suggest a complex interplay between visual and central saccadic mechanisms during reading.

Mechanisms for generating and compensating for the smallest possible saccades

Microsaccades are small eye movements that occur during gaze fixation. Although taking place only when we attempt to stabilize gaze position, microsaccades can be understood by relating them to the larger voluntary saccades, which abruptly shift gaze position. Starting from this approach to microsaccade analysis, I show how it can lead to significant insight about the generation and functional role of these eye movements. Like larger saccades, microsaccades are now known to be generated by brainstem structures involved not only in compiling motor commands for eye movements, but also in identifying and selecting salient target locations in the visual environment. In addition, these small eye movements both influence and are influenced by sensory and cognitive processes in various areas of the brain, and in a manner that is similar to the interactions between larger saccades and sensory or cognitive processes. By approaching the study of microsaccades from the perspective of what has been learned about their larger counterparts, we are now in a position to make greater strides in our understanding of the function of the smallest possible saccadic eye movements.

Visual perception and saccadic eye movements

We use saccades several times per second to move the fovea between points of interest and build an understanding of our visual environment. Recent behavioral experiments show evidence for the integration of pre- and postsaccadic information (even subliminally), the modulation of visual sensitivity, and the rapid reallocation of attention. The recent physiological literature has identified a characteristic modulation of neural responsiveness-perisaccadic reduction followed by a postsaccadic increase-that is found in many visual areas, but whose source is as yet unknown. This modulation seems optimal for reducing sensitivity during and boosting sensitivity between saccades, but no study has yet established a direct causal link between neural and behavioral changes.

An equivalent noise investigation of saccadic suppression

Visual stimuli presented just before or during an eye movement are more difficult to detect than those same visual stimuli presented during fixation. This laboratory phenomenon--behavioral saccadic suppression--is thought to underlie the everyday experience of not perceiving the motion created by our own eye movements-saccadic omission. At the neural level, many cortical and subcortical areas respond differently to perisaccadic visual stimuli than to stimuli presented during fixation. Those neural response changes, however, are complex and the link to the behavioral phenomena of reduced detectability remains tentative. We used a well established model of human visual detection performance to provide a quantitative description of behavioral saccadic suppression and thereby allow a more focused search for its neural mechanisms. We used an equivalent noise method to distinguish between three mechanisms that could underlie saccadic suppression. The first hypothesized mechanism reduces the gain of the visual system, the second increases internal noise levels in a stimulus-dependent manner, and the third increases stimulus uncertainty. All three mechanisms predict that perisaccadic stimuli should be more difficult to detect, but each mechanism predicts a unique pattern of detectability as a function of the amount of external noise. Our experimental finding was that saccades increased detection thresholds at low external noise, but had little influence on thresholds at high levels of external noise. A formal analysis of these data in the equivalent noise analysis framework showed that the most parsimonious mechanism underlying saccadic suppression is a stimulus-independent reduction in response gain.

Effects of microsaccades on contrast detection and V1 responses in macaques

Microsaccades can elevate contrast detection thresholds of human observers and modulate the activity of neurons in monkey visual cortex. Whether microsaccades elevate contrast detection thresholds in monkey observers is not known and bears on the interpretation of neurophysiological experiments. To answer this question, we trained two monkeys to perform a 2AFC contrast detection task. Performance was worse on trials in which a microsaccade occurred during the stimulus presentation. The magnitude of the effect was modest (threshold changes of <0.2 log unit) and color specific: achromatic sensitivity was impaired, but red-green sensitivity was not. To explore the neural basis of this effect, we recorded the responses of individual V1 neurons to a white noise stimulus. Microsaccades produced a suppression of spiking activity followed by an excitatory rebound that was similar for L - M cone-opponent and L + M nonopponent V1 neurons. We conclude that microsaccades in the monkey increase luminance contrast detection thresholds and modulate the spiking activity of V1 neurons, but the luminance specificity of the behavioral suppression is likely implemented downstream of V1.

Effects of saccades on visual processing in primate MSTd

In surveying their visual environment, primates, including humans make frequent rapid eye movements known as saccades. Saccades result in rapid motion of the retinal image and yet this motion is not perceived. We recorded saccade-related changes in neural activity in the dorsal medial superior temporal area (MSTd) of alert macaque monkeys. We show that the spontaneous activity of neurons in MSTd is modulated around the time of saccades. Some cells show considerable suppression of spontaneous activity, while most show early and significant enhancement. While this modulation of spontaneous activity is variable, the concomitant modulation of neural responses evoked by flashed visual stimuli is uniform and stereotypical - visual responses are suppressed for stimuli presented around the time of saccades and enhanced for stimuli presented afterwards. The combined modulation of spontaneous activity and evoked visual responses likely serves to reduce the detectability of peri-saccadic stimuli and promote the perceptual awareness of visual stimuli between saccades.

Microsaccadic suppression of visual bursts in the primate superior colliculus

Saccadic suppression, a behavioral phenomenon in which perceptual thresholds are elevated before, during, and after saccadic eye movements, is an important mechanism for maintaining perceptual stability. However, even during fixation, the eyes never remain still, but undergo movements including microsaccades, drift, and tremor. The neural mechanisms for mediating perceptual stability in the face of these "fixational" movements are not fully understood. Here, we investigated one component of such mechanisms: a neural correlate of microsaccadic suppression. We measured the size of short-latency, stimulus-induced visual bursts in superior colliculus neurons of adult, male rhesus macaques. We found that microsaccades caused approximately 30% suppression of the bursts. Suppression started approximately 70 ms before microsaccade onset and ended approximately 70 ms after microsaccade end, a time course similar to behavioral measures of this phenomenon in humans. We also identified a new behavioral effect of microsaccadic suppression on saccadic reaction times, even for continuously presented, suprathreshold visual stimuli. These results provide evidence that the superior colliculus is part of the mechanism for suppressing self-generated visual signals during microsaccades that might otherwise disrupt perceptual stability.

Visual perception: saccadic omission--suppression or temporal masking?

Although we don't perceive visual stimuli during saccadic eye movements, new evidence shows that our brains do process these stimuli and they can influence our subsequent visual perception.

Functional distinction between visuomovement and movement neurons in macaque frontal eye field during saccade countermanding

In the previous studies on the neural control of saccade initiation using the countermanding paradigm, movement and visuomovement neurons in the frontal eye field were grouped as movement-related neurons. The activity of both types of neurons was modulated when a saccade was inhibited in response to a stop signal, and this modulation occurred early enough to contribute to the control of the saccade initiation. We now report a functional difference between these two classes of neurons when saccades are produced. Movement neurons exhibited a progressive accumulation of discharge rate following target presentation that triggered a saccade when it reached a threshold. When saccades were inhibited with lower probability in response to a stop signal appearing at longer delays, this accumulating activity was interrupted at levels progressively closer to the threshold. In contrast, visuomovement neurons exhibited a maintained elevated discharge rate following target presentation that was followed by a further enhancement immediately before the saccade initiation. When saccades were inhibited in response to a stop signal, the late enhancement was absent and the maintained activity decayed regardless of stop-signal delay. These results demonstrate that the activity of movement neurons realizes the progressive commitment to the saccade initiation modeled by the activation of the go unit in computational models of countermanding performance. The lack of correspondence of the activity of visuomovement neurons with any elements of these models indicates that visuomovement neurons perform a function other than the saccade preparation such as a corollary discharge to update visual processing.

Improved visual sensitivity during smooth pursuit eye movements: Temporal and spatial characteristics

Recently, we showed that contrast sensitivity for color and high–spatial frequency luminance stimuli is enhanced during smooth pursuit eye movements (Schütz et al., 2008). In this study, we investigated the enhancement over a wide range of temporal and spatial frequencies. In Experiment 1, we measured the temporal impulse response function (TIRF) for colored stimuli. The TIRF for pursuit and fixation differed mostly with respect to the gain but not with respect to the natural temporal frequency. Hence, the sensitivity enhancement seems to be rather independent of the temporal frequency of the stimuli. In Experiment 2, we measured the spatial contrast sensitivity function for luminance-defined Gabor patches with spatial frequencies ranging from 0.2 to 7 cpd. We found a sensitivity improvement during pursuit for spatial frequencies above 2–3 cpd. Between 0.5 and 3 cpd, sensitivity was impaired by smooth pursuit eye movements, but no consistent difference was observed below 0.5 cpd. The results of both experiments are consistent with an increased contrast gain of the parvocellular retinogeniculate pathway.

Direction and contrast tuning of macaque MSTd neurons during saccades

Saccades are rapid eye movements that change the direction of gaze, although the full-field image motion associated with these movements is rarely perceived. The attenuation of visual perception during saccades is referred to as saccadic suppression. The mechanisms that produce saccadic suppression are not well understood. We recorded from neurons in the dorsal medial superior temporal area (MSTd) of alert macaque monkeys and compared the neural responses produced by the retinal slip associated with saccades (active motion) to responses evoked by identical motion presented during fixation (passive motion). We provide evidence for a neural correlate of saccadic suppression and expand on two contentious results from previous studies. First, we confirm the finding that some neurons in MSTd reverse their preferred direction during saccades. We quantify this effect by calculating changes in direction tuning index for a large cell population. Second, it has been noted that neural activity associated with saccades can arrive in the parietal cortex <or=30 ms earlier than activity produced by similar visual stimulation during fixation. This led to the question of whether the saccade-related responses were visual in origin or were motor signals arising from saccade-planning areas of the brain. By comparing the responses to saccades made over textured backgrounds of different contrasts, we provide strong evidence that saccade-related responses were visual in origin. Refinements of the possible models of saccadic suppression are discussed.

On the impact of attention and motor planning on the lateral geniculate nucleus

Although the lateral geniculate nucleus (LGN) is one of the most thoroughly characterized thalamic nuclei, its functional role remains controversial. Traditionally, the LGN in primates has been viewed as the lowest level of a set of feedforward parallel visual pathways to cortex. These feedforward pathways are pictured as connected hierarchies of areas designed to construct the visual image gradually - adding more complex features as one marches through successive levels of the hierarchy. In terms of synapse number and circuitry, the anatomy suggests that the LGN can be viewed also as the ultimate terminus in a series of feedback pathways that originate at the highest cortical levels. Since the visual system is dynamic, a more accurate picture of image construction might be one in which information flows bidirectionally, through both the feedforward and feedback pathways constantly and simultaneously. Based upon evidence from anatomy, physiology, and imaging, we argue that the LGN is more than a simple gate for retinal information. Here, we review evidence that suggests that one function of the LGN is to enhance relevant visual signals through circuits related to both motor planning and attention. Specifically, we argue that major extraretinal inputs to the LGN may provide: (1) eye movement information to enhance and bind visual signals related to new saccade targets and (2) top-down and bottom-up information about target relevance to selectively enhance visual signals through spatial attention.

Saccadic modulation of neural responses: possible roles in saccadic suppression, enhancement, and time compression

Humans use saccadic eye movements to make frequent gaze changes, yet the associated full-field image motion is not perceived. The theory of saccadic suppression has been proposed to account for this phenomenon, but it is not clear whether suppression originates from a retinal signal at saccade onset or from the brain before saccade onset. Perceptually, visual sensitivity is reduced before saccades and enhanced afterward. Over the same time period, the perception of time is compressed and even inverted. We explore the origins and neural basis of these effects by recording from neurons in the dorsal medial superior temporal area (MSTd) of alert macaque monkeys. Neuronal responses to flashed presentations of a textured pattern presented at random times relative to saccades exhibit a stereotypical pattern of modulation. Response amplitudes are strongly suppressed for flashes presented up to 90 ms before saccades. Immediately after the suppression, there is a period of 200-450 ms in which flashes generate enhanced response amplitudes. Our results show that (1) MSTd is not directly suppressed, rather suppression is inherited from earlier visual areas; (2) early suppression of the visual system must be of extra-retinal origin; (3) postsaccadic enhancement of neural activity occurs in MSTd; and (4) the enhanced responses have reduced latencies. As a whole, these observations reveal response properties that could account for perceptual observations relating to presaccadic suppression, postsaccadic enhancement and time compression.

Brain circuits for the internal monitoring of movements

Each movement we make activates our own sensory receptors, thus causing a problem for the brain: the spurious, movement-related sensations must be discriminated from the sensory inputs that really matter, those representing our environment. Here we consider circuits for solving this problem in the primate brain. Such circuits convey a copy of each motor command, known as a corollary discharge (CD), to brain regions that use sensory input. In the visual system, CD signals may help to produce a stable visual percept from the jumpy images resulting from our rapid eye movements. A candidate pathway for providing CD for vision ascends from the superior colliculus to the frontal cortex in the primate brain. This circuit conveys warning signals about impending eye movements that are used for planning subsequent movements and analyzing the visual world. Identifying this circuit has provided a model for studying CD in other primate sensory systems and may lead to a better understanding of motor and mental disorders.

Neuronal mechanisms of visual stability

Human vision is stable and continuous in spite of the incessant interruptions produced by saccadic eye movements. These rapid eye movements serve vision by directing the high resolution fovea rapidly from one part of the visual scene to another. They should detract from vision because they generate two major problems: displacement of the retinal image with each saccade and blurring of the image during the saccade. This review considers the substantial advances in understanding the neuronal mechanisms underlying this visual stability derived primarily from neuronal recording and inactivation studies in the monkey, an excellent model for systems in the human brain. For the first problem, saccadic displacement, two neuronal candidates are salient. First are the neurons in frontal and parietal cortex with shifting receptive fields that provide anticipatory activity with each saccade and are driven by a corollary discharge. These could provide the mechanism for a retinotopic hypothesis of visual stability and possibly for a transsaccadic memory hypothesis, The second neuronal mechanism is provided by neurons whose visual response is modulated by eye position (gain field neurons) or are largely independent of eye position (real position neurons), and these neurons could provide the basis for a spatiotopic hypothesis. For the second problem, saccadic suppression, visual masking and corollary discharge are well established mechanisms, and possible neuronal correlates have been identified for each.

Corollary discharge circuits for saccadic modulation of the pigeon visual system

A saccadic eye movement causes a variety of transient perceptual sequelae that might be the results of corollary discharge. Here we describe the neural circuits for saccadic corollary discharge that modulates activity throughout the pigeon visual system. Saccades in pigeons caused inhibition that was mediated by corollary discharge followed by enhancement of firing activity in the telencephalic hyperpallium, visual thalamus and pretectal nucleus lentiformis mesencephali (nLM) with opposite responses in the accessory optic nucleus (nBOR). Inactivation of thalamic neurons eliminated saccadic responses in telencephalic neurons, and inactivation of both the nLM and the nBOR abolished saccadic responses in thalamic neurons. Saccade-related omnipause neurons in the brainstem raphe complex inhibited the nBOR and excited the nLM, whereas inactivation of raphe neurons eliminated saccadic responses in both optokinetic and thalamic neurons. It seems that saccadic responses in telencephalic neurons are generated by corollary discharge signals from brainstem neurons that are transmitted through optokinetic and thalamic neurons. These signals might have important roles in visual perception.

Low-threshold Ca2+-associated bursts are rare events in the LGN of the awake behaving monkey

It has been proposed that low-threshold Ca2+ (LT)-associated bursts in the lateral geniculate nucleus (LGN) of awake animals communicate significant or unexpected visual events to cortex. The present study investigated this hypothesis by examining the incidence of LT bursts in 146 cells recorded from the LGN of three macaque monkeys. Bursts were defined as clusters of two or more action potentials separated by not more than 4 ms and preceded by a > or = 100-ms quiescent interval. The incidence of bursts was examined in several intensive-training Go-NoGo and target selection tasks as well as in training-free tasks where natural scenes with both familiar and novel contents were shown. Our chief findings were as follows. 1) Bursts occur in the majority of cells under every condition tested, 2) burst incidence is very low (<1 burst every 10 s), 3) bursts occur in association with a receptive field stimulus on average only once every 23 times in 65% of cells tested, 4) cells responding with bursts to the stimulus also tended to exhibit higher levels of spontaneous bursting, 5) the presence of bursts did not depend on the novelty of the stimulus or its behavioral relevance. When the monkeys explored static natural scenes, 6) bursts were not correlated with short-term changes in the image sampled by the cell's receptive field during saccades. Burst incidence 7) did not increase when images were novel or when they evoked an emotional reaction, and 8) bursts did not decrease when images were familiar. 9) Bursts were not correlated with saccades in the dark, but 10) more spikes participated in bursts in the dark. Although these results confirm the occurrence of LT bursts in LGN cells of awake monkeys, they do not support the hypothesis that these bursts are a privileged means of transferring sensory information, that they signal unexpected or significant visual events, or that they are involved uniquely in the coding of natural scenes.