Preparing to move increases the sensitivity of superior colliculus neurons

The adaptive global effect: Luminance contrast modulates the global effect zone

When two peripheral objects are presented in close proximity, saccades towards one of these objects land at a weighted average location between the two objects. This phenomenon, known as the 'global effect' or 'saccade averaging', disappears when the distance between the objects increases. When objects are further apart, outside the averaging zone, saccades land on one of the objects with little or no saccade averaging. Although it is known that the strength of the global effect is dependent on the specific features of the two objects, it is unclear if the size of the zone in which averaging can occur (i.e., the averaging zone) is adaptive. The aim of the current study was to investigate whether the size of the averaging zone adapts to variations in object luminance contrast of the objects. In order to systematically assess changes in the averaging zone, in two experiments, observers made saccadic eye movements while the luminance of the target and the distractor varied. We report three major findings: 1) When a distractor was more luminant relative to the target, the averaging zone increased (Exp. 1). Notably, saccade averaging never entirely ceased to exist, even for remote distractors. 2) When target and distractor were equiluminant, the averaging zone did not change with absolute luminance (Exp. 2). 3) Higher (relative and absolute) luminance increased the averaging zone especially for shorter saccadic response times (SRT). We conclude that the averaging zone is adaptive and becomes larger with increasing relative luminance and especially when SRTs are short.

Pathways for Naturalistic Looking Behavior in Primate II. Superior Colliculus Integrates Parallel Top-down and Bottom-up Inputs

Volitional signals for gaze control are provided by multiple parallel pathways converging on the midbrain superior colliculus (SC), whose deeper layers output to the brainstem gaze circuits. In the first of two papers (Takahashi and Veale, 2023), we described the properties of gaze behavior of several species under both laboratory and natural conditions, as well as the current understanding of the brainstem and spinal cord circuits implementing gaze control in primate. In this paper, we review the parallel pathways by which sensory and task information reaches SC and how these sensory and task signals interact within SC's multilayered structure. This includes both bottom-up (world statistics) signals mediated by sensory cortex, association cortex, and subcortical structures, as well as top-down (goal and task) influences which arrive via either direct excitatory pathways from cerebral cortex, or via indirect basal ganglia relays resulting in inhibition or dis-inhibition as appropriate for alternative behaviors. Models of attention such as saliency maps serve as convenient frameworks to organize our understanding of both the separate computations of each neural pathway, as well as the interaction between the multiple parallel pathways influencing gaze. While the spatial interactions between gaze's neural pathways are relatively well understood, the temporal interactions between and within pathways will be an important area of future study, requiring both improved technical methods for measurement and improvement of our understanding of how temporal dynamics results in the observed spatiotemporal allocation of gaze.

Pre-saccadic Neural Enhancements in Marmoset Area MT

Each time we make an eye movement, attention moves before the eyes, resulting in a perceptual enhancement at the target. Recent psychophysical studies suggest that this pre-saccadic attention enhances the visual features at the saccade target, whereas covert attention causes only spatially selective enhancements. While previous nonhuman primate studies have found that pre-saccadic attention does enhance neural responses spatially, no studies have tested whether changes in neural tuning reflect an automatic feature enhancement. Here we examined pre-saccadic attention using a saccade foraging task developed for marmoset monkeys (one male and one female). We recorded from neurons in the middle temporal area with peripheral receptive fields that contained a motion stimulus, which would either be the target of a saccade or a distracter as a saccade was made to another location. We established that marmosets, like macaques, show enhanced pre-saccadic neural responses for saccades toward the receptive field, including increases in firing rate and motion information. We then examined if the specific changes in neural tuning might support feature enhancements for the target. Neurons exhibited diverse changes in tuning but predominantly showed additive and multiplicative increases that were uniformly applied across motion directions. These findings confirm that marmoset monkeys, like macaques, exhibit pre-saccadic neural enhancements during saccade foraging tasks with minimal training requirements. However, at the level of individual neurons, the lack of feature-tuned enhancements is similar to neural effects reported during covert spatial attention.

Laminar compartmentalization of attention modulation in area V4 aligns with the demands of visual processing hierarchy in the cortex

Attention selectively enhances neural responses to low contrast stimuli in visual area V4, a critical hub that sends projections both up and down the visual hierarchy. Veridical encoding of contrast information is a key computation in early visual areas, while later stages encoding higher level features benefit from improved sensitivity to low contrast. How area V4 meets these distinct information processing demands in the attentive state is unknown. We found that attentional modulation in V4 is cortical layer and cell-class specific. Putative excitatory neurons in the superficial layers show enhanced boosting of low contrast information, while those of deep layers exhibit contrast-independent scaling. Computational modeling suggested the extent of spatial integration of inhibitory neurons as the mechanism behind such laminar differences. Considering that superficial neurons are known to project to higher areas and deep layers to early visual areas, our findings suggest that the interactions between attention and contrast in V4 are compartmentalized, in alignment with the demands of the visual processing hierarchy.

Sensory tuning in neuronal movement commands

Movement control is critical for successful interaction with our environment. However, movement does not occur in complete isolation of sensation, and this is particularly true of eye movements. Here, we show that the neuronal eye movement commands emitted by the superior colliculus (SC), a structure classically associated with oculomotor control, encompass a robust visual sensory representation of eye movement targets. Thus, similar saccades toward different images are associated with different saccade-related "motor" bursts. Such sensory tuning in SC saccade motor commands appeared for all image manipulations that we tested, from simple visual features to real-life object images, and it was also strongest in the most motor neurons in the deeper collicular layers. Visual-feature discrimination performance in the motor commands was also stronger than in visual responses. Comparing SC motor command feature discrimination performance to that in the primary visual cortex during steady-state gaze fixation revealed that collicular motor bursts possess a reliable perisaccadic sensory representation of the peripheral saccade target's visual appearance, exactly when retinal input is expected to be most uncertain. Our results demonstrate that SC neuronal movement commands likely serve a fundamentally sensory function.

Visual Functions of the Primate Superior Colliculus

The superior colliculus (SC) is a subcortical brain structure that is relevant for sensation, cognition, and action. In nonhuman primates, a rich history of studies has provided unprecedented detail about this structure's role in controlling orienting behaviors; as a result, the primate SC has become primarily regarded as a motor control structure. However, as in other species, the primate SC is also a highly visual structure: A fraction of its inputs is retinal and complemented by inputs from visual cortical areas, including the primary visual cortex. Motivated by this, recent investigations are revealing the rich visual pattern analysis capabilities of the primate SC, placing this structure in an ideal position to guide orienting movements. The anatomical proximity of the primate SC to both early visual inputs and final motor control apparatuses, as well as its ascending feedback projections to the cortex, affirms an important role for this structure in active perception.

Done in 65 ms: Express Visuomotor Responses in Upper Limb Muscles in Rhesus Macaques

How rapidly can the brain transform vision into action? Work in humans has established that the transformation for visually-guided reaching can be remarkably rapid, with the first phase of upper limb muscle recruitment, the express visuomotor response, beginning within less than 100 ms of visual target presentation. Such short-latency responses limit the opportunities for extensive cortical processing, leading to the hypothesis that they are generated via the subcortical tecto-reticulo-spinal pathway. Here, we examine whether nonhuman primates (NHPs) exhibit express visuomotor responses. Two male macaques made visually-guided reaches in a behavioral paradigm known to elicit express visuomotor responses in humans, while we acquired intramuscular recordings from the deltoid muscle. Across several variants of this paradigm, express visuomotor responses began within 65 ms (range: 48-91 ms) of target presentation. Although the timing of the express visuomotor response did not co-vary with reaction time, larger express visuomotor responses tended to precede shorter latency reaches. Further, we observed that the magnitude of the express visuomotor response could be muted by contextual context, although this effect was quite variable. Overall, the response properties in NHPs resemble those in humans. Our results establish a new benchmark for visuomotor transformations underlying visually-guided reaches, setting the stage for experiments that can directly compare the role of cortical and subcortical areas in reaching when time is of the essence.

Motion distractors perturb saccade programming later in time than static distractors

The mechanism that reweights oculomotor vectors based on visual features is unclear. However, the latency of oculomotor visual activations gives insight into their antecedent featural processing. We compared the oculomotor processing time course of grayscale, task-irrelevant static and motion distractors during target selection by continuously measuring a battery of human saccadic behavioral metrics as a function of time after distractor onset. The motion direction was towards or away from the target and the motion speed was fast or slow. We compared static and motion distractors and observed that both distractors elicited curved saccades and shifted endpoints at short latencies (∼25 ms). After 50 ms, saccade trajectory biasing elicited by motion distractors lagged static distractor trajectory biasing by 10 ms. There were no such latency differences between distractor motion directions or motion speeds. This pattern suggests that additional processing of motion stimuli occurred prior to the propagation of visual information into the oculomotor system. We examined the interaction of distractor processing time (DPT) with two additional factors: saccadic reaction time (SRT) and saccadic amplitude. Shorter SRTs were associated with shorter DPT latencies of biased saccade trajectories. Both SRT and saccadic amplitude were associated with the magnitude of saccade trajectory biases.

Faster Detection of "Darks" than "Brights" by Monkey Superior Colliculus Neurons

Visual processing is segregated into ON and OFF channels as early as in the retina, and the superficial (output) layers of the primary visual cortex (V1) are dominated by neurons preferring dark stimuli. However, it is not clear how the timing of neural processing differs between "darks" and "brights" in general, especially in light of psychophysical evidence; it is also equally not clear how subcortical visual pathways that are critical for active orienting represent stimuli of positive (luminance increments) and negative (luminance decrements) contrast polarity. Here, we recorded from all visually-responsive neuron types in the superior colliculus (SC) of two male rhesus macaque monkeys. We presented a disk (0.51° radius) within the response fields (RFs) of neurons, and we varied, across trials, stimulus Weber contrast relative to a gray background. We also varied contrast polarity. There was a large diversity of preferences for darks and brights across the population. However, regardless of individual neural sensitivity, most neurons responded significantly earlier to dark than bright stimuli. This resulted in a dissociation between neural preference and visual response onset latency: a neuron could exhibit a weaker response to a dark stimulus than to a bright stimulus of the same contrast, but it would still have an earlier response to the dark stimulus. Our results highlight an additional candidate visual neural pathway for explaining behavioral differences between the processing of darks and brights, and they demonstrate the importance of temporal aspects in the visual neural code for orienting eye movements.SIGNIFICANCE STATEMENT Objects in our environment, such as birds flying across a bright sky, often project shadows (or images darker than the surround) on our retina. We studied how primate superior colliculus (SC) neurons visually process such dark stimuli. We found that the overall population of SC neurons represented both dark and bright stimuli equally well, as evidenced by a relatively equal distribution of neurons that were either more or less sensitive to darks. However, independent of sensitivity, the great majority of neurons detected dark stimuli earlier than bright stimuli, evidenced by a smaller response latency for the dark stimuli. Thus, SC neural response latency can be dissociated from response sensitivity, and it favors the faster detection of dark image contrasts.

Oculomotor Target Selection is Mediated by Complex Objects

Oculomotor target selection often requires discriminating visual features, but it remains unclear how oculomotor substrates encoding saccade vectors functionally contribute to this process. One possibility is that oculomotor vector representations (observed directly as physiological activation or inferred from behavioral interference) of potential targets are continuously re-weighted by task-relevance computed elsewhere in specialized visual modules, while an alternative possibility is that oculomotor modules utilize local featural analyses to actively discriminate potential targets. Strengthening the former account, oculomotor vector representations have longer onset latencies for ventral- (i.e., color) than dorsal-stream features (i.e., luminance), suggesting that oculomotor vector representations originate from featurally-relevant specialized visual modules. Here, we extended this reasoning by behaviorally examining whether the onset latency of saccadic interference elicited by visually complex stimuli is greater than is commonly observed for simple stimuli. We measured human saccade metrics (saccade curvature, endpoint deviations, saccade frequency, error proportion) as a function of time after abrupt distractor onset. Distractors were novel, visually complex, and had to be discriminated from targets to guide saccades. The earliest saccadic interference latency was ~110 ms, considerably longer than previous experiments, suggesting that sensory representations projected into the oculomotor system are gated to allow for sufficient featural processing to satisfy task demands. Surprisingly, initial oculomotor vector representations encoded features, as we manipulated the visual similarity between targets and distractors and observed increased vector modulation response magnitude and duration when the distractor was highly similar to the target. Oculomotor vector modulation was gradually extinguished over the time course of the experiment.

High-contrast, moving targets in an emerging target paradigm promote fast visuomotor responses during visually guided reaching

Humans have a remarkable capacity to rapidly interact with the surrounding environment, often by transforming visual input into motor output on a moment-to-moment basis. But what visual features promote rapid reaching? High-contrast, fast-moving targets elicit strong responses in the superior colliculus (SC), a structure associated with express saccades and implicated in rapid electromyographic (EMG) responses on upper limb muscles. To test the influence of stimulus properties on rapid reaches, we had human subjects perform visually guided reaches to moving targets varied by speed (experiment 1) or speed and contrast (experiment 2) in an emerging target paradigm that has recently been shown to robustly elicit fast visuomotor responses. Our analysis focused on stimulus-locked responses (SLRs) on upper limb muscles. SLRs appear within <100 ms of target presentation, and as the first wave of muscle recruitment they have been hypothesized to arise from the SC. Across 32 subjects studied in both experiments, 97% expressed SLRs in the emerging target paradigm, whereas only 69% expressed SLRs in an immediate response paradigm toward static targets. Faster-moving targets (experiment 1) evoked large-magnitude SLRs, whereas high-contrast fast-moving targets (experiment 2) evoked short-latency, large-magnitude SLRs. In some instances, SLR magnitude exceeded the magnitude of movement-aligned activity. Both large-magnitude and short-latency SLRs were correlated with short-latency reach reaction times. Our results support the hypothesis that, in scenarios requiring expedited responses, a subcortical pathway originating in the SC elicits the earliest wave of muscle recruitment, expediting reaction times.NEW & NOTEWORTHY How does the brain rapidly transform vision into action? Here, by recording upper limb muscle activity, we find that high-contrast and fast-moving targets are highly effective at evoking rapid visually guided reaches. We surmise that a brain stem circuit originating in the superior colliculus contributes to the most rapid reaching responses. When time is of the essence, cortical areas may serve to prime this circuit and elaborate subsequent phases of recruitment.

Instantaneous movement-unrelated midbrain activity modifies ongoing eye movements

At any moment in time, new information is sampled from the environment and interacts with ongoing brain state. Often, such interaction takes place within individual circuits that are capable of both mediating the internally ongoing plan as well as representing exogenous sensory events. Here, we investigated how sensory-driven neural activity can be integrated, very often in the same neuron types, into ongoing saccade motor commands. Despite the ballistic nature of saccades, visually induced action potentials in the rhesus macaque superior colliculus (SC), a structure known to drive eye movements, not only occurred intra-saccadically, but they were also associated with highly predictable modifications of ongoing eye movements. Such predictable modifications reflected a simultaneity of movement-related discharge at one SC site and visually induced activity at another. Our results suggest instantaneous readout of the SC during movement generation, irrespective of activity source, and they explain a significant component of kinematic variability of motor outputs.

Unraveling circuits of visual perception and cognition through the superior colliculus

The superior colliculus is a conserved sensorimotor structure that integrates visual and other sensory information to drive reflexive behaviors. Although the evidence for this is strong and compelling, a number of experiments reveal a role for the superior colliculus in behaviors usually associated with the cerebral cortex, such as attention and decision-making. Indeed, in addition to collicular outputs targeting brainstem regions controlling movements, the superior colliculus also has ascending projections linking it to forebrain structures including the basal ganglia and amygdala, highlighting the fact that the superior colliculus, with its vast inputs and outputs, can influence processing throughout the neuraxis. Today, modern molecular and genetic methods combined with sophisticated behavioral assessments have the potential to make significant breakthroughs in our understanding of the evolution and conservation of neuronal cell types and circuits in the superior colliculus that give rise to simple and complex behaviors.

Active vision at the foveal scale in the primate superior colliculus

The primate superior colliculus (SC) has recently been shown to possess both a large foveal representation as well as a varied visual processing repertoire. This structure is also known to contribute to eye movement generation. Here, we describe our current understanding of how SC visual and movement-related signals interact within the realm of small eye movements associated with the foveal scale of visuomotor behavior. Within the SC's foveal representation, there is a full spectrum of visual, visual-motor, and motor-related discharge for fixational eye movements. Moreover, a substantial number of neurons only emit movement-related discharge when microsaccades are visually guided, but not when similar movements are generated toward a blank. This represents a particularly striking example of integrating vision and action at the foveal scale. Beyond that, SC visual responses themselves are strongly modulated, and in multiple ways, by the occurrence of small eye movements. Intriguingly, this impact can extend to eccentricities well beyond the fovea, causing both sensitivity enhancement and suppression in the periphery. Because of large foveal magnification of neural tissue, such long-range eccentricity effects are neurally warped into smaller differences in anatomical space, providing a structural means for linking peripheral and foveal visual modulations around fixational eye movements. Finally, even the retinal-image visual flows associated with tiny fixational eye movements are signaled fairly faithfully by peripheral SC neurons with relatively large receptive fields. These results demonstrate how studying active vision at the foveal scale represents an opportunity for understanding primate vision during natural behaviors involving ever-present foveating eye movements.NEW & NOTEWORTHY The primate superior colliculus (SC) is ideally suited for active vision at the foveal scale: it enables detailed foveal visual analysis by accurately driving small eye movements, and it also possesses a visual processing machinery that is sensitive to active eye movement behavior. Studying active vision at the foveal scale in the primate SC is informative for broader aspects of active perception, including the overt and covert processing of peripheral extra-foveal visual scene locations.

Preparation of saccade sequences and eye programming affect endogenous covert attention

Endogenous attention can be allocated in parallel to at least two saccade target locations of a planned sequence, but attentional resources are larger in the location of the first than the second saccade. The meridian effect that is observed in endogenous attention can be explained by eye programming, but it is not known how eye-movement preparation and eye programming can together affect endogenous attention during sequential saccades. We used a double-task paradigm to investigate this issue. In two experiments, we confirmed the relation between the preparation of sequential saccades and attentional selection and also showed that eye programming could eliminate deterioration of attentional resources in the second saccade location. The finding of the meridian effect in both the saccadic task and the target discrimination task additionally indicates the important role of eye programming in endogenous attention. The results were discussed in terms of the Premotor Theory of Attention.

A Prototypical Template for Rapid Face Detection Is Embedded in the Monkey Superior Colliculus

Human babies respond preferentially to faces or face-like images. It has been proposed that an innate and rapid face detection system is present at birth before the cortical visual pathway is developed in many species, including primates. However, in primates, the visual area responsible for this process is yet to be unraveled. We hypothesized that the superior colliculus (SC) that receives direct and indirect retinal visual inputs may serve as an innate rapid face-detection system in primates. To test this hypothesis, we examined the responsiveness of monkey SC neurons to first-order information of faces required for face detection (basic spatial layout of facial features including eyes, nose, and mouth), by analyzing neuronal responses to line drawing images of: (1) face-like patterns with contours and properly placed facial features; (2) non-face patterns including face contours only; and (3) nonface random patterns with contours and randomly placed face features. Here, we show that SC neurons respond stronger and faster to upright and inverted face-like patterns compared to the responses to nonface patterns, regardless of contrast polarity and contour shapes. Furthermore, SC neurons with central receptive fields (RFs) were more selective to face-like patterns. In addition, the population activity of SC neurons with central RFs can discriminate face-like patterns from nonface patterns as early as 50 ms after the stimulus onset. Our results provide strong neurophysiological evidence for the involvement of the primate SC in face detection and suggest the existence of a broadly tuned template for face detection in the subcortical visual pathway.

Stimulus-Locked Responses on Human Upper Limb Muscles and Corrective Reaches Are Preferentially Evoked by Low Spatial Frequencies

In situations requiring immediate action, humans can generate visually-guided responses at remarkably short latencies. Here, to better understand the visual attributes that best evoke such rapid responses, we recorded upper limb muscle activity while participants performed visually-guided reaches towards Gabor patches composed of differing spatial frequencies (SFs). We studied reaches initiated from a stable posture (experiment 1, a static condition), or during on-line reach corrections to an abruptly displaced target (experiment 2, a dynamic condition). In both experiments, we detail the latency and prevalence of stimulus-locked responses (SLRs), which are brief bursts of EMG activity that are time-locked to target presentation rather than movement onset. SLRs represent the first wave of EMG recruitment influenced by target presentation, and enable quantification of rapid visuomotor transformations. In both experiments, reach targets composed of low SFs elicited the shortest latency and most prevalent SLRs, with SLR latency increasing and SLR prevalence decreasing for reach targets composed of progressively higher SFs. SLRs could be evoked in either the static or dynamic condition, and when present in experiment 2, were associated with shorter latency and larger magnitude corrections. The results in experiment 2 are consistent with a linkage between the forces produced by SLRs and the earliest portion of on-line reach corrections. Overall, our results demonstrate that stimuli composed of low SFs preferentially evoke the most rapid visuomotor responses that, in the context of rapidly correcting an on-going reaching movement, are associated with earlier and larger on-line reach corrections.

Discriminating between anticipatory and visually triggered saccades: measuring minimal visual saccadic response time using luminance

We describe a novel behavioral method to accurately discriminate anticipatory (i.e., saccades not generated by visual input) from visually triggered saccades and to identify the minimal visual saccadic reaction time (SRT). This method can be used to calculate a feasible lower bound cutoff for latencies of visually triggered saccades within a certain experimental context or participant group. We apply this method to compute the minimal visual SRT for two different saccade target luminance levels. Three main findings are presented: 1) the minimal visual SRT for all participants was 46 ms shorter for bright targets than for dim targets, 2) the transition from non-visually triggered to visually triggered saccades occurred abruptly, independent of target luminance, and 3) although the absolute minimal visual SRTs varied between participants, the response pattern (response to bright targets being faster than to dim targets) was consistent across participants. These results are consistent with variability in saccadic and neural responses to luminance as has been reported in monkeys. On the basis of these results, we argue that differences in the minimal visual SRT can easily occur when stimuli vary in luminance or other saliency features. Applying an absolute cutoff (i.e., 70-90 ms) that approaches the minimal neuronal conduction delays, which is general practice in many laboratories, may result in the wrongful inclusion of saccades that are not visually triggered. It is suggested to assess the lower SRT bound for visually triggered saccades when piloting an experimental setup and before including saccades based on particular latency criteria. NEW & NOTEWORTHY We successfully developed an anticipation paradigm to discriminate between anticipatory and visually triggered saccades by measuring the minimal visual saccadic response time (SRT). We show that the 70- to 90-ms lower bound cutoff for visually triggered saccades should be applied in a flexible way and that the transitional interval is very short. The paradigm can be employed to investigate the effects of different stimulus features, experimental conditions, and participant groups on the minimal visual SRT in humans.

Higher order, multifeatural object encoding by the oculomotor system

Previous behavioral and physiological research has demonstrated that as the behavioral relevance of potential saccade goals increases, they elicit more competition during target selection processing as evidenced by increased saccade curvature and neural activity. However, these effects have only been demonstrated for lower order feature singletons, and it remains unclear whether more complicated featural differences between higher order objects also elicit vector modulation. Therefore, we measured human saccades curvature elicited by distractors bilaterally flanking a target during a visual search saccade task and systematically varied subsets of features shared between the two distractors and the target, referred to as objective similarity (OS). Our results demonstrate that saccades deviated away from the distractor highest in OS to the target and that there was a linear relationship between the magnitude of saccade deviation and the number of feature differences between the most similar distractor and the target. Furthermore, an analysis of curvature over the time course of the saccade demonstrated that curvature only occurred in the first 20-30 ms of the movement. Given the multifeatural complexity of the novel stimuli, these results suggest that saccadic target selection processing involves dynamically reweighting vector representations for movement planning to several possible targets based on their behavioral relevance. NEW & NOTEWORTHY We demonstrate that small featural differences between unfamiliar, higher order object representations modulate vector weights during saccadic target selection processing. Such effects have previously only been demonstrated for familiar, simple feature singletons (e.g., color) in which features characterize entire objects. The complexity and novelty of our stimuli suggest that the oculomotor system dynamically receives visual/cognitive information processed in the higher order representational networks of the cortical visual processing hierarchy and integrates this information for saccadic movement planning.

Orientation and Contrast Tuning Properties and Temporal Flicker Fusion Characteristics of Primate Superior Colliculus Neurons

The primate superior colliculus is traditionally studied from the perspectives of gaze control, target selection, and selective attention. However, this structure is also visually responsive, and it is the primary visual structure in several species. Thus, understanding the visual tuning properties of the primate superior colliculus is important, especially given that the superior colliculus is part of an alternative visual pathway running in parallel to the predominant geniculo-cortical pathway. In recent previous studies, we have characterized receptive field organization and spatial frequency tuning properties in the primate (rhesus macaque) superior colliculus. Here, we explored additional aspects like orientation tuning, putative center-surround interactions, and temporal frequency tuning characteristics of visually-responsive superior colliculus neurons. We found that orientation tuning exists in the primate superior colliculus, but that such tuning is relatively moderate in strength. We also used stimuli of different sizes to explore contrast sensitivity and center-surround interactions. We found that stimulus size within a visual receptive field primarily affects the slope of contrast sensitivity curves without altering maximal firing rate. Additionally, sustained firing rates, long after stimulus onset, strongly depend on stimulus size, and this is also reflected in local field potentials. This suggests the presence of inhibitory interactions within and around classical receptive fields. Finally, primate superior colliculus neurons exhibit temporal frequency tuning for frequencies lower than 30 Hz, with critical flicker fusion frequencies of <20 Hz. These results support the hypothesis that the primate superior colliculus might contribute to visual performance, likely by mediating coarse, but rapid, object detection and identification capabilities for the purpose of facilitating or inhibiting orienting responses. Such mediation may be particularly amplified in blindsight subjects who lose portions of their primary visual cortex and therefore rely on alternative visual pathways including the pathway through the superior colliculus.

Spatial frequency sensitivity in macaque midbrain

Visual brain areas exhibit tuning characteristics well suited for image statistics present in our natural environment. However, visual sensation is an active process, and if there are any brain areas that ought to be particularly in tune with natural scene statistics, it would be sensory-motor areas critical for guiding behavior. Here we found that the rhesus macaque superior colliculus, a structure instrumental for rapid visual exploration with saccades, detects low spatial frequencies, which are the most prevalent in natural scenes, much more rapidly than high spatial frequencies. Importantly, this accelerated detection happens independently of whether a neuron is more or less sensitive to low spatial frequencies to begin with. At the population level, the superior colliculus additionally over-represents low spatial frequencies in neural response sensitivity, even at near-foveal eccentricities. Thus, the superior colliculus possesses both temporal and response gain mechanisms for efficient gaze realignment in low-spatial-frequency-dominated natural environments.

Frontal Eye Field Inactivation Reduces Saccade Preparation in the Superior Colliculus but Does Not Alter How Preparatory Activity Relates to Saccades of a Given Latency

A neural correlate for saccadic reaction times (SRTs) in the gap saccade task is the level of low-frequency activity in the intermediate layers of the superior colliculus (iSC) just before visual target onset: greater levels of such preparatory iSC low-frequency activity precede shorter SRTs. The frontal eye fields (FEFs) are one likely source of iSC preparatory activity, since FEF preparatory activity is also inversely related to SRT. To better understand the FEF’s role in saccade preparation, and the way in which such preparation relates to SRT, in two male rhesus monkeys, we compared iSC preparatory activity across unilateral reversible cryogenic inactivation of the FEF. FEF inactivation increased contralesional SRTs, and lowered ipsilesional iSC preparatory activity. FEF inactivation also reduced rostral iSC activity during the gap period. Importantly, the distributions of SRTs generated with or without FEF inactivation overlapped, enabling us to conduct a novel population-level analyses examining iSC preparatory activity just before generation of SRT-matched saccades. When matched for SRTs, we observed no change during FEF inactivation in the relationship between iSC preparatory activity and SRT-matched saccades across a range of SRTs, even for the occasional express saccade. Thus, while our results emphasize that the FEF has an overall excitatory influence on preparatory activity in the iSC, the communication between the iSC and downstream oculomotor brainstem is unaltered for SRT-matched saccades.

Change in sensitivity to visual error in superior colliculus during saccade adaptation

Saccadic eye movements provide a valuable model to study the brain mechanisms underlying motor learning. If a target is displaced surreptitiously while a saccade is underway, the saccade appears to be in error. If the error persists gradual neuronal adjustments cause the eye movement again to land near the target. This saccade adaptation typically follows an exponential time course, i.e., adaptation speed slows as adaptation progresses, indicating that the sensitivity to error decreases during adaptation. Previous studies suggested that the superior colliculus (SC) sends error signals to drive saccade adaptation. The objective of this study is to test whether the SC error signal is related to the decrease in the error sensitivity during adaptation. We show here that the visual activity of SC neurons, which is induced by a constant visual error that drives adaptation, decreases during saccade adaptation. This decrease of sensitivity to visual error was not correlated with the changes of primary saccade amplitude. Therefore, a possible interpretation of this result is that the reduction of visual sensitivity of SC neurons contributes an error sensitivity signal that could help control the saccade adaptation process.

Circuits for Action and Cognition: A View from the Superior Colliculus

The superior colliculus is one of the most well-studied structures in the brain, and with each new report, its proposed role in behavior seems to increase in complexity. Forty years of evidence show that the colliculus is critical for reorienting an organism toward objects of interest. In monkeys, this involves saccadic eye movements. Recent work in the monkey colliculus and in the homologous optic tectum of the bird extends our understanding of the role of the colliculus in higher mental functions, such as attention and decision making. In this review, we highlight some of these recent results, as well as those capitalizing on circuit-based methodologies using transgenic mice models, to understand the contribution of the colliculus to attention and decision making. The wealth of information we have about the colliculus, together with new tools, provides a unique opportunity to obtain a detailed accounting of the neurons, circuits, and computations that underlie complex behavior.

A neural locus for spatial-frequency specific saccadic suppression in visual-motor neurons of the primate superior colliculus

Saccades cause rapid retinal-image shifts that go perceptually unnoticed several times per second. The mechanisms for saccadic suppression have been controversial, in part because of sparse understanding of neural substrates. In this study we uncovered an unexpectedly specific neural locus for spatial frequency-specific saccadic suppression in the superior colliculus (SC). We first developed a sensitive behavioral measure of suppression in two macaque monkeys, demonstrating selectivity to low spatial frequencies similar to that observed in earlier behavioral studies. We then investigated visual responses in either purely visual SC neurons or anatomically deeper visual motor neurons, which are also involved in saccade generation commands. Surprisingly, visual motor neurons showed the strongest visual suppression, and the suppression was dependent on spatial frequency, as in behavior. Most importantly, suppression selectivity for spatial frequency in visual motor neurons was highly predictive of behavioral suppression effects in each individual animal, with our recorded population explaining up to ~74% of behavioral variance even on completely different experimental sessions. Visual SC neurons had mild suppression, which was unselective for spatial frequency and thus only explained up to ~48% of behavioral variance. In terms of spatial frequency-specific saccadic suppression, our results run contrary to predictions that may be associated with a hypothesized SC saccadic suppression mechanism, in which a motor command in the visual motor and motor neurons is first relayed to the more superficial purely visual neurons, to suppress them and to then potentially be fed back to cortex. Instead, an extraretinal modulatory signal mediating spatial-frequency-specific suppression may already be established in visual motor neurons.NEW & NOTEWORTHY Saccades, which repeatedly realign the line of sight, introduce spurious signals in retinal images that normally go unnoticed. In part, this happens because of perisaccadic suppression of visual sensitivity, which is known to depend on spatial frequency. We discovered that a specific subtype of superior colliculus (SC) neurons demonstrates spatial-frequency-dependent suppression. Curiously, it is the neurons that help mediate the saccadic command itself that exhibit such suppression, and not the purely visual ones.

An Extended Normalization Model of Attention Accounts for Feature-Based Attentional Enhancement of Both Response and Coherence Gain

Paying attention to a sensory feature improves its perception and impairs that of others. Recent work has shown that a Normalization Model of Attention (NMoA) can account for a wide range of physiological findings and the influence of different attentional manipulations on visual performance. A key prediction of the NMoA is that attention to a visual feature like an orientation or a motion direction will increase the response of neurons preferring the attended feature (response gain) rather than increase the sensory input strength of the attended stimulus (input gain). This effect of feature-based attention on neuronal responses should translate to similar patterns of improvement in behavioral performance, with psychometric functions showing response gain rather than input gain when attention is directed to the task-relevant feature. In contrast, we report here that when human subjects are cued to attend to one of two motion directions in a transparent motion display, attentional effects manifest as a combination of input and response gain. Further, the impact on input gain is greater when attention is directed towards a narrow range of motion directions than when it is directed towards a broad range. These results are captured by an extended NMoA, which either includes a stimulus-independent attentional contribution to normalization or utilizes direction-tuned normalization. The proposed extensions are consistent with the feature-similarity gain model of attention and the attentional modulation in extrastriate area MT, where neuronal responses are enhanced and suppressed by attention to preferred and non-preferred motion directions respectively.

We report a pattern of feature-based attentional effects on human psychophysical performance, which cannot be accounted for by the Normalization Model of Attention using biologically plausible parameters. Specifically, this prominent model of attentional modulation predicts that attention to a visual feature like a specific motion direction will lead to a response gain in the input-response function, rather than the input gain that we actually observe. In our data, the input gain is greater when attention is directed towards a narrow range of motion directions, again contrary to the model’s prediction. We therefore propose two physiologically testable extensions of the model that include direction-tuned normalization mechanisms of attention. Both extensions account for our data without affecting the previously demonstrated successful performance of the NMoA.

Unmasking saccadic uncrowding

Stimuli that are briefly presented around the time of saccades are often perceived with spatiotemporal distortions. These distortions do not always have deleterious effects on the visibility and identification of a stimulus. Recent studies reported that when a stimulus is the target of an intended saccade, it is released from both masking and crowding. Here, we investigated pre-saccadic changes in single and crowded letter recognition performance in the absence (Experiment 1) and the presence (Experiment 2) of backward masks to determine the extent to which saccadic "uncrowding" and "unmasking" mechanisms are similar. Our results show that pre-saccadic improvements in letter recognition performance are mostly due to the presence of masks and/or stimulus transients which occur after the target is presented. More importantly, we did not find any decrease in crowding strength before impending saccades. A simplified version of a dual-channel neural model, originally proposed to explain masking phenomena, with several saccadic add-on mechanisms, could account for our results in Experiment 1. However, this model falls short in explaining how saccades drastically reduced the effect of backward masking (Experiment 2). The addition of a remapping mechanism that alters the relative spatial positions of stimuli was needed to fully account for the improvements observed when backward masks followed the letter stimuli. Taken together, our results (i) are inconsistent with saccadic uncrowding, (ii) strongly support saccadic unmasking, and (iii) suggest that pre-saccadic letter recognition is modulated by multiple perisaccadic mechanisms with different time courses.

Fixational eye movements predict visual sensitivity

During steady fixation, observers make small fixational saccades at a rate of around 1–2 per second. Presentation of a visual stimulus triggers a biphasic modulation in fixational saccade rate—an initial inhibition followed by a period of elevated rate and a subsequent return to baseline. Here we show that, during passive viewing, this rate signature is highly sensitive to small changes in stimulus contrast. By training a linear support vector machine to classify trials in which a stimulus is either present or absent, we directly compared the contrast sensitivity of fixational eye movements with individuals' psychophysical judgements. Classification accuracy closely matched psychophysical performance, and predicted individuals' threshold estimates with less bias and overall error than those obtained using specific features of the signature. Performance of the classifier was robust to changes in the training set (novel subjects and/or contrasts) and good prediction accuracy was obtained with a practicable number of trials. Our results indicate a tight coupling between the sensitivity of visual perceptual judgements and fixational eye control mechanisms. This raises the possibility that fixational saccades could provide a novel and objective means of estimating visual contrast sensitivity without the need for observers to make any explicit judgement.

A sodium afterdepolarization in rat superior colliculus neurons and its contribution to population activity

The mammalian superior colliculus (SC) is a midbrain structure that integrates multimodal sensory inputs and computes commands to initiate rapid eye movements. SC neurons burst with the sudden onset of a visual stimulus, followed by persistent activity that may underlie shifts of attention and decision making. Experiments in vitro suggest that circuit reverberations play a role in the burst activity in the SC, but the origin of persistent activity is unclear. In the present study we characterized an afterdepolarization (ADP) that follows action potentials in slices of rat SC. Population responses seen with voltage-sensitive dye imaging consisted of rapid spikes followed immediately by a second distinct depolarization of lower amplitude and longer duration. Patch-clamp recordings showed qualitatively similar behavior: in nearly all neurons throughout the SC, rapid spikes were followed by an ADP. Ionic and pharmacological manipulations along with experiments with current and voltage steps indicated that the ADP of SC neurons arises from Na(+) current that either persists or resurges following Na(+) channel inactivation at the end of an action potential. Comparisons of pharmacological properties and frequency dependence revealed a clear parallel between patch-clamp recordings and voltage imaging experiments, indicating a common underlying membrane mechanism for the ADP in both single neurons and populations. The ADP can initiate repetitive spiking at intervals consistent with the frequency of persistent activity in the SC. These results indicate that SC neurons have intrinsic membrane properties that can contribute to electrical activity that underlies shifts of attention and decision making.

Perisaccadic Updating of Visual Representations and Attentional States: Linking Behavior and Neurophysiology

During natural vision, saccadic eye movements lead to frequent retinal image changes that result in different neuronal subpopulations representing the same visual feature across fixations. Despite these potentially disruptive changes to the neural representation, our visual percept is remarkably stable. Visual receptive field remapping, characterized as an anticipatory shift in the position of a neuron's spatial receptive field immediately before saccades, has been proposed as one possible neural substrate for visual stability. Many of the specific properties of remapping, e.g., the exact direction of remapping relative to the saccade vector and the precise mechanisms by which remapping could instantiate stability, remain a matter of debate. Recent studies have also shown that visual attention, like perception itself, can be sustained across saccades, suggesting that the attentional control system can also compensate for eye movements. Classical remapping could have an attentional component, or there could be a distinct attentional analog of visual remapping. At this time we do not yet fully understand how the stability of attentional representations relates to perisaccadic receptive field shifts. In this review, we develop a vocabulary for discussing perisaccadic shifts in receptive field location and perisaccadic shifts of attentional focus, review and synthesize behavioral and neurophysiological studies of perisaccadic perception and perisaccadic attention, and identify open questions that remain to be experimentally addressed.

Linking express saccade occurance to stimulus properties and sensorimotor integration in the superior colliculus

Express saccades represent the fastest possible eye movements to visual targets with reaction times that approach minimum sensory-motor conduction delays. Previous work in monkeys has identified two specific neural signals in the superior colliculus (SC: a midbrain sensorimotor integration structure involved in gaze control) that are required to execute express saccades: 1) previsual activity consisting of a low-frequency increase in action potentials in sensory-motor neurons immediately before the arrival of a visual response; and 2) a transient visual-sensory response consisting of a high-frequency burst of action potentials in visually responsive neurons resulting from the appearance of a visual target stimulus. To better understand how these two neural signals interact to produce express saccades, we manipulated the arrival time and magnitude of visual responses in the SC by altering target luminance and we examined the corresponding influences on SC activity and express saccade generation. We recorded from saccade neurons with visual-, motor-, and previsual-related activity in the SC of monkeys performing the gap saccade task while target luminance was systematically varied between 0.001 and 42.5 cd/m(2) against a black background (∼0.0001 cd/m(2)). Our results demonstrated that 1) express saccade latencies were linked directly to the arrival time in the SC of visual responses produced by abruptly appearing visual stimuli; 2) express saccades were generated toward both dim and bright targets whenever sufficient previsual activity was present; and 3) target luminance altered the likelihood of producing an express saccade. When an express saccade was generated, visuomotor neurons increased their activity immediately before the arrival of the visual response in the SC and saccade initiation. Furthermore, the visual and motor responses of visuomotor neurons merged into a single burst of action potentials, while the visual response of visual-only neurons was unaffected. A linear combination model was used to test which SC signals best predicted the likelihood of producing an express saccade. In addition to visual response magnitude and previsual activity of saccade neurons, the model identified presaccadic activity (activity occurring during the 30-ms epoch immediately before saccade initiation) as a third important signal for predicting express saccades. We conclude that express saccades can be predicted by visual, previsual, and presaccadic signals recorded from visuomotor neurons in the intermediate layers of the SC.

Attention enhances contrast appearance via increased input baseline of neural responses

Covert spatial attention increases the perceived contrast of stimuli at attended locations, presumably via enhancement of visual neural responses. However, the relation between perceived contrast and the underlying neural responses has not been characterized. In this study, we systematically varied stimulus contrast, using a two-alternative, forced-choice comparison task to probe the effect of attention on appearance across the contrast range. We modeled performance in the task as a function of underlying neural contrast-response functions. Fitting this model to the observed data revealed that an increased input baseline in the neural responses accounted for the enhancement of apparent contrast with spatial attention.

Computing with a canonical neural circuits model with pool normalization and modulating feedback

Evidence suggests that the brain uses an operational set of canonical computations like normalization, input filtering, and response gain enhancement via reentrant feedback. Here, we propose a three-stage columnar architecture of cascaded model neurons to describe a core circuit combining signal pathways of feedforward and feedback processing and the inhibitory pooling of neurons to normalize the activity. We present an analytical investigation of such a circuit by first reducing its detail through the lumping of initial feedforward response filtering and reentrant modulating signal amplification. The resulting excitatory-inhibitory pair of neurons is analyzed in a 2D phase-space. The inhibitory pool activation is treated as a separate mechanism exhibiting different effects. We analyze subtractive as well as divisive (shunting) interaction to implement center-surround mechanisms that include normalization effects in the characteristics of real neurons. Different variants of a core model architecture are derived and analyzed--in particular, individual excitatory neurons (without pool inhibition), the interaction with an inhibitory subtractive or divisive (i.e., shunting) pool, and the dynamics of recurrent self-excitation combined with divisive inhibition. The stability and existence properties of these model instances are characterized, which serve as guidelines to adjust these properties through proper model parameterization. The significance of the derived results is demonstrated by theoretical predictions of response behaviors in the case of multiple interacting hypercolumns in a single and in multiple feature dimensions. In numerical simulations, we confirm these predictions and provide some explanations for different neural computational properties. Among those, we consider orientation contrast-dependent response behavior, different forms of attentional modulation, contrast element grouping, and the dynamic adaptation of the silent surround in extraclassical receptive field configurations, using only slight variations of the same core reference model.

Response normalization in the superficial layers of the superior colliculus as a possible mechanism for saccadic averaging

How does the brain decide where to look? Neuronal networks within the superior colliculus (SC) encode locations of intended eye movements. When faced with multiple targets, the relative activities of neuronal populations compete for the selection of a saccade. However, the computational principles underlying saccadic choices remain poorly understood. We used voltage imaging of slices of rat SC to record circuit dynamics of population responses to single- and dual-site electrical stimulation to begin to reveal some of the principles of how populations of neurons interact. Stimulation of two distant sites simultaneously within the SC produced two distinct peaks of activity, whereas stimulation of two nearby sites simultaneously exhibited a single, merged peak centered between the two sites. The distances required to produce merged peaks of activity corresponded to target separations that evoked averaging saccades in humans performing a corresponding dual target task. The merged activity was well accounted for by a linear weighed summation and a divisive normalization of the responses evoked by the single-site stimulations. Interestingly, the merging of activity occurred within the superficial SC, suggesting a novel pathway for saccadic eye movement choice.

Excitatory synaptic feedback from the motor layer to the sensory layers of the superior colliculus

Neural circuits that translate sensory information into motor commands are organized in a feedforward manner converting sensory information into motor output. The superior colliculus (SC) follows this pattern as it plays a role in converting visual information from the retina and visual cortex into motor commands for rapid eye movements (saccades). Feedback from movement to sensory regions is hypothesized to play critical roles in attention, visual image stability, and saccadic suppression, but in contrast to feedforward pathways, motor feedback to sensory regions has received much less attention. The present study used voltage imaging and patch-clamp recording in slices of rat SC to test the hypothesis of an excitatory synaptic pathway from the motor layers of the SC back to the sensory superficial layers. Voltage imaging revealed an extensive depolarization of the superficial layers evoked by electrical stimulation of the motor layers. A pharmacologically isolated excitatory synaptic potential in the superficial layers depended on stimulus strength in the motor layers in a manner consistent with orthodromic excitation. Patch-clamp recording from neurons in the sensory layers revealed excitatory synaptic potentials in response to glutamate application in the motor layers. The location, size, and morphology of responsive neurons indicated they were likely to be narrow-field vertical cells. This excitatory projection from motor to sensory layers adds an important element to the circuitry of the SC and reveals a novel feedback pathway that could play a role in enhancing sensory responses to attended targets as well as visual image stabilization.

A unifying mechanistic model of selective attention in spiking neurons

Visuospatial attention produces myriad effects on the activity and selectivity of cortical neurons. Spiking neuron models capable of reproducing a wide variety of these effects remain elusive. We present a model called the Attentional Routing Circuit (ARC) that provides a mechanistic description of selective attentional processing in cortex. The model is described mathematically and implemented at the level of individual spiking neurons, with the computations for performing selective attentional processing being mapped to specific neuron types and laminar circuitry. The model is used to simulate three studies of attention in macaque, and is shown to quantitatively match several observed forms of attentional modulation. Specifically, ARC demonstrates that with shifts of spatial attention, neurons may exhibit shifting and shrinking of receptive fields; increases in responses without changes in selectivity for non-spatial features (i.e. response gain), and; that the effect on contrast-response functions is better explained as a response-gain effect than as contrast-gain. Unlike past models, ARC embodies a single mechanism that unifies the above forms of attentional modulation, is consistent with a wide array of available data, and makes several specific and quantifiable predictions.

At a given moment, a tremendous amount of visual information falls on the retinae, far more than the brain is capable of processing. By directing attention to a spatial location, stimuli at that position can be selectively processed, while irrelevant information from non-attended locations can be largely ignored. We present a detailed model that describes the mechanisms by which visual spatial attention may be implemented in the brain. Using this model, we simulated three previous studies of spatial attention in primates, and analysed the simulation data using the same methods as in the original experiments. Across these simulations, and without altering model parameters, our model produces results that are statistically indistinguishable from those recorded in primates. Unlike previous work, our model provides greater biological detail of how the brain performs selective visual processing, while also accurately demonstrating numerous forms of selective attention. Our results suggest that these seemingly different forms of attentional effects may result from a single mechanism for selectively processing attended stimuli.

Neuronal responses to face-like and facial stimuli in the monkey superior colliculus

The superficial layers of the superior colliculus (sSC) appear to function as a subcortical visual pathway that bypasses the striate cortex for the rapid processing of coarse facial information. We investigated the responses of neurons in the monkey sSC during a delayed non-matching-to-sample (DNMS) task in which monkeys were required to discriminate among five categories of visual stimuli [photos of faces with different gaze directions, line drawings of faces, face-like patterns (three dark blobs on a bright oval), eye-like patterns, and simple geometric patterns]. Of the 605 sSC neurons recorded, 216 neurons responded to the visual stimuli. Among the stimuli, face-like patterns elicited responses with the shortest latencies. Low-pass filtering of the images did not influence the responses. However, scrambling of the images increased the responses in the late phase, and this was consistent with a feedback influence from upstream areas. A multidimensional scaling (MDS) analysis of the population data indicated that the sSC neurons could separately encode face-like patterns during the first 25-ms period after stimulus onset, and stimulus categorization developed in the next three 25-ms periods. The amount of stimulus information conveyed by the sSC neurons and the number of stimulus-differentiating neurons were consistently higher during the 2nd to 4th 25-ms periods than during the first 25-ms period. These results suggested that population activity of the sSC neurons preferentially filtered face-like patterns with short latencies to allow for the rapid processing of coarse facial information and developed categorization of the stimuli in later phases through feedback from upstream areas.

Competitive Integration of Visual and Goal-related Signals on Neuronal Accumulation Rate: A Correlate of Oculomotor Capture in the Superior Colliculus

The mechanisms that underlie the integration of visual and goal-related signals for the production of saccades remain poorly understood. Here, we examined how spatial proximity of competing stimuli shapes goal-directed responses in the superior colliculus (SC), a midbrain structure closely associated with the control of visual attention and eye movements. Monkeys were trained to perform an oculomotor-capture task [Theeuwes, J., Kramer, A. F., Hahn, S., Irwin, D. E., & Zelinsky, G. J. Influence of attentional capture on oculomotor control. Journal of Experimental Psychology. Human Perception and Performance, 25, 1595–1608, 1999], in which a target singleton was revealed via an isoluminant color change in all but one item. On a portion of the trials, an additional salient item abruptly appeared near or far from the target. We quantified how spatial proximity between the abrupt-onset and the target shaped the goal-directed response. We found that the appearance of an abrupt-onset near the target induced a transient decrease in goal-directed discharge of SC visuomotor neurons. Although this was indicative of spatial competition, it was immediately followed by a rebound in presaccadic activation, which facilitated the saccadic response (i.e., it induced shorter saccadic RT). A similar suppression also occurred at most nontarget locations even in the absence of the abrupt-onset. This is indicative of a mechanism that enabled monkeys to quickly discount stimuli that shared the common nontarget feature. These results reveal a pattern of excitation/inhibition across the SC visuomotor map that acted to facilitate optimal behavior—the short duration suppression minimized the probability of capture by salient distractors, whereas a subsequent boost in accumulation rate ensured a fast goal-directed response. Such nonlinear dynamics should be incorporated into future biologically plausible models of saccade behavior.

Laminar profile of visual response properties in ferret superior colliculus

In the superior colliculus (SC), visual afferent inputs from various sources converge in a highly organized way such that all layers form topographically aligned representations of contralateral external space. Despite this anatomical organization, it remains unclear how the layer-specific termination of different visual input pathways is reflected in the nature of visual response properties and their distribution across layers. To uncover the physiological correlates underlying the laminar organization of the SC, we recorded multiunit and local field potential activity simultaneously from all layers with dual-shank multichannel linear probes. We found that the location of spatial receptive fields was strongly conserved across all visual responsive layers. There was a tendency for receptive field size to increase with depth in the SC, with superficial receptive fields significantly smaller than deep receptive fields. Additionally, superficial layers responded significantly faster than deeper layers to flash stimulation. In some recordings, flash-evoked responses were characterized by the presence of gamma oscillatory activity (40-60 Hz) in multiunit and field potential signals, which was strongest in retinorecipient layers. While SC neurons tended to respond only weakly to full-field drifting gratings, we observed very similar oscillatory responses to the offset of grating stimuli, suggesting gamma oscillations are produced following light offset. Oscillatory spiking activity was highly correlated between horizontally distributed neurons within these layers, with oscillations temporally locked to the stimulus. Together, visual response properties provide physiological evidence reflecting the laminar-specific termination of visual afferent pathways in the SC, most notably characterized by the oscillatory entrainment of superficial neurons.

Rapid simultaneous enhancement of visual sensitivity and perceived contrast during saccade preparation

Humans and other animals with foveate vision make saccadic eye movements to prioritize the visual analysis of behaviorally relevant information. Even before movement onset, visual processing is selectively enhanced at the target of a saccade, presumably gated by brain areas controlling eye movements. Here we assess concurrent changes in visual performance and perceived contrast before saccades, and show that saccade preparation enhances perception rapidly, altering early visual processing in a manner akin to increasing the physical contrast of the visual input. Observers compared orientation and contrast of a test stimulus, appearing briefly before a saccade, to a standard stimulus, presented previously during a fixation period. We found simultaneous progressive enhancement in both orientation discrimination performance and perceived contrast as time approached saccade onset. These effects were robust as early as 60 ms after the eye movement was cued, much faster than the voluntary deployment of covert attention (without eye movements), which takes ∼300 ms. Our results link the dynamics of saccade preparation, visual performance, and subjective experience and show that upcoming eye movements alter visual processing by increasing the signal strength.

Perisaccadic remapping and rescaling of visual responses in macaque superior colliculus

Visual neurons have spatial receptive fields that encode the positions of objects relative to the fovea. Because foveate animals execute frequent saccadic eye movements, this position information is constantly changing, even though the visual world is generally stationary. Interestingly, visual receptive fields in many brain regions have been found to exhibit changes in strength, size, or position around the time of each saccade, and these changes have often been suggested to be involved in the maintenance of perceptual stability. Crucial to the circuitry underlying perisaccadic changes in visual receptive fields is the superior colliculus (SC), a brainstem structure responsible for integrating visual and oculomotor signals. In this work we have studied the time-course of receptive field changes in the SC. We find that the distribution of the latencies of SC responses to stimuli placed outside the fixation receptive field is bimodal: The first mode is comprised of early responses that are temporally locked to the onset of the visual probe stimulus and stronger for probes placed closer to the classical receptive field. We suggest that such responses are therefore consistent with a perisaccadic rescaling, or enhancement, of weak visual responses within a fixed spatial receptive field. The second mode is more similar to the remapping that has been reported in the cortex, as responses are time-locked to saccade onset and stronger for stimuli placed in the postsaccadic receptive field location. We suggest that these two temporal phases of spatial updating may represent different sources of input to the SC.

Spatiotemporal structure of visual receptive fields in macaque superior colliculus

Saccades are useful for directing the high-acuity fovea to visual targets that are of behavioral relevance. The selection of visual targets for eye movements involves the superior colliculus (SC), where many neurons respond to visual stimuli. Many of these neurons are also activated before and during saccades of specific directions and amplitudes. Although the role of the SC in controlling eye movements has been thoroughly examined, far less is known about the nature of the visual responses in this area. We have, therefore, recorded from neurons in the intermediate layers of the macaque SC, while using a sparse-noise mapping procedure to obtain a detailed characterization of the spatiotemporal structure of visual receptive fields. We find that SC responses to flashed visual stimuli start roughly 50 ms after the onset of the stimulus and last for on average ∼70 ms. About 50% of these neurons are strongly suppressed by visual stimuli flashed at certain locations flanking the excitatory center, and the spatiotemporal pattern of suppression exerts a predictable influence on the timing of saccades. This suppression may, therefore, contribute to the filtering of distractor stimuli during target selection. We also find that saccades affect the processing of visual stimuli by SC neurons in a manner that is quite similar to the saccadic suppression and postsaccadic enhancement that has been observed in the cortex and in perception. However, in contrast to what has been observed in the cortex, decreased visual sensitivity was generally associated with increased firing rates, while increased sensitivity was associated with decreased firing rates. Overall, these results suggest that the processing of visual stimuli by SC receptive fields can influence oculomotor behavior and that oculomotor signals originating in the SC can shape perisaccadic visual perception.

Eye movements and attention: the role of pre-saccadic shifts of attention in perception, memory and the control of saccades

Saccadic eye movements and perceptual attention work in a coordinated fashion to allow selection of the objects, features or regions with the greatest momentary need for limited visual processing resources. This study investigates perceptual characteristics of pre-saccadic shifts of attention during a sequence of saccades using the visual manipulations employed to study mechanisms of attention during maintained fixation. The first part of this paper reviews studies of the connections between saccades and attention, and their significance for both saccadic control and perception. The second part presents three experiments that examine the effects of pre-saccadic shifts of attention on vision during sequences of saccades. Perceptual enhancements at the saccadic goal location relative to non-goal locations were found across a range of stimulus contrasts, with either perceptual discrimination or detection tasks, with either single or multiple perceptual targets, and regardless of the presence of external noise. The results show that the preparation of saccades can evoke a variety of attentional effects, including attentionally-mediated changes in the strength of perceptual representations, selection of targets for encoding in visual memory, exclusion of external noise, or changes in the levels of internal visual noise. The visual changes evoked by saccadic planning make it possible for the visual system to effectively use saccadic eye movements to explore the visual environment.

Spatiotemporal analysis of electrically evoked activity in the chicken optic tectum: a VSDI study

The midbrain is an important processing area for sensory information in vertebrates. The optic tectum and its mammalian counterpart, the superior colliculus, receive multimodal, topographic information and contain a sensory map that plays a role in spatial attention and orientation movements. Many studies have investigated the tectal circuitry by cytochemistry and by characterization of particular cell types. However, only a few studies have investigated network activation throughout the depth of the tectum. Our study provides the first data on spatiotemporal activity profiles in the depth and width of the avian optic tectum. We used an optical imaging approach with voltage-sensitive dyes to investigate population responses at a high temporal and spatial resolution. With the necessary caution due to cell extension across several layers, we can thus link our findings tentatively with the general layout of the avian optic tectum. Single electrical stimuli in the retinorecipient layers 1-4 evoked a complex optical response pattern with two components: a short, strong transient response and a weaker persistent response that lasted several hundred milliseconds. The response started in layer 5 and spread within this layer before it propagated into deeper layers. This is in line with neuroanatomical and earlier physiological data. Analysis of temporal sequence and pharmacological manipulations revealed that these responses were mainly driven by postsynaptic activation. Thus tectal network responses to patterned input can be studied by voltage-sensitive dye imaging.

Control from below: the role of a midbrain network in spatial attention

Spatial attention enables the brain to analyse and evaluate information selectively from a specific location in space, a capacity essential for any animal to behave adaptively in a complex world. We usually think of spatial attention as being controlled by a frontoparietal network in the forebrain. However, emerging evidence shows that a midbrain network also plays a critical role in controlling spatial attention. Moreover, the highly differentiated, retinotopic organization of the midbrain network, especially in birds, makes it amenable to detailed analysis with modern techniques that can elucidate circuit, cellular and synaptic mechanisms of attention. The following review discusses the role of the midbrain network in controlling attention, the neural circuits that support this role and current knowledge about the computations performed by these circuits.

Spatial interactions in the superior colliculus predict saccade behavior in a neural field model

During natural vision, eye movements are dynamically controlled by the combinations of goal-related top-down (TD) and stimulus-related bottom-up (BU) neural signals that map onto objects or locations of interest in the visual world. In primates, both BU and TD signals converge in many areas of the brain, including the intermediate layers of the superior colliculus (SCi), a midbrain structure that contains a retinotopically coded map for saccades. How TD and BU signals combine or interact within the SCi map to influence saccades remains poorly understood and actively debated. It has been proposed that winner-take-all competition between these signals occurs dynamically within this map to determine the next location for gaze. Here, we examine how TD and BU signals interact spatially within an artificial two-dimensional dynamic winner-take-all neural field model of the SCi to influence saccadic RT (SRT). We measured point images (spatially organized population activity on the SC map) physiologically to inform the TD and BU model parameters. In this model, TD and BU signals interacted nonlinearly within the SCi map to influence SRT via changes to the (1) spatial size or extent of individual signals, (2) peak magnitude of individual signals, (3) total number of competing signals, and (4) the total spatial separation between signals in the visual field. This model reproduced previous behavioral studies of TD and BU influences on SRT and accounted for multiple inconsistencies between them. This is achieved by demonstrating how, under different experimental conditions, the spatial interactions of TD and BU signals can lead to either increases or decreases in SRT. Our results suggest that dynamic winner-take-all modeling with local excitation and distal inhibition in two dimensions accurately reflects both the physiological activity within the SCi map and the behavioral changes in SRT that result from BU and TD manipulations.

Visual adaptation and novelty responses in the superior colliculus

The brain's ability to ignore repeating, often redundant, information while enhancing novel information processing is paramount to survival. When stimuli are repeatedly presented, the response of visually sensitive neurons decreases in magnitude, that is, neurons adapt or habituate, although the mechanism is not yet known. We monitored the activity of visual neurons in the superior colliculus (SC) of rhesus monkeys who actively fixated while repeated visual events were presented. We dissociated adaptation from habituation as mechanisms of the response decrement by using a Bayesian model of adaptation, and by employing a paradigm including rare trials that included an oddball stimulus that was either brighter or dimmer. If the mechanism is adaptation, response recovery should be seen only for the brighter stimulus; if the mechanism is habituation, response recovery ('dishabituation') should be seen for both the brighter and dimmer stimuli. We observed a reduction in the magnitude of the initial transient response and an increase in response onset latency with stimulus repetition for all visually responsive neurons in the SC. Response decrement was successfully captured by the adaptation model, which also predicted the effects of presentation rate and rare luminance changes. However, in a subset of neurons with sustained activity in response to visual stimuli, a novelty signal akin to dishabituation was observed late in the visual response profile for both brighter and dimmer stimuli, and was not captured by the model. This suggests that SC neurons integrate both rapidly discounted information about repeating stimuli and novelty information about oddball events, to support efficient selection in a cluttered dynamic world.