Visual Functions of the Primate Superior Colliculus

Perisaccadic perceptual mislocalization strength depends on the visual appearance of saccade targets

We normally perceive a stable visual environment despite eye movements. To achieve such stability, visual processing integrates information across a given saccade, and laboratory hallmarks of such integration are robustly observed by presenting brief perisaccadic visual probes. In one classic phenomenon, probe locations are grossly mislocalized. This mislocalization is believed to depend, at least in part, on corollary discharge associated with saccade-related neuronal movement commands. However, we recently found that superior colliculus motor bursts, a known source of corollary discharge, can be different for different image appearances of the saccade target. Therefore, here we investigated whether perisaccadic mislocalization also depends on saccade target appearance. We asked human participants to generate saccades to either low (0.5 cycles/°) or high (5 cycles/°) spatial frequency gratings. We always placed a high-contrast target spot at grating center, to ensure matched saccades across image types. We presented a single, brief perisaccadic probe, which was high in contrast to avoid saccadic suppression, and the subjects pointed (via mouse cursor) at the seen probe location. We observed stronger perisaccadic mislocalization for low-spatial frequency saccade targets and for upper visual field probe locations. This was despite matched saccade metrics and kinematics across conditions, and it was also despite matched probe visibility for the different saccade target images (low vs. high spatial frequency). Assuming that perisaccadic visual mislocalization depends on corollary discharge, our results suggest that such discharge might relay more than just spatial saccade vectors to the visual system; saccade target visual features can also be transmitted.NEW & NOTEWORTHY Brief visual probes are grossly mislocalized when presented in the temporal vicinity of saccades. Although the mechanisms of such mislocalization are still under investigation, one component of them could derive from corollary discharge signals associated with saccade movement commands. Here, we were motivated by the observation that superior colliculus movement bursts, one source of corollary discharge, vary with saccade target image appearance. If so, then perisaccadic mislocalization should also do so, which we confirmed.

High-level visual cognition deep down in the brain

A recent study by Peysakhovich and colleagues reveals how the superior colliculus (SC), a deep brain structure commonly associated with spatial orienting and motor control, causally contributes to the abstraction of visual categories. This highlights how subcortical areas with motor-control labels may have central roles in high-level visual cognition and opens avenues for investigation.

Genetically defined neuron types underlying visuomotor transformation in the superior colliculus

The superior colliculus (SC) is a conserved midbrain structure that is important for transforming visual and other sensory information into motor actions. Decades of investigations in numerous species have made the SC and its nonmammalian homologue, the optic tectum, one of the best studied structures in the brain, with rich information now available regarding its anatomical organization, its extensive inputs and outputs and its important functions in many reflexive and cognitive behaviours. Excitingly, recent studies using modern genomic and physiological approaches have begun to reveal the diverse neuronal subtypes in the SC, as well as their unique functions in visuomotor transformation. Studies have also started to uncover how subtypes of SC neurons form intricate circuits to mediate visual processing and visually guided behaviours. Here, we review these recent discoveries on the cell types and neuronal circuits underlying visuomotor transformations mediated by the SC. We also highlight the important future directions made possible by these new developments.

Saccadic "inhibition" unveils the late influence of image content on oculomotor programming

Image content is prioritized in the visual system. Faces are a paradigmatic example, receiving preferential processing along the visual pathway compared to other visual stimuli. Moreover, face prioritization manifests also in behavior. People tend to look at faces more frequently and for longer periods, and saccadic reaction times can be faster when targeting a face as opposed to a phase-scrambled control. However, it is currently not clear at which stage image content affects oculomotor planning and execution. It can be hypothesized that image content directly influences oculomotor signal generation. Alternatively, the image content could exert its influence on oculomotor planning and execution at a later stage, after the image has been processed. Here we aim to disentangle these two alternative hypotheses by measuring the frequency of saccades toward a visual target when the latter is followed by a visual transient in the central visual field. Behaviorally, this paradigm leads to a reduction in saccade frequency that happens about 90 ms after any visual transient event, also known as saccadic "inhibition". In two experiments, we measured occurrence of saccades in visually guided saccades as well as microsaccades during fixation, using face and noise-matched visual stimuli. We observed that while the reduction in saccade occurrence was similar for both stimulus types, face stimuli lead to a prolonged reduction in eye movements. Moreover, saccade kinematics were altered by both stimulus types, showing an amplitude reduction without change in peak velocity for the earliest saccades. Taken together, our experiments imply that face stimuli primarily affect the later stages of the behavioral phenomenon of saccadic "inhibition". We propose that while some stimulus features are processed at an early stage and can quickly influence eye movements, a delayed signal conveying image content information is necessary to further inhibit/delay activity in the oculomotor system to trigger eye movements.

Multiunit Frontal Eye Field Activity Codes the Visuomotor Transformation, But Not Gaze Prediction or Retrospective Target Memory, in a Delayed Saccade Task

Single-unit (SU) activity-action potentials isolated from one neuron-has traditionally been employed to relate neuronal activity to behavior. However, recent investigations have shown that multiunit (MU) activity-ensemble neural activity recorded within the vicinity of one microelectrode-may also contain accurate estimations of task-related neural population dynamics. Here, using an established model-fitting approach, we compared the spatial codes of SU response fields with corresponding MU response fields recorded from the frontal eye fields (FEFs) in head-unrestrained monkeys (Macaca mulatta) during a memory-guided saccade task. Overall, both SU and MU populations showed a simple visuomotor transformation: the visual response coded target-in-eye coordinates, transitioning progressively during the delay toward a future gaze-in-eye code in the saccade motor response. However, the SU population showed additional secondary codes, including a predictive gaze code in the visual response and retention of a target code in the motor response. Further, when SUs were separated into regular/fast spiking neurons, these cell types showed different spatial code progressions during the late delay period, only converging toward gaze coding during the final saccade motor response. Finally, reconstructing MU populations (by summing SU data within the same sites) failed to replicate either the SU or MU pattern. These results confirm the theoretical and practical potential of MU activity recordings as a biomarker for fundamental sensorimotor transformations (e.g., target-to-gaze coding in the oculomotor system), while also highlighting the importance of SU activity for coding more subtle (e.g., predictive/memory) aspects of sensorimotor behavior.

Perception-action Dissociations as a Window into Consciousness

Understanding the neural correlates of unconscious perception stands as a primary goal of experimental research in cognitive psychology and neuroscience. In this Perspectives paper, we explain why experimental protocols probing qualitative dissociations between perception and action provide valuable insights into conscious and unconscious processing, along with their corresponding neural correlates. We present research that utilizes human eye movements as a sensitive indicator of unconscious visual processing. Given the increasing reliance on oculomotor and pupillary responses in consciousness research, these dissociations also provide a cautionary tale about inferring conscious perception solely based on no-report protocols.

Behind mouse eyes: The function and control of eye movements in mice

The mouse visual system has become the most popular model to study the cellular and circuit mechanisms of sensory processing. However, the importance of eye movements only started to be appreciated recently. Eye movements provide a basis for predictive sensing and deliver insights into various brain functions and dysfunctions. A plethora of knowledge on the central control of eye movements and their role in perception and behaviour arose from work on primates. However, an overview of various eye movements in mice and a comparison to primates is missing. Here, we review the eye movement types described to date in mice and compare them to those observed in primates. We discuss the central neuronal mechanisms for their generation and control. Furthermore, we review the mounting literature on eye movements in mice during head-fixed and freely moving behaviours. Finally, we highlight gaps in our understanding and suggest future directions for research.

Brain-wide arousal signals are segregated from movement planning in the superior colliculus

The superior colliculus (SC) is traditionally considered a brain region that functions as an interface between processing visual inputs and generating eye movement outputs. Although its role as a primary reflex center is thought to be conserved across vertebrate species, evidence suggests that the SC has evolved to support higher-order cognitive functions including spatial attention. When it comes to oculomotor areas such as the SC, it is critical that high precision fixation and eye movements are maintained even in the presence of signals related to ongoing changes in cognition and brain state, both of which have the potential to interfere with eye position encoding and movement generation. In this study, we recorded spiking responses of neuronal populations in the SC while monkeys performed a memory-guided saccade task and found that the activity of some of the neurons fluctuated over tens of minutes. By leveraging the statistical power afforded by high-dimensional neuronal recordings, we were able to identify a low-dimensional pattern of activity that was correlated with the subjects' arousal levels. Importantly, we found that the spiking responses of deep-layer SC neurons were less correlated with this brain-wide arousal signal, and that neural activity associated with changes in pupil size and saccade tuning did not overlap in population activity space with movement initiation signals. Taken together, these findings provide a framework for understanding how signals related to cognition and arousal can be embedded in the population activity of oculomotor structures without compromising the fidelity of the motor output.

Spatial and single-nucleus transcriptomics decoding the molecular landscape and cellular organization of avian optic tectum

The avian optic tectum (OT) has been studied for its diverse functions, yet a comprehensive molecular landscape at the cellular level has been lacking. In this study, we applied spatial transcriptome sequencing and single-nucleus RNA sequencing (snRNA-seq) to explore the cellular organization and molecular characteristics of the avian OT from two species: Columba livia and Taeniopygia guttata. We identified precise layer structures and provided comprehensive layer-specific signatures of avian OT. Furthermore, we elucidated diverse functions in different layers, with the stratum griseum periventriculare (SGP) potentially playing a key role in advanced functions of OT, like fear response and associative learning. We characterized detailed neuronal subtypes and identified a population of FOXG1+ excitatory neurons, resembling those found in the mouse neocortex, potentially involved in neocortex-related functions and expansion of avian OT. These findings could contribute to our understanding of the architecture of OT, shedding light on visual perception and multifunctional association.

Express detection of visual objects by primate superior colliculus neurons

Primate superior colliculus (SC) neurons exhibit visual feature tuning properties and are implicated in a subcortical network hypothesized to mediate fast threat and/or conspecific detection. However, the mechanisms through which SC neurons contribute to peripheral object detection, for supporting rapid orienting responses, remain unclear. Here we explored whether, and how quickly, SC neurons detect real-life object stimuli. We presented experimentally-controlled gray-scale images of seven different object categories, and their corresponding luminance- and spectral-matched image controls, within the extrafoveal response fields of SC neurons. We found that all of our functionally-identified SC neuron types preferentially detected real-life objects even in their very first stimulus-evoked visual bursts. Intriguingly, even visually-responsive motor-related neurons exhibited such robust early object detection. We further identified spatial frequency information in visual images as an important, but not exhaustive, source for the earliest (within 100 ms) but not for the late (after 100 ms) component of object detection by SC neurons. Our results demonstrate rapid and robust detection of extrafoveal visual objects by the SC. Besides supporting recent evidence that even SC saccade-related motor bursts can preferentially represent visual objects, these results reveal a plausible mechanism through which rapid orienting responses to extrafoveal visual objects can be mediated.

Visual feature tuning properties of stimulus-driven saccadic inhibition in macaque monkeys

Saccadic inhibition refers to a short-latency transient cessation of saccade generation after visual sensory transients. This oculomotor phenomenon occurs with a latency that is consistent with a rapid influence of sensory responses, such as stimulus-induced visual bursts, on oculomotor control circuitry. However, the neural mechanisms underlying saccadic inhibition are not well understood. Here, we exploited the fact that macaque monkeys experience robust saccadic inhibition to test the hypothesis that inhibition time and strength exhibit systematic visual feature tuning properties to a multitude of visual feature dimensions commonly used in vision science. We measured saccades in three monkeys actively controlling their gaze on a target, and we presented visual onset events at random times. Across seven experiments, the visual onsets tested size, spatial frequency, contrast, orientation, motion direction, and motion speed dependencies of saccadic inhibition. We also investigated how inhibition might depend on the behavioral relevance of the appearing stimuli. We found that saccadic inhibition starts earlier, and is stronger, for large stimuli of low spatial frequencies and high contrasts. Moreover, saccadic inhibition timing depends on motion direction and orientation, with earlier inhibition systematically occurring for horizontally drifting vertical gratings. On the other hand, saccadic inhibition is stronger for faster motions and when the appearing stimuli are subsequently foveated. Besides documenting a range of feature tuning dimensions of saccadic inhibition to the properties of exogenous visual stimuli, our results establish macaque monkeys as an ideal model system for unraveling the neural mechanisms underlying a ubiquitous oculomotor phenomenon in visual neuroscience.NEW & NOTEWORTHY Visual onsets dramatically reduce saccade generation likelihood with very short latencies. Such latencies suggest that stimulus-induced visual responses, normally jump-starting perceptual and scene analysis processes, can also directly impact the decision of whether to generate saccades or not, causing saccadic inhibition. Consistent with this, we found that changing the appearance of the visual onsets systematically alters the properties of saccadic inhibition. These results constrain neurally inspired models of coordination between saccade generation and exogenous sensory stimulation.

Oculomotor feature discrimination is cortically mediated

Eye movements are often directed toward stimuli with specific features. Decades of neurophysiological research has determined that this behavior is subserved by a feature-reweighting of the neural activation encoding potential eye movements. Despite the considerable body of research examining feature-based target selection, no comprehensive theoretical account of the feature-reweighting mechanism has yet been proposed. Given that such a theory is fundamental to our understanding of the nature of oculomotor processing, we propose an oculomotor feature-reweighting mechanism here. We first summarize the considerable anatomical and functional evidence suggesting that oculomotor substrates that encode potential eye movements rely on the visual cortices for feature information. Next, we highlight the results from our recent behavioral experiments demonstrating that feature information manifests in the oculomotor system in order of featural complexity, regardless of whether the feature information is task-relevant. Based on the available evidence, we propose an oculomotor feature-reweighting mechanism whereby (1) visual information is projected into the oculomotor system only after a visual representation manifests in the highest stage of the cortical visual processing hierarchy necessary to represent the relevant features and (2) these dynamically recruited cortical module(s) then perform feature discrimination via shifting neural feature representations, while also maintaining parity between the feature representations in cortical and oculomotor substrates by dynamically reweighting oculomotor vectors. Finally, we discuss how our behavioral experiments may extend to other areas in vision science and its possible clinical applications.

Peri-Saccadic Orientation Identification Performance and Visual Neural Sensitivity Are Higher in the Upper Visual Field

Visual neural processing is distributed among a multitude of sensory and sensory-motor brain areas exhibiting varying degrees of functional specializations and spatial representational anisotropies. Such diversity raises the question of how perceptual performance is determined, at any one moment in time, during natural active visual behavior. Here, exploiting a known dichotomy between the primary visual cortex (V1) and superior colliculus (SC) in representing either the upper or lower visual fields, we asked whether peri-saccadic orientation identification performance is dominated by one or the other spatial anisotropy. Humans (48 participants, 29 females) reported the orientation of peri-saccadic upper visual field stimuli significantly better than lower visual field stimuli, unlike their performance during steady-state gaze fixation, and contrary to expected perceptual superiority in the lower visual field in the absence of saccades. Consistent with this, peri-saccadic superior colliculus visual neural responses in two male rhesus macaque monkeys were also significantly stronger in the upper visual field than in the lower visual field. Thus, peri-saccadic orientation identification performance is more in line with oculomotor, rather than visual, map spatial anisotropies.SIGNIFICANCE STATEMENT Different brain areas respond to visual stimulation, but they differ in the degrees of functional specializations and spatial anisotropies that they exhibit. For example, the superior colliculus (SC) both responds to visual stimulation, like the primary visual cortex (V1), and controls oculomotor behavior. Compared with the primary visual cortex, the superior colliculus exhibits an opposite pattern of upper/lower visual field anisotropy, being more sensitive to the upper visual field. Here, we show that human peri-saccadic orientation identification performance is better in the upper compared with the lower visual field. Consistent with this, monkey superior colliculus visual neural responses to peri-saccadic stimuli follow a similar pattern. Our results indicate that peri-saccadic perceptual performance reflects oculomotor, rather than visual, map spatial anisotropies.

Sensory tuning in neuronal movement commands

Movement control is critical for successful interaction with our environment. However, movement does not occur in complete isolation of sensation, and this is particularly true of eye movements. Here, we show that the neuronal eye movement commands emitted by the superior colliculus (SC), a structure classically associated with oculomotor control, encompass a robust visual sensory representation of eye movement targets. Thus, similar saccades toward different images are associated with different saccade-related "motor" bursts. Such sensory tuning in SC saccade motor commands appeared for all image manipulations that we tested, from simple visual features to real-life object images, and it was also strongest in the most motor neurons in the deeper collicular layers. Visual-feature discrimination performance in the motor commands was also stronger than in visual responses. Comparing SC motor command feature discrimination performance to that in the primary visual cortex during steady-state gaze fixation revealed that collicular motor bursts possess a reliable perisaccadic sensory representation of the peripheral saccade target's visual appearance, exactly when retinal input is expected to be most uncertain. Our results demonstrate that SC neuronal movement commands likely serve a fundamentally sensory function.