Midbrain activity shapes high-level visual properties in the primate temporal cortex

Detecting biological motion signals in human and monkey superior colliculus: a subcortical-cortical pathway for biological motion perception

Most vertebrates, including humans, are highly adept at detecting and encoding biological motion, even when it is portrayed by just a few point lights attached to the head and major joints. However, the function of subcortical regions in biological motion perception has been scarcely explored. Here, we investigate the role of the superior colliculus in local biological motion processing. Using high-field (3 T) and ultra-high-field (7 T) functional magnetic resonance imaging, we record the neural responses of the superior colliculus to scrambled point-light walkers (with local kinematics retained) in both humans and male macaque monkeys. Results show that the superior colliculus, especially the superficial layers, selectively responds to local biological motion. Furthermore, dynamic causal modeling analysis reveals a subcortical-cortical functional pathway that transmits local biological motion signals from the superior colliculus via the middle temporal visual complex to the posterior superior temporal sulcus in the human brain. These findings suggest the existence of a cross-species mechanism in the superior colliculus that facilitates the detection of local biological motion at the early stage of the visual processing stream.

Central visual pathways affected by degenerative retinal disease before and after gene therapy

Genetic diseases affecting the retina can result in partial or complete loss of visual function. Leber's congenital amaurosis (LCA) is a rare blinding disease, usually inherited in an autosomally recessive manner, with no cure. Retinal gene therapy has been shown to improve vision in LCA patients caused by mutations in the RPE65 gene (LCA2). However, little is known about how activity in central visual pathways is affected by the disease or by subsequent gene therapy. Functional MRI (fMRI) was used to assess retinal signal transmission in cortical and subcortical visual structures before and 1 year after retinal intervention. The fMRI paradigm consisted of 15-s blocks of flickering (8 Hz) black and white checkerboards interleaved with 15 s of blank (black) screen. Visual activation in the brain was assessed using the general linear model, with multiple comparisons corrected using the false discovery rate method. Response to visual stimulation through untreated eyes of LCA2 patients showed heightened fMRI responses in the superior colliculus and diminished activities in the lateral geniculate nucleus (LGN) compared to controls, indicating a shift in the patients' visual processing towards the retinotectal pathway. Following gene therapy, stimuli presented to the treated eye elicited significantly stronger fMRI responses in the LGN and primary visual cortex, indicating some re-engagement of the geniculostriate pathway (GS) pathway. Across patients, the post-treatment LGN fMRI responses correlated significantly with performance on a clinical test measuring light sensitivity. Our results demonstrate that the low vision observed in LCA2 patients involves a shift in visual processing toward the retinotectal pathway, and that gene therapy partially reinstates visual transmission through the GS pathway. This selective boosting of retinal output through the GS pathway and its correlation to improved visual performance, following several years of degenerative retinal disease, is striking. However, while retinal gene therapy and other ocular interventions have given hope to RPE65 patients, it may take years before development of therapies tailored to treat the diseases in other low vision patients are available. Our demonstration of a shift toward the retinotectal pathway in these patients may spur the development of new tools and rehabilitation strategies to help maximize the use of residual visual abilities and augment experience-dependent plasticity.

Rapid integration of face detection and task set in visually guided reaching

The superior colliculus (SC) has been increasingly implicated in the rapid processing of evolutionarily relevant stimuli like faces, but the behavioural relevance of such processing is unclear. The SC has also been implicated in the generation of express visuomotor responses (EVR), which are very short-latency (~80 ms) bursts of muscle activity time-locked to visual target presentation. These observations led us to investigate the influence of faces on EVRs. We recorded upper limb muscle activity from healthy participants as they reached toward targets in the presence of a distractor. In some experiments, faces were used as stimuli. Across blocks of trials, we varied the instruction as to which stimulus served as the target or distractor. Doing so allowed us to assess the impact of instruction on muscle recruitment given identical visual stimuli. We found that responses were uniquely modulated in tasks involving high-contrast faces, promoting reaches toward or away from a face depending on instruction. Follow-up experiments confirmed that the phenomenon required highly salient repeated faces and was not observed to non-facial stimuli nor to faces expressing different affects. This study extends the hypothesis that the SC mediates the EVR by demonstrating that faces impact muscle recruitment at short latencies that precede cortical activity for face perception. Our results constitute direct evidence for the behavioural relevance of face detection in the brainstem, and also implicate a role for top-down cortical pre-setting of the EVR depending on task context.

Multiscale chemogenetic dissection of fronto-temporal top-down regulation for object memory in primates

Visual object memory is a fundamental element of various cognitive abilities, and the underlying neural mechanisms have been extensively examined especially in the anterior temporal cortex of primates. However, both macroscopic large-scale functional network in which this region is embedded and microscopic neuron-level dynamics of top-down regulation it receives for object memory remains elusive. Here, we identified the orbitofrontal node as a critical partner of the anterior temporal node for object memory by combining whole-brain functional imaging during rest and a short-term object memory task in male macaques. Focal chemogenetic silencing of the identified orbitofrontal node downregulated both the local orbitofrontal and remote anterior temporal nodes during the task, in association with deteriorated mnemonic, but not perceptual, performance. Furthermore, imaging-guided neuronal recordings in the same monkeys during the same task causally revealed that orbitofrontal top-down modulation enhanced stimulus-selective mnemonic signal in individual anterior temporal neurons while leaving bottom-up perceptual signal unchanged. Furthermore, similar activity difference was also observed between correct and mnemonic error trials before silencing, suggesting its behavioral relevance. These multifaceted but convergent results provide a multiscale causal understanding of dynamic top-down regulation of the anterior temporal cortex along the ventral fronto-temporal network underpinning short-term object memory in primates.

Visual neurons recognize complex image transformations

Natural visual scenes are dominated by sequences of transforming images. Spatial visual information is thought to be processed by detection of elemental stimulus features which are recomposed into scenes. How image information is integrated over time is unclear. We explored visual information encoding in the optic tectum. Unbiased stimulus presentation shows that the majority of tectal neurons recognize image sequences. This is achieved by temporally dynamic response properties, which encode complex image transitions over several hundred milliseconds. Calcium imaging reveals that neurons that encode spatiotemporal image sequences fire in spike sequences that predict a logical diagram of spatiotemporal information processing. Furthermore, the temporal scale of visual information is tuned by experience. This study indicates how neurons recognize dynamic visual scenes that transform over time.

Common and distinct neural mechanisms of attention

Despite a constant deluge of sensory stimulation, only a fraction of it is used to guide behavior. This selective processing is generally referred to as attention, and much research has focused on the neural mechanisms controlling it. Recently, research has broadened to include more ways by which different species selectively process sensory information, whether due to the sensory input itself or to different behavioral and brain states. This work has produced a complex and disjointed body of evidence across different species and forms of attention. However, it has also provided opportunities to better understand the breadth of attentional mechanisms. Here, we summarize the evidence that suggests that different forms of selective processing are supported by mechanisms both common and distinct.

Hierarchical computation of 3D motion across macaque areas MT and FST

Computing behaviorally relevant representations of three-dimensional (3D) motion from two-dimensional (2D) retinal signals is critical for survival. To ascertain where and how the primate visual system performs this computation, we recorded from the macaque middle temporal (MT) area and its downstream target, the fundus of the superior temporal sulcus (area FST). Area MT is a key site of 2D motion processing, but its role in 3D motion processing is controversial. The functions of FST remain highly underexplored. To distinguish representations of 3D motion from those of 2D retinal motion, we contrast responses to multiple motion cues during a motion discrimination task. The results reveal a hierarchical transformation whereby many FST but not MT neurons are selective for 3D motion. Modeling results further show how generalized, cue-invariant representations of 3D motion in FST may be created by selectively integrating the output of 2D motion selective MT neurons.

Express detection of visual objects by primate superior colliculus neurons

Primate superior colliculus (SC) neurons exhibit visual feature tuning properties and are implicated in a subcortical network hypothesized to mediate fast threat and/or conspecific detection. However, the mechanisms through which SC neurons contribute to peripheral object detection, for supporting rapid orienting responses, remain unclear. Here we explored whether, and how quickly, SC neurons detect real-life object stimuli. We presented experimentally-controlled gray-scale images of seven different object categories, and their corresponding luminance- and spectral-matched image controls, within the extrafoveal response fields of SC neurons. We found that all of our functionally-identified SC neuron types preferentially detected real-life objects even in their very first stimulus-evoked visual bursts. Intriguingly, even visually-responsive motor-related neurons exhibited such robust early object detection. We further identified spatial frequency information in visual images as an important, but not exhaustive, source for the earliest (within 100 ms) but not for the late (after 100 ms) component of object detection by SC neurons. Our results demonstrate rapid and robust detection of extrafoveal visual objects by the SC. Besides supporting recent evidence that even SC saccade-related motor bursts can preferentially represent visual objects, these results reveal a plausible mechanism through which rapid orienting responses to extrafoveal visual objects can be mediated.

Computational assessment of visual coding across mouse brain areas and behavioural states

Introduction

Our brain is bombarded by a diverse range of visual stimuli, which are converted into corresponding neuronal responses and processed throughout the visual system. The neural activity patterns that result from these external stimuli vary depending on the object or scene being observed, but they also change as a result of internal or behavioural states. This raises the question of to what extent it is possible to predict the presented visual stimuli from neural activity across behavioural states, and how this varies in different brain regions.

Methods

To address this question, we assessed the computational capacity of decoders to extract visual information in awake behaving mice, by analysing publicly available standardised datasets from the Allen Brain Institute. We evaluated how natural movie frames can be distinguished based on the activity of units recorded in distinct brain regions and under different behavioural states. This analysis revealed the spectrum of visual information present in different brain regions in response to binary and multiclass classification tasks.

Results

Visual cortical areas showed highest classification accuracies, followed by thalamic and midbrain regions, with hippocampal regions showing close to chance accuracy. In addition, we found that behavioural variability led to a decrease in decoding accuracy, whereby large behavioural changes between train and test sessions reduced the classification performance of the decoders. A generalised linear model analysis suggested that this deterioration in classification might be due to an independent modulation of neural activity by stimulus and behaviour. Finally, we reconstructed the natural movie frames from optimal linear classifiers, and observed a strong similarity between reconstructed and actual movie frames. However, the similarity was significantly higher when the decoders were trained and tested on sessions with similar behavioural states.

Conclusion

Our analysis provides a systematic assessment of visual coding in the mouse brain, and sheds light on the spectrum of visual information present across brain areas and behavioural states.

Peri-Saccadic Orientation Identification Performance and Visual Neural Sensitivity Are Higher in the Upper Visual Field

Visual neural processing is distributed among a multitude of sensory and sensory-motor brain areas exhibiting varying degrees of functional specializations and spatial representational anisotropies. Such diversity raises the question of how perceptual performance is determined, at any one moment in time, during natural active visual behavior. Here, exploiting a known dichotomy between the primary visual cortex (V1) and superior colliculus (SC) in representing either the upper or lower visual fields, we asked whether peri-saccadic orientation identification performance is dominated by one or the other spatial anisotropy. Humans (48 participants, 29 females) reported the orientation of peri-saccadic upper visual field stimuli significantly better than lower visual field stimuli, unlike their performance during steady-state gaze fixation, and contrary to expected perceptual superiority in the lower visual field in the absence of saccades. Consistent with this, peri-saccadic superior colliculus visual neural responses in two male rhesus macaque monkeys were also significantly stronger in the upper visual field than in the lower visual field. Thus, peri-saccadic orientation identification performance is more in line with oculomotor, rather than visual, map spatial anisotropies.SIGNIFICANCE STATEMENT Different brain areas respond to visual stimulation, but they differ in the degrees of functional specializations and spatial anisotropies that they exhibit. For example, the superior colliculus (SC) both responds to visual stimulation, like the primary visual cortex (V1), and controls oculomotor behavior. Compared with the primary visual cortex, the superior colliculus exhibits an opposite pattern of upper/lower visual field anisotropy, being more sensitive to the upper visual field. Here, we show that human peri-saccadic orientation identification performance is better in the upper compared with the lower visual field. Consistent with this, monkey superior colliculus visual neural responses to peri-saccadic stimuli follow a similar pattern. Our results indicate that peri-saccadic perceptual performance reflects oculomotor, rather than visual, map spatial anisotropies.

Sensory tuning in neuronal movement commands

Movement control is critical for successful interaction with our environment. However, movement does not occur in complete isolation of sensation, and this is particularly true of eye movements. Here, we show that the neuronal eye movement commands emitted by the superior colliculus (SC), a structure classically associated with oculomotor control, encompass a robust visual sensory representation of eye movement targets. Thus, similar saccades toward different images are associated with different saccade-related "motor" bursts. Such sensory tuning in SC saccade motor commands appeared for all image manipulations that we tested, from simple visual features to real-life object images, and it was also strongest in the most motor neurons in the deeper collicular layers. Visual-feature discrimination performance in the motor commands was also stronger than in visual responses. Comparing SC motor command feature discrimination performance to that in the primary visual cortex during steady-state gaze fixation revealed that collicular motor bursts possess a reliable perisaccadic sensory representation of the peripheral saccade target's visual appearance, exactly when retinal input is expected to be most uncertain. Our results demonstrate that SC neuronal movement commands likely serve a fundamentally sensory function.

Visual Functions of the Primate Superior Colliculus

The superior colliculus (SC) is a subcortical brain structure that is relevant for sensation, cognition, and action. In nonhuman primates, a rich history of studies has provided unprecedented detail about this structure's role in controlling orienting behaviors; as a result, the primate SC has become primarily regarded as a motor control structure. However, as in other species, the primate SC is also a highly visual structure: A fraction of its inputs is retinal and complemented by inputs from visual cortical areas, including the primary visual cortex. Motivated by this, recent investigations are revealing the rich visual pattern analysis capabilities of the primate SC, placing this structure in an ideal position to guide orienting movements. The anatomical proximity of the primate SC to both early visual inputs and final motor control apparatuses, as well as its ascending feedback projections to the cortex, affirms an important role for this structure in active perception.

Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates

The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.

A neural mechanism for terminating decisions

The brain makes decisions by accumulating evidence until there is enough to stop and choose. Neural mechanisms of evidence accumulation are established in association cortex, but the site and mechanism of termination are unknown. Here, we show that the superior colliculus (SC) plays a causal role in terminating decisions, and we provide evidence for a mechanism by which this occurs. We recorded simultaneously from neurons in the lateral intraparietal area (LIP) and SC while monkeys made perceptual decisions. Despite similar trial-averaged activity, we found distinct single-trial dynamics in the two areas: LIP displayed drift-diffusion dynamics and SC displayed bursting dynamics. We hypothesized that the bursts manifest a threshold mechanism applied to signals represented in LIP to terminate the decision. Consistent with this hypothesis, SC inactivation produced behavioral effects diagnostic of an impaired threshold sensor and prolonged the buildup of activity in LIP. The results reveal the transformation from deliberation to commitment.

Done in 65 ms: Express Visuomotor Responses in Upper Limb Muscles in Rhesus Macaques

How rapidly can the brain transform vision into action? Work in humans has established that the transformation for visually-guided reaching can be remarkably rapid, with the first phase of upper limb muscle recruitment, the express visuomotor response, beginning within less than 100 ms of visual target presentation. Such short-latency responses limit the opportunities for extensive cortical processing, leading to the hypothesis that they are generated via the subcortical tecto-reticulo-spinal pathway. Here, we examine whether nonhuman primates (NHPs) exhibit express visuomotor responses. Two male macaques made visually-guided reaches in a behavioral paradigm known to elicit express visuomotor responses in humans, while we acquired intramuscular recordings from the deltoid muscle. Across several variants of this paradigm, express visuomotor responses began within 65 ms (range: 48-91 ms) of target presentation. Although the timing of the express visuomotor response did not co-vary with reaction time, larger express visuomotor responses tended to precede shorter latency reaches. Further, we observed that the magnitude of the express visuomotor response could be muted by contextual context, although this effect was quite variable. Overall, the response properties in NHPs resemble those in humans. Our results establish a new benchmark for visuomotor transformations underlying visually-guided reaches, setting the stage for experiments that can directly compare the role of cortical and subcortical areas in reaching when time is of the essence.

A genetically defined tecto-thalamic pathway drives a system of superior-colliculus-dependent visual cortices

Cortical responses to visual stimuli are believed to rely on the geniculo-striate pathway. However, recent work has challenged this notion by showing that responses in the postrhinal cortex (POR), a visual cortical area, instead depend on the tecto-thalamic pathway, which conveys visual information to the cortex via the superior colliculus (SC). Does POR's SC-dependence point to a wider system of tecto-thalamic cortical visual areas? What information might this system extract from the visual world? We discovered multiple mouse cortical areas whose visual responses rely on SC, with the most lateral showing the strongest SC-dependence. This system is driven by a genetically defined cell type that connects the SC to the pulvinar thalamic nucleus. Finally, we show that SC-dependent cortices distinguish self-generated from externally generated visual motion. Hence, lateral visual areas comprise a system that relies on the tecto-thalamic pathway and contributes to processing visual motion as animals move through the environment.

Attention to Stimuli of Learned versus Innate Biological Value Relies on Separate Neural Systems

The neural bases of attention, a set of neural processes that promote behavioral selection, is a subject of intense investigation. In humans, rewarded cues influence attention, even when those cues are irrelevant to the current task. Because the amygdala plays a role in reward processing, and the activity of amygdala neurons has been linked to spatial attention, we reasoned that the amygdala may be essential for attending to rewarded images. To test this possibility, we used an attentional capture task, which provides a quantitative measure of attentional bias. Specifically, we compared reaction times (RTs) of adult male rhesus monkeys with bilateral amygdala lesions and unoperated controls as they made a saccade away from a high- or low-value rewarded image to a peripheral target. We predicted that: (1) RTs will be longer for high- compared with low-value images, revealing attentional capture by rewarded stimuli; and (2) relative to controls, monkeys with amygdala lesions would exhibit shorter RT for high-value images. For comparison, we assessed the same groups of monkeys for attentional capture by images of predators and conspecifics, categories thought to have innate biological value. In performing the attentional capture task, all monkeys were slowed more by high-value relative to low-value rewarded images. Contrary to our prediction, amygdala lesions failed to disrupt this effect. When presented with images of predators and conspecifics, however, monkeys with amygdala lesions showed significantly diminished attentional capture relative to controls. Thus, separate neural pathways are responsible for allocating attention to stimuli with learned versus innate value.SIGNIFICANCE STATEMENT Valuable objects attract attention. The amygdala is known to contribute to reward processing and the encoding of object reward value. We therefore examined whether the amygdala is necessary for allocating attention to rewarded objects. For comparison, we assessed the amygdala's contribution to attending to objects with innate biological value: predators and conspecifics. We found that the macaque amygdala is necessary for directing attention to images with innate biological value, but not for directing attention to recently learned reward-predictive images. These findings indicate that the amygdala makes selective contributions to attending to valuable objects. The data are relevant to mental health disorders, such as social anxiety disorders and small animal phobias, that arise from biased attention to select categories of objects.

Superior colliculus saccade motor bursts do not dictate movement kinematics

The primate superior colliculus (SC) contains a topographic map of space, such that the anatomical location of active neurons defines a desired eye movement vector. Complementing such a spatial code, SC neurons also exhibit saccade-related bursts that are tightly synchronized with movement onset. Current models suggest that such bursts constitute a rate code dictating movement kinematics. Here, using two complementary approaches, we demonstrate a dissociation between the SC rate code and saccade kinematics. First, we show that SC burst strength systematically varies depending on whether saccades of the same amplitude are directed towards the upper or lower visual fields, but the movements themselves have similar kinematics. Second, we show that for the same saccade vector, when saccades are significantly slowed down by the absence of a visible saccade target, SC saccade-related burst strengths can be elevated rather than diminished. Thus, SC saccade-related motor bursts do not necessarily dictate movement kinematics.

Attention control in the primate brain

Attention is fundamental to all cognition. In the primate brain, it is implemented by a large-scale network that consists of areas spanning across all major lobes, also including subcortical regions. Classical attention accounts assume that control over the selection process in this network is exerted by 'top-down' mechanisms in the fronto-parietal cortex that influence sensory representations via feedback signals. More recent studies have expanded this view of attentional control. In this review, we will start from a traditional top-down account of attention control, and then discuss more recent findings on feature-based attention, thalamic influences, temporal network dynamics, and behavioral dynamics that collectively lead to substantial modifications. We outline how the different emerging accounts can be reconciled and integrated into a unified theory.

The Superior Colliculus: Cell Types, Connectivity, and Behavior

The superior colliculus (SC), one of the most well-characterized midbrain sensorimotor structures where visual, auditory, and somatosensory information are integrated to initiate motor commands, is highly conserved across vertebrate evolution. Moreover, cell-type-specific SC neurons integrate afferent signals within local networks to generate defined output related to innate and cognitive behaviors. This review focuses on the recent progress in understanding of phenotypic diversity amongst SC neurons and their intrinsic circuits and long-projection targets. We further describe relevant neural circuits and specific cell types in relation to behavioral outputs and cognitive functions. The systematic delineation of SC organization, cell types, and neural connections is further put into context across species as these depend upon laminar architecture. Moreover, we focus on SC neural circuitry involving saccadic eye movement, and cognitive and innate behaviors. Overall, the review provides insight into SC functioning and represents a basis for further understanding of the pathology associated with SC dysfunction.

Microsaccades as a marker not a cause for attention-related modulation

Recent evidence suggests that microsaccades are causally linked to the attention-related modulation of neurons-specifically, that microsaccades toward the attended location are required for the subsequent changes in firing rate. These findings have raised questions about whether attention-related modulation is due to different states of attention as traditionally assumed or might instead be a secondary effect of microsaccades. Here, in two rhesus macaques, we tested the relationship between microsaccades and attention-related modulation in the superior colliculus (SC), a brain structure crucial for allocating attention. We found that attention-related modulation emerged even in the absence of microsaccades, was already present prior to microsaccades toward the cued stimulus, and persisted through the suppression of activity that accompanied all microsaccades. Nonetheless, consistent with previous findings, we also found significant attention-related modulation when microsaccades were directed toward, rather than away from, the cued location. Thus, despite the clear links between microsaccades and attention, microsaccades are not necessary for attention-related modulation, at least not in the SC. They do, however, provide an additional marker for the state of attention, especially at times when attention is shifting from one location to another.

Completing the puzzle: Why studies in non-human primates are needed to better understand the effects of non-invasive brain stimulation

Brain stimulation is a core method in neuroscience. Numerous non-invasive brain stimulation (NIBS) techniques are currently in use in basic and clinical research, and recent advances promise the ability to non-invasively access deep brain structures. While encouraging, there is a surprising gap in our understanding of precisely how NIBS perturbs neural activity throughout an interconnected network, and how such perturbed neural activity ultimately links to behaviour. In this review, we will consider why non-human primate (NHP) models of NIBS are ideally situated to address this gap in knowledge, and why the oculomotor network that moves our line of sight offers a particularly valuable platform in which to empirically test hypothesis regarding NIBS-induced changes in brain and behaviour. NHP models of NIBS will enable investigation of the complex, dynamic effects of brain stimulation across multiple hierarchically interconnected brain areas, networks, and effectors. By establishing such links between brain and behavioural output, work in NHPs can help optimize experimental and therapeutic approaches, improve NIBS efficacy, and reduce side-effects of NIBS.

Trial-by-trial modulation of express visuomotor responses induced by symbolic or barely detectable cues

Human cerebral cortex can produce visuomotor responses that are modulated by contextual and task-specific constraints. However, the distributed cortical network for visuomotor transformations limits the minimal response time of that pathway. Notably, humans can generate express visuomotor responses in arm muscles that are inflexibly tuned to the target location and occur 80-120 ms from stimulus presentation [stimulus-locked responses (SLRs)]. This suggests a subcortical pathway for visuomotor transformations that might involve the superior colliculus and its downstream reticulo-spinal projections. Here we investigated whether cognitive expectations can modulate the SLR. In one experiment, we recorded surface electromyogram (EMG) from shoulder muscles as participants reached toward a visual target whose location was unpredictable in control conditions and partially predictable in cue conditions by interpreting a symbolic cue (75% validity). Valid symbolic cues led to earlier and larger SLRs than control conditions; invalid symbolic cues produced later and smaller SLRs than control conditions. This is consistent with a cortical top-down modulation of the putative subcortical SLR network. In a second experiment, we presented high-contrast targets in isolation (control) or ∼24 ms after low-contrast stimuli, which could appear at the same (valid cue) or opposite (invalid cue) location as the target and with equal probability (50% cue validity). We observed earlier SLRs than control with the valid low-contrast cues, whereas the invalid cues led to the opposite results. These findings may reflect bottom-up attentional mechanisms, potentially evolving subcortically via the superior colliculus. Overall, our results support both top-down and bottom-up modulations of the putative subcortical SLR network in humans.NEW & NOTEWORTHY Express visuomotor responses in humans appear to reflect subcortical sensorimotor transformation of visual inputs, potentially conveyed via the tecto-reticulo-spinal pathway. Here we show that the express responses are influenced by both symbolic and barely detectable spatial cues about stimulus location. The symbolic cue-induced effects suggest cortical top-down modulation of the putative subcortical visuomotor network. The effects of barely detectable cues may reflect exogenous facilitation mechanisms of the tecto-reticulo-spinal pathway.

Oculomotor Target Selection is Mediated by Complex Objects

Oculomotor target selection often requires discriminating visual features, but it remains unclear how oculomotor substrates encoding saccade vectors functionally contribute to this process. One possibility is that oculomotor vector representations (observed directly as physiological activation or inferred from behavioral interference) of potential targets are continuously re-weighted by task-relevance computed elsewhere in specialized visual modules, while an alternative possibility is that oculomotor modules utilize local featural analyses to actively discriminate potential targets. Strengthening the former account, oculomotor vector representations have longer onset latencies for ventral- (i.e., color) than dorsal-stream features (i.e., luminance), suggesting that oculomotor vector representations originate from featurally-relevant specialized visual modules. Here, we extended this reasoning by behaviorally examining whether the onset latency of saccadic interference elicited by visually complex stimuli is greater than is commonly observed for simple stimuli. We measured human saccade metrics (saccade curvature, endpoint deviations, saccade frequency, error proportion) as a function of time after abrupt distractor onset. Distractors were novel, visually complex, and had to be discriminated from targets to guide saccades. The earliest saccadic interference latency was ~110 ms, considerably longer than previous experiments, suggesting that sensory representations projected into the oculomotor system are gated to allow for sufficient featural processing to satisfy task demands. Surprisingly, initial oculomotor vector representations encoded features, as we manipulated the visual similarity between targets and distractors and observed increased vector modulation response magnitude and duration when the distractor was highly similar to the target. Oculomotor vector modulation was gradually extinguished over the time course of the experiment.

Unraveling circuits of visual perception and cognition through the superior colliculus

The superior colliculus is a conserved sensorimotor structure that integrates visual and other sensory information to drive reflexive behaviors. Although the evidence for this is strong and compelling, a number of experiments reveal a role for the superior colliculus in behaviors usually associated with the cerebral cortex, such as attention and decision-making. Indeed, in addition to collicular outputs targeting brainstem regions controlling movements, the superior colliculus also has ascending projections linking it to forebrain structures including the basal ganglia and amygdala, highlighting the fact that the superior colliculus, with its vast inputs and outputs, can influence processing throughout the neuraxis. Today, modern molecular and genetic methods combined with sophisticated behavioral assessments have the potential to make significant breakthroughs in our understanding of the evolution and conservation of neuronal cell types and circuits in the superior colliculus that give rise to simple and complex behaviors.

Active vision at the foveal scale in the primate superior colliculus

The primate superior colliculus (SC) has recently been shown to possess both a large foveal representation as well as a varied visual processing repertoire. This structure is also known to contribute to eye movement generation. Here, we describe our current understanding of how SC visual and movement-related signals interact within the realm of small eye movements associated with the foveal scale of visuomotor behavior. Within the SC's foveal representation, there is a full spectrum of visual, visual-motor, and motor-related discharge for fixational eye movements. Moreover, a substantial number of neurons only emit movement-related discharge when microsaccades are visually guided, but not when similar movements are generated toward a blank. This represents a particularly striking example of integrating vision and action at the foveal scale. Beyond that, SC visual responses themselves are strongly modulated, and in multiple ways, by the occurrence of small eye movements. Intriguingly, this impact can extend to eccentricities well beyond the fovea, causing both sensitivity enhancement and suppression in the periphery. Because of large foveal magnification of neural tissue, such long-range eccentricity effects are neurally warped into smaller differences in anatomical space, providing a structural means for linking peripheral and foveal visual modulations around fixational eye movements. Finally, even the retinal-image visual flows associated with tiny fixational eye movements are signaled fairly faithfully by peripheral SC neurons with relatively large receptive fields. These results demonstrate how studying active vision at the foveal scale represents an opportunity for understanding primate vision during natural behaviors involving ever-present foveating eye movements.NEW & NOTEWORTHY The primate superior colliculus (SC) is ideally suited for active vision at the foveal scale: it enables detailed foveal visual analysis by accurately driving small eye movements, and it also possesses a visual processing machinery that is sensitive to active eye movement behavior. Studying active vision at the foveal scale in the primate SC is informative for broader aspects of active perception, including the overt and covert processing of peripheral extra-foveal visual scene locations.