Microstimulation of the superior colliculus focuses attention without moving the eyes

Salient distractors can induce saccade adaptation

When saccadic eye movements consistently fail to land on their intended target, saccade accuracy is maintained by gradually adapting the movement size of successive saccades. The proposed error signal for saccade adaptation has been based on the distance between where the eye lands and the visual target (retinal error). We studied whether the error signal could alternatively be based on the distance between the predicted and actual locus of attention after the saccade. Unlike conventional adaptation experiments that surreptitiously displace the target once a saccade is initiated towards it, we instead attempted to draw attention away from the target by briefly presenting salient distractor images on one side of the target after the saccade. To test whether less salient, more predictable distractors would induce less adaptation, we separately used fixed random noise distractors. We found that both visual attention distractors were able to induce a small degree of downward saccade adaptation but significantly more to the more salient distractors. As in conventional adaptation experiments, upward adaptation was less effective and salient distractors did not significantly increase amplitudes. We conclude that the locus of attention after the saccade can act as an error signal for saccade adaptation.

Cervical dystonia: a disorder of the midbrain network for covert attentional orienting

While the pathogenesis of cervical dystonia remains unknown, recent animal and clinical experimental studies have indicated its probable mechanisms. Abnormal temporal discrimination is a mediational endophenotype of cervical dystonia and informs new concepts of disease pathogenesis. Our hypothesis is that both abnormal temporal discrimination and cervical dystonia are due to a disorder of the midbrain network for covert attentional orienting caused by reduced gamma-aminobutyric acid (GABA) inhibition, resulting, in turn, from as yet undetermined, genetic mutations. Such disinhibition is (a) subclinically manifested by abnormal temporal discrimination due to prolonged duration firing of the visual sensory neurons in the superficial laminae of the superior colliculus and (b) clinically manifested by cervical dystonia due to disinhibited burst activity of the cephalomotor neurons of the intermediate and deep laminae of the superior colliculus. Abnormal temporal discrimination in unaffected first-degree relatives of patients with cervical dystonia represents a subclinical manifestation of defective GABA activity both within the superior colliculus and from the substantia nigra pars reticulata. A number of experiments are required to prove or disprove this hypothesis.

Directing eye gaze enhances auditory spatial cue discrimination

The present study demonstrates, for the first time, a specific enhancement of auditory spatial cue discrimination due to eye gaze. Whereas the region of sharpest visual acuity, called the fovea, can be directed at will by moving one's eyes, auditory spatial information is derived primarily from head-related acoustic cues. Past auditory studies have found better discrimination in front of the head [1-3] but have not manipulated subjects' gaze, thus overlooking potential oculomotor influences. Electrophysiological studies have shown that the inferior colliculus, a critical auditory midbrain nucleus, shows visual and oculomotor responses [4-6] and modulations of auditory activity [7-9], and that auditory neurons in the superior colliculus show shifting receptive fields [10-13]. How the auditory system leverages this crossmodal information at the behavioral level remains unknown. Here we directed subjects' gaze (with an eccentric dot) or auditory attention (with lateralized noise) while they performed an auditory spatial cue discrimination task. We found that directing gaze toward a sound significantly enhances discrimination of both interaural level and time differences, whereas directing auditory spatial attention does not. These results show that oculomotor information variably enhances auditory spatial resolution even when the head remains stationary, revealing a distinct behavioral benefit possibly arising from auditory-oculomotor interactions at an earlier level of processing than previously demonstrated.

Endogenous attention signals evoked by threshold contrast detection in human superior colliculus

Human superior colliculus (SC) responds in a retinotopically selective manner when attention is deployed on a high-contrast visual stimulus using a discrimination task. To further elucidate the role of SC in endogenous visual attention, high-resolution fMRI was used to demonstrate that SC also exhibits a retinotopically selective response for covert attention in the absence of significant visual stimulation using a threshold-contrast detection task. SC neurons have a laminar organization according to their function, with visually responsive neurons present in the superficial layers and visuomotor neurons in the intermediate layers. The results show that the response evoked by the threshold-contrast detection task is significantly deeper than the response evoked by the high-contrast speed discrimination task, reflecting a functional dissociation of the attentional enhancement of visuomotor and visual neurons, respectively. Such a functional dissociation of attention within SC laminae provides a subcortical basis for the oculomotor theory of attention.

Transient pupil response is modulated by contrast-based saliency

The sudden appearance of a novel stimulus in the environment initiates a series of orienting responses that include coordinated shifts of gaze and attention, and also transient changes in pupil size. Although numerous studies have identified a significant effect of stimulus saliency on shifts of gaze and attention, saliency effects on pupil size are less understood. To examine salience-evoked pupil responses, we presented visual, auditory, or audiovisual stimuli while monkeys fixated a central visual spot. Transient pupil dilation was elicited after visual stimulus presentation regardless of target luminance relative to background, and auditory stimuli also evoked similar pupil responses. Importantly, the evoked pupil response was modulated by contrast-based saliency, with faster and larger pupil responses following the presentation of more salient stimuli. The initial transient component of pupil dilation was qualitatively similar to that evoked by weak microstimulation of the midbrain superior colliculus. The pupil responses elicited by audiovisual stimuli were well predicted by a linear summation of each modality response. Together, the results suggest that the transient pupil response, as one component of orienting, is modulated by contrast-based saliency, and the superior colliculus is likely involved in its coordination.

Tricks of the mind: Visual hallucinations as disorders of attention

Visual hallucinations are common across a number of disorders but to date, a unifying pathophysiology underlying these phenomena has not been described. In this manuscript, we combine insights from neuropathological, neuropsychological and neuroimaging studies to propose a testable common neural mechanism for visual hallucinations. We propose that 'simple' visual hallucinations arise from disturbances within regions responsible for the primary processing of visual information, however with no further modulation of perceptual content by attention. In contrast, 'complex' visual hallucinations reflect dysfunction within and between the Attentional Control Networks, leading to the inappropriate interpretation of ambiguous percepts. The incorrect information perceived by hallucinators is often differentially interpreted depending on the time-course and the neuroarchitecture underlying the interpretation. Disorders with 'complex' hallucinations without retained insight are proposed to be associated with a reduction in the activity within the Dorsal Attention Network. The review concludes by showing that a variety of pathological processes can ultimately manifest in any of these three categories, depending on the precise location of the impairment.

Effect of microstimulation of the superior colliculus on visual space attention

We investigated the effect of microstimulation of the superficial layers of the superior colliculus (SC) on the performance of animals in a peripheral detection paradigm while maintaining fixation. In a matching-to-sample paradigm, a sample stimulus was presented at one location followed by a brief test stimulus at that (relevant) location and a distractor at another (irrelevant) location. While maintaining fixation, the monkey indicated whether the sample and the test stimulus matched, ignoring the distractor. The relevant and irrelevant locations were switched from trial to trial. Cells in the superficial layers of SC gave enhanced responses when the attended test stimulus was inside the receptive field compared with when the (physically identical) distractor was inside the field. These effects were found only in an "automatic" attentional cueing paradigm, in which a peripheral stimulus explicitly cued the animal as to the relevant location in the receptive field. No attentional effects were found with block of trials. The transient enhancement to the attended stimulus was observed at the onset and not at the offset of the stimulus. Electrical stimulation at the site corresponding to the irrelevant distractor location in the SC causes it to gain control over attention, causing impaired performance of the task at the relevant location. Stimulation at unattended sites without the presence of a distractor stimulus causes little or no impairment in performance. The effect of stimulation decays with successive stimulations. The animals learn to ignore the stimulation unless the parameters of the task are varied.

Perception of social cues of danger in autism spectrum disorders

Intuitive grasping of the meaning of subtle social cues is particularly affected in autism spectrum disorders (ASD). Despite their relevance in social communication, the effect of averted gaze in fearful faces in conveying a signal of environmental threat has not been investigated using real face stimuli in adults with ASD. Here, using functional MRI, we show that briefly presented fearful faces with averted gaze, previously shown to be a strong communicative signal of environmental danger, produce different patterns of brain activation than fearful faces with direct gaze in a group of 26 normally intelligent adults with ASD compared with 26 matched controls. While implicit cue of threat produces brain activation in attention, emotion processing and mental state attribution networks in controls, this effect is absent in individuals with ASD. Instead, individuals with ASD show activation in the subcortical face-processing system in response to direct eye contact. An effect of differences in looking behavior was excluded in a separate eye tracking experiment. Our data suggest that individuals with ASD are more sensitive to direct eye contact than to social signals of danger conveyed by averted fearful gaze.

Perceptual modulation of motor--but not visual--responses in the frontal eye field during an urgent-decision task

Neuronal activity in the frontal eye field (FEF) ranges from purely motor (related to saccade production) to purely visual (related to stimulus presence). According to numerous studies, visual responses correlate strongly with early perceptual analysis of the visual scene, including the deployment of spatial attention, whereas motor responses do not. Thus, functionally, the consensus is that visually responsive FEF neurons select a target among visible objects, whereas motor-related neurons plan specific eye movements based on such earlier target selection. However, these conclusions are based on behavioral tasks that themselves promote a serial arrangement of perceptual analysis followed by motor planning. So, is the presumed functional hierarchy in FEF an intrinsic property of its circuitry or does it reflect just one possible mode of operation? We investigate this in monkeys performing a rapid-choice task in which, crucially, motor planning always starts ahead of task-critical perceptual analysis, and the two relevant spatial locations are equally informative and equally likely to be target or distracter. We find that the choice is instantiated in FEF as a competition between oculomotor plans, in agreement with model predictions. Notably, although perception strongly influences the motor neurons, it has little if any measurable impact on the visual cells; more generally, the more dominant the visual response, the weaker the perceptual modulation. The results indicate that, contrary to expectations, during rapid saccadic choices perceptual information may directly modulate ongoing saccadic plans, and this process is not contingent on prior selection of the saccadic goal by visually driven FEF responses.

New perspectives on the owl's map of auditory space

A map of sound direction was found in the owl's midbrain more than three decades ago. This finding suggested that the brain reconstructs spatial coordinates to represent them. Subsequent research elucidated the variables used to compute the map. Here we provide a review of the processes leading to its emergence and an updated perspective on how and what information is represented.

Reach preparation enhances visual performance and appearance

We investigated the impact of the preparation of reach movements on visual perception by simultaneously quantifying both an objective measure of visual sensitivity and the subjective experience of apparent contrast. Using a two-by-two alternative forced choice task, observers compared the orientation (clockwise or counterclockwise) and the contrast (higher or lower) of a Standard Gabor and a Test Gabor, the latter of which was presented during reach preparation, at the reach target location or the opposite location. Discrimination performance was better overall at the reach target than at the opposite location. Perceived contrast increased continuously at the target relative to the opposite location during reach preparation, that is, after the onset of the cue indicating the reach target. The finding that performance and appearance do not evolve in parallel during reach preparation points to a distinction with saccade preparation, for which we have shown previously there is a parallel temporal evolution of performance and appearance. Yet akin to saccade preparation, this study reveals that overall reach preparation enhances both visual performance and appearance.

The efference cascade, consciousness, and its self: naturalizing the first person pivot of action control

The 20 billion neurons of the neocortex have a mere hundred thousand motor neurons by which to express cortical contents in overt behavior. Implemented through a staggered cortical "efference cascade" originating in the descending axons of layer five pyramidal cells throughout the neocortical expanse, this steep convergence accomplishes final integration for action of cortical information through a system of interconnected subcortical way stations. Coherent and effective action control requires the inclusion of a continually updated joint "global best estimate" of current sensory, motivational, and motor circumstances in this process. I have previously proposed that this running best estimate is extracted from cortical probabilistic preliminaries by a subcortical neural "reality model" implementing our conscious sensory phenomenology. As such it must exhibit first person perspectival organization, suggested to derive from formating requirements of the brain's subsystem for gaze control, with the superior colliculus at its base. Gaze movements provide the leading edge of behavior by capturing targets of engagement prior to contact. The rotation-based geometry of directional gaze movements places their implicit origin inside the head, a location recoverable by cortical probabilistic source reconstruction from the rampant primary sensory variance generated by the incessant play of collicularly triggered gaze movements. At the interface between cortex and colliculus lies the dorsal pulvinar. Its unique long-range inhibitory circuitry may precipitate the brain's global best estimate of its momentary circumstances through multiple constraint satisfaction across its afferents from numerous cortical areas and colliculus. As phenomenal content of our sensory awareness, such a global best estimate would exhibit perspectival organization centered on a purely implicit first person origin, inherently incapable of appearing as a phenomenal content of the sensory space it serves.

Anticipatory alpha phase influences visual working memory performance

Alpha band (8-12 Hz) phase dynamics in the visual cortex are thought to reflect fluctuations in cortical excitability that influences perceptual processing. As such, visual stimuli are better detected when their onset is concurrent with specific phases of the alpha cycle. However, it is unclear whether alpha phase differentially influences cognitive performance at specific times relative to stimulus onset (i.e., is the influence of phase maximal before, at, or after stimulus onset?). To address this, participants performed a delayed-recognition, working memory (WM) task for visual motion direction during two separate visits. The first visit utilized functional magnetic resonance (fMRI) imaging to identify neural regions associated with task performance. Replicating previous studies, fMRI data showed engagement of visual cortical area V5, as well as a prefrontal cortical region, the inferior frontal junction (IFJ). During the second visit, transcranial magnetic stimulation (TMS) was applied separately to both the right IFJ and right V5 (with the vertex as a control region) while electroencephalography (EEG) was simultaneously recorded. During each trial, a single pulse of TMS (spTMS) was applied at one of six time points (-200, -100, -50, 0, 80, 160 ms) relative to the encoded stimulus onset. Results demonstrated a relationship between the phase of the posterior alpha signal prior to stimulus encoding and subsequent response times to the memory probe two seconds later. Specifically, spTMS to V5, and not the IFJ or vertex, yielded faster response times, indicating improved WM performance, when delivered during the peak, compared to the trough, of the alpha cycle, but only when spTMS was applied 100 ms prior to stimulus onset. These faster responses to the probe correlated with decreased early event related potential (ERP) amplitudes (i.e., P1) to the probe stimuli. Moreover, participants that were least affected by spTMS exhibited greater functional connectivity between V5 and fronto-parietal regions. These results suggest that posterior alpha phase indexes a critical time period for motion processing in the context of WM encoding goals, which occurs in anticipation of stimulus onset.

Superior colliculus and visual spatial attention

The superior colliculus (SC) has long been known to be part of the network of brain areas involved in spatial attention, but recent findings have dramatically refined our understanding of its functional role. The SC both implements the motor consequences of attention and plays a crucial role in the process of target selection that precedes movement. Moreover, even in the absence of overt orienting movements, SC activity is related to shifts of covert attention and is necessary for the normal control of spatial attention during perceptual judgments. The neuronal circuits that link the SC to spatial attention may include attention-related areas of the cerebral cortex, but recent results show that the SC's contribution involves mechanisms that operate independently of the established signatures of attention in visual cortex. These findings raise new issues and suggest novel possibilities for understanding the brain mechanisms that enable spatial attention.

Optogenetic investigation of the role of the superior colliculus in orienting movements

In vivo studies have demonstrated that the superior colliculus (SC) integrates sensory information and plays a role in controlling orienting motor output. However, how the complex microcircuitry within the SC, as documented by slice studies, subserves these functions is unclear. Optogenetics affords the potential to examine, in behaving animals, the functional roles of specific neuron types that comprise heterogeneous nuclei. As a first step toward understanding how SC microcircuitry underlies motor output, we applied optogenetics to mice performing an odor discrimination task in which sensory decisions are reported by either a leftward or rightward SC-dependent orienting movement. We unilaterally expressed either channelrhodopsin-2 or halorhodopsin in the SC and delivered light in order to excite or inhibit motor-related SC activity as the movement was planned. We found that manipulating SC activity predictably affected the direction of the selected movement in a manner that depended on the difficulty of the odor discrimination. This study demonstrates that the SC plays a similar role in directional orienting movements in mice as it does in other species, and provides a framework for future investigations into how specific SC cell types contribute to motor control.

Automatic control of visual selection

This paper seeks out to reduce the role of the homunculus, the 'little man in the head' that is still prominent in most psychological theories regarding the control our behaviour. We argue that once engaged in a task (which is a volitional act), visual selection run off more or less in an automatic fashion. We argue that the salience map that drives automatic selection is not only determined by raw physical salience of the objects in the environment but also by the way these objects appear to the person. We provide evidence that priming (feature priming, priming by working memory and reward priming) sharpens the cortical representation of these objects such that these objects appear to be more salient above and beyond their physical salience. We demonstrate that this type of priming is not under volitional control: it occurs even if observers try to volitionally prepare for something else. In other words, looking at red prepares our brain for things that are red even if we volitionally try to prepare for green.

Flexible cognitive resources: competitive content maps for attention and memory

The brain has finite processing resources so that, as tasks become harder, performance degrades. Where do the limits on these resources come from? We focus on a variety of capacity-limited buffers related to attention, recognition, and memory that we claim have a two-dimensional 'map' architecture, where individual items compete for cortical real estate. This competitive format leads to capacity limits that are flexible, set by the nature of the content and their locations within an anatomically delimited space. We contrast this format with the standard 'slot' architecture and its fixed capacity. Using visual spatial attention and visual short-term memory as case studies, we suggest that competitive maps are a concrete and plausible architecture that limits cognitive capacity across many domains.

Allocation of attention for dissociated visual and motor goals

In daily life, selecting an object visually is closely intertwined with processing that object as a potential goal for action. Since visual and motor goals are typically identical, it remains unknown whether attention is primarily allocated to a visual target, a motor goal, or both. Here, we dissociated visual and motor goals using a visuomotor adaptation paradigm, in which participants reached toward a visual target using a computer mouse or a stylus pen, while the direction of the cursor was rotated 45° counter-clockwise from the direction of the hand movement. Thus, as visuomotor adaptation was accomplished, the visual target was dissociated from the movement goal. Then, we measured the locus of attention using an attention-demanding rapid serial visual presentation (RSVP) task, in which participants detected a pre-defined visual stimulus among the successive visual stimuli presented on either the visual target, the motor goal, or a neutral control location. We demonstrated that before visuomotor adaptation, participants performed better when the RSVP stream was presented at the visual target than at other locations. However, once visual and motor goals were dissociated following visuomotor adaptation, performance at the visual and motor goals was equated and better than performance at the control location. Therefore, we concluded that attentional resources are allocated both to visual target and motor goals during goal-directed reaching movements.

Manipulation of object choice by electrical microstimulation in macaque frontal eye fields

For each saccade, we select an object to direct gaze and to specify the direction and amplitude of eye movement. Although these 2 processes are inevitably interdependent when visual stimuli are held stationary, several lines of evidence suggest that the neuronal signals in the frontal eye fields (FEF) that underlie the selection of visual objects are distinct from those underlying the selection of saccades. In the present study, we overtly dissociated these 2 processes spatially and temporally using the covert object-tracking paradigm, in which 4 identical objects moved randomly for 3 s before monkeys made a saccade to a previously selected target. To assess the causal role of the FEF in the 2 selection processes, we applied electrical microstimulation to the FEF at various times during the motion period. When stimulation was delivered at the motion onset, animals tended to choose an object that was initially presented at a particular location depending on the stimulation site. In contrast, the same stimulation delivered at the motion end failed to alter saccade end points. These results indicate that manipulation of FEF activity can change the selection of a visual object without affecting saccade goals, suggesting the existence of neurons solely regulating visual selection.

Rapid simultaneous enhancement of visual sensitivity and perceived contrast during saccade preparation

Humans and other animals with foveate vision make saccadic eye movements to prioritize the visual analysis of behaviorally relevant information. Even before movement onset, visual processing is selectively enhanced at the target of a saccade, presumably gated by brain areas controlling eye movements. Here we assess concurrent changes in visual performance and perceived contrast before saccades, and show that saccade preparation enhances perception rapidly, altering early visual processing in a manner akin to increasing the physical contrast of the visual input. Observers compared orientation and contrast of a test stimulus, appearing briefly before a saccade, to a standard stimulus, presented previously during a fixation period. We found simultaneous progressive enhancement in both orientation discrimination performance and perceived contrast as time approached saccade onset. These effects were robust as early as 60 ms after the eye movement was cued, much faster than the voluntary deployment of covert attention (without eye movements), which takes ∼300 ms. Our results link the dynamics of saccade preparation, visual performance, and subjective experience and show that upcoming eye movements alter visual processing by increasing the signal strength.

Stimulus-specific adaptation, habituation and change detection in the gaze control system

This prospect article addresses the neurobiology of detecting and responding to changes or unexpected events. Change detection is an ongoing computational task performed by the brain as part of the broader process of saliency mapping and selection of the next target for attention. In the optic tectum (OT) of the barn owl, the probability of the stimulus has a dramatic influence on the neural response to that stimulus; rare or deviant stimuli induce stronger responses compared to common stimuli. This phenomenon, known as stimulus-specific adaptation, has recently attracted scientific interest because of its possible role in change detection. In the barn owl's OT, it may underlie the ability to orient specifically to unexpected events and is therefore opening new directions for research on the neurobiology of fundamental psychological phenomena such as habituation, attention, and surprise.

Spatiotemporal structure of visual receptive fields in macaque superior colliculus

Saccades are useful for directing the high-acuity fovea to visual targets that are of behavioral relevance. The selection of visual targets for eye movements involves the superior colliculus (SC), where many neurons respond to visual stimuli. Many of these neurons are also activated before and during saccades of specific directions and amplitudes. Although the role of the SC in controlling eye movements has been thoroughly examined, far less is known about the nature of the visual responses in this area. We have, therefore, recorded from neurons in the intermediate layers of the macaque SC, while using a sparse-noise mapping procedure to obtain a detailed characterization of the spatiotemporal structure of visual receptive fields. We find that SC responses to flashed visual stimuli start roughly 50 ms after the onset of the stimulus and last for on average ∼70 ms. About 50% of these neurons are strongly suppressed by visual stimuli flashed at certain locations flanking the excitatory center, and the spatiotemporal pattern of suppression exerts a predictable influence on the timing of saccades. This suppression may, therefore, contribute to the filtering of distractor stimuli during target selection. We also find that saccades affect the processing of visual stimuli by SC neurons in a manner that is quite similar to the saccadic suppression and postsaccadic enhancement that has been observed in the cortex and in perception. However, in contrast to what has been observed in the cortex, decreased visual sensitivity was generally associated with increased firing rates, while increased sensitivity was associated with decreased firing rates. Overall, these results suggest that the processing of visual stimuli by SC receptive fields can influence oculomotor behavior and that oculomotor signals originating in the SC can shape perisaccadic visual perception.

An FMRI study of the neural systems involved in visually cued auditory top-down spatial and temporal attention

Top-down attention to spatial and temporal cues has been thoroughly studied in the visual domain. However, because the neural systems that are important for auditory top-down temporal attention (i.e., attention based on time interval cues) remain undefined, the differences in brain activity between directed attention to auditory spatial location (compared with time intervals) are unclear. Using fMRI (magnetic resonance imaging), we measured the activations caused by cue-target paradigms by inducing the visual cueing of attention to an auditory target within a spatial or temporal domain. Imaging results showed that the dorsal frontoparietal network (dFPN), which consists of the bilateral intraparietal sulcus and the frontal eye field, responded to spatial orienting of attention, but activity was absent in the bilateral frontal eye field (FEF) during temporal orienting of attention. Furthermore, the fMRI results indicated that activity in the right ventrolateral prefrontal cortex (VLPFC) was significantly stronger during spatial orienting of attention than during temporal orienting of attention, while the DLPFC showed no significant differences between the two processes. We conclude that the bilateral dFPN and the right VLPFC contribute to auditory spatial orienting of attention. Furthermore, specific activations related to temporal cognition were confirmed within the superior occipital gyrus, tegmentum, motor area, thalamus and putamen.

Embodied attention and word learning by toddlers

Many theories of early word learning begin with the uncertainty inherent to learning a word from its co-occurrence with a visual scene. However, the relevant visual scene for infant word learning is neither from the adult theorist's view nor the mature partner's view, but is rather from the learner's personal view. Here we show that when 18-month old infants interacted with objects in play with their parents, they created moments in which a single object was visually dominant. If parents named the object during these moments of bottom-up selectivity, later forced-choice tests showed that infants learned the name, but did not when naming occurred during a less visually selective moment. The momentary visual input for parents and toddlers was captured via head cameras placed low on each participant's forehead as parents played with and named objects for their infant. Frame-by-frame analyses of the head camera images at and around naming moments were conducted to determine the visual properties at input that were associated with learning. The analyses indicated that learning occurred when bottom-up visual information was clean and uncluttered. The sensory-motor behaviors of infants and parents were also analyzed to determine how their actions on the objects may have created these optimal visual moments for learning. The results are discussed with respect to early word learning, embodied attention, and the social role of parents in early word learning.

Dissociation of pursuit target selection from saccade execution

Pursuit and saccades almost always select the same target. Is this the results of a common selection process or does smooth pursuit obligatorily follow the stimulus targeted by saccades? To address this question, we used microstimulation of the primate superior colliculus (SC) to redirect the eyes from a selected pursuit target to a distracter moving in the opposite direction. During each trial, monkeys pursued a horizontally moving array of colored target stimuli. In half of the trials, this target array was accompanied by a distracter array moving horizontally in the opposite direction, offset by the vertical amplitude of the stimulation-evoked saccade. We stimulated the SC during maintained pursuit on half of the trials, and measured pursuit eye velocity during the 50-ms interval immediately following the stimulation-evoked saccade to the distracter array. Saccades evoked by SC stimulation did not alter pursuit target selection. Pursuit velocity on average changed by less than 10% of that expected if the monkey had completely switched targets. Moreover, the same changes in velocity occurred when there was no distracter, indicating that even these small changes in pursuit velocity were a direct effect of the evoked saccade, not partial selection of the distracter. These results show that motor execution of saccades is not sufficient to select a pursuit target, and support the idea that the coordination of pursuit and saccades is accomplished by a shared target selection process.

Attention deficits without cortical neuronal deficits

The ability to selectively process relevant stimuli is a fundamental function of the primate visual system. The best understood correlate of this function is the enhanced response of neurons in visual cortex to attended stimuli^1,2. However, recent results show that the superior colliculus (SC), a midbrain structure, also plays a crucial role in visual attention^3–5. It has been assumed that the SC acts through the same well-known mechanisms in visual cortex^3,5. Here we tested this hypothesis by transiently inactivating the SC during a motion-change detection task and measuring responses in two visual cortical areas. We found that despite large deficits in visual attention, the enhanced responses of neurons in visual cortex to attended stimuli were unchanged. These results show that the SC contributes to visual attention through mechanisms that are independent of the classic effects in visual cortex, demonstrating that other processes must play a major role in visual attention.

Visual fixation as equilibrium: evidence from superior colliculus inactivation

During visual fixation, the image of an object is maintained within the fovea. Previous studies have shown that such maintenance involves the deep superior colliculus (dSC). However, the mechanisms by which the dSC supports visual fixation remain controversial. According to one view, activity in the rostral dSC maintains gaze direction by preventing neurons in the caudal dSC from issuing saccade commands. An alternative hypothesis proposes that gaze direction is achieved through equilibrium of target position signals originating from the two dSCs. Here, we show in monkeys that artificially reducing activity in the rostral half of one dSC results in a biased estimate of target position during fixation, consistent with the second hypothesis, rather than an inability to maintain gaze fixation as predicted by the first hypothesis. After injection of muscimol at rostral sites in the dSC, fixation became more stable since microsaccade rate was reduced rather than increased. Moreover, the scatter of eye positions was offset relative to preinactivation baselines. The magnitude and the direction of the offsets depended on both the target size and the injected site in the collicular map. Other oculomotor parameters, such as the accuracy of saccades to peripheral targets and the amplitude and velocity of fixational saccades, were largely unaffected. These results suggest that the rostral half of the dSC supports visual fixation through a distributed representation of behaviorally relevant target position signals. The inactivation-induced fixation offset establishes the foveal visual stimulation that is required to restore the balance of activity between the two dSCs.

Paying Attention through Eye Movements: A Computational Investigation of the Premotor Theory of Spatial Attention

Growing evidence indicates that planning eye movements and orienting visuospatial attention share overlapping brain mechanisms. A tight link between endogenous attention and eye movements is maintained by the premotor theory, in contrast to other accounts that postulate the existence of specific attention mechanisms that modulate the activity of information processing systems. The strong assumption of equivalence between attention and eye movements, however, is challenged by demonstrations that human observers are able to keep attention on a specific location while moving the eyes elsewhere. Here we investigate whether a recurrent model of saccadic planning can account for attentional effects without requiring additional or specific mechanisms separate from the circuits that perform sensorimotor transformations for eye movements. The model builds on the basis function approach and includes a circuit that performs spatial remapping using an “internal forward model” of how visual inputs are modified as a result of saccadic movements. Simulations show that the latter circuit is crucial to account for dissociations between attention and eye movements that may be invoked to disprove the premotor theory. The model provides new insights into how spatial remapping may be implemented in parietal cortex and offers a computational framework for recent proposals that link visual stability with remapping of attention pointers.

Passive auditory stimulation improves vision in hemianopia

Techniques employed in rehabilitation of visual field disorders such as hemianopia are usually based on either visual or audio-visual stimulation and patients have to perform a training task. Here we present results from a completely different, novel approach that was based on passive unimodal auditory stimulation. Ten patients with either left or right-sided pure hemianopia (without neglect) received one hour of unilateral passive auditory stimulation on either their anopic or their intact side by application of repetitive trains of sound pulses emitted simultaneously via two loudspeakers. Immediately before and after passive auditory stimulation as well as after a period of recovery, patients completed a simple visual task requiring detection of light flashes presented along the horizontal plane in total darkness. The results showed that one-time passive auditory stimulation on the side of the blind, but not of the intact, hemifield of patients with hemianopia induced an improvement in visual detections by almost 100% within 30 min after passive auditory stimulation. This enhancement in performance was reversible and was reduced to baseline 1.5 h later. A non-significant trend of a shift of the visual field border toward the blind hemifield was obtained after passive auditory stimulation. These results are compatible with the view that passive auditory stimulation elicited some activation of the residual visual pathways, which are known to be multisensory and may also be sensitive to unimodal auditory stimuli as were used here.

Lesion of the isthmo-optic nucleus impairs target selection for visually guided reaching

Neurons in the isthmo-optic nucleus (ION) of the avian midbrain receive input predominantly from the ipsilateral optic tectum and project to the contralateral retina. Therefore, lesion in the ION removes tectal efferent signals to the retina in birds. In the present study, we trained Japanese quail to reach a target stimulus on a touch-sensor monitor with their beak. ION lesions significantly decreased response accuracy when the target was presented simultaneously with distractors but not when presented alone. Thus the removal of the tectal efferent signals to the retina severely impaired target selection in a competitive visual search as if the ION-lesioning caused visual extinction, which is a neuropsychological deficit seen in human hemispatial neglect patients. We suggest that the avian tectum and its efferent path to the retina improve the accuracy of target selection for visual orienting and visually guided reaching with beak.

The role of low and high spatial frequencies in exogenous attention to biologically salient stimuli

Exogenous attention can be understood as an adaptive tool that permits the detection and processing of biologically salient events even when the individual is engaged in a resource-consuming task. Indirect data suggest that the spatial frequency of stimulation may be a crucial element in this process. Behavioral and neural data (both functional and structural) were analyzed for 36 participants engaged in a digit categorization task in which distracters were presented. Distracters were biologically salient or anodyne images, and had three spatial frequency formats: intact, low spatial frequencies only, and high spatial frequencies only. Behavior confirmed enhanced exogenous attention to biologically salient distracters. The activity in the right and left intraparietal sulci and the right middle frontal gyrus was associated with this behavioral pattern and was greater in response to salient than to neutral distracters, the three areas presenting strong correlations to each other. Importantly, the enhanced response of this network to biologically salient distracters with respect to neutral distracters relied on low spatial frequencies to a significantly greater extent than on high spatial frequencies. Structural analyses suggested the involvement of internal capsule, superior longitudinal fasciculus and corpus callosum in this network. Results confirm that exogenous attention is preferentially captured by biologically salient information, and suggest that the architecture and function underlying this process are low spatial frequency-biased.

Auditory signals evolve from hybrid- to eye-centered coordinates in the primate superior colliculus

Visual and auditory spatial signals initially arise in different reference frames. It has been postulated that auditory signals are translated from a head-centered to an eye-centered frame of reference compatible with the visual spatial maps, but, to date, only various forms of hybrid reference frames for sound have been identified. Here, we show that the auditory representation of space in the superior colliculus involves a hybrid reference frame immediately after the sound onset but evolves to become predominantly eye centered, and more similar to the visual representation, by the time of a saccade to that sound. Specifically, during the first 500 ms after the sound onset, auditory response patterns (N = 103) were usually neither head nor eye centered: 64% of neurons showed such a hybrid pattern, whereas 29% were more eye centered and 8% were more head centered. This differed from the pattern observed for visual targets (N = 156): 86% were eye centered, <1% were head centered, and only 13% exhibited a hybrid of both reference frames. For auditory-evoked activity observed within 20 ms of the saccade (N = 154), the proportion of eye-centered response patterns increased to 69%, whereas the hybrid and head-centered response patterns dropped to 30% and <1%, respectively. This pattern approached, although did not quite reach, that observed for saccade-related activity for visual targets: 89% were eye centered, 11% were hybrid, and <1% were head centered (N = 162). The plainly eye-centered visual response patterns and predominantly eye-centered auditory motor response patterns lie in marked contrast to our previous study of the intraparietal cortex, where both visual and auditory sensory and motor-related activity used a predominantly hybrid reference frame (Mullette-Gillman et al. 2005, 2009). Our present findings indicate that auditory signals are ultimately translated into a reference frame roughly similar to that used for vision, but suggest that such signals might emerge only in motor areas responsible for directing gaze to visual and auditory stimuli.

Midbrain contributions to sensorimotor decision making

Making decisions about future actions is a fundamental function of the nervous system. Classical theories hold that separate sets of brain regions are responsible for selecting and implementing an action. Traditionally, action selection has been considered the domain of high-level regions, such as the prefrontal cortex, whereas action generation is thought to be carried out by dedicated cortical and subcortical motor regions. However, increasing evidence suggests that the activity of individual neurons in cortical motor structures reflects abstract properties of "decision variables" rather than conveying simple motor commands. Less is known, though, about the role of subcortical structures in decision making. In particular, the superior colliculus (SC) is critical for planning and initiating visually guided, gaze-displacing movements and selecting visual targets, but whether and how it contributes more generally to sensorimotor decisions are unclear. Here, we show that the SC is intimately involved in orienting decisions based on odor cues, even though the SC does not explicitly process olfactory stimuli. Neurons were recorded from the intermediate and deep SC layers in rats trained to perform a delayed-response, odor-cued spatial choice task. SC neurons commonly fired well in advance of movement initiation, predicting the chosen direction nearly 1 s before movement. Moreover, under conditions of sensory uncertainty, SC activity varied with task difficulty and reward outcome, reflecting the influence of decision variables on the intercollicular competition thought to underlie orienting movements. These results indicate that the SC plays a more general role in decisions than previously appreciated, extending beyond visuomotor functions.

Cell-type-specific synchronization of neural activity in FEF with V4 during attention

Shifts of gaze and shifts of attention are closely linked and it is debated whether they result from the same neural mechanisms. Both processes involve the frontal eye fields (FEF), an area which is also a source of top-down feedback to area V4 during covert attention. To test the relative contributions of oculomotor and attention-related FEF signals to such feedback, we recorded simultaneously from both areas in a covert attention task and in a saccade task. In the attention task, only visual and visuomovement FEF neurons showed enhanced responses, whereas movement cells were unchanged. Importantly, visual, but not movement or visuomovement cells, showed enhanced gamma frequency synchronization with activity in V4 during attention. Within FEF, beta synchronization was increased for movement cells during attention but was suppressed in the saccade task. These findings support the idea that the attentional modulation of visual processing is not mediated by movement neurons.

Microstimulation of the monkey superior colliculus induces pupil dilation without evoking saccades

The orienting reflex is initiated by a salient stimulus and facilitates quick, appropriate action. It involves a rapid shift of the eyes, head, and attention and other physiological responses such as changes in heart rate and transient pupil dilation. The SC is a critical structure in the midbrain that selects incoming stimuli based on saliency and relevance to coordinate orienting behaviors, particularly gaze shifts, but its causal role in pupil dilation remains poorly understood in mammals. Here, we examined the role of the primate SC in the control of pupil dynamics. While requiring monkeys to keep their gaze fixed, we delivered weak electrical microstimulation to the SC, so that saccadic eye movements were not evoked. Pupil size increased transiently after microstimulation of the intermediate SC layers (SCi) and the size of evoked pupil dilation was larger on a dim versus bright background. In contrast, microstimulation of the superficial SC layers did not cause pupil dilation. Thus, the SCi is directly involved not only in shifts of gaze and attention, but also in pupil dilation as part of the orienting reflex, and the function of pupil dilation may be related to increasing visual sensitivity. The shared neural mechanisms suggest that pupil dilation may be associated with covert attention.

Reciprocal inhibition of inhibition: a circuit motif for flexible categorization in stimulus selection

As a precursor to the selection of a stimulus for gaze and attention, a midbrain network categorizes stimuli into "strongest" and "others." The categorization tracks flexibly, in real time, the absolute strength of the strongest stimulus. In this study, we take a first-principles approach to computations that are essential for such categorization. We demonstrate that classical feedforward lateral inhibition cannot produce flexible categorization. However, circuits in which the strength of lateral inhibition varies with the relative strength of competing stimuli categorize successfully. One particular implementation--reciprocal inhibition of feedforward lateral inhibition--is structurally the simplest, and it outperforms others in flexibly categorizing rapidly and reliably. Strong predictions of this anatomically supported circuit model are validated by neural responses measured in the owl midbrain. The results demonstrate the extraordinary power of a remarkably simple, neurally grounded circuit motif in producing flexible categorization, a computation fundamental to attention, perception, and decision making.

Intrinsic reference frames of superior colliculus visuomotor receptive fields during head-unrestrained gaze shifts

A sensorimotor neuron's receptive field and its frame of reference are easily conflated within the natural variability of spatial behavior. Here, we capitalized on such natural variations in 3-D eye and head positions during head-unrestrained gaze shifts to visual targets in two monkeys: to determine whether intermediate/deep layer superior colliculus (SC) receptive fields code visual targets or gaze kinematics, within four different frames of reference. Visuomotor receptive fields were either characterized during gaze shifts to visual targets from a central fixation position (32 U) or were partially characterized from each of three initial fixation points (31 U). Natural variations of initial 3-D gaze and head orientation (including torsion) provided spatial separation between four different coordinate frame models (space, head, eye, fixed-vector relative to fixation), whereas natural saccade errors provided spatial separation between target and gaze positions. Using a new statistical method based on predictive sum-of-squares, we found that in our population of 63 neurons (1) receptive field fits to target positions were significantly better than fits to actual gaze shift locations and (2) eye-centered models gave significantly better fits than the head or space frame. An intermediate frames analysis confirmed that individual neuron fits were distributed target-in-eye coordinates. Gaze position "gain" effects with the spatial tuning required for a 3-D reference frame transformation were significant in 23% (7/31) of neurons tested. We conclude that the SC primarily represents gaze targets relative to the eye but also carries early signatures of the 3-D sensorimotor transformation.

Insights into cortical mechanisms of behavior from microstimulation experiments

Even the simplest behaviors depend on a large number of neurons that are distributed across many brain regions. Because electrical microstimulation can change the activity of localized subsets of neurons, it has provided valuable evidence that specific neurons contribute to particular behaviors. Here we review what has been learned about cortical function from behavioral studies using microstimulation in animals and humans. Experiments that examine how microstimulation affects the perception of stimuli have shown that the effects of microstimulation are usually highly specific and can be related to the stimuli preferred by neurons at the stimulated site. Experiments that ask subjects to detect cortical microstimulation in the absence of other stimuli have provided further insights. Although subjects typically can detect microstimulation of primary sensory or motor cortex, they are generally unable to detect stimulation of most of cortex without extensive practice. With practice, however, stimulation of any part of cortex can become detected. These training effects suggest that some patterns of cortical activity cannot be readily accessed to guide behavior, but that the adult brain retains enough plasticity to learn to process novel patterns of neuronal activity arising anywhere in cortex.

Neural basis of feature-based contextual effects on visual search behavior

Searching for a visual object is known to be adaptable to context, and it is thought to result from the selection of neural representations distributed on a visual salience map, wherein stimulus-driven and goal-directed signals are combined. Here we investigated the neural basis of this adaptability by recording superior colliculus (SC) neurons while three female rhesus monkeys (Macaca mulatta) searched with saccadic eye movements for a target presented in an array of visual stimuli whose feature composition varied from trial to trial. We found that sensory-motor activity associated with distracters was enhanced or suppressed depending on the search array composition and that it corresponded to the monkey's search strategy, as assessed by the distribution of the occasional errant saccades. This feature-related modulation occurred independently from the saccade goal and facilitated the process of saccade target selection. We also observed feature-related enhancement in the activity associated with distracters that had been the search target during the previous session. Consistent with recurrent processing, both feature-related neuronal modulations occurred more than 60 ms after the onset of the visually evoked responses, and their near coincidence with the time of saccade target selection suggests that they are integral to this process. These results suggest that SC neuronal activity is shaped by the visual context as dictated by both stimulus-driven and goal-directed signals. Given the close proximity of the SC to the motor circuit, our findings suggest a direct link between perception and action and no need for distinct salience and motor maps.

Dopamine, affordance and active inference

The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or salience of (external or internal) cues that engender action. In other words, dopamine balances bottom-up sensory information and top-down prior beliefs when making hierarchical inferences (predictions) about cues that have affordance. In this paper, we focus on the consequences of changing tonic levels of dopamine firing using simulations of cued sequential movements. Crucially, the predictions driving movements are based upon a hierarchical generative model that infers the context in which movements are made. This means that we can confuse agents by changing the context (order) in which cues are presented. These simulations provide a (Bayes-optimal) model of contextual uncertainty and set switching that can be quantified in terms of behavioural and electrophysiological responses. Furthermore, one can simulate dopaminergic lesions (by changing the precision of prediction errors) to produce pathological behaviours that are reminiscent of those seen in neurological disorders such as Parkinson's disease. We use these simulations to demonstrate how a single functional role for dopamine at the synaptic level can manifest in different ways at the behavioural level.

Deficits in reach target selection during inactivation of the midbrain superior colliculus

Purposive action requires the selection of a single movement goal from multiple possibilities. Neural structures involved in movement planning and execution often exhibit activity related to target selection. A key question is whether this activity is specific to the type of movement produced by the structure, perhaps consisting of a competition among effector-specific movement plans, or whether it constitutes a more abstract, effector-independent selection signal. Here, we show that temporary focal inactivation of the primate superior colliculus (SC), an area involved in eye-movement target selection and execution, causes striking target selection deficits for reaching movements, which cannot be readily explained as a simple impairment in visual perception or motor execution. This indicates that target selection activity in the SC does not simply represent a competition among eye-movement goals and, instead, suggests that the SC contributes to a more general purpose priority map that influences target selection for other actions, such as reaches.

Interaction between visual- and goal-related neuronal signals on the trajectories of saccadic eye movements

During natural viewing, the trajectories of saccadic eye movements often deviate dramatically from a straight-line path between objects. In human studies, saccades have been shown to deviate toward or away from salient visual distractors depending on visual- and goal-related parameters, but the neurophysiological basis for this is not well understood. Some studies suggest that deviation toward is associated with competition between simultaneously active sites within the intermediate layers of the superior colliculus (SC), a midbrain structure that integrates sensory and goal-related signals for the production of saccades. In contrast, deviation away is hypothesized to reflect a higher-level process, whereby the neural site associated with the distractor isactively suppressed via a form of endogenous, top-down inhibition. We tested this hypothesis by measuring presaccadic distractor-evoked activation of SC visuomotor neurons while monkeys performed a simple task configured specifically to induce a high degree of saccades that deviate away. In the SC, cognitive processes such as top-down expectation are represented as variation in the sustained, low-frequency presaccadic discharge. We reasoned that any inhibition at the distractor-related locus associated with saccade deviation should affect the excitability of the neuron, thereby affecting the discharge rate. We found that, although the task produced robust deviation away, there was no evidence of a relationship between saccade deviation and distractor-evoked activation outside a short perisaccadic window that began no earlier than 22 msec before saccade onset. This indicates that deviation away is not adequately explained by a form of sustained, top-down inhibition at the distractor-related locus in the SC. The results are discussed in relation to the primary sources of inhibition associated with saccadic control.

Mechanisms for generating and compensating for the smallest possible saccades

Microsaccades are small eye movements that occur during gaze fixation. Although taking place only when we attempt to stabilize gaze position, microsaccades can be understood by relating them to the larger voluntary saccades, which abruptly shift gaze position. Starting from this approach to microsaccade analysis, I show how it can lead to significant insight about the generation and functional role of these eye movements. Like larger saccades, microsaccades are now known to be generated by brainstem structures involved not only in compiling motor commands for eye movements, but also in identifying and selecting salient target locations in the visual environment. In addition, these small eye movements both influence and are influenced by sensory and cognitive processes in various areas of the brain, and in a manner that is similar to the interactions between larger saccades and sensory or cognitive processes. By approaching the study of microsaccades from the perspective of what has been learned about their larger counterparts, we are now in a position to make greater strides in our understanding of the function of the smallest possible saccadic eye movements.

Contribution of the central thalamus to the generation of volitional saccades

Lesions in the motor thalamus can cause deficits in somatic movements. However, the involvement of the thalamus in the generation of eye movements has only recently been elucidated. In this article, we review recent advances into the role of the thalamus in eye movements. Anatomically, the anterior group of the intralaminar nuclei and paralaminar portion of the ventrolateral, ventroanterior and mediodorsal nuclei of the thalamus send massive projections to the frontal eye field and supplementary eye field. In addition, these parts of the thalamus, collectively known as the 'oculomotor thalamus', receive inputs from the cerebellum, the basal ganglia and virtually all stages of the saccade-generating pathways in the brainstem. In their pioneering work in the 1980s, Schlag and Schlag-Rey found a variety of eye movement-related neurons in the oculomotor thalamus, and proposed that this region might constitute a 'central controller' playing a role in monitoring eye movements and generating self-paced saccades. This hypothesis has been evaluated by recent experiments in non-human primates and by clinical observations of subjects with thalamic lesions. In addition, several recent studies have also addressed the involvement of the oculomotor thalamus in the generation of anti-saccades and the selection of targets for saccades. These studies have revealed the impact of subcortical signals on the higher-order cortical processing underlying saccades, and suggest the possibility of future studies using the oculomotor system as a model to explore the neural mechanisms of global cortico-subcortical loops and the neural basis of a local network between the thalamus and cortex.

Split of spatial attention as predicted by a systems-level model of visual attention

Can we attend to multiple distinct spatial locations at the same time? According to a recent psychophysical study [J. Dubois et al. (2009)Journal of Vision, 9, 3.1-11] such a split of spatial attention might be limited to short periods of time. Following N. P. Bichot et al. [(1999)Perception & Psychophysics, 61, 403-423] subjects had to report the identity of multiple letters that were briefly presented at different locations, while two of these locations (targets) were relevant for a concurrent shape comparison task. In addition to the design used by Bichot et al. stimulus onset asynchrony between shape onset and letters was systematically varied. In general, the performance of subjects was superior at target locations. Furthermore, for short stimulus onset asynchronies, performance was simultaneously increasing at both target locations. For longer stimulus onset asynchronies, however, performance deteriorated at one of the target locations while increasing at the other target location. It was hypothesized that this dynamic deployment of attention might be caused by competitive processes in saccade-related structures such as the frontal eye field. Here we simulated the task of Dubois et al. using a systems-level model of attention. Our results are consistent with recent findings in the frontal eye field obtained during covert visual search, and they support the view of a transient deployment of spatial attention to multiple stimuli in the early epoch of target selection.

Control from below: the role of a midbrain network in spatial attention

Spatial attention enables the brain to analyse and evaluate information selectively from a specific location in space, a capacity essential for any animal to behave adaptively in a complex world. We usually think of spatial attention as being controlled by a frontoparietal network in the forebrain. However, emerging evidence shows that a midbrain network also plays a critical role in controlling spatial attention. Moreover, the highly differentiated, retinotopic organization of the midbrain network, especially in birds, makes it amenable to detailed analysis with modern techniques that can elucidate circuit, cellular and synaptic mechanisms of attention. The following review discusses the role of the midbrain network in controlling attention, the neural circuits that support this role and current knowledge about the computations performed by these circuits.