Microstimulation of the superior colliculus focuses attention without moving the eyes

Active inference, attention, and motor preparation

Perception is the foundation of cognition and is fundamental to our beliefs and consequent action planning. The Editorial (this issue) asks: "what mechanisms, if any, mediate between perceptual and cognitive processes?" It has recently been argued that attention might furnish such a mechanism. In this paper, we pursue the idea that action planning (motor preparation) is an attentional phenomenon directed toward kinesthetic signals. This rests on a view of motor control as active inference, where predictions of proprioceptive signals are fulfilled by peripheral motor reflexes. If valid, active inference suggests that attention should not be limited to the optimal biasing of perceptual signals in the exteroceptive (e.g., visual) domain but should also bias proprioceptive signals during movement. Here, we investigate this idea using a classical attention (Posner) paradigm cast in a motor setting. Specially, we looked for decreases in reaction times when movements were preceded by valid relative to invalid cues. Furthermore, we addressed the hierarchical level at which putative attentional effects were expressed by independently cueing the nature of the movement and the hand used to execute it. We found a significant interaction between the validity of movement and effector cues on reaction times. This suggests that attentional bias might be mediated at a low level in the motor hierarchy, in an intrinsic frame of reference. This finding is consistent with attentional enabling of top-down predictions of proprioceptive input and may rely upon the same synaptic mechanisms that mediate directed spatial attention in the visual system.

Using neuronal populations to study the mechanisms underlying spatial and feature attention

Visual attention affects both perception and neuronal responses. Whether the same neuronal mechanisms mediate spatial attention, which improves perception of attended locations, and nonspatial forms of attention has been a subject of considerable debate. Spatial and feature attention have similar effects on individual neurons. Because visual cortex is retinotopically organized, however, spatial attention can comodulate local neuronal populations, whereas feature attention generally requires more selective modulation. We compared the effects of feature and spatial attention on local and spatially separated populations by recording simultaneously from dozens of neurons in both hemispheres of V4. Feature and spatial attention affect the activity of local populations similarly, modulating both firing rates and correlations between pairs of nearby neurons. However, whereas spatial attention appears to act on local populations, feature attention is coordinated across hemispheres. Our results are consistent with a unified attentional mechanism that can modulate the responses of arbitrary subgroups of neurons.

Flexible categorization of relative stimulus strength by the optic tectum

Categorization is the process by which the brain segregates continuously variable stimuli into discrete groups. We report that patterns of neural population activity in the owl optic tectum (OT) categorize stimuli based on their relative strengths into "strongest" versus "other." The category boundary shifts adaptively to track changes in the absolute strength of the strongest stimulus. This population-wide categorization is mediated by the responses of a small subset of neurons. Our data constitute the first direct demonstration of explicit categorization of stimuli by a neural network based on relative stimulus strength or salience. The finding of categorization by the population code relaxes constraints on the properties of downstream decoders that might read out the location of the strongest stimulus. These results indicate that the ensemble neural code in the OT could mediate bottom-up stimulus selection for gaze and attention, a form of stimulus categorization in which the category boundary often shifts within hundreds of milliseconds.

The role of a midbrain network in competitive stimulus selection

A midbrain network interacts with the well-known frontoparietal forebrain network to select stimuli for gaze and spatial attention. The midbrain network, containing the superior colliculus (SC; optic tectum, OT, in non-mammalian vertebrates) and the isthmic nuclei, helps evaluate the relative priorities of competing stimuli and encodes them in a topographic map of space. Behavioral experiments in monkeys demonstrate an essential contribution of the SC to stimulus selection when the relative priorities of competing stimuli are similar. Neurophysiological results from the owl OT demonstrate a neural correlate of this essential contribution of the SC/OT. The multi-layered, spatiotopic organization of the midbrain network lends itself to the analysis and modeling of the mechanisms underlying stimulus selection for gaze and spatial attention.

Visual cognition

Visual cognition, high-level vision, mid-level vision and top-down processing all refer to decision-based scene analyses that combine prior knowledge with retinal input to generate representations. The label "visual cognition" is little used at present, but research and experiments on mid- and high-level, inference-based vision have flourished, becoming in the 21st century a significant, if often understated part, of current vision research. How does visual cognition work? What are its moving parts? This paper reviews the origins and architecture of visual cognition and briefly describes some work in the areas of routines, attention, surfaces, objects, and events (motion, causality, and agency). Most vision scientists avoid being too explicit when presenting concepts about visual cognition, having learned that explicit models invite easy criticism. What we see in the literature is ample evidence for visual cognition, but few or only cautious attempts to detail how it might work. This is the great unfinished business of vision research: at some point we will be done with characterizing how the visual system measures the world and we will have to return to the question of how vision constructs models of objects, surfaces, scenes, and events.

Signaling of the strongest stimulus in the owl optic tectum

Essential to the selection of the next target for gaze or attention is the ability to compare the strengths of multiple competing stimuli (bottom-up information) and to signal the strongest one. Although the optic tectum (OT) has been causally implicated in stimulus selection, how it computes the strongest stimulus is unknown. Here, we demonstrate that OT neurons in the barn owl systematically encode the relative strengths of simultaneously occurring stimuli independently of sensory modality. Moreover, special "switch-like" responses of a subset of neurons abruptly increase when the stimulus inside their receptive field becomes the strongest one. Such responses are not predicted by responses to single stimuli and, indeed, are eliminated in the absence of competitive interactions. We demonstrate that this sensory transformation substantially boosts the representation of the strongest stimulus by creating a binary discrimination signal, thereby setting the stage for potential winner-take-all target selection for gaze and attention.

Investigating the nature and time-course of the modality shift effect between vision and touch

It is well known that stimuli grab attention to their location, but do they also grab attention to their sensory modality? The modality shift effect (MSE), the observation that responding to a stimulus leads to reaction time benefits for subsequent stimuli in the same modality, suggests that this may be the case. If noninformative cue stimuli, which do not require a response, also lead to benefits for their modality, this would suggest that the effect is automatic. We investigated the time-course of the visuotactile MSE and the difference between the effects of cues and targets. In Experiment 1, when visual and tactile tasks and stimulus locations were matched, uninformative cues did not lead to reaction time benefits for targets in the same modality. However, the modality of the previous target led to a significant MSE. Only stimuli that require a response, therefore, appear to lead to reaction time benefits for their modality. In Experiment 2, increasing attention to the cue stimuli attenuated the effect of the previous target, but the cues still did not lead to a MSE. In Experiment 3, a MSE was demonstrated between successive targets, and this effect decreased with increasing intertrial intervals. Overall, these studies demonstrate how cue- and target-induced effects interact and suggest that modalities do not automatically capture attention as locations do; rather, the MSE is more similar to other task repetition effects.

Thalamic pathways for active vision

Active vision requires the integration of information coming from the retina with that generated internally within the brain, especially by saccadic eye movements. Just as visual information reaches cortex via the lateral geniculate nucleus of the thalamus, this internal information reaches the cerebral cortex through other higher-order nuclei of the thalamus. This review summarizes recent work on four of these thalamic nuclei. The first two pathways convey internal information about upcoming saccades (a corollary discharge) and probably contribute to the neuronal mechanisms that underlie stable visual perception. The second two pathways might contribute to the neuronal mechanisms underlying visual spatial attention in cortex and in the thalamus itself.

Space coding by gamma oscillations in the barn owl optic tectum

Gamma-band (25-140 Hz) oscillations of the local field potential (LFP) are evoked by sensory stimuli in the mammalian forebrain and may be strongly modulated in amplitude when animals attend to these stimuli. The optic tectum (OT) is a midbrain structure known to contribute to multimodal sensory processing, gaze control, and attention. We found that presentation of spatially localized stimuli, either visual or auditory, evoked robust gamma oscillations with distinctive properties in the superficial (visual) layers and in the deep (multimodal) layers of the owl's OT. Across layers, gamma power was tuned sharply for stimulus location and represented space topographically. In the superficial layers, induced LFP power peaked strongly in the low-gamma band (25-90 Hz) and increased gradually with visual contrast across a wide range of contrasts. Spikes recorded in these layers included presumptive axonal (input) spikes that encoded stimulus properties nearly identically with gamma oscillations and were tightly phase locked with the oscillations, suggesting that they contribute to the LFP oscillations. In the deep layers, induced LFP power was distributed across the low and high (90-140 Hz) gamma-bands and tended to reach its maximum value at relatively low visual contrasts. In these layers, gamma power was more sharply tuned for stimulus location, on average, than were somatic spike rates, and somatic spikes synchronized with gamma oscillations. Such gamma synchronized discharges of deep-layer neurons could provide a high-resolution temporal code for signaling the location of salient sensory stimuli.

The eye dominates in guiding attention during simultaneous eye and hand movements

Prior to the onset of a saccade or a reach, attention is directed to the goal of the upcoming movement. However, it remains unknown whether attentional resources are shared across effectors for simultaneous eye and hand movements. Using a 4-AFC shape discrimination task, we investigated attentional allocation during the planning of a saccade alone, reach alone, or combined saccade and reach to one of five peripheral locations. Target discrimination was better when the probe appeared at the goal of the impending movement than when it appeared elsewhere. However, discrimination performance at the movement goal was not better for combined eye-hand movements compared to either effector alone, suggesting a shared limited attentional resource rather than separate pools of effector-specific attention. To test which effector dominates in guiding attention, we then separated eye and hand movement goals in two conditions: (1) cued reach/fixed saccade--subjects made saccades to the same peripheral location throughout the block, while the reach goal was cued and (2) cued saccade/fixed reach--subjects made reaches to the same location, while the saccade goal was cued. For both conditions, discrimination performance was consistently better at the eye goal than the hand goal. This indicates that shared attentional resources are guided predominantly by the eye during the planning of eye and hand movements.

Recurrent antitopographic inhibition mediates competitive stimulus selection in an attention network

Topographically organized neurons represent multiple stimuli within complex visual scenes and compete for subsequent processing in higher visual centers. The underlying neural mechanisms of this process have long been elusive. We investigate an experimentally constrained model of a midbrain structure: the optic tectum and the reciprocally connected nucleus isthmi. We show that a recurrent antitopographic inhibition mediates the competitive stimulus selection between distant sensory inputs in this visual pathway. This recurrent antitopographic inhibition is fundamentally different from surround inhibition in that it projects on all locations of its input layer, except to the locus from which it receives input. At a larger scale, the model shows how a focal top-down input from a forebrain region, the arcopallial gaze field, biases the competitive stimulus selection via the combined activation of a local excitation and the recurrent antitopographic inhibition. Our findings reveal circuit mechanisms of competitive stimulus selection and should motivate a search for anatomical implementations of these mechanisms in a range of vertebrate attentional systems.

Integrating conflict detection and attentional control mechanisms

Human behavior involves monitoring and adjusting performance to meet established goals. Performance-monitoring systems that act by detecting conflict in stimulus and response processing have been hypothesized to influence cortical control systems to adjust and improve performance. Here we used fMRI to investigate the neural mechanisms of conflict monitoring and resolution during voluntary spatial attention. We tested the hypothesis that the ACC would be sensitive to conflict during attentional orienting and influence activity in the frontoparietal attentional control network that selectively modulates visual information processing. We found that activity in ACC increased monotonically with increasing attentional conflict. This increased conflict detection activity was correlated with both increased activity in the attentional control network and improved speed and accuracy from one trial to the next. These results establish a long hypothesized interaction between conflict detection systems and neural systems supporting voluntary control of visual attention.

Covert shift of attention modulates the ongoing neural activity in a reaching area of the macaque dorsomedial visual stream

Background

Attention is used to enhance neural processing of selected parts of a visual scene. It increases neural responses to stimuli near target locations and is usually coupled to eye movements. Covert attention shifts, however, decouple the attentional focus from gaze, allowing to direct the attention to a peripheral location without moving the eyes. We tested whether covert attention shifts modulate ongoing neuronal activity in cortical area V6A, an area that provides a bridge between visual signals and arm-motor control.

Methodology/Principal Findings

We performed single cell recordings from 3 Macaca Fascicularis trained to fixate straight-head, while shifting attention outward to a peripheral cue and inward again to the fixation point. We found that neurons in V6A are influenced by spatial attention. The attentional modulation occurs without gaze shifts and cannot be explained by visual stimulations. Visual, motor, and attentional responses can occur in combination in single neurons.

Conclusions/Significance

This modulation in an area primarily involved in visuo-motor transformation for reaching may form a neural basis for coupling attention to the preparation of reaching movements. Our results show that cortical processes of attention are related not only to eye-movements, as many studies have shown, but also to arm movements, a finding that has been suggested by some previous behavioral findings. Therefore, the widely-held view that spatial attention is tightly intertwined with—and perhaps directly derived from—motor preparatory processes should be extended to a broader spectrum of motor processes than just eye movements.

Inhibition of Steady-State Smooth Pursuit and Catch-Up Saccades by Abrupt Visual and Auditory Onsets

It is known that visual transients prolong saccadic latency and reduce saccadic frequency. The latter effect was attributed to subcortical structures because it occurred only 60–70 ms after stimulus onset. We examined the effects of large task-irrelevant transients on steady-state pursuit and the generation of catch-up saccades. Two screen-wide stripes of equal contrast (4, 20, or 100%) were briefly flashed at equal eccentricities (3, 6, or 12°) from the pursuit target. About 100 ms after flash onset, we observed that pursuit gain dropped by 6–12% and catch-up saccades were entirely suppressed. The relatively long latency of the inhibition suggests that it results from cortical mechanisms that may act by promoting fixation or the deployment of attention over the visual field. In addition, we show that a loud irrelevant sound is able to generate the same inhibition of saccades as visual transients, whereas it only induces a weak modulation of pursuit gain, indicating a privileged access of acoustic information to the saccadic system. Finally, irrelevant changes in motion direction orthogonal to pursuit had a smaller and later inhibitory effect.

Neural basis of visual selective attention

Attentional modulation along the object-recognition pathway of the cortical visual system of primates has been shown to consist of enhanced representation of the retinal input at a specific location in space, or of objects located anywhere in the visual field which possess a critical object feature. Moreover, selective attention mechanisms allow the visual system to resolve competition among multiple objects in a crowded scene in favor of the object that is relevant for the current behavior. Finally, selective attention affects the spontaneous activity of neurons as well as their visually driven responses, and it does so not only by modulating the spiking activity of individual neurons, but also by modulating the degree of coherent firing within the critical neuronal populations. WIREs Cogni Sci 2011 2 392-407 DOI: 10.1002/wcs.117 For further resources related to this article, please visit the WIREs website.

Topography of covert visual attention in human superior colliculus

Experiments were performed to examine the topography of covert visual attention signals in human superior colliculus (SC), both across its surface and in its depth. We measured the retinotopic organization of SC to direct visual stimulation using a 90° wedge of moving dots that slowly rotated around fixation. Subjects (n = 5) were cued to perform a difficult speed-discrimination task in the rotating region. To measure the retinotopy of covert attention, we used a full-field array of similarly moving dots. Subjects were cued to perform the same speed-discrimination task within a 90° wedge-shaped region, and only the cue rotated around fixation. High-resolution functional magnetic resonance imaging (fMRI, 1.2 mm voxels) data were acquired throughout SC. These data were then aligned to a high-resolution T1-weighted reference volume. The SC was segmented in this volume so that the surface of the SC could be computationally modeled and to permit calculation of a depth map for laminar analysis. Retinotopic maps were obtained for both direct visual stimulation and covert attention. These maps showed a similar spatial distribution to visual stimulation maps observed in rhesus macaque and were in registration with each other. Within the depth of SC, both visual attention and stimulation produced activity primarily in the superficial and intermediate layers, but stimulation activity extended significantly more deeply than attention.

Post-error behavioral adjustments are facilitated by activation and suppression of task-relevant and task-irrelevant information processing

Error monitoring by the posterior medial frontal cortex (pMFC) has been linked to post-error behavioral adaptation effects and cognitive control dynamics in lateral prefrontal cortex (LPFC). It remains unknown, however, whether control adjustments following errors produce post-error behavioral adjustments (PEBAs) by inhibiting inappropriate responses or facilitating goal-directed ones. Here we used functional magnetic resonance imaging to investigate the hemodynamic correlates of PEBAs in a stimulus-response compatibility task. Our task was designed to test whether PEBAs are implemented by suppressing motor responses primed by irrelevant stimulus features (face location), redirecting attention to relevant features (face gender), or both or neither of these possibilities. Independent of PEBAs, error-related pMFC activation was followed by post-error recruitment of prefrontal and parietal control regions and, crucially, both (1) suppressed response-related activity in sensorimotor cortex and (2) enhanced target processing in face-sensitive sensory cortex ("fusiform face area"). More importantly, by investigating the covariation between post-error hemodynamic activity and individual differences in PEBAs, we showed that modulation of task-related motor and sensory processing was dependent on whether participants produced generally slower responses ("post-error slowing"; PES) or selectively reduced interference effects ("post-error reduction of interference"; PERI), respectively. Each of these behaviorally dependent effects was mediated by distinct LPFC control mechanisms (PES: inferior frontal junction; PERI: superior frontal sulcus). While establishing relationships between PEBAs and cognitive control, our findings suggest that the neural architecture underlying sequential behavioral adaptation may be determined primarily by how control is executed by the individual when adjustments are needed.

Spatially distributed encoding of covert attentional shifts in human thalamus

Spatial attention modulates signal processing within visual nuclei of the thalamus—but do other nuclei govern the locus of attention in top-down mode? We examined functional MRI (fMRI) data from three subjects performing a task requiring covert attention to 1 of 16 positions in a circular array. Target position was cued after stimulus offset, requiring subjects to perform target detection from iconic visual memory. We found positionally specific responses at multiple thalamic sites, with individual voxels activating at more than one direction of attentional shift. Voxel clusters at anatomically equivalent sites across subjects revealed a broad range of directional tuning at each site, with little sign of contralateral bias. By reference to a thalamic atlas, we identified the nuclear correspondence of the four most reliably activated sites across subjects: mediodorsal/central-intralaminar (oculomotor thalamus), caudal intralaminar/parafascicular, suprageniculate/limitans, and medial pulvinar/lateral posterior. Hence, the cortical network generating a top-down control signal for relocating attention acts in concert with a spatially selective thalamic apparatus—the set of active nuclei mirroring the thalamic territory of cortical “eye-field” areas, thus supporting theories which propose the visuomotor origins of covert attentional selection.

Shedding new light on the role of the basal ganglia-superior colliculus pathway in eye movements

A large body of work spanning 25+ years provides compelling evidence for the involvement of the basal ganglia-superior colliculus pathway in the initiation of rapid, orienting movements of the eyes, called saccades. The role of this pathway in saccade control is similar to the role of the basal ganglia-thalamic pathway in the control of skeletal movement: a transient cessation in tonic inhibition supplied by the basal ganglia to motor structures releases movements via the direct pathway whereas a transient increase in inhibition by the basal ganglia to motor structures prevents movements via the indirect pathway. In parallel with recent advances in the study and treatment of patients with basal ganglia disease and in animal experiments in the skeletal motor system, the results of studies exploring the role of the basal ganglia-superior colliculus pathway in saccades highlight the need for a revisiting of our understanding of the role of this pathway in saccades. The discovery of many different response profiles of neurons in the substantia nigra pars reticulata of the basal ganglia and in the superior colliculus, coupled with advances in experimental and statistical techniques including sophisticated behavioral procedures and multiple neuron recording and analysis, point toward a role for the basal ganglia-superior colliculus pathway in cognitive events intervening between vision and action, such as memory, target selection and saccade choice and valuation.

The neural basis of visual attention

Visual attention is the mechanism the nervous system uses to highlight specific locations, objects or features within the visual field. This can be accomplished by making an eye movement to bring the object onto the fovea (overt attention) or by increased processing of visual information in neurons representing more peripheral regions of the visual field (covert attention). This review will examine two aspects of visual attention: the changes in neural responses within visual cortices due to the allocation of covert attention; and the neural activity in higher cortical areas involved in guiding the allocation of attention. The first section will highlight processes that occur during visual spatial attention and feature-based attention in cortical visual areas and several related models that have recently been proposed to explain this activity. The second section will focus on the parietofrontal network thought to be involved in targeting eye movements and allocating covert attention. It will describe evidence that the lateral intraparietal area, frontal eye field and superior colliculus are involved in the guidance of visual attention, and describe the priority map model, which is thought to operate in at least several of these areas.

Inactivation of primate superior colliculus biases target choice for smooth pursuit, saccades, and button press responses

In addition to its well-known role in the control of saccades, the primate superior colliculus (SC) has been implicated in the processes of target choice for overt orienting movements and for covert spatial attention. We focally inactivated the SC, by muscimol injection, while monkeys selected the target of a smooth pursuit, saccade, or button press response from two competing stimuli. The choice stimuli were placed so that one appeared within and the other appeared outside the affected visual field. SC inactivation biased the subject to choose stimuli out of the affected visual field for all three types of responses, although the effects on target choice were significantly smaller for button presses. Inactivation caused no changes in the selection of single stimuli within or out of the affected visual field, indicating the choice bias was not caused by deficits in response execution. The inactivation-induced bias for smooth pursuit and button press responses indicates SC activity is important for selecting the target, independent of any role in saccade preparation.

Multiple Manifestations of Microstimulation in the Optic Tectum: Eye Movements, Pupil Dilations, and Sensory Priming

It is well established that the optic tectum (or its mammalian homologue, the superior colliculus) is involved in directing gaze toward salient stimuli. However, salient stimuli typically induce orienting responses beyond gaze shifts. The role of the optic tectum in generating responses such as pupil dilation, galvanic responses, or covert shifts is not clear. In the present work, we studied the effects of microstimulation in the optic tectum of the barn owl ( Tyto alba) on pupil diameter and on eye shifts. Experiments were conducted in lightly anesthetized head-restrained barn owls. We report that low-level microstimulation in the deep layers of the optic tectum readily induced pupil dilation responses (PDRs), as well as small eye movements. Electrically evoked PDRs, similar to acoustically evoked PDRs, were long-lasting and habituated to repeated stimuli. We further show that microstimulation in the external nucleus of the inferior colliculus also induced PDRs. Finally, in experiments in which tectal microstimulations were coupled with acoustic stimuli, we show a tendency of the microstimulation to enhance pupil responses and eye shifts to previously habituated acoustic stimuli. The enhancement was dependent on the site of stimulation in the tectal spatial map; responses to sounds with spatial cues that matched the site of stimulation were more enhanced compared with sounds with spatial cues that did not match. These results suggest that the optic tectum is directly involved in autonomic orienting reflexes as well as in gaze shifts, highlighting the central role of the optic tectum in mediating the body responses to salient stimuli.

Stimulus-driven competition in a cholinergic midbrain nucleus

The mechanisms by which the brain selects a particular stimulus as the next target for gaze are poorly understood. A cholinergic nucleus in the owl’s midbrain exhibits functional properties that suggest its role in bottom-up stimulus selection. Neurons in the nucleus isthmi pars parvocellularis (Ipc) respond to wide ranges of visual and auditory features, but they are not tuned to particular values of those features. Instead, they encode the relative strengths of stimuli across the entirety of space. Many neurons exhibit switch-like properties, abruptly increasing their responses to a stimulus in their receptive field when it becomes the strongest stimulus. This information propagates directly to the optic tectum, a structure involved in gaze control and stimulus selection, as periodic (25–50 Hz) bursts of cholinergic activity. The functional properties of Ipc neurons resemble those of a “salience map”, a core component in computational models for spatial attention and gaze control.

Interactions between stimulus-specific adaptation and visual auditory integration in the forebrain of the barn owl

Neural adaptation and visual auditory integration are two well studied and common phenomena in the brain, yet little is known about the interaction between them. In the present study, we investigated a visual forebrain area in barn owls, the entopallium (E), which has been shown recently to encompass auditory responses as well. Responses of neurons to sequences of visual, auditory, and bimodal (visual and auditory together) events were analyzed. Sequences comprised two stimuli, one with a low probability of occurrence and the other with a high probability. Neurons in the E tended to respond more strongly to low probability visual stimuli than to high probability stimuli. Such a phenomenon is known as stimulus-specific adaptation (SSA) and is considered to be a neural correlate of change detection. Responses to the corresponding auditory sequences did not reveal an equivalent tendency. Interestingly, however, SSA to bimodal events was stronger than to visual events alone. This enhancement was apparent when the visual and auditory stimuli were presented from matching locations in space (congruent) but not when the bimodal stimuli were spatially incongruent. These findings suggest that the ongoing task of detecting unexpected events can benefit from the integration of visual and auditory information.

Temporal sequence of attentional modulation in the lateral intraparietal area and middle temporal area during rapid covert shifts of attention

In the visual system, spatial attention enhances sensory responses to stimuli at attended locations relative to unattended locations. Which brain structures direct the locus of attention, and how is attentional modulation delivered to structures in the visual system? We trained monkeys on an attention-switch task designed to precisely measure the onset of attentional modulation during rapid shifts of spatial attention. Here we show that attentional modulation appears substantially earlier in the lateral intraparietal area (LIP) than in an anatomically connected lower visual area, the middle temporal area. This temporal sequence of attentional latencies demonstrates that endogenous changes of state can occur in higher visual areas before lower visual areas and satisfies a critical prediction of the hypothesis that LIP is a source of top-down attentional signals to early visual cortex.

Top-down control of visual attention

Top-down visual attention improves perception of selected stimuli and that improvement is reflected in the neural activity at many stages throughout the visual system. Recent studies of top-down attention have elaborated on the signatures of its effects within visual cortex and have begun identifying its causal basis. Evidence from these studies suggests that the correlates of spatial attention exhibited by neurons within the visual system originate from a distributed network of structures involved in the programming of saccadic eye movements. We summarize this evidence and discuss its relationship to the neural mechanisms of spatial working memory.

Perisaccadic gamma modulation in Parkinson disease patients and healthy subjects

We quantified the anterior-posterior distribution of the gamma modulation index (GMI), an index of perisaccadic phasic modulation of the gamma (35-45 Hz) range electroencephalogram (EEG), in healthy human subjects and Parkinson disease (PD) patients. The EEG was recorded over the frontal, parietal, temporal and occipital sites in 11 idiopathic PD patients (age 50-70 years, four females), 4 age matched healthy volunteers (1 female) and 17 young healthy controls (age 21-30 years, four females) Eye movements were recorded with EOG and ISCAN camera. Subjects executed saccades to a mark at right and back to fixation point and vice versa. The saccades directed away from center/fixation (centrifugal CF) were analyzed. Two minutes of EEG were obtained from each subject for the two possible saccade types (centrifugal rightwards and leftwards at 15 degrees). Each perisaccadic EEG segment was analyzed using continuous wavelet transform for quantifying the power and time course of gamma EEG ranges for each saccade type. A three way ANOVA was used for statistical analysis. Perisaccadic GMI (peak intrasaccadic power divided by mean power) in healthy subjects was higher over the contralateral hemisphere to the saccade direction, for both centrifugal saccades at anterior, posterior and occipital recording sites. Contrary to the healthy subject GMI remained near one in PD, i.e., there was no evidence of intrasaccadic gamma power increase in PD patients.

Motor output evoked by subsaccadic stimulation of primate frontal eye fields

In addition to its role in shifting the line of sight, the oculomotor system is also involved in the covert orienting of visuospatial attention. Causal evidence supporting this premotor theory of attention, or oculomotor readiness hypothesis, comes from the effect of subsaccadic threshold stimulation of the oculomotor system on behavior and neural activity in the absence of evoked saccades, which parallels the effects of covert attention. Here, by recording neck-muscle activity from monkeys and systematically titrating the level of stimulation current delivered to the frontal eye fields (FEF), we show that such subsaccadic stimulation is not divorced from immediate motor output but instead evokes neck-muscle responses at latencies that approach the minimal conduction time to the motor periphery. On average, neck-muscle thresholds were approximately 25% lower than saccade thresholds, and this difference is larger for FEF sites associated with progressively larger saccades. Importantly, we commonly observed lower neck-muscle thresholds even at sites evoking saccades <or=5 degrees in magnitude, although such small saccades are not associated with head motion. Neck-muscle thresholds compare well with the current levels used in previous studies to influence behavior or neural activity through activation of FEF neurons feeding back to extrastriate cortex. Our results complement this previous work by suggesting that the neurobiologic substrate that covertly orients visuospatial attention shares this command with head premotor circuits in the brainstem, culminating with recruitment in the motor periphery.

Anatomical correlate of impaired covert visual attentional processes in patients with cerebellar lesions

In the past years, claims of cognitive and attentional function of the cerebellum have first been raised but were later refuted. One reason for this controversy might be that attentional deficits only occur when specific cerebellar structures are affected. To further elucidate this matter and to determine which cerebellar regions might be involved in deficits of covert visual attention, we used new brain imaging tools of lesion mapping that allow a direct comparison with control patients. A total of 26 patients with unilateral right-sided cerebellar infarcts were tested on a covert visual attention task. Eight (31%) patients showed markedly slowed responses, especially in trials in which an invalid cue necessitated reorienting of the focus of attention for target detection. Compared with the 18 patients who performed within the range of healthy control subjects, only the impaired patients had lesions of cerebellar vermal structures such as the pyramid. We suggest that these midcerebellar regions are indirectly involved in covert visual attention via oculomotor control mechanisms. Thus, specific cerebellar structures do influence attentional orienting, whereas others do not.

Global inhibition and stimulus competition in the owl optic tectum

Stimulus selection for gaze and spatial attention involves competition among stimuli across sensory modalities and across all of space. We demonstrate that such cross-modal, global competition takes place in the intermediate and deep layers of the optic tectum, a structure known to be involved in gaze control and attention. A variety of either visual or auditory stimuli located anywhere outside of a neuron's receptive field (RF) were shown to suppress or completely eliminate responses to a visual stimulus located inside the RF in nitrous oxide sedated owls. The essential mechanism underlying this stimulus competition is global, divisive inhibition. Unlike the effect of the classical inhibitory surround, which decreases with distance from the RF center and shapes neuronal responses to individual stimuli, global inhibition acts across the entirety of space and modulates responses primarily in the context of multiple stimuli. Whereas the source of this global inhibition is as yet unknown, our data indicate that different networks mediate the classical surround and global inhibition. We hypothesize that this global, cross-modal inhibition, which acts automatically in a bottom-up manner even in sedated animals, is critical to the creation of a map of stimulus salience in the optic tectum.

Visual target selection and motor planning define attentional enhancement at perceptual processing stages

Extracting information from the visual field can be achieved by covertly orienting attention to different regions, or by making saccades to bring areas of interest onto the fovea. While much research has shown a link between covert attention and saccade preparation, the nature of that link remains a matter of dispute. Covert presaccadic orienting could result from target selection or from planning a motor act toward an object. We examined the contribution of visual target selection and motor preparation to attentional orienting in humans by dissociating these two habitually aligned processes with saccadic adaptation. Adaptation introduces a discrepancy between the visual target evoking a saccade and the motor metrics of that saccade, which, unbeknownst to the participant, brings the eyes to a different spatial location. We examined attentional orienting by recording event-related potentials (ERPs) to task-irrelevant visual probes flashed during saccade preparation at four equidistant locations including the visual target location and the upcoming motor endpoint. ERPs as early as 130–170 ms post-probe were modulated by attention at both the visual target and motor endpoint locations. These results indicate that both target selection and motor preparation determine the focus of spatial attention, resulting in enhanced processing of stimuli at early visual-perceptual stages.

Intention and attention: different functional roles for LIPd and LIPv

Establishing the circuitry underlying attentional and oculomotor control is a long-standing goal of systems neuroscience. The macaque lateral intraparietal area (LIP) has been implicated in both processes, but numerous studies have produced contradictory findings. Anatomically, LIP consists of a dorsal and ventral subdivision, but the functional importance of this division remains unclear. We injected muscimol, a GABA(A) agonist, and manganese, a magnetic resonance imaging lucent paramagnetic ion, into different portions of LIP, examined the effects of the resulting reversible inactivation on saccade planning and attention, and visualized each injection using anatomical magnetic resonance imaging. We found that dorsal LIP (LIPd) is primarily involved in oculomotor planning, whereas ventral LIP (LIPv) contributes to both attentional and oculomotor processes. Additional testing revealed that the two functions were dissociable, even in LIPv. Using our technique, we found a clear structure-function relationship that distinguishes LIPv from LIPd and found dissociable circuits for attention and eye movements in the posterior parietal cortex.

Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey

Single neurons in cortical area LIP are known to carry information relevant to both sensory and value-based decisions that are reported by eye movements. It is not known, however, how sensory and value information are combined in LIP when individual decisions must be based on a combination of these variables. To investigate this issue, we conducted behavioral and electrophysiological experiments in rhesus monkeys during performance of a two-alternative, forced-choice discrimination of motion direction (sensory component). Monkeys reported each decision by making an eye movement to one of two visual targets associated with the two possible directions of motion. We introduced choice biases to the monkeys' decision process (value component) by randomly interleaving balanced reward conditions (equal reward value for the two choices) with unbalanced conditions (one alternative worth twice as much as the other). The monkeys' behavior, as well as that of most LIP neurons, reflected the influence of all relevant variables: the strength of the sensory information, the value of the target in the neuron's response field, and the value of the target outside the response field. Overall, detailed analysis and computer simulation reveal that our data are consistent with a two-stage drift diffusion model proposed by Diederich and Bussmeyer [1] for the effect of payoffs in the context of sensory discrimination tasks. Initial processing of payoff information strongly influences the starting point for the accumulation of sensory evidence, while exerting little if any effect on the rate of accumulation of sensory evidence.

The spatial distribution of receptive field changes in a model of peri-saccadic perception: predictive remapping and shifts towards the saccade target

At the time of an impending saccade receptive fields (RFs) undergo dynamic changes, that is, their spatial profile is altered. This phenomenon has been observed in several monkey visual areas. Although their link to eye movements is obvious, neither the exact pattern nor their function is fully clear. Several RF shifts have been interpreted in terms of predictive remapping mediating visual stability. In particular, even prior to saccade onset some cells become responsive to stimuli presented in their future, post-saccadic RF. In visual area V4, however, the overall effect of RF dynamics consists of a shrinkage and shift of RFs towards the saccade target. These observations have been linked to a pre-saccadically enhanced processing of the future fixation. In order to better understand these seemingly different outcomes, we analyzed the RF shifts predicted by a recently proposed computational model of peri-saccadic perception (Hamker, Zirnsak, Calow, & Lappe, 2008). This model unifies peri-saccadic compression, pre-saccadic attention shifts, and peri-saccadic receptive field dynamics in a common framework of oculomotor reentry signals in extrastriate visual cortical maps. According to the simulations that we present in the current paper, a spatially selective oculomotor feedback signal leads to RF dynamics which are both consistent with the observations made in studies aiming to investigate predictive remapping and saccade target shifts. Thus, the seemingly distinct experimental observations could be grounded in the same neural mechanism leading to different RF dynamics dependent on the location of the RF in visual space.

Influence and limitations of popout in the selection of salient visual stimuli by area V4 neurons

The neural mechanism of bottom-up attention and its relationship to top-down attention are poorly understood. Visual stimuli that differ from others in their component features are salient and tend to draw attention in a bottom-up manner. "Popout" stimuli differ uniformly from surrounding items and are more easily detected than stimuli composed of a conjunction of surrounding features. We compared the responses of single area V4 neurons to popout and conjunction stimuli appearing within the classical receptive field (CRF) and found that their responses are modulated by popout. This selectivity was more robust when larger numbers of surrounding items and multiple features were included in the display, and it was absent when only a few items were presented immediately outside the CRF. In addition, the popout modulation of V4 activity was eliminated when top-down attention was directed to locations outside of the CRFs during saccade preparation, indicating that the salience of popout stimuli is not sufficient to drive selection by V4 neurons. These results demonstrate that neurons in feature-selective cortex are influenced by bottom-up attention, but that this influence is limited by top-down attention.

Inactivation of primate superior colliculus impairs covert selection of signals for perceptual judgments

Primates base perceptual judgments on some sensory inputs while ignoring others. The covert selection of sensory information for perception is often thought to be accomplished mostly by the cerebral cortex, whereas the overt orienting toward relevant stimuli involves various additional structures such as the superior colliculus, a subcortical region involved in the control of eye movements. Contrary to this view, we show that the superior colliculus is necessary for determining which stimuli will inform perceptual judgments, even in the absence of orienting movements. Reversible inactivation of the superior colliculus in monkeys performing a motion discrimination task caused profound inattention for stimuli in the affected visual field, but only when distracters containing counterinformative signals appeared in the unaffected field. When distracting stimuli contained no information, discrimination performance was largely unaffected. Thus, the superior colliculus is a bottleneck in the covert selection of signals for perceptual judgments.

Frontal eye field activity enhances object identification during covert visual search

We investigated the link between neuronal activity in the frontal eye field (FEF) and the enhancement of visual processing associated with covert spatial attention in the absence of eye movements. We correlated activity recorded in the FEF of monkeys manually reporting the identity of a visual search target to performance accuracy and reaction time. Monkeys were cued to the most probable target location with a cue array containing a popout color singleton. Neurons exhibited spatially selective responses for the popout cue stimulus and for the target of the search array. The magnitude of activity related to the location of the cue prior to the presentation of the search array was correlated with trends in behavioral performance across valid, invalid, and neutral cue trial conditions. However, the speed and accuracy of the behavioral report on individual trials were predicted by the magnitude of spatial selectivity related to the target to be identified, not for the spatial cue. A minimum level of selectivity was necessary for target detection and a higher level for target identification. Muscimol inactivation of FEF produced spatially selective perceptual deficits in the covert search task that were correlated with the effectiveness of the inactivation and were strongest on invalid cue trials that require an endogenous attention shift. These results demonstrate a strong functional link between FEF activity and covert spatial attention and suggest that spatial signals from FEF directly influence visual processing during the time that a stimulus to be identified is being processed by the visual system.

When are attention and saccade preparation dissociated?

To understand the mechanisms of visual attention, it is crucial to know the relationship between attention and saccades. Some theories propose a close relationship, whereas others view the attention and saccade systems as completely independent. One possible way to resolve this controversy is to distinguish between the maintenance and shifting of attention. The present study used a novel paradigm that allowed simultaneous measurement of attentional allocation and saccade preparation. Saccades toward the location where attention was maintained were either facilitated or suppressed depending on the probability of making a saccade to that location and the match between the attended location and the saccade location on the previous trial. Shifting attention to another location was always associated with saccade facilitation. The findings provide a new view, demonstrating that the maintenance of attention and shifting of attention differ in their relationship to the oculomotor system.

The geometry of perisaccadic visual perception

Our ability to explore our surroundings requires a combination of high-resolution vision and frequent rotations of the visual axis toward objects of interest. Such gaze shifts are themselves a source of powerful retinal stimulation, and so the visual system appears to have evolved mechanisms to maintain perceptual stability during movements of the eyes in space. The mechanisms underlying this perceptual stability can be probed in the laboratory by briefly presenting a stimulus around the time of a saccadic eye movement and asking subjects to report its position. Under such conditions, there is a systematic misperception of the probes toward the saccade end point. This perisaccadic compression of visual space has been the subject of much research, but few studies have attempted to relate it to specific brain mechanisms. Here, we show that the magnitude of perceptual compression for a wide variety of probe stimuli and saccade amplitudes is quantitatively predicted by a simple heuristic model based on the geometry of retinotopic representations in the primate brain. Specifically, we propose that perisaccadic compression is determined by the distance between the probe and saccade end point on a map that has a logarithmic representation of visual space, similar to those found in numerous cortical and subcortical visual structures. Under this assumption, the psychophysical data on perisaccadic compression can be appreciated intuitively by imagining that, around the time of a saccade, the brain confounds nearby oculomotor and sensory signals while attempting to localize the position of objects in visual space.

Explicit eye movements failed to facilitate the precision of subsequent attentional localization

This study investigated the usefulness of explicit spatial coordinates from eye movements for the precision of covert shifts of attention within dense arrays of items. Observers shifted their attention covertly from one item to the next in response to a series of beeps and reported the color of the disc on which the series ended, providing an estimate of the accuracy of the "attentional walk". We compared performance in this task when only covert shifts of attention were done to performance when observers first executed an explicit eye movement to the starting point of the attentional walk before beginning the covert attentional walk. The hypothesis was that the eye movement would activate explicit coordinates of the starting point of the attentional walk within brain systems that are involved in controlling both shifts of attention and eye movements. This in turn would provide an anchor for the attentional walk, thereby improving performance. The evidence did not support this hypothesis. Performance was no better with an explicit eye movement prior to the attentional walk than without one. This suggests that covert orienting--shifting attention--and overt orienting--shifting the eyes-access the same coordinate system and therefore activating new coordinates interferes with the old ones, no matter what the system of orienting is.

The role of visual working memory (VWM) in the control of gaze during visual search

We investigated the interactions among visual working memory (VWM), attention, and gaze control in a visual search task that was performed while a color was held in VWM for a concurrent discrimination task. In the search task, participants were required to foveate a cued item within a circular array of colored objects. During the saccade to the target, the array was sometimes rotated so that the eyes landed midway between the target object and an adjacent distractor object, necessitating a second saccade to foveate the target. When the color of the adjacent distractor matched a color being maintained in VWM, execution of this secondary saccade was impaired, indicating that the current contents of VWM bias saccade targeting mechanisms that direct gaze toward target objects during visual search.

Functional imaging of the human superior colliculus: an optimised approach

Effective functional imaging of the human Superior Colliculus (SC) has often been regarded as difficult because of the small size of the SC and its proximity to sources of pulsatile (cardiac) noise. An optimised approach to functional imaging of the SC with fMRI is presented, based upon the novel finding that visually-induced BOLD responses in the SC are qualitatively different from responses in both cortical (V1) and sub-cortical (LGN) comparison areas. An optimised model with a Haemodynamic Response Function (HRF) which peaks early (4-5 s) and then falls rapidly is shown to be best suited for revealing SC responses, while a model peaking at 6 s and falling more slowly was most sensitive in the two comparison areas. Additionally, a method of correcting for the noise characteristics of fMRI responses proposed recently by de Zwart et al. (de Zwart, J. A., van Gelderen, P., Fukunaga, M., & Duyn, J. H. (2008). Reducing correlated noise in fMRI data. Magn Reson Med, 59, 939-945) is modified for use in the SC, and shown to be highly effective at further improving the statistical detectability of responses by modelling out noise. Together these methods represent a significant advance over previous approaches to functional imaging of the human SC. They permit the routine detection of strong SC activity in single subjects at standard spatial resolutions.

Visual modulation of auditory responses in the owl inferior colliculus

The barn owl's central auditory system creates a map of auditory space in the external nucleus of the inferior colliculus (ICX). Although the crucial role visual experience plays in the formation and maintenance of this auditory space map is well established, the mechanism by which vision influences ICX responses remains unclear. Surprisingly, previous experiments have found that in the absence of extensive pharmacological manipulation, visual stimuli do not drive neural responses in the ICX. Here we investigated the influence of dynamic visual stimuli on auditory responses in the ICX. We show that a salient visual stimulus, when coincident with an auditory stimulus, can modulate auditory responses in the ICX even though the same visual stimulus may elicit no neural responses when presented alone. For each ICX neuron, the most effective auditory and visual stimuli were located in the same region of space. In addition, the magnitude of the visual modulation of auditory responses was dependent on the context of the stimulus presentation with novel visual stimuli eliciting consistently larger response modulations than frequently presented visual stimuli. Thus the visual modulation of ICX responses is dependent on the characteristics of the visual stimulus as well as on the spatial and temporal correspondence of the auditory and visual stimuli. These results demonstrate moment-to-moment visual enhancements of auditory responsiveness that, in the short-term, increase auditory responses to salient bimodal stimuli and in the long-term could serve to instruct the adaptive auditory plasticity necessary to maintain accurate auditory orienting behavior.

The normalization model of attention

Attention has been found to have a wide variety of effects on the responses of neurons in visual cortex. We describe a model of attention that exhibits each of these different forms of attentional modulation, depending on the stimulus conditions and the spread (or selectivity) of the attention field in the model. The model helps reconcile proposals that have been taken to represent alternative theories of attention. We argue that the variety and complexity of the results reported in the literature emerge from the variety of empirical protocols that were used, such that the results observed in any one experiment depended on the stimulus conditions and the subject's attentional strategy, a notion that we define precisely in terms of the attention field in the model, but that has not typically been completely under experimental control.

Non-visually evoked activity of isthmo-optic neurons in awake, head-unrestrained quail

Changes in the internal state of the brain may modulate retinal function. In birds, most neurons in the isthmo-optic (IO) nucleus project their axons topographically into the contralateral retina, and activity in IO neurons enhances visual responses of retinal ganglion cells in the target retinal region. To elucidate the significance of this pathway, we recorded spikes of IO neurons in four awake Japanese quail using an implanted electrode assembly while recording unrestrained head movements. The IO neurons fired passively in response to visual stimuli in receptive fields and non-visually without visual stimuli or eye-head movements. Non-visually evoked activity was observed in the middle of eye-head fixation, as well as at about 200 ms before the onset of head saccades. Intensity of activity before onset of head saccades depended on the direction of motion of subsequent head saccades. Local retinal output may be enhanced by centrifugal signals before gaze shifts.

Distinct mechanisms for top-down control of neural gain and sensitivity in the owl optic tectum

We demonstrate that distinct mechanisms of top-down control regulate, respectively, the sensitivity and gain of sensory responses in the owl's optic tectum (OT). Electrical microstimulation in the forebrain gaze control area, the arcopallial gaze field (AGF), results in a space-specific regulation of sensory responses in the OT. AGF microstimulation increases the responsiveness of OT neurons representing stimuli at the same location as that represented at the AGF site. We show that the mechanism that underlies this effect operates focally to enhance neuronal sensitivity and improve tuning consistency and spatial resolution. At the same time, AGF microstimulation decreases the responsiveness of OT neurons representing stimuli at all other locations. The mechanism that underlies this effect operates globally to modulate neuronal gain. The coordinated action of these different mechanisms can account for many of the reported effects of spatial attention on neural responses in monkeys and on behavioral performance in humans.

Modelling attention in individual cells leads to a system with realistic saccade behaviours

Single cell recordings in monkey inferior temporal cortex (IT) and area V4 during visual search tasks indicate that modulation of responses by the search target object occurs in the late portion of the cell's sensory response (Chelazzi et al. in J Neurophysiol 80:2918-2940, 1998; Cereb Cortex 11:761-772, 2001) whereas attention to a spatial location influences earlier responses (Luck et al. in J Neurophysiol 77:24-42, 1997). Previous computational models have not captured differences in the latency of these attentional effects and yet the more protracted development of the object-based effect could have implications for behaviour. We present a neurodynamic biased competition model of visual attention in which we aimed to model the timecourse of spatial and object-based attention in order to simulate cellular responses and saccade onset times observed in monkey recordings. In common with other models, a top-down prefrontal signal, related to the search target, biases activity in the ventral visual stream. However, we conclude that this bias signal is more complex than modelled elsewhere: the latency of object-based effects in V4 and IT, and saccade onset, can be accurately simulated when the target object feedback bias consists of a sensory response component in addition to a mnemonic response. These attentional effects in V4 and IT cellular responses lead to a system that is able to produce search scan paths similar to those observed in monkeys and humans, with attention being guided to locations containing behaviourally relevant stimuli. This work demonstrates that accurate modelling of the timecourse of single cell responses can lead to biologically realistic behaviours being demonstrated by the system as a whole.