Attention-dependent suppression of metabolic activity in the early stages of the macaque visual system

A neural model of selective attention and object segmentation in the visual scene: an approach based on partial synchronization and star-like architecture of connections

A brain-inspired computational system is presented that allows sequential selection and processing of objects from a visual scene. The system is comprised of three modules. The selective attention module is designed as a network of spiking neurons of the Hodgkin-Huxley type with star-like connections between the central unit and peripheral elements. The attention focus is represented by those peripheral neurons that generate spikes synchronously with the central neuron while the activity of other peripheral neurons is suppressed. Such dynamics corresponds to the partial synchronization mode. It is shown that peripheral neurons with higher firing rates are preferentially drawn into partial synchronization. We show that local excitatory connections facilitate synchronization, while local inhibitory connections help distinguishing between two groups of peripheral neurons with similar intrinsic frequencies. The module automatically scans a visual scene and sequentially selects regions of interest for detailed processing and object segmentation. The contour extraction module implements standard image processing algorithms for contour extraction. The module computes raw contours of objects accompanied by noise and some spurious inclusions. At the next stage, the object segmentation module designed as a network of phase oscillators is used for precise determination of object boundaries and noise suppression. This module has a star-like architecture of connections. The segmented object is represented by a group of peripheral oscillators working in the regime of partial synchronization with the central oscillator. The functioning of each module is illustrated by an example of processing of the visual scene taken from a visual stream of a robot camera.

Gain control in the visual thalamus during perception and cognition

The thalamus has traditionally been thought to passively relay sensory information to the cortex. By showing that responses in visual thalamus are modulated by perceptual and cognitive tasks, recent fMRI and physiology studies have helped revise this view. The modulatory input to the visual thalamus derives from functionally distinct cortical and subcortical feedback pathways. These pathways enable the lateral geniculate nucleus and pulvinar to regulate the information transmitted to cortical areas according to cognitive requirements. Emerging evidence suggests that such regulation involves changing the degree of synchrony between neurons as well as changing the magnitude of thalamic activity. These findings support a role for the thalamus that extends as far as contributing to the control of visual attention and awareness.

Exploring BOLD changes during spatial attention in non-stimulated visual cortex

Blood oxygen level-dependent (BOLD) responses were measured in parts of primary visual cortex that represented unstimulated visual field regions at different distances from a stimulated central target location. The composition of the visual scene varied by the presence or absence of additional peripheral distracter stimuli. Bottom-up effects were assessed by comparing peripheral activity during central stimulation vs. no stimulation. Top-down effects were assessed by comparing active vs. passive conditions. In passive conditions subjects simply watched the central letter stimuli and in active conditions they had to report occurrence of pre-defined targets in a rapid serial letter stream. Onset of the central letter stream enhanced activity in V1 representations of the stimulated region. Within representations of the periphery activation decreased and finally turned into deactivation with increasing distance from the stimulated location. This pattern was most pronounced in the active conditions and during the presence of peripheral stimuli. Active search for a target did not lead to additional enhancement at areas representing the attentional focus but to a stronger deactivation in the vicinity. Suppressed neuronal activity was also found in the non distracter condition suggesting a top-down attention driven effect. Our observations suggest that BOLD signal decreases in primary visual cortex are modulated by bottom-up sensory-driven factors such as the presence of distracters in the visual field as well as by top-down attentional processes.

Parallel processing in the corticogeniculate pathway of the macaque monkey

Although corticothalamic feedback is ubiquitous across species and modalities, its role in sensory processing is unclear. This study provides a detailed description of the visual physiology of corticogeniculate neurons in the primate. Using electrical stimulation to identify corticogeniculate neurons, we distinguish three groups of neurons with response properties that closely resemble those of neurons in the magnocellular, parvocellular, and koniocellular layers of their target structure, the lateral geniculate nucleus (LGN) of the thalamus. Our results indicate that corticogeniculate feedback in the primate is stream specific, and provide strong evidence in support of the view that corticothalamic feedback can influence the transmission of sensory information from the thalamus to the cortex in a stream-selective manner.

The processing of three-dimensional shape from disparity in the human brain

Three-dimensional (3D) shape is important for the visual control of grasping and manipulation and for object recognition. Although there has been some progress in our understanding of how 3D shape is extracted from motion and other monocular cues, little is known of how the human brain extracts 3D shape from disparity, commonly regarded as the strongest depth cue. Previous fMRI studies in the awake monkey have established that the interaction between stereo (present or absent) and the order of disparity (zero or second order) constitutes the MR signature of regions housing second-order disparity-selective neurons (Janssen et al., 2000; Srivastava et al., 2006; Durand et al., 2007; Joly et al., 2007). Testing the interaction between stereo and order of disparity in a large cohort of human subjects, revealed the involvement of five IPS regions (VIPS/V7*, POIPS, DIPSM, DIPSA, and phAIP), as well as V3 and the V3A complex in occipital cortex, the posterior inferior temporal gyrus (ITG), and ventral premotor cortex (vPrCS) in the extraction and processing of 3D shape from stereo. Control experiments ruled out attention and convergence eye movements as confounding factors. Many of these regions, DIPSM, DIPSA, phAIP, and probably posterior ITG and ventral premotor cortex, correspond to monkey regions with similar functionality, whereas the evolutionarily new or modified regions are located in occipital (the V3A complex) and occipitoparietal cortex (VIPS/V7* and POIPS). Interestingly, activity in these occipital regions correlates with the depth amplitude perceived by the subjects in the 3D surfaces used as stimuli in these fMRI experiments.

Effects of sustained spatial attention in the human lateral geniculate nucleus and superior colliculus

The role of subcortical visual structures such as the lateral geniculate nucleus (LGN) and the superior colliculus (SC) in the control of visual spatial attention remains poorly understood. Here, we used high-resolution functional magnetic resonance imaging to measure responses in the human LGN and SC during sustained spatial attention. Subjects covertly and continuously tracked one of two segments that rotated through the visual field, composed of either moving dots or transient colored shapes. Activity in both nuclei was generally enhanced by attention, independent of the stimulus type, with the voxels responding more sensitively to stimulus contrast (those dominated by magnocellular input) exhibiting greater attentional enhancement. The LGN contained clusters of voxels exhibiting attentional enhancement or weak suppression, whereas the SC exhibited predominantly attentional enhancement, which was significantly stronger than in the LGN. The spatial distribution of the attentional effects was unrelated to the retinotopic organization in either structure. The results demonstrate that each of the major subcortical visual pathways participates in attentional selection, and their differential magnitudes of modulation suggest distinct roles.

Selective attention model with spiking elements

A new biologically plausible model of visual selective attention is developed based on synaptically coupled Hodgkin-Huxley neurons. The model is designed according to a two-layer architecture of excitatory and inhibitory connections which comprises two central neurons and a population of peripheral neurons. Two types of inhibition from the central neurons are present: fixed inhibition which is responsible for the formation of the attention focus, and short-term plastic inhibition which is responsible for the shift of attention. The regimes of synchronous dynamics associated with the development of the attentional focus are studied. In particular, the regime of partial synchronization between spiking activity of the central and peripheral neurons is interpreted as object selection to the focus of attention. It is shown that peripheral neurons with higher firing rates are selected preferentially by the attention system. The model correctly reproduces some observations concerning the mechanisms of attentional control, such as the coherence of spikes in the population of neurons included in the focus of attention, and the inhibition of neurons outside the focus of attention. Sequential selection of stimuli simultaneously present in the visual scene is demonstrated by the model in the frequency domain in both a formal example and a real image.

Voluntary visual attention and phenomenal line length

In 1956, Fraisse, et al. reported subjects judged that lines were longer when voluntary attention was focused on the lines than when attention was distracted from the lines. In the many attempts to repeat these results, none has ascertained whether attention on reported line length was a phenomenal effect. In the present study, 46 subjects were shown as stimuli pairs of horizontal or vertical briefly flashed lines with a fixation cross placed equidistant between the lines but far from each one. A change in color of one arm of the cross was used as a cue to focus subjects' voluntary attention on one line. Analysis showed attention increased the judged length of attended lines. Since this effect of attention also occurred when subjects were absolutely certain they saw the stimulus lines differed in length, this effect indicates that attention increased the phenomenal length of the attended lines. This lengthening was quite small: it involved a maximum mean increase of about .15 in the probability of the comparative response that the attended line was longer. This effect occurred in the horizontal dimension and was almost absent in the vertical dimension. In agreement with data indicating that flashed lines expand phenomenally by activating motion detectors and that focused attention makes neural motion responses increase in amplitude, the present results suggest that focused attention makes attended lines look longer because it makes these lines expand phenomenally more rapidly.

Emerging views of corticothalamic function

Although it is now generally accepted that the thalamus is more than a simple relay of sensory signals to the cortex, we are just beginning to gain an understanding of how corticothalamic feedback influences sensory processing. Results from an increasing number of studies across sensory systems and different species reveal effects of feedback both on the receptive fields of thalamic neurons and on the transmission of sensory information between the thalamus and cortex. Importantly, these studies demonstrate that the cortico-thalamic projection cannot be viewed in isolation, but must be considered as an integral part of a thalamo-corticothalamic circuit which intimately interconnects the thalamus and cortex for sensory processing.

The center-surround profile of the focus of attention arises from recurrent processing in visual cortex

We recently demonstrated with magnetoencephalographic recordings in human observers that the focus of attention in visual search has a spatial profile consisting of a center enhancement surrounded by a narrow zone of sensory attenuation. Here, we report new data from 2 experiments providing insights into the cortical processes that cause the surround attenuation. We show that surround suppression appears in search tasks that require spatial scrutiny, that is the precise binding of search-relevant features at the target's location but not in tasks that permit target discrimination without precise localization. Furthermore, we demonstrate that surround attenuation is linked with a stronger recurrent activity modulation in early visual cortex. Finally, we show that surround suppression appears with a delay (more than 175 ms) that is beyond the time course of the initial feedforward sweep of processing in the visual system. These observations together indicate that the suppressive surround is associated with recurrent processing and binding in the visual cortex.

Spatial attention changes excitability of human visual cortex to direct stimulation

Conscious perception depends not only on sensory input, but also on attention [1, 2]. Recent studies in monkeys [3-6] and humans [7-12] suggest that influences of spatial attention on visual awareness may reflect top-down influences on excitability of visual cortex. Here we tested this specifically, by providing direct input into human visual cortex via cortical transcranial magnetic stimulation (TMS) to produce illusory visual percepts, called phosphenes. We found that a lower TMS intensity was needed to elicit a conscious phosphene when its apparent spatial location was attended, rather than unattended. Our results indicate that spatial attention can enhance visual-cortex excitability, and visual awareness, even when sensory signals from the eye via the thalamic pathway are bypassed.

How do attention and adaptation affect contrast sensitivity?

Attention and adaptation are both mechanisms that optimize visual performance. Attention optimizes performance by increasing contrast sensitivity for and neural response to attended stimuli while decreasing them for unattended stimuli; adaptation optimizes performance by increasing contrast sensitivity for and neural response to changing stimuli while decreasing them for unchanging stimuli. We investigated whether and how the adaptation state and the attentional effect on contrast sensitivity interact. We measured contrast sensitivity with an orientation-discrimination task, in two adaptation conditions--adapt to 0% or 100% contrast--in focused, distributed, and withdrawn attentional conditions. We used threshold and asymptotic performance to index the magnitude of the attentional effect--enhancement or impairment in contrast sensitivity--before and after adapting to high-contrast stimuli. The results show that attention and adaptation affect the contrast psychometric function in a similar but opposite way: Attention increases stimulus salience, whereas adaptation reduces stimulus salience. An interesting finding is that the adaptation state does not modulate the magnitude of the attentional effect. This suggests that attention affects the normalized signal once the effect of contrast adaptation has taken place and that these two mechanisms act separately to change contrast sensitivity. Attention can overcome adaptation to restore contrast sensitivity.

Attention: control in the visual cortex

A recent study in which the human visual cortex was directly stimulated to create visual percepts has shown that visual spatial attention can act directly on neural activity in sensory cortex without involving attentional modulation of subcortical visual inputs.

Does attention alter appearance?

Abrupt onsets in the visual field can change the appearance of subsequent stimuli, according to one interpretation, by engaging an attentional mechanism that increases effective stimulus contrast. However, abrupt onsets can also engage capacity-unlimited and thus attention-independent sensory mechanisms. We conducted a series of experiments to differentiate the sensory and attentional accounts. Observers compared the contrasts of uncued low-contrast peripheral targets with simultaneous targets cued by one of three cue types with different sensory attributes: white or black peripheral abrupt onsets and central gaze direction cues devoid of sensory activity near the target locations. Each cue facilitated the perception of perithreshold targets; however, the white abrupt onsets increased the perceived contrast of suprathreshold targets, whereas the black abrupt onsets tended to reduce the perceived contrast, and the gaze direction cues had no significant effect. The effectiveness of the gaze direction cues in automatically orienting attention was demonstrated in a control experiment in which they consistently speeded response times. The results suggest that sensory interaction, and not attention, is responsible for changes in appearance.

Neural dynamics of autistic behaviors: cognitive, emotional, and timing substrates

What brain mechanisms underlie autism, and how do they give rise to autistic behavioral symptoms? This article describes a neural model, called the Imbalanced Spectrally Timed Adaptive Resonance Theory (iSTART) model, that proposes how cognitive, emotional, timing, and motor processes that involve brain regions such as the prefrontal and temporal cortex, amygdala, hippocampus, and cerebellum may interact to create and perpetuate autistic symptoms. These model processes were originally developed to explain data concerning how the brain controls normal behaviors. The iSTART model shows how autistic behavioral symptoms may arise from prescribed breakdowns in these brain processes, notably a combination of underaroused emotional depression in the amygdala and related affective brain regions, learning of hyperspecific recognition categories in the temporal and prefrontal cortices, and breakdowns of adaptively timed attentional and motor circuits in the hippocampal system and cerebellum. The model clarifies how malfunctions in a subset of these mechanisms can, through a systemwide vicious circle of environmentally mediated feedback, cause and maintain problems with them all.

More attention must be paid: The neurobiology of attentional effort

Increases in attentional effort are defined as the motivated activation of attentional systems in response to detrimental challenges on attentional performance, such as the presentation of distractors, prolonged time-on-task, changing target stimulus characteristics and stimulus presentation parameters, circadian phase shifts, stress or sickness. Increases in attentional effort are motivated by the expected performance outcome; in the absence of such motivation, attentional performance continues to decline or may cease altogether. The beneficial effects of increased attentional effort are due in part to the activation of top-down mechanisms that act to optimize input detection and processing, thereby stabilizing or recovering attentional performance in response to challenges. Following a description of the psychological construct "attentional effort", evidence is reviewed indicating that increases in the activity of cortical cholinergic inputs represent a major component of the neuronal circuitry mediating increases in attentional effort. A neuronal model describes how error detection and reward loss, indicating declining performance, are integrated with motivational mechanisms on the basis of neuronal circuits between prefrontal/anterior cingulate and mesolimbic regions. The cortical cholinergic input system is activated by projections of mesolimbic structures to the basal forebrain cholinergic system. In prefrontal regions, increases in cholinergic activity are hypothesized to contribute to the activation of the anterior attention system and associated executive functions, particularly the top-down optimization of input processing in sensory regions. Moreover, and influenced in part by prefrontal projections to the basal forebrain, increases in cholinergic activity in sensory and other posterior cortical regions contribute directly to the modification of receptive field properties or the suppression of contextual information and, therefore, to the mediation of top-down effects. The definition of attentional effort as a cognitive incentive, and the description of a neuronal circuitry model that integrates brain systems involved in performance monitoring, the processing of incentives, activation of attention systems and modulation of input functions, suggest that 'attentional effort' represents a viable construct for cognitive neuroscience research.

Increases in Alpha Oscillatory Power Reflect an Active Retinotopic Mechanism for Distracter Suppression During Sustained Visuospatial Attention

Human electrophysiological (EEG) studies have demonstrated the involvement of alpha band (8- to 14-Hz) oscillations in the anticipatory biasing of attention. In the context of visual spatial attention within bilateral stimulus arrays, alpha has exhibited greater amplitude over parietooccipital cortex contralateral to the hemifield required to be ignored, relative to that measured when the same hemifield is to be attended. Whether this differential effect arises solely from alpha desynchronization (decreases) over the “attending” hemisphere, from synchronization (increases) over the “ignoring” hemisphere, or both, has not been fully resolved. This is because of the confounding effect of externally evoked desynchronization that occurs involuntarily in response to visual cues. Here, bilateral flickering stimuli were presented simultaneously and continuously over entire trial blocks, such that externally evoked alpha desynchronization is equated in precue baseline and postcue intervals. Equivalent random letter sequences were superimposed on the left and right flicker stimuli. Subjects were required to count the presentations of the target letter “X” at the cued hemifield over an 8-s period and ignore the sequence in the opposite hemifield. The data showed significant increases in alpha power over the ignoring hemisphere relative to the precue baseline, observable for both cue directions. A strong attentional bias necessitated by the subjective difficulty in gating the distracting letter sequence is reflected in a large effect size of 2.1 (η2 = 0.82), measured from the attention × hemisphere interaction. This strongly suggests that alpha synchronization reflects an active attentional suppression mechanism, rather than a passive one reflecting “idling” circuits.

Always returning: feedback and sensory processing in visual cortex and thalamus

Feedback projections are an integral part of the mammalian visual system. Although it is tempting to relegate them to a subsidiary role in visual processing, because their supposed latency and lag might appear to be unfavourable for an involvement in fast processing, this is a dangerous simplification. Certainly for the world in motion, feedback from higher motion areas can influence the transfer of ascending input when, or even before, the input arrives. Here, we consider the circuit formed by layer 6 feedback cells in the visual cortex and how this straddles the retinothalamic and thalamocortical transfer of visual input. We discuss its links to feedback from the cortical motion area MT (V5), and suggest that motion perception involves a dynamic interplay between MT, V1 and the thalamus. This review is part of the TINS special issue on The Neural Substrates of Cognition.

Dysregulation of thalamic sensory "transmission" in schizophrenia: neurochemical vulnerability to hallucinations

Cholinergic arousal mechanisms predispose thalamic and cortical neurons to fire action potentials at gamma rhythms, which have a tendency to resonate in thalamocortical networks, thereby forming coherent assemblies under constraints of sensory input to specific thalamic nuclei, on the one hand, and prefrontal and limbic attentional mechanisms, on the other. Perception may be based on sustained assemblies of coherent gamma oscillations in thalamocortical circuits. In schizophrenia, the impact of sensory input on self-organization of thalamocortical activity may be generally reduced. As a result, processes underlying perception can become uncoupled from sensory input, particularly at times of hyperarousal, leading to domination of attentional mechanisms and the emergence of hallucinations. Evidence is reviewed that implicates excessive neuronal noise in specific thalamic nuclei in the generation of hallucinations in schizophrenia. Nicotinic receptor abnormalities, dopaminergic hyperactivity and glutamate-receptor hypofunction are reconciled within a model of psychotic symptom generation that places crucial emphasis on dysfunction of the reticular thalamic nucleus.

Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision

The spatial focus of attention has traditionally been envisioned as a simple spatial gradient of enhanced activity that falls off monotonically with increasing distance. Here, we show with high-density magnetoencephalographic recordings in human observers that the focus of attention is not a simple monotonic gradient but instead contains an excitatory peak surrounded by a narrow inhibitory region. To demonstrate this center-surround profile, we asked subjects to focus attention onto a color pop-out target and then presented probe stimuli at various distances from the target. We observed that the electromagnetic response to the probe was enhanced when the probe was presented at the location of the target, but the probe response was suppressed in a narrow zone surrounding the target and then recovered at more distant locations. Withdrawing attention from the pop-out target by engaging observers in a demanding foveal task eliminated this pattern, confirming a truly attention-driven effect. These results indicate that neural enhancement and suppression coexist in a spatially structured manner that is optimal to attenuate the most deleterious noise during visual object identification.

Unraveling the attentional functions of cortical cholinergic inputs: interactions between signal-driven and cognitive modulation of signal detection

Neurophysiological studies demonstrated that increases in cholinergic transmission in sensory areas enhance the cortical processing of thalamic inputs. Cholinergic activity also suppresses the retrieval of internal associations, thereby further promoting sensory input processing. Behavioral studies documented the role of cortical cholinergic inputs in attentional functions and capacities by demonstrating, for example, that the integrity of the cortical cholinergic input system is necessary for attentional performance, and that the activity of cortical cholinergic inputs is selectively enhanced during attentional performance. This review aims at integrating the neurophysiological and behavioral evidence on the functions of cortical cholinergic inputs and hypothesizes that the cortical cholinergic input system generally acts to optimize the processing of signals in attention-demanding contexts. Such signals 'recruit', via activation of basal forebrain corticopetal cholinergic projections, the cortical attention systems and thereby amplify the processing of attention-demanding signals (termed 'signal-driven cholinergic modulation of detection'). The activity of corticopetal cholinergic projections is also modulated by direct prefrontal projections to the basal forebrain and, indirectly, to cholinergic terminals elsewhere in the cortex; thus, cortical cholinergic inputs are also involved in the mediation of top-down effects, such as the knowledge-based augmentation of detection (see Footnote 1) of signals and the filtering of irrelevant information (termed 'cognitive cholinergic modulation of detection'). Thus, depending on the quality of signals and task characteristics, cortical cholinergic activity reflects the combined effects of signal-driven and cognitive modulation of detection. This hypothesis begins to explain signal intensity or duration-dependent performance in attention tasks, the distinct effects of cortex-wide versus prefrontal cholinergic deafferentation on attention performance, and it generates specific predictions concerning cortical acetylcholine (ACh) release in attention task-performing animals. Finally, the consequences of abnormalities in the regulation of cortical cholinergic inputs for the manifestation of the symptoms of major neuropsychiatric disorders are conceptualized in terms of dysregulation in the signal-driven and cognitive cholinergic modulation of detection processes.

Color mechanisms used in selecting stimuli for attention and making discriminations

Previous work (Nagy & Thomas, 2003) showed that signals in different Cardinal color mechanisms could be combined to facilitate search for a color target. Further investigation (Nagy et al., 2003) suggested that signals in one Cardinal color mechanism were used to select a subset of stimuli to be attended, while signals in second Cardinal mechanism were used to discriminate the stimuli within the selected subset. In the studies described below, we asked if observers could use color mechanisms tuned to directions other than the Cardinal directions to select and discriminate stimuli. Observers searched for a single target stimulus that differed in chromaticity from nine distractor stimuli. A two-alternative forced-choice procedure was used to estimate thresholds. Results were consistent with the hypothesis that color mechanisms tuned to many different directions in color space mediate discrimination, but suggest that only signals in Cardinal mechanisms can be used to select stimuli for attention.

Results imply that the selection of stimuli for attention on the basis of color may be mediated at the level of the lateral geniculate nucleus (LGN).

Attentional Load and Sensory Competition in Human Vision: Modulation of fMRI Responses by Load at Fixation during Task-irrelevant Stimulation in the Peripheral Visual Field

Perceptual suppression of distractors may depend on both endogenous and exogenous factors, such as attentional load of the current task and sensory competition among simultaneous stimuli, respectively. We used functional magnetic resonance imaging (fMRI) to compare these two types of attentional effects and examine how they may interact in the human brain. We varied the attentional load of a visual monitoring task performed on a rapid stream at central fixation without altering the central stimuli themselves, while measuring the impact on fMRI responses to task-irrelevant peripheral checkerboards presented either unilaterally or bilaterally. Activations in visual cortex for irrelevant peripheral stimulation decreased with increasing attentional load at fixation. This relative decrease was present even in V1, but became larger for successive visual areas through to V4. Decreases in activation for contralateral peripheral checkerboards due to higher central load were more pronounced within retinotopic cortex corresponding to 'inner' peripheral locations relatively near the central targets than for more eccentric 'outer' locations, demonstrating a predominant suppression of nearby surround rather than strict 'tunnel vision' during higher task load at central fixation. Contralateral activations for peripheral stimulation in one hemifield were reduced by competition with concurrent stimulation in the other hemifield only in inferior parietal cortex, not in retinotopic areas of occipital visual cortex. In addition, central attentional load interacted with competition due to bilateral versus unilateral peripheral stimuli specifically in posterior parietal and fusiform regions. These results reveal that task-dependent attentional load, and interhemifield stimulus-competition, can produce distinct influences on the neural responses to peripheral visual stimuli within the human visual system. These distinct mechanisms in selective visual processing may be integrated within posterior parietal areas, rather than earlier occipital cortex.

Fusion of autoradiographs with an MR volume using 2-D and 3-D linear transformations

In the past years, the development of 3-D medical imaging has enabled the 3-D imaging of in vivo tissues, from an anatomical (MR, CT) or even functional (fMRI, PET, SPECT) point of view. However, despite immense technological progress, the resolution of these images is still short of the level of anatomical or functional details that in vitro imaging (e.g., histology, autoradiography) permits. The motivation of this work is to compare fMRI activations to activations observed in autoradiographic images from the same animals. We aim to fuse post-mortem autoradiographic data with a pre-mortem anatomical MR image. We first reconstruct a 3-D volume from the 2-D autoradiographic sections, coherent both in geometry and intensity. Then, this volume is fused with the MR image. This way, we ensure that the reconstructed 3-D volume can be superimposed onto the MR image that represents the reference anatomy. We demonstrate that this fusion can be achieved by using only simple global transformations (rigid and/or affine, 2-D and 3-D), while yielding very satisfactory results.

Push-Pull Mechanism of Selective Attention in Human Extrastriate Cortex

Selective attention operates in visual cortex by facilitating processing of selected stimuli and by filtering out unwanted information from nearby distracters over circumscribed regions of visual space. The neural representation of unattended stimuli outside this focus of attention is less well understood. We studied the neural fate of unattended stimuli using functional magnetic resonance imaging by dissociating the activity evoked by attended (target) stimuli presented to the periphery of a visual hemifield and unattended (distracter) stimuli presented simultaneously to a corresponding location of the contralateral hemifield. Subjects covertly directed attention to a series of target stimuli and performed either a low or a high attentional-load search task on a stream of otherwise identical stimuli. With this task, target-search-related activity increased with increasing attentional load, whereas distracter-related activity decreased with increasing load in areas V4 and TEO but not in early areas V1 and V2. This finding presents evidence for a load-dependent push-pull mechanism of selective attention that operates over large portions of the visual field at intermediate processing stages. This mechanism appeared to be controlled by a distributed frontoparietal network of brain areas that reflected processes related to target selection during spatially directed attention.

Selective activation and deactivation of the human brain structures between speeded and precisely timed tapping responses to identical visual stimulus: an fMRI study

We investigated the difference between brain activities in speeded and precisely timed responses to identical visual stimulus using fMRI. Stimulus used was a row of seven light-emitting diodes (LEDs) lightened up one after another with constant speed within a trial but with various speeds between trials. Subjects were asked to execute finger-thumb tapping with the right hand in response to the onset of the first LED light in the reaction time (RT) task and in anticipation of the onset of the last (i.e., seventh) LED light in the timing task. In control condition, they were asked to passively view the stimulus without motor response. Results showed that various movement-related areas including contralateral cingulate motor cortex were commonly activated for both tasks relative to the control condition, suggesting these structures are involved in general perception and response execution rather than specific function for speeded or precisely timed responses. In the RT task, the presupplementary motor area extending to the cingulate sulcus was activated more strongly than in the timing task probably to focus attention to the onset of the first LED light unpredictably presented after random foreperiods. The lateral occipital area extending to the temporo-parieto-occipital junction was activated more strongly in the timing task than in the RT task; the same area was deactivated in the RT task relative to the control condition. Auditory-related areas were also deactivated in the both tasks. This inter- and intramodal task-specific modification including deactivation underscores significance of the context for perception and action and can have an important role in dexterous or skilled performance.

The role of salience in localized attentional interference

Observers were cued to attend to two discs from an array and made a discrimination of a target presented within one of the discs. In Experiments 1 and 2, the relative attentional salience of the two attended items was manipulated via the cues (size changes in Experiment 1; size and color changes in Experiment 2). In Experiment 3, the relative salience was manipulated via the luminance contrast of the items themselves. In Experiment 4, relative attentional salience was controlled through a probability manipulation. In all experiments, target performance improved with the relative salience of the target, as well as with increased spatial separation between the two items. This localized interference between cued items varied with visual field. Results are discussed in the context of competition-based models of attentional selection.

Reciprocal modulation of neuromagnetic induced gamma activity by attention in the human visual and auditory cortex

For attentional control of behavior, the brain permanently resolves a competition between the impressions supplied by different senses. Here, using a dual-modality temporal order detection task, we studied attentional modulation of oscillatory neuromagnetic activity in the human cerebral cortex. On each trial, after simultaneous exposure to visual and auditory noise, subjects were presented with an asynchronous pair of a visual and an auditory stimulus. Either of the two stimuli could occur first equally often, their order was not cued. Subjects had to determine the leading stimulus in a pair and attentively monitor it to respond upon its offset. With the attended visual or auditory stimuli, spectral power analysis revealed marked enhancements of induced gamma activity within 250 ms post-stimulus onset over the modality-specific cortices (occipital at 64 Hz, right temporal at 53 Hz). When unattended, however, the stimuli led to a significantly decreased (beneath baseline) gamma response in these cortical regions. The gamma decreases occurred at lower frequencies ( approximately 30 Hz) than did the gamma increases. An increase in the gamma power and frequency for the attended modality and their decrease for the unattended modality suggest that attentional regulation of multisensory processing involves reciprocal changes in synchronization of respective cortical networks. We assume that the gamma decrease reflects an active suppression of the task-irrelevant sensory input. This suppression occurs at lower frequencies, suggesting an involvement of larger scale cell assemblies.

Negative BOLD in the visual cortex: evidence against blood stealing

The positive BOLD (blood oxygen level-dependent) response elicited in human visual cortex by a localized visual stimulus is accompanied by a reduction in the BOLD response in regions of the visual cortex that represent unstimulated locations in the visual field. We have suggested previously that this negative BOLD reflects attention-related suppression of neural activity, but it might also be explained in terms of "blood stealing," i.e., hemodynamic changes that have no neural correlate. We distinguish two possible hemodynamic effects of this type: (1). blood flow reduction caused by locally reduced pressure in vessels that share their blood supply with nearby dilated vessels; and (2). blood flow reduction caused by active constriction of vessels under neural control. The first is ruled out as an explanation of negative BOLD by showing that a visual stimulus that stimulates primary visual cortex in one hemisphere can cause extensive suppression in the other hemisphere i.e., it is not a local phenomenon. Negative BOLD most likely reflects suppression of neural activity, but could also reflect an active blood flow control system.

Set size effects in the macaque striate cortex

Attentive processing is often described as a competition for resources among stimuli by mutual suppression. This is supported by findings that activity in extrastriate cortex is suppressed when several stimuli are presented simultaneously, compared to a single stimulus. In this study, we randomly varied the number of simultaneously presented figures (set size) in an attention-demanding change detection task, while we recorded multiunit activity in striate cortex (V1) in monkeys. After figure-background segregation, activity was suppressed as set size increased. This effect was stronger and started earlier among cells stimulated by the background than those stimulated by the figures themselves. As a consequence, contextual modulation, a correlate of figure-background segregation, increased with set size, approximately 100 msec after its initial generation. The results indicate that suppression of responses under increasing attentional demands differentially affects figure and background responses in area V1.

Attention affects the stereoscopic depth aftereffect

'Preattentive' vision is typically considered to include several low-level processes, including the perception of depth from binocular disparity and motion parallax. However, doubt was cast on this model when it was shown that a secondary attentional task can modulate the motion aftereffect (Chaudhuri, 1990 Nature 344 60-62). Here we investigate whether attention can also affect the depth aftereffect (Blakemore and Julesz, 1971 Science 171 286-288). Subjects adapted to stationary or moving random-dot patterns segmented into depth planes while attention was manipulated with a secondary task (character processing at parametrically varied rates). We found that the duration of the depth aftereffect can be affected by attentional manipulations, and both its duration and that of the motion aftereffect varied with the difficulty of the secondary task. The results are discussed in the context of dynamic feedback models of vision, and support the penetrability of low-level sensory processes by attentional mechanisms.

Hallucinations: synchronisation of thalamocortical gamma oscillations underconstrained by sensory input

What we perceive is the product of an intrinsic process and not part of external physical reality. This notion is consistent with the philosophical position of transcendental idealism but also agrees with physiological findings on the thalamocortical system. gamma-Frequency rhythms of discharge activity from thalamic and cortical neurons are facilitated by cholinergic arousal and resonate in thalamocortical networks, thereby transiently forming assemblies of coherent gamma oscillations under constraints of sensory input and prefrontal attentional mechanisms. Perception and conscious experience may be based on such assemblies and sensory input to thalamic nuclei plays merely a constraining role in their formation. In schizophrenia, the ability of sensory input to modulate self-organisation of thalamocortical gamma activity may be generally reduced. If during arousal thalamocortical self-organisation is underconstrained by sensory input, then attentional mechanisms alone may determine the content of perception and hallucinations may arise.

Recognition by top-down and bottom-up processing in cortex: the control of selective attention

Visual recognition is achieved by a hierarchy of bidirectionally connected cortical areas. The entry of signals into higher areas involves the serial sampling of information within a movable window of attention. Here we explore how the cortex can move this window and integrate the sampled information. To make this concrete, we modeled the process of visual word recognition by hierarchical cortical areas representing features, letters, and words. At the start of the recognition process, nodes representing all contextually possible words are active. Simple connectivity rules allow a parallel top-down (T-D) computation of the relative probability of each feature at each location given the set of active words. This information is then used to guide the window of attention to information-rich features (e.g., a feature that is present in the visual image but has lowest probability). Bottom-up processing of this feature excludes words that do not contain it and leads to T-D recomputation of feature probabilities. Recognition occurs after several such cycles when all but one word has been excluded. We show that when 950 words are stored in long-term memory, recognition occurs after an average of 4.9 cycles. Because covert attention can be moved every 20-30 ms, word recognition could be as fast as determined experimentally (<200 ms of cortical processing). This model accounts for the findings that recognition time depends logarithmically on set size, recognition time is reduced when context reduces the number of possible targets, the time to classify a nonword decreases when its approximation to English decreases, and in high level cortex, the firing of neurons tuned to an object increases progressively as its recognition occurs. More generally the model provides a physiologically plausible view of how bi-directional signal flow in cortex guides attention to produce efficient recognition.

Attention during adaptation weakens negative afterimages

The effect of attention during adaptation on subsequent negative afterimages was examined. One of 2 overlapped outline figures was attended during a 7-10-s adaptation period. When the figures were readily perceptually segregated (on the basis of color or motion), the subsequent afterimages were initially weaker for the previously attended figure. This effect was confirmed by demonstrations that the onset of a single afterimage was delayed when an afterimage inducer was attended during adaptation compared with when a central digit stream or an overlapped (brightness-balanced) figure that did not generate an afterimage was attended. The attention effect was further confirmed using a criterion-independent (dot-integration) paradigm. The fact that selective attention during adaptation weakened or delayed afterimages suggests that attention primarily facilitates the adaptation of polarity-independent processes that modulate the visibility of afterimages rather than facilitating the adaptation of polarity-selective processes that mediate the formation of afterimages.

Cognitive processing in the primary visual cortex: from perception to memory

The primary visual cortex is the first cortical area of the visual system that receives information from the external visual world. Based on the receptive field characteristics of the neurons in this area, it has been assumed that the primary visual cortex is a pure sensory area extracting basic elements of the visual scene. This information is then subsequently further processed upstream in the higher-order visual areas and provides us with perception and storage of the visual environment. However, recent findings show that such neural implementations are observed in the primary visual cortex. These neural correlates are expressed by the modulated activity of the late response of a neuron to a stimulus, and most likely depend on recurrent interactions between several areas of the visual system. This favors the concept of a distributed nature of visual processing in perceptual organization.

Primary visual cortex and visual awareness

The primary visual cortex (V1) is probably the best characterized area of primate cortex, but whether this region contributes directly to conscious visual experience is controversial. Early neurophysiological and neuroimaging studies found that visual awareness was best correlated with neural activity in extrastriate visual areas, but recent studies have found similarly powerful effects in V1. Lesion and inactivation studies have provided further evidence that V1 might be necessary for conscious perception. Whereas hierarchical models propose that damage to V1 simply disrupts the flow of information to extrastriate areas that are crucial for awareness, interactive models propose that recurrent connections between V1 and higher areas form functional circuits that support awareness. Further investigation into V1 and its interactions with higher areas might uncover fundamental aspects of the neural basis of visual awareness.

The selective tuning model of attention: psychophysical evidence for a suppressive annulus around an attended item

The selective tuning model [Artif. Intell. 78 (1995) 507] is a neurobiologically plausible neural network model of visual attention. One of its key predictions is that to simultaneously solve the problems of convergence of neural input and selection of attended items, the portions of the visual neural network that process an attended stimulus must be surrounded by inhibition. To test this hypothesis, we mapped the attentional field around an attended location in a matching task where the subject's attention was directed to a cued target while the distance of a probe item to the target was varied systematically. The main result was that accuracy increased with inter-target separation. The observed pattern of variation of accuracy with distance provided strong evidence in favor of the critical prediction of the model that attention is actively inhibited in the immediate vicinity of an attended location.

Attention-dependent coupling between beta activities recorded in the cat's thalamic and cortical representations of the central visual field

We have previously proposed that enhanced 16-24 Hz (beta) local field potential activity in the primary visual cortex and lateral geniculate nucleus may be an electrophysiological correlate of the attentional mechanism that increases the gain of afferent visual information flow to the cortex. In this study, we measured coupling between beta signals recorded in the thalamic (i.e. lateral geniculate or perigeniculate) and cortical representations of the central visual field (within 5 degrees from area centralis), during visual and auditory attentive situations. Signal coupling was calculated in two ways: (i) by means of crosscorrelation between raw beta activities, which depends primarily on phase coherence, and (ii) by phase-independent crosscorrelation between amplitude envelopes of beta activities. Mean amplitudes of raw signal cross correlations obtained for thalamo-cortical recording pairs were not significantly different when calculated during behavioural demands for either visual or auditory attention. In contrast, amplitudes of envelope cross correlations obtained during behaviour requiring visual attention were, on average, two times higher than those calculated during the auditory task. This attention-related coupling emerged from synchronized amplitude modulation of beta oscillatory activity that occurs within the cortico-thalamic circuit involved in central vision.

How does attention attenuate target-distractor interference in vision? Evidence from magnetoencephalographic recordings

This study used magnetoencephalographic and electroencephalographic recordings to investigate the neural mechanisms that underlie the attentional resolution of ambiguous feature coding in visual search. We addressed this issue by comparing neural activity related to target discrimination under conditions of more versus less feature overlap between the target and distractor items. The results show that increasing feature overlap leads to a focal enhancement of neural activity in ventral occipito-temporal areas, consistent with the larger need to attenuate distractor interference. Furthermore, the results suggest that distractor attenuation proceeds as a stepwise operation, with different spatial locations containing interfering features being suppressed successively. These findings support theories of visual search that emphasize location-based attentional selection as a key mechanism in resolving ambiguous feature coding in vision.

Attention modulates responses in the human lateral geniculate nucleus

Attentional mechanisms are important for selecting relevant information and filtering out irrelevant information from cluttered visual scenes. Selective attention has previously been shown to affect neural activity in both extrastriate and striate visual cortex. Here, evidence from functional brain imaging shows that attentional response modulation is not confined to cortical processing, but can occur as early as the thalamic level. We found that attention modulated neural activity in the human lateral geniculate nucleus (LGN) in several ways: it enhanced neural responses to attended stimuli, attenuated responses to ignored stimuli and increased baseline activity in the absence of visual stimulation. The LGN, traditionally viewed as the gateway to visual cortex, may also serve as a 'gatekeeper' in controlling attentional response gain.

Surfing a spike wave down the ventral stream

Numerous theories of neural processing, often motivated by experimental observations, have explored the computational properties of neural codes based on the absolute or relative timing of spikes in spike trains. Spiking neuron models and theories however, as well as their experimental counterparts, have generally been limited to the simulation or observation of isolated neurons, isolated spike trains, or reduced neural populations. Such theories would therefore seem inappropriate to capture the properties of a neural code relying on temporal spike patterns distributed across large neuronal populations. Here we report a range of computer simulations and theoretical considerations that were designed to explore the possibilities of one such code and its relevance for visual processing. In a unified framework where the relation between stimulus saliency and spike relative timing plays the central role, we describe how the ventral stream of the visual system could process natural input scenes and extract meaningful information, both rapidly and reliably. The first wave of spikes generated in the retina in response to a visual stimulation carries information explicitly in its spatio-temporal structure: the most salient information is represented by the first spikes over the population. This spike wave, propagating through a hierarchy of visual areas, is regenerated at each processing stage, where its temporal structure can be modified by (i). the selectivity of the cortical neurons, (ii). lateral interactions and (iii). top-down attentional influences from higher order cortical areas. The resulting model could account for the remarkable efficiency and rapidity of processing observed in the primate visual system.

The attentional blink in space and time

We report the results of two experiments addressing spatiotemporal variations in the "attentional blink" (AB). In the first experiment, six streams of letters were presented simultaneously around a circle on a screen. The identity of the letters changed every 140 ms. The task was to identify two target digits (T1 and T2) that could appear in any of the streams with a variable time lag between the two. The results show that the AB is not constant across space and that following the allocation of attention to a certain location (the location of T1), discrimination can be better at locations quite far away from T1, than at locations closest to T1. Furthermore, performance at the farthest locations seemed to recover sooner from the AB than locations closer to where T1 appeared. Similar results were obtained in a second experiment where observers performed a cued discrimination task. The results accord well with the proposal that there is a region around the attended site (the center of attention) where attentional resolution is particularly poor, worse than at sites further away from the attended one. We propose that this reflects lateral inhibition of neurons responsive to the region around the attended site, with the goal of suppressing potentially distracting or interfering information.

Auditory and visual attention modulate motion processing in area MT+

Behavioral and physiological studies have established that visual attention to a given feature or location can modulate early visual processing. In the present experiment, we asked whether auditory attention can likewise influence visual processing. We used a visual illusion, the motion aftereffect (MAE), to assess the effects of visual and auditory attention on motion processing in human area MT+. We acquired psychophysical and functional magnetic resonance imaging (fMRI) data while subjects fixated and viewed moving and stationary stimuli in alternating blocks. For each of four motion conditions, we measured the duration of the subsequent MAE, the time for activity in MT+ to return to baseline after motion adaptation (decay time), and the magnitude of MT+ activity during motion adaptation. For each subject, we first obtained measures of motion processing in the absence of attentional demands, by comparing reversing and expanding motion conditions. Subjects perceived the MAE following adaptation to expanding but not reversing motion, as observed previously, and decay times in MT+ were selectively prolonged after expanding motion. We then assessed the effects of performing either a visual or an auditory attentional task during expanding motion adaptation. Performance of the attentional task, whether visual or auditory, produced a significant reduction of subsequent MAE perception and associated decay times in MT+, as compared to expanding motion with fixation only. Both attentional tasks also reduced the magnitude of activation during motion adaptation. These data show that auditory attention, like visual attention, can modify sensory processing at a remarkably early stage of the visual hierarchy.

Perceptual and neuronal correspondence in primary visual cortex

Recent findings from the study of primary visual cortex in humans and animals blur the distinction between early and late visual processing. Under some conditions, the activity of neurons in primary visual cortex appears as close or closer to perception than activity in 'higher' visual areas.