Mechanisms of feature- and space-based attention: response modulation and baseline increases

Anticipatory attentional suppression of visual features indexed by oscillatory alpha-band power increases: a high-density electrical mapping study

Retinotopically specific increases in alpha-band ( approximately 10 Hz) oscillatory power have been strongly implicated in the suppression of processing for irrelevant parts of the visual field during the deployment of visuospatial attention. Here, we asked whether this alpha suppression mechanism also plays a role in the nonspatial anticipatory biasing of feature-based attention. Visual word cues informed subjects what the task-relevant feature of an upcoming visual stimulus (S2) was, while high-density electroencephalographic recordings were acquired. We examined anticipatory oscillatory activity in the Cue-to-S2 interval ( approximately 2 s). Subjects were cued on a trial-by-trial basis to attend to either the color or direction of motion of an upcoming dot field array, and to respond when they detected that a subset of the dots differed from the majority along the target feature dimension. We used the features of color and motion, expressly because they have well known, spatially separated cortical processing areas, to distinguish shifts in alpha power over areas processing each feature. Alpha power from dorsal regions increased when motion was the irrelevant feature (i.e., color was cued), and alpha power from ventral regions increased when color was irrelevant. Thus, alpha-suppression mechanisms appear to operate during feature-based selection in much the same manner as has been shown for space-based attention.

Synchronous retinotopic frontal-temporal activity during long-term memory for spatial location

Early visual areas in occipital cortex are known to be retinotopic. Recently, retinotopic maps have been reported in frontal and parietal cortex during spatial attention and working memory. The present event-related potential (ERP) and functional magnetic resonance imaging (fMRI) study determined whether spatial long-term memory was associated with retinotopic activity in frontal and parietal regions, and assessed whether retinotopic activity in these higher level control regions was synchronous with retinotopic activity in lower level visual sensory regions. During encoding, abstract shapes were presented to the left or right of fixation. During retrieval, old and new shapes were presented at fixation and participants classified each shape as old and previously on the "left", old and previously on the "right", or "new". Retinotopic effects were manifested by accurate memory for items previously presented on the left producing activity in the right hemisphere and accurate memory for items previously presented on the right producing activity in the left hemisphere. Retinotopic ERP activity was observed in frontal regions and visual sensory (occipital and temporal) regions. In frontal cortex, retinotopic fMRI activity was localized to the frontal eye fields. There were no significant ERP or fMRI retinotopic memory effects in parietal regions. The present long-term memory retinotopic effects complement previous spatial attention and working memory findings (and suggest retinotopic activity in parietal cortex may require an external peripheral stimulus). Furthermore, ERP cross-correlogram analysis revealed that retinotopic activations in frontal and temporal regions were synchronous, indicating that these regions interact during retrieval of spatial information.

Conscious and nonconscious memory effects are temporally dissociable

Intentional (explicit) retrieval can reactivate sensory cortex, which is widely assumed to reflect conscious processing. In the present study, we used an explicit visual memory event-related potential paradigm to investigate whether such retrieval related sensory activity could be separated into conscious and nonconscious components. During study, abstract shapes were presented in the left or right visual field. During test, old and new shapes were presented centrally and participants classified each shape as "old-left", "old-right", or "new". Conscious activity was isolated by comparing accurate memory for shape and location (old-hits) with forgotten shapes (old-misses), and nonconscious activity was isolated by comparing old-left-misses with old-right-misses and vice versa. Conscious visual sensory activity had a late temporal onset (after 800 ms) while nonconscious visual sensory activity had an early temporal onset (before 800 ms). These results suggest explicit memory related sensory activity reflects both conscious and nonconscious processes that are temporally dissociable.

Feature selection in the human brain: electrophysiological correlates of sensory enhancement and feature integration

This study examined the latency and amplitude of cortical processes associated with feature-based visual selective attention, using frequency-domain and time-domain measures derived from dense-array electroencephalography. Participants were asked to identify targets based on conjunctions of three types of object features (color, size, and completeness). This procedure aimed to examine (1) the modulation of sensory responses to one or more stimulus features characterizing an object and (2) the facilitation and reduction effects associated with competing features, attended and unattended, in the same object. The selection negativity, an event-related potential measure of sensory amplification for attended features, showed a parametric increase of amplitude as a function of the number of attended features. Late oscillations in the gamma band range were also smaller for stimuli with one or more non-attended visual features but were enhanced for stimuli sharing the overall gestalt with the target. The latency of this late gamma modulation was delayed when two target features were combined, compared to one single discriminative feature. Latency analyses also showed that late bursts of induced high-frequency oscillatory activity peaked around 60 ms later than the selection negativity. Oscillatory activity reflected both selective amplification and competition between object features. These results suggest that sensory amplification of selected features is followed by integrative processing in more widespread networks. Oscillatory activity in these networks is reduced by distraction and is enhanced when attended features can be mapped to specific action.

Shape-specific preparatory activity mediates attention to targets in human visual cortex

The mechanisms of attention prioritize sensory input for efficient perceptual processing. Influential theories suggest that attentional biases are mediated via preparatory activation of task-relevant perceptual representations in visual cortex, but the neural evidence for a preparatory coding model of attention remains incomplete. In this experiment, we tested core assumptions underlying a preparatory coding model for attentional bias. Exploiting multivoxel pattern analysis of functional neuroimaging data obtained during a non-spatial attention task, we examined the locus, time-course, and functional significance of shape-specific preparatory attention in the human brain. Following an attentional cue, yet before the onset of a visual target, we observed selective activation of target-specific neural subpopulations within shape-processing visual cortex (lateral occipital complex). Target-specific modulation of baseline activity was sustained throughout the duration of the attention trial and the degree of target specificity that characterized preparatory activation patterns correlated with perceptual performance. We conclude that top-down attention selectively activates target-specific neural codes, providing a competitive bias favoring task-relevant representations over competing representations distributed within the same subregion of visual cortex.

Perceptual expectation evokes category-selective cortical activity

Selective visual attention directed to a location (even in the absence of a stimulus) increases activity in the corresponding regions of visual cortex and enhances the speed and accuracy of target perception. We further explored top-down influences on perceptual representations by manipulating observers' expectations about the category of an upcoming target. Observers viewed a display in which an object (either a face or a house) gradually emerged from a state of phase-scrambled noise; a cue established expectation about the object category. Observers were faster to categorize faces (gender discrimination) or houses (structural discrimination) when the category of the partially scrambled object matched their expectation. Functional magnetic resonance imaging revealed that this expectation was associated with anticipatory increases in category-specific visual cortical activity, even in the absence of object- or category-specific visual information. Expecting a face evoked increased activity in face-selective cortical regions in the fusiform gyrus and superior temporal sulcus. Conversely, expecting a house increased activity in parahippocampal gyrus. These results suggest that visual anticipation facilitates subsequent perception by recruiting, in advance, the same cortical mechanisms as those involved in perception.

Anticipatory and stimulus-evoked blood oxygenation level-dependent modulations related to spatial attention reflect a common additive signal

Covert attention is associated with prestimulus blood oxygenation level-dependent (BOLD) modulations in visual cortex. In some situations, this preparatory activity can predict how well human subjects will perceive upcoming visual objects. Preparatory activity may mediate this behavioral effect by affecting the stimulus-evoked response, but the relationship between preparatory and stimulus-evoked BOLD modulations is unclear. Here, we examine this relationship by comparing the effects of spatial attention on anticipatory and stimulus-evoked signals and by measuring the trial-to-trial correlation between prestimulus and poststimulus modulations. We find that in extrastriate visual cortex (V4), modulations related to spatial attention are relatively large, extend from prestimulus through the peak of the evoked response, and are slightly larger in the evoked response compared with the prestimulus response. In striate cortex (V1), the frontal eye fields (FEF), and the intraparietal sulcus (IPS), modulations related to spatial attention are relatively small, are confined primarily to the prestimulus period, and are slightly larger in preparatory versus stimulus-evoked activity. Importantly, across visual cortex, the attentional biases (activity for attended versus unattended locations) in preparatory and evoked activity are more positively correlated, trial-by-trial, than would be expected on the basis of activity measured in subjects at rest. We argue that this pattern of results suggests that the same mechanisms underlie preparatory and stimulus-evoked BOLD modulations related to spatial attention and that incoming sensory signals add to preexistent biases in preparatory activity to generate the stimulus-evoked response.

The phase of ongoing EEG oscillations predicts visual perception

Oscillations are ubiquitous in electrical recordings of brain activity. While the amplitude of ongoing oscillatory activity is known to correlate with various aspects of perception, the influence of oscillatory phase on perception remains unknown. In particular, since phase varies on a much faster timescale than the more sluggish amplitude fluctuations, phase effects could reveal the fine-grained neural mechanisms underlying perception. We presented brief flashes of light at the individual luminance threshold while EEG was recorded. Although the stimulus on each trial was identical, subjects detected approximately half of the flashes (hits) and entirely missed the other half (misses). Phase distributions across trials were compared between hits and misses. We found that shortly before stimulus onset, each of the two distributions exhibited significant phase concentration, but at different phase angles. This effect was strongest in the theta and alpha frequency bands. In this time-frequency range, oscillatory phase accounted for at least 16% of variability in detection performance and allowed the prediction of performance on the single-trial level. This finding indicates that the visual detection threshold fluctuates over time along with the phase of ongoing EEG activity. The results support the notion that ongoing oscillations shape our perception, possibly by providing a temporal reference frame for neural codes that rely on precise spike timing.

State-dependent effects of stimulus presentation duration on the temporal dynamics of neural responses in the inferotemporal cortex of macaque monkeys

During natural vision, stimuli are viewed for different durations as the state of brain activity changes over time. Here we studied the effects of stimulus presentation duration on cell responses (n=259) in three subdivisions of the inferotemporal (IT) cortex of fixating macaque monkeys as neural baseline firing rates varied over the course of recording. First, cell responses to the presentation of 120 images were tested, and four images that elicited significant responses with various degrees of effectiveness were selected for further study. Then the four selected images were presented to the monkeys for five different presentation durations (18, 70, 140, 210, and 350 ms). We found that depending on the magnitude of neural baseline activity, stimulus presentation duration affected the response properties and efficiency of neural information processing in the IT cortex. Short stimulus presentation durations elicited phasic responses consisting of rhythmic activation and inactivation, which conveyed a lower amount of stimulus information, particularly following higher baseline firing rates. Longer presentation durations elicited a sustained pattern of response and carried a greater amount of information, particularly at lower baseline firing rates. Finally, a significantly higher proportion of cells in the posterior IT compared with the anterior IT had a tendency to have high baseline activity, recruit stronger phasic responses and convey less information. It is plausible that during natural vision, as stimuli with various exposure durations affect the visual system, top-down influence or competition within local neural networks differentially influences the function of IT cells by changing their baseline activity.

The role of early visual cortex in visual short-term memory and visual attention

We measured cortical activity with functional magnetic resonance imaging to probe the involvement of early visual cortex in visual short-term memory and visual attention. In four experimental tasks, human subjects viewed two visual stimuli separated by a variable delay period. The tasks placed differential demands on short-term memory and attention, but the stimuli were visually identical until after the delay period. Early visual cortex exhibited sustained responses throughout the delay when subjects performed attention-demanding tasks, but delay-period activity was not distinguishable from zero when subjects performed a task that required short-term memory. This dissociation reveals different computational mechanisms underlying the two processes.

Top-down and bottom-up mechanisms in biasing competition in the human brain

The biased competition theory of selective attention has been an influential neural theory of attention, motivating numerous animal and human studies of visual attention and visual representation. There is now neural evidence in favor of all three of its most basic principles: that representation in the visual system is competitive; that both top-down and bottom-up biasing mechanisms influence the ongoing competition; and that competition is integrated across brain systems. We review the evidence in favor of these three principles, and in particular, findings related to six more specific neural predictions derived from these original principles.

Ongoing activity fluctuations in hMT+ bias the perception of coherent visual motion

We have recently shown that intrinsic fluctuations of ongoing activity during baseline have an impact on perceptual decisions reported for an ambiguous visual stimulus (Hesselmann et al., 2008). To test whether this result generalizes from the visual object domain to other perceptual and neural systems, the current study investigated the effect of ongoing signal fluctuations in motion-sensitive brain regions on the perception of coherent visual motion. We determined motion coherence thresholds individually for each subject using a dynamic random dot display. During functional magnetic resonance imaging (fMRI), brief events of subliminal, supraliminal, and periliminal coherent motion were presented with long and variable interstimulus intervals between them. On each trial, subjects reported whether they had perceived "coherent" or "random" motion, and fMRI signal time courses were analyzed separately as a function of stimulus and percept type. In the right motion-sensitive occipito-temporal cortex (hMT+), coherent percepts of periliminal stimuli yielded a larger stimulus-evoked response than random percepts. Prestimulus baseline activity in this region was also significantly higher in these coherent trials than in random trials. As in our previous study, however, the relation between ongoing and evoked activity was not additive but interacted with perceptual outcome. Our data thus suggest that endogenous fluctuations in baseline activity have a generic effect on subsequent perceptual decisions. Although mainstream analytical techniques used in functional neuroimaging do not capture this nonadditive effect of baseline on evoked response, it is in accord with postulates from theoretical frameworks as, for instance, predictive coding.

Rapid retinotopic reactivation during spatial memory

Memories are thought to be constructed from features processed in different cortical regions. However, it is unknown how the retrieval process unfolds over time. The present investigation aimed to address this issue by combining evidence from event-related potentials (ERPs) and functional magnetic resonance imaging (fMRI). During study, abstract shapes were presented to the left or right of fixation and participants were instructed to remember each shape and its spatial location. At test, studied (old) and new shapes were presented at fixation and participants classified each shape as old and on the "left", old and on the "right", or "new". Accurate memory for items previously presented on the left or right produced fMRI activity in the right or left extrastriate cortex (BA18), respectively. ERP results revealed these retinotopic memory effects occurred within 100-250 ms after stimulus onset indicating memory construction can occur very rapidly.

Selective attention to affective value alters how the brain processes olfactory stimuli

How does selective attention to affect influence sensory processing? In a functional magnetic resonance imaging investigation, when subjects were instructed to remember and rate the pleasantness of a jasmine odor, activations were greater in the medial orbito-frontal and pregenual cingulate cortex than when subjects were instructed to remember and rate the intensity of the odor. When the subjects were instructed to remember and rate the intensity, activations were greater in the inferior frontal gyrus. These top-down effects occurred not only during odor delivery but started in a preparation period after the instruction before odor delivery, and continued after termination of the odor in a short-term memory period. Thus, depending on the context in which odors are presented and whether affect is relevant, the brain prepares itself, responds to, and remembers an odor differently. These findings show that when attention is paid to affective value, the brain systems engaged to prepare for, represent, and remember a sensory stimulus are different from those engaged when attention is directed to the physical properties of a stimulus such as its intensity. This differential biasing of brain regions engaged in processing a sensory stimulus depending on whether the cognitive demand is for affect-related versus more sensory-related processing may be an important aspect of cognition and attention. This has many implications for understanding the effects not only of olfactory but also of other sensory stimuli.

Processing 3D form and 3D motion: respective contributions of attention-based and stimulus-driven activity

This study aims at segregating the neural substrate for the 3D-form and 3D-motion attributes in structure-from-motion perception, and at disentangling the stimulus-driven and endogenous-attention-driven processing of these attributes. Attention and stimulus were manipulated independently: participants had to detect the transitions of one attribute--form, 3D motion or colour--while the visual stimulus underwent successive transitions of all attributes. We compared the BOLD activity related to form and 3D motion in three conditions: stimulus-driven processing (unattended transitions), endogenous attentional selection (task) or both stimulus-driven processing and attentional selection (attended transitions). In all conditions, the form versus 3D-motion contrasts revealed a clear dorsal/ventral segregation. However, while the form-related activity is consistent with previously described shape-selective areas, the activity related to 3D motion does not encompass the usual "visual motion" areas, but rather corresponds to a high-level motion system, including IPL and STS areas. Second, we found a dissociation between the neural processing of unattended attributes and that involved in endogenous attentional selection. Areas selective for 3D-motion and form showed either increased activity at transitions of these respective attributes or decreased activity when subjects' attention was directed to a competing attribute. We propose that both facilitatory and suppressive mechanisms of attribute selection are involved depending on the conditions driving this selection. Therefore, attentional selection is not limited to an increased activity in areas processing stimulus properties, and may unveil different functional localization from stimulus modulation.

Anticipatory suppression of nonattended locations in visual cortex marks target location and predicts perception

Spatial attention is associated with modulations in prestimulus, anticipatory blood oxygen level-dependent (BOLD) activity across the brain. It is unclear, however, if these anticipatory modulations depend on the computational demands of the upcoming task. Here, we show that anticipation of low-contrast stimuli, relative to high-contrast stimuli, is associated with increased prestimulus BOLD activity in the frontal eye field (FEF) and the posterior inferior frontal sulcus (IFS) but not in the intraparietal sulcus (IPS). In visual cortex, anticipation of low-contrast stimuli is associated with increased suppression of activity corresponding to unattended (but not attended) locations, and this suppression predicts whether subjects will accurately perceive low-contrast stimuli. These results suggest that when a stimulus will be difficult to distinguish from the background, top-down signals from FEF and IFS can facilitate perception by marking its location through the suppression of unattended locations in visual cortex.

Attention and active vision

Visual perception results from the interaction of incoming sensory signals and top down cognitive and motor signals. Here we focus on the representation of attended locations in parietal cortex and in earlier visual cortical areas. We review evidence that these spatial representations are modulated not only by selective attention but also by the intention to move the eyes. We describe recent experiments in monkey and human that elucidate the mechanisms and circuitry involved in updating, or remapping, the representations of salient stimuli. Two central ideas emerge. First, selective attention and remapping are closely intertwined, and together contribute to the percept of spatial stability. Second, remapping is accomplished not by a single area but by the participation of parietal, frontal and extrastriate cortex as well as subcortical structures. This neural circuitry is distinguished by significant redundancy and plasticity, suggesting that the updating of salient stimuli is fundamental for spatial stability and visuospatial behavior. We conclude that multiple processes and pathways contribute to active vision in the primate brain.

Baseline shifts do not predict attentional modulation of target processing during feature-based visual attention

Cues that direct selective attention to a spatial location have been observed to increase baseline neural activity in visual areas that represent a to-be-attended stimulus location. Analogous attention-related baseline shifts have also been observed in response to attention-directing cues for non-spatial stimulus features. It has been proposed that baseline shifts with preparatory attention may serve as the mechanism by which attention modulates the responses to subsequent visual targets that match the attended location or feature. Using functional MRI, we localized color- and motion-sensitive visual areas in individual subjects and investigated the relationship between cue-induced baseline shifts and the subsequent attentional modulation of task-relevant target stimuli. Although attention-directing cues often led to increased background neural activity in feature specific visual areas, these increases were not correlated with either behavior in the task or subsequent attentional modulation of the visual targets. These findings cast doubt on the hypothesis that attention-related shifts in baseline neural activity result in selective sensory processing of visual targets during feature-based selective attention.