Mechanisms of feature- and space-based attention: response modulation and baseline increases

Attentional templates for target features versus locations

Visual search is guided by visual working memory representations (i.e., attentional templates) that are activated prior to search and contain target-defining features (e.g., color). In the present study, we tested whether attentional templates can also contain spatial target properties (knowing where to look for) and whether attentional selection guided by such feature-specific templates is equally efficient than selection that is based on feature-specific templates (knowing what to look for). In every trial, search displays were either preceded by semantic color or location cues, indicating the upcoming target color or location, respectively. Qualitative differences between feature- and location-based template guidance were substantiated in terms of selection efficiency in low-load (one target color/location) versus high-load trials (two target colors/locations). Behavioral and electrophysiological (N2pc) measures of target selection speed and accuracy were combined for converging evidence. In line with previous studies, we found that color search was highly efficient, even under high-low conditions, when multiple attentional templates were activated to guide attentional selection in a spatially global fashion. Importantly, results in the location task almost perfectly mirrored the findings of the color task, suggesting that multiple templates for different target locations were activated concurrently when two possible target locations were task relevant. Our findings align with accounts that assume a common neuronal network during preparation for location and color search, but regard spatial and feature-based selection mechanisms as independent.

The influence of depth on object selection and manipulation in visual working memory within a 3D context

Recent studies have examined whether the internal selection mechanism functions similarly for perception and visual working memory (VWM). However, the process of how we access and manipulate object representations distributed in a 3D space remains unclear. In this study, we utilized a memory search task to investigate the effect of depth on object selection and manipulation within VWM. The memory display consisted of colored items half positioned at the near depth plane and the other half at the far plane. During memory maintenance, the participants were instructed to search for a target representation and update its color. The results showed that under object-based attention (Experiments 1, 3, and 5), the update time was faster for targets at the near plane than for those at the far plane. This effect was absent in VWM when deploying spatial attention (Experiment 2) and in visual search regardless of the type of attention deployed (Experiment 4). The differential effects of depth on spatial and object-based attention in VWM suggest that spatial attention primarily relied on 2D location information irrespective of depth, whereas object-based attention seemed to prioritize memory representations at the front plane before shifting to the back. Our findings shed light on the interaction between depth perception and the selection mechanisms within VWM in a 3D context, emphasizing the importance of ordinal, rather than metric, spatial information in guiding object-based attention in VWM.

Sustained selective attention to chromatic information enhances visuocortical gain at the population level

Prior work in selective attention research has shown that colour-selective attention enhances neural activity in visuocortical areas sensitive to the attended colour while suppressing activity in areas sensitive to ignored colours. However, it is currently unclear whether this effect is limited to attending to specific colour hues or extends to chromatic information more broadly. To investigate this question, we used steady-state visual evoked potentials (ssVEPs) frequency tagging to quantify participants' visuocortical responses to specific elements embedded in arrays of flickering, randomly moving mid-complex patterns. Participants were instructed to attend to either coloured or greyscale patterns while ignoring the others. We found that attending to either coloured or greyscale patterns produced robust increases in ssVEP amplitudes both compared to ignored stimuli and to baseline. There was however no evidence of suppressed responses to ignored patterns. These findings demonstrate that attentional selection based on the presence or absence of chromatic information prompts selectively enhanced visuocortical processing but this selective amplification is not accompanied by suppression of unattended stimuli. Findings are consistent with theoretical notions that predict strong competition between specific exemplars within a given feature dimension, such as red or green, but weak competition between broadly defined stimulus categories, such as chromatic versus non-chromatic.

Top-Down Biasing of Visual Cortical Activity Encodes Attended Information and Facilitates Behavioral Performance in Visual Spatial Attention

Top-down attention plays a vital role in selecting relevant stimuli and suppressing distracting information. During top-down visual-spatial attention, control signals from the dorsal attention network modulate the baseline neuronal activity in the visual cortex in favor of task-relevant stimuli. While several studies have demonstrated that baseline shift during anticipatory attention occurs in multiple visual areas, such effects have not been systematically investigated across the visual hierarchy, especially when different attention conditions are matched for stimulus and task factors. In this fMRI study, we investigated anticipatory attention signals using univariate and multivariate (MVPA) analysis in multiple visual cortical areas. First, the univariate analysis yielded significant activation differences in higher-order visual areas, with the effect weaker in early visual areas. Second, however, in contrast, MVPA decoding was significant in predicting attention conditions in all visual areas and IPS, with lower-order visual areas (e.g., V1) having greater decoding accuracy than higher-order visual areas (e.g., LO1). Third, the strength of decoding accuracy predicted the behavioral performance in the discrimination task. All the results were highly replicable and consistent across two datasets with same experimental paradigms but recorded at two research sites, and two experimental conditions where the direction of spatial attention was driven either by external instructions (cue-instructed attention) or from internal decisions (free-choice attention). Our results provide clear evidence, not available in past univariate investigations, that top-down attentional control signals selectively bias neuronal processing throughout the visual hierarchy, and that this biasing is correlated with the task performance.

Learned feature regularities enable suppression of spatially overlapping stimuli

Contemporary theories of attentional control state that information can be prioritized based on selection history. Even though theories agree that selection history can impact representations of spatial location, which in turn helps guide attention, there remains disagreement on whether nonspatial features (e.g., color) are modulated in a similar way. While previous work has demonstrated color suppression using visual search tasks, it is possible that the location corresponding to the distractor was suppressed, consistent with a spatial mechanism of suppression. Here, we sought to rule out this possibility by testing whether similar suppression of a learned distractor color can occur for spatially overlapping visual stimuli. On a given trial, two spatially superimposed stimuli (line arrays) were tilted either left or right of vertical and presented in one of four distinct colors. Subjects performed a speeded report of the orientation of the “target” array with the most lines. Critically, the distractor array was regularly one color, and this high-probability color was never the color of the target array, which encouraged learned suppression. In two experiments, responses to the target array were fastest when the distractor array was in the high-probability color, suggesting participants suppressed the distractor color. Additionally, when regularities were removed, the high-probability distractor color continued to benefit speeded target identification for individual subjects (E1) but slowed target identification (E2) when presented in the target array. Together, these results indicate that learned suppression of feature-based regularities modulates target detection performance independent of spatial location and persists over time.

Closed-Loop Neurofeedback of α Synchrony during Goal-Directed Attention

α Oscillations in sensory cortex, under frontal control, desynchronize during attentive preparation. Here, in a selective attention study with simultaneous EEG in humans of either sex, we first demonstrate that diminished anticipatory α synchrony between the mid-frontal region of the dorsal attention network and ventral visual sensory cortex [frontal-sensory synchrony (FSS)] significantly correlates with greater task performance. Then, in a double-blind, randomized controlled study in healthy adults, we implement closed-loop neurofeedback (NF) of the anticipatory α FSS signal over 10 d of training. We refer to this closed-loop experimental approach of rapid NF integrated within a cognitive task as cognitive NF (cNF). We show that cNF results in significant trial-by-trial modulation of the anticipatory α FSS measure during training, concomitant plasticity of stimulus-evoked α/θ responses, as well as transfer of benefits to response time (RT) improvements on a standard test of sustained attention. In a third study, we implement cNF training in children with attention deficit hyperactivity disorder (ADHD), replicating trial-by-trial modulation of the anticipatory α FSS signal as well as significant improvement of sustained attention RTs. These first findings demonstrate the basic mechanisms and translational utility of rapid cognitive-task-integrated NF.SIGNIFICANCE STATEMENT When humans prepare to attend to incoming sensory information, neural oscillations in the α band (8-14 Hz) undergo desynchronization under the control of prefrontal cortex. Here, in an attention study with electroencephalography, we first show that frontal-sensory synchrony (FSS) of α oscillations during attentive preparation significantly correlates with task performance. Then, in a randomized controlled study in healthy adults, we show that neurofeedback (NF) training of this α FSS signal within the attention task is feasible. We show that this rapid cognitive NF (cNF) approach engenders plasticity of stimulus-evoked neural responses, and improves performance on a standard test of sustained attention. In a final study, we implement cNF in children with attention deficit hyperactivity disorder (ADHD), replicating the improvement of sustained attention found in adults.

Effect of attentional selection on working memory for depth in a retro-cueing paradigm

Recent studies have shown that the temporary storage and manipulation of depth information (working memory for depth; WMd) is largely different from that of visual information in a 2D context (visual working memory; VWM). Although there has been abundant evidence on VWM showing that cueing a memory item during retention could bias attention to its internal representation and thus improves its memory performance (a retro-cue effect), it is unknown whether such an effect differs for WMd that is nested in a 3D context compared with that in a conventional 2D context. Here, we used a change detection task to investigate the effect of attentional selection on WMd by testing several types of retro-cue. The memory array consisted of items positioned at various stereoscopic depth planes, and a cue was presented during retention. Participants needed to make judgments on whether the depth position of target (one memory item) had changed. Our study showed reliable valid retro-cue benefits but no invalid retro-cue cost, indicating that the relational information may be registered in WMd to prevent a strategical removal of the unattended item. There was also a slight improvement in memory performance for cueing depth order compared with that for cueing other feature dimensions or 2D locations. The attentional effect on memory representation in a 3D context is different from that in a 2D context, and the divergence may suggest the distinctive nature of working memory for depth.

Changes in visual cortical processing attenuate singleton distraction during visual search

The ability to suppress distractions is essential to successful completion of goal-directed behaviors. Several behavioral studies have recently provided strong evidence that learned suppression may be particularly efficient in reducing distractor interference. Expectations about a distractor's repeated location, color, or even presence are rapidly learned and used to attenuate interference. In this study, we use a visual search paradigm in which a color singleton, which is known to capture attention, occurs within blocks with high or low frequency. The behavioral results show reduced singleton interference during the high compared to the low frequency block (Won et al., 2019). The fMRI results provide evidence that the attenuation of distractor interference is supported by changes in singleton, target, and non-salient distractor representations within retinotopic visual cortex. These changes in visual cortex are accompanied by findings that singleton-present trials compared to non-singleton trials produce greater activation in bilateral parietal cortex, indicative of attentional capture, in low frequency, but not high frequency blocks. Together, these results suggest that the readout of saliency signals associated with an expected color singleton from visual cortex is suppressed, resulting in less competition for attentional priority in frontoparietal attentional control regions.

In search of exogenous feature-based attention

Visual attention prioritizes the processing of sensory information at specific spatial locations (spatial attention; SA) or with specific feature values (feature-based attention; FBA). SA is well characterized in terms of behavior, brain activity, and temporal dynamics-for both top-down (endogenous) and bottom-up (exogenous) spatial orienting. FBA has been thoroughly studied in terms of top-down endogenous orienting, but much less is known about the potential of bottom-up exogenous influences of FBA. Here, in four experiments, we adapted a procedure used in two previous studies that reported exogenous FBA effects, with the goal of replicating and expanding on these findings, especially regarding its temporal dynamics. Unlike the two previous studies, we did not find significant effects of exogenous FBA. This was true (1) whether accuracy or RT was prioritized as the main measure, (2) with precues presented peripherally or centrally, (3) with cue-to-stimulus ISIs of varying durations, (4) with four or eight possible target locations, (5) at different meridians, (6) with either brief or long stimulus presentations, (7) and with either fixation contingent or noncontingent stimulus displays. In the last experiment, a postexperiment participant questionnaire indicated that only a small subset of participants, who mistakenly believed the irrelevant color of the precue indicated which stimulus was the target, exhibited benefits for valid exogenous FBA precues. Overall, we conclude that with the protocol used in the studies reporting exogenous FBA, the exogenous stimulus-driven influence of FBA is elusive at best, and that FBA is primarily a top-down, goal-driven process.

Strategic deployment of feature-based attentional gain in primate visual cortex

Attending to visual stimuli enhances the gain of those neurons in primate visual cortex that preferentially respond to the matching locations and features (on-target gain). Although this is well suited to enhance the neuronal representation of attended stimuli, it is nonoptimal under difficult discrimination conditions, as in the presence of similar distractors. In such cases, directing attention to neighboring neuronal populations (off-target gain) has been shown to be the most efficient strategy, but although such a strategic deployment of attention has been shown behaviorally, its underlying neural mechanisms are unknown. Here, we investigated how attention affects the population responses of neurons in the middle temporal (MT) visual area of rhesus monkeys to bidirectional movement inside the neurons' receptive field (RF). The monkeys were trained to focus their attention onto the fixation spot or to detect a direction or speed change in one of the motion directions (the "target"), ignoring the distractor motion. Population activity profiles were determined by systematically varying the patterns' directions while maintaining a constant angle between them. As expected, the response profiles show a peak for each of the 2 motion directions. Switching spatial attention from the fixation spot into the RF enhanced the peak representing the attended stimulus and suppressed the distractor representation. Importantly, the population data show a direction-dependent attentional modulation that does not peak at the target feature but rather along the slopes of the activity profile representing the target direction. Our results show that attentional gains are strategically deployed to optimize the discriminability of target stimuli, in line with an optimal gain mechanism proposed by Navalpakkam and Itti.

Expectation and attention increase the integration of top-down and bottom-up signals in perception through different pathways

Perception likely results from the interplay between sensory information and top-down signals. In this electroencephalography (EEG) study, we utilised the hierarchical frequency tagging (HFT) method to examine how such integration is modulated by expectation and attention. Using intermodulation (IM) components as a measure of nonlinear signal integration, we show in three different experiments that both expectation and attention enhance integration between top-down and bottom-up signals. Based on a multispectral phase coherence (MSPC) measure, we present two direct physiological measures to demonstrate the distinct yet related mechanisms of expectation and attention, which would not have been possible using other amplitude-based measures. Our results link expectation to the modulation of descending signals and to the integration of top-down and bottom-up information at lower levels of the visual hierarchy. Meanwhile, the results link attention to the modulation of ascending signals and to the integration of information at higher levels of the visual hierarchy. These results are consistent with the predictive coding account of perception.

Dissociating the impact of attention and expectation on early sensory processing

Most studies that focus on understanding how top-down knowledge influences behavior attempt to manipulate either 'attention' or 'expectation' and often use the terms interchangeably. However, having expectations about statistical regularities in the environment and the act of willfully allocating attention to a subset of relevant sensory inputs are logically distinct processes that could, in principle, rely on similar neural mechanisms and influence information processing at the same stages. In support of this framework, several recent studies attempted to isolate expectation from attention, and advanced the idea that expectation and attention both modulate early sensory processing. Here, we argue that there is currently insufficient empirical evidence to support this conclusion, because previous studies have not fully isolated the effects of expectation and attention. Instead, most prior studies manipulated the relevance of different sensory features, and as a result, few existing findings speak directly to the potentially separable influences of expectation and attention on early sensory processing. Indeed, recent studies that attempt to more strictly isolate expectation and attention suggest that expectation has little influence on early sensory responses and primarily influences later 'decisional' stages of information processing.

Task-dependent effects of voluntary space-based and involuntary feature-based attention on visual working memory

Previous research has shown that visual working memory (VWM) can be modulated by space-based or feature-based attentional selection. However, it remains unclear how the two modes of attention operate jointly to affect VWM, and in particular, if involuntary feature-based attention plays a role in VWM. In this study, a pre-cued change detection paradigm was employed to investigate the concurrent effects of space- and feature-based attention on VWM. Space-based attention was manipulated by informative spatial cueing and by varying the proximity between the test item and the cued (fixated) memory item, while feature-based attention was induced in an involuntary manner by having the test item to share the same color or shape with the cued item on a fraction of trials. The results showed that: (1) the memory performance for the cued items was always better than the uncued items, suggesting a beneficial effect of voluntary spatial attention; (2) with a brief duration of the memory array (250 ms), cue-test proximity benefited VWM in the shape judgment task but not in the color judgment task, whereas with a longer duration (1200 ms), no proximity effect was found for either task; (3) VWM was improved for the same-colored items regardless of the task and duration; (4) VWM was improved for the same-shaped items only in the shape judgment task with the longer duration of the memory array. A discrimination task further showed that the proximity effect associated with VWM reflects a perceptual bottleneck in memory encoding for shape but not for color with a brief display. Our results suggest that involuntary feature-based attention could be triggered by spatial cueing to modulate VWM; involuntary color-based attention facilitates VWM independently of task, whereas shape-based facilitation is task-dependent, i.e., confined only to the shape judgment task, presumably reflecting different attention-guiding potencies of the two features.

Attending to What and Where: Background Connectivity Integrates Categorical and Spatial Attention

Top-down attention prioritizes the processing of goal-relevant information throughout visual cortex based on where that information is found in space and what it looks like. Whereas attentional goals often have both spatial and featural components, most research on the neural basis of attention has examined these components separately. Here we investigated how these attentional components are integrated by examining the attentional modulation of functional connectivity between visual areas with different selectivity. Specifically, we used fMRI to measure temporal correlations between spatially selective regions of early visual cortex and category-selective regions in ventral temporal cortex while participants performed a task that benefitted from both spatial and categorical attention. We found that categorical attention modulated the connectivity of category-selective areas, but only with retinotopic areas that coded for the spatially attended location. Similarly, spatial attention modulated the connectivity of retinotopic areas only with the areas coding for the attended category. This pattern of results suggests that attentional modulation of connectivity is driven both by spatial selection and featural biases. Combined with exploratory analyses of frontoparietal areas that track these changes in connectivity among visual areas, this study begins to shed light on how different components of attention are integrated in support of more complex behavioral goals.

What does the dot-probe task measure? A reverse correlation analysis of electrocortical activity

The dot-probe task is considered a gold standard for assessing the intrinsic attentive selection of one of two lateralized visual cues, measured by the response time to a subsequent, lateralized response probe. However, this task has recently been associated with poor reliability and conflicting results. To resolve these discrepancies, we tested the underlying assumption of the dot-probe task-that fast probe responses index heightened cue selection-using an electrophysiological measure of selective attention. Specifically, we used a reverse correlation approach in combination with frequency-tagged steady-state visual potentials (ssVEPs). Twenty-one participants completed a modified dot-probe task in which each member of a pair of lateralized face cues, varying in emotional expression (angry-angry, neutral-angry, neutral-neutral), flickered at one of two frequencies (15 or 20 Hz), to evoke ssVEPs. One cue was then replaced by a response probe, and participants indicated the probe orientation (0° or 90°). We analyzed the ssVEP evoked by the cues as a function of response speed to the subsequent probe (i.e., a reverse correlation analysis). Electrophysiological measures of cue processing varied with probe hemifield location: Faster responses to left probes were associated with weak amplification of the preceding left cue, apparent only in a median split analysis. By contrast, faster responses to right probes were systematically and parametrically predicted by diminished visuocortical selection of the preceding right cue. Together, these findings highlight the poor validity of the dot-probe task, in terms of quantifying intrinsic, nondirected attentive selection irrespective of probe/cue location.

Attention to Color Sharpens Neural Population Tuning via Feedback Processing in the Human Visual Cortex Hierarchy

Attention can facilitate the selection of elementary object features such as color, orientation, or motion. This is referred to as feature-based attention and it is commonly attributed to a modulation of the gain and tuning of feature-selective units in visual cortex. Although gain mechanisms are well characterized, little is known about the cortical processes underlying the sharpening of feature selectivity. Here, we show with high-resolution magnetoencephalography in human observers (men and women) that sharpened selectivity for a particular color arises from feedback processing in the human visual cortex hierarchy. To assess color selectivity, we analyze the response to a color probe that varies in color distance from an attended color target. We find that attention causes an initial gain enhancement in anterior ventral extrastriate cortex that is coarsely selective for the target color and transitions within ∼100 ms into a sharper tuned profile in more posterior ventral occipital cortex. We conclude that attention sharpens selectivity over time by attenuating the response at lower levels of the cortical hierarchy to color values neighboring the target in color space. These observations support computational models proposing that attention tunes feature selectivity in visual cortex through backward-propagating attenuation of units less tuned to the target.SIGNIFICANCE STATEMENT Whether searching for your car, a particular item of clothing, or just obeying traffic lights, in everyday life, we must select items based on color. But how does attention allow us to select a specific color? Here, we use high spatiotemporal resolution neuromagnetic recordings to examine how color selectivity emerges in the human brain. We find that color selectivity evolves as a coarse to fine process from higher to lower levels within the visual cortex hierarchy. Our observations support computational models proposing that feature selectivity increases over time by attenuating the responses of less-selective cells in lower-level brain areas. These data emphasize that color perception involves multiple areas across a hierarchy of regions, interacting with each other in a complex, recursive manner.

Task-specific, dimension-based attentional shaping of motion processing in monkey area MT

Nonspatially selective attention is based on the notion that specific features or objects in the visual environment are effectively prioritized in cortical visual processing. Feature-based attention (FBA), in particular, is a well-studied process that dynamically and selectively addresses neurons preferentially processing the attended feature attribute (e.g., leftward motion). In everyday life, however, behavior may require high sensitivity for an entire feature dimension (e.g., motion), but experimental evidence for a feature dimension-specific attentional modulation on a cellular level is lacking. Therefore, we investigated neuronal activity in macaque motion-selective mediotemporal area (MT) in an experimental setting requiring the monkeys to detect either a motion change or a color change. We hypothesized that neural activity in MT is enhanced when the task requires perceptual sensitivity to motion. In line with this, we found that mean firing rates were higher in the motion task and that response variability and latency were lower compared with values in the color task, despite identical visual stimulation. This task-specific, dimension-based modulation of motion processing emerged already in the absence of visual input, was independent of the relation between the attended and stimulating motion direction, and was accompanied by a spatially global reduction of neuronal variability. The results provide single-cell support for the hypothesis of a feature dimension-specific top-down signal emphasizing the processing of an entire feature class.NEW & NOTEWORTHY Cortical processing serving visual perception prioritizes information according to current task requirements. We provide evidence in favor of a dimension-based attentional mechanism addressing all neurons that process visual information in the task-relevant feature domain. Behavioral tasks required monkeys to attend either color or motion, causing modulations of response strength, variability, latency, and baseline activity of motion-selective monkey area MT neurons irrespective of the attended motion direction but specific to the attended feature dimension.

Attentional Modulation of Neuronal Activity Depends on Neuronal Feature Selectivity

Attention exerts a powerful influence on visual perception. The impact of attention on neuronal activity manifests at early visual information processing stages and progressively increases throughout the visual cortical hierarchy. However, the neuronal mechanisms of attention are unresolved. In particular, the rules governing attentional modulation of individual neurons, whether they are facilitated by or suppressed by attention, are not known. To obtain a more granular or neuron- and circuit-level understanding of the mechanisms of attention and to directly test the feature similarity gain model in V1, we compared attentional modulation with neuronal feature selectivity across a large population of V1 neurons in alert and behaving macaque monkeys trained on an attention-demanding contrast-change detection task. We utilized emerging multi-electrode array technology to record simultaneously from V1 neurons spanning all six cortical layers so that we could characterize the laminar position and physiological response properties of diverse V1 neuronal populations. We found significant relationships between attentional modulation and neuronal position within the cortical hierarchy, neuronal physiology, and neuronal feature selectivity. Our results support the feature similarity gain model and further suggest that attentional modulation depends critically upon the match between neuronal feature selectivity and the features required for the task.

No Evidence for Automatic Remapping of Stimulus Features or Location Found with fMRI

The input to our visual system shifts every time we move our eyes. To maintain a stable percept of the world, visual representations must be updated with each saccade. Near the time of a saccade, neurons in several visual areas become sensitive to the regions of visual space that their receptive fields occupy after the saccade. This process, known as remapping, transfers information from one set of neurons to another, and may provide a mechanism for visual stability. However, it is not clear whether remapping transfers information about stimulus features in addition to information about stimulus location. To investigate this issue, we recorded blood-oxygen-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses while human subjects viewed images of faces and houses (two visual categories with many feature differences). Immediately after some image presentations, subjects made a saccade that moved the previously stimulated location to the opposite side of the visual field. We then used a combination of univariate analyses and multivariate pattern analyses to test whether information about stimulus location and stimulus features were remapped to the ipsilateral hemisphere after the saccades. We found no reliable indication of stimulus feature remapping in any region. However, we also found no reliable indication of stimulus location remapping, despite the fact that our paradigm was highly similar to previous fMRI studies of remapping. The absence of location remapping in our study precludes strong conclusions regarding feature remapping. However, these results also suggest that measurement of location remapping with fMRI depends strongly on the details of the experimental paradigm used. We highlight differences in our approach from the original fMRI studies of remapping, discuss potential reasons for the failure to generalize prior location remapping results, and suggest directions for future research.

EPS Mid-Career Award 2014

In visual search, observers try to find known target objects among distractors in visual scenes where the location of the targets is uncertain. This review article discusses the attentional processes that are active during search and their neural basis. Four successive phases of visual search are described. During the initial preparatory phase, a representation of the current search goal is activated. Once visual input has arrived, information about the presence of target-matching features is accumulated in parallel across the visual field (guidance). This information is then used to allocate spatial attention to particular objects (selection), before representations of selected objects are activated in visual working memory (recognition). These four phases of attentional control in visual search are characterized both at the cognitive level and at the neural implementation level. It will become clear that search is a continuous process that unfolds in real time. Selective attention in visual search is described as the gradual emergence of spatially specific and temporally sustained biases for representations of task-relevant visual objects in cortical maps.

Distinct effects of trial-driven and task Set-related control in primary visual cortex

Task sets are task-specific configurations of cognitive processes that facilitate task-appropriate reactions to stimuli. While it is established that the trial-by-trial deployment of visual attention to expected stimuli influences neural responses in primary visual cortex (V1) in a retinotopically specific manner, it is not clear whether the mechanisms that help maintain a task set over many trials also operate with similar retinotopic specificity. Here, we address this question by using BOLD fMRI to characterize how portions of V1 that are specialized for different eccentricities respond during distinct components of an attention-demanding discrimination task: cue-driven preparation for a trial, trial-driven processing, task-initiation at the beginning of a block of trials, and task-maintenance throughout a block of trials. Tasks required either unimodal attention to an auditory or a visual stimulus or selective intermodal attention to the visual or auditory component of simultaneously presented visual and auditory stimuli. We found that while the retinotopic patterns of trial-driven and cue-driven activity depended on the attended stimulus, the retinotopic patterns of task-initiation and task-maintenance activity did not. Further, only the retinotopic patterns of trial-driven activity were found to depend on the presence of inter-modal distraction. Participants who performed well on the intermodal selective attention tasks showed strong task-specific modulations of both trial-driven and task-maintenance activity. Importantly, task-related modulations of trial-driven and task-maintenance activity were in opposite directions. Together, these results confirm that there are (at least) two different processes for top-down control of V1: One, working trial-by-trial, differently modulates activity across different eccentricity sectors - portions of V1 corresponding to different visual eccentricities. The second process works across longer epochs of task performance, and does not differ among eccentricity sectors. These results are discussed in the context of previous literature examining top-down control of visual cortical areas.

Sensory gain outperforms efficient readout mechanisms in predicting attention-related improvements in behavior

Spatial attention has been postulated to facilitate perceptual processing via several different mechanisms. For instance, attention can amplify neural responses in sensory areas (sensory gain), mediate neural variability (noise modulation), or alter the manner in which sensory signals are selectively read out by postsensory decision mechanisms (efficient readout). Even in the context of simple behavioral tasks, it is unclear how well each of these mechanisms can account for the relationship between attention-modulated changes in behavior and neural activity because few studies have systematically mapped changes between stimulus intensity, attentional focus, neural activity, and behavioral performance. Here, we used a combination of psychophysics, event-related potentials (ERPs), and quantitative modeling to explicitly link attention-related changes in perceptual sensitivity with changes in the ERP amplitudes recorded from human observers. Spatial attention led to a multiplicative increase in the amplitude of an early sensory ERP component (the P1, peaking ∼80-130 ms poststimulus) and in the amplitude of the late positive deflection component (peaking ∼230-330 ms poststimulus). A simple model based on signal detection theory demonstrates that these multiplicative gain changes were sufficient to account for attention-related improvements in perceptual sensitivity, without a need to invoke noise modulation. Moreover, combining the observed multiplicative gain with a postsensory readout mechanism resulted in a significantly poorer description of the observed behavioral data. We conclude that, at least in the context of relatively simple visual discrimination tasks, spatial attention modulates perceptual sensitivity primarily by modulating the gain of neural responses during early sensory processing.

Maintenance of relational information in working memory leads to suppression of the sensory cortex

Working memory (WM) for sensory-based information about individual objects and their locations appears to involve interactions between lateral prefrontal and sensory cortexes. The mechanisms and representations for maintenance of more abstract, nonsensory information in WM are unknown, particularly whether such actively maintained information can become independent of the sensory information from which it was derived. Previous studies of WM for individual visual items found increased electroencephalogram (EEG) alpha (8-13 Hz) power over posterior electrode sites, which appears to correspond to the suppression of cortical areas that represent irrelevant sensory information. Here, we recorded EEG while participants performed a visual WM task that involved maintaining either concrete spatial coordinates or abstract relational information. Maintenance of relational information resulted in higher alpha power in posterior electrodes. Furthermore, lateralization of alpha power due to a covert shift of attention to one visual hemifield was marginally weaker during storage of relational information than during storage of concrete information. These results suggest that abstract relational information is maintained in WM differently from concrete, sensory representations and that during maintenance of abstract information, posterior sensory regions become task irrelevant and are thus suppressed.

Changing the spatial scope of attention alters patterns of neural gain in human cortex

Over the last several decades, spatial attention has been shown to influence the activity of neurons in visual cortex in various ways. These conflicting observations have inspired competing models to account for the influence of attention on perception and behavior. Here, we used electroencephalography (EEG) to assess steady-state visual evoked potentials (SSVEP) in human subjects and showed that highly focused spatial attention primarily enhanced neural responses to high-contrast stimuli (response gain), whereas distributed attention primarily enhanced responses to medium-contrast stimuli (contrast gain). Together, these data suggest that different patterns of neural modulation do not reflect fundamentally different neural mechanisms, but instead reflect changes in the spatial extent of attention.

A mouse model of higher visual cortical function

During sensory experience, the retina transmits a diverse array of signals to the brain, which must be parsed to generate meaningful percepts that can guide decisions and actions. Decades of anatomical and physiological studies in primates and carnivores have revealed a complex parallel and hierarchical organization by which distinct visual features are distributed to, and processed by, different brain regions. However, these studies have been limited in their ability to dissect the circuit mechanisms involved in the transformation of sensory inputs into complex cortical representations and action patterns. Multiple groups have therefore pushed to explore the organization and function of higher visual areas in the mouse. Here we review the anatomical and physiological findings of these recent explorations in mouse visual cortex. These studies find that sensory input is processed in a diverse set of higher areas that are each interconnected with specific limbic and motor systems. This hierarchical and parallel organization is consistent with the multiple streams that have been found in the higher visual areas of primates. We therefore propose that the mouse visual system is a useful model to explore the circuits underlying the transformation of sensory inputs into goal-directed perceptions and actions.

Functional brain organization of preparatory attentional control in visual search

Looking for an object that may be present in a cluttered visual display requires an advanced specification of that object to be created and then matched against the incoming visual input. Here, fast event-related fMRI was used to identify the brain networks that are active when preparing to search for a visual target. By isolating the preparation phase of the task it has been possible to show that for an identical stimulus, different patterns of cortical activation occur depending on whether participants anticipate a 'feature' or a 'conjunction' search task. When anticipating a conjunction search task, there was more robust activation in ventral occipital areas, new activity in the transverse occipital sulci and right posterior intraparietal sulcus. In addition, preparing for either type of search activated ventral striatum and lateral cerebellum. These results suggest that when participants anticipate a demanding search task, they develop a different advanced representation of a visually identical target stimulus compared to when they anticipate a nondemanding search.

Atypical balance between occipital and fronto-parietal activation for visual shape extraction in dyslexia

Reading requires the extraction of letter shapes from a complex background of text, and an impairment in visual shape extraction would cause difficulty in reading. To investigate the neural mechanisms of visual shape extraction in dyslexia, we used functional magnetic resonance imaging (fMRI) to examine brain activation while adults with or without dyslexia responded to the change of an arrow’s direction in a complex, relative to a simple, visual background. In comparison to adults with typical reading ability, adults with dyslexia exhibited opposite patterns of atypical activation: decreased activation in occipital visual areas associated with visual perception, and increased activation in frontal and parietal regions associated with visual attention. These findings indicate that dyslexia involves atypical brain organization for fundamental processes of visual shape extraction even when reading is not involved. Overengagement in higher-order association cortices, required to compensate for underengagment in lower-order visual cortices, may result in competition for top-down attentional resources helpful for fluent reading.

Category-selective attention modulates unconscious processes in the middle occipital gyrus

Many studies have revealed the top-down modulation (spatial attention, attentional load, etc.) on unconscious processing. However, there is little research about how category-selective attention could modulate the unconscious processing. In the present study, using functional magnetic resonance imaging (fMRI), the results showed that category-selective attention modulated unconscious face/tool processing in the middle occipital gyrus (MOG). Interestingly, MOG effects were of opposed direction for face and tool processes. During unconscious face processing, activation in MOG decreased under the face-selective attention compared with tool-selective attention. This result was in line with the predictive coding theory. During unconscious tool processing, however, activation in MOG increased under the tool-selective attention compared with face-selective attention. The different effects might be ascribed to an interaction between top-down category-selective processes and bottom-up processes in the partial awareness level as proposed by Kouider, De Gardelle, Sackur, and Dupoux (2010). Specifically, we suppose an "excessive activation" hypothesis.

Effects of task and attentional selection on responses in human visual cortex

Multiple visual tasks can be performed on the same visual input, with different tasks presumably engaging different neuronal populations. The modular layout of the visual system implies that specific cortical regions carry more information about certain stimulus attributes than others. Thus it is reasonable to assume that decisions during a task will be optimal if they are based on the responses of the most informative neuronal signals, which presumably originate in regions with the sharpest tuning for the relevant stimulus feature. Previous studies have supported this position. Here we present the results of two fMRI experiments that confirm these findings and expand on earlier investigations by addressing the effects of the physical properties of an attended stimulus on task-related modulations in human visual cortex. Specifically, we ask whether performing two-alternative forced choice speed- and color-discrimination tasks (and other attentional processes) can modulate neural activity independent of visual stimulation and whether the effect of spatial attention depends on which task is being performed. The results indicate that 1) when stimulation and spatial attention are constant, responses in V4 and MT+ depend on the task being performed and are independent of the tested physical properties of the selected stimulus, 2) this task-dependent modulation might require a stimulus--task-specific preparatory mechanisms alone are not sufficient to drive responses, and 3) independent of which task is being performed, spatial attention adds a baseline shift to responses in MT+ and V4 when a stimulus is present.

Cortical cross-frequency coupling predicts perceptual outcomes

Functional networks are comprised of neuronal ensembles bound through synchronization across multiple intrinsic oscillatory frequencies. Various coupled interactions between brain oscillators have been described (e.g., phase-amplitude coupling), but with little evidence that these interactions actually influence perceptual sensitivity. Here, electroencephalographic (EEG) recordings were made during a sustained-attention task to demonstrate that cross-frequency coupling has significant consequences for perceptual outcomes (i.e., whether participants detect a near-threshold visual target). The data reveal that phase-detection relationships at higher frequencies are dependent on the phase of lower frequencies, such that higher frequencies alternate between periods when their phase is either strongly or weakly predictive of visual-target detection. Moreover, the specific higher frequencies and scalp topographies linked to visual-target detection also alternate as a function of lower-frequency phase. Cross-frequency coupling between lower (i.e., delta and theta) and higher frequencies (e.g., low- and high-beta) thus results in dramatic fluctuations of visual-target detection.

Visual short-term memory: activity supporting encoding and maintenance in retinotopic visual cortex

Recent studies have demonstrated that retinotopic cortex maintains information about visual stimuli during retention intervals. However, the process by which transient stimulus-evoked sensory responses are transformed into enduring memory representations is unknown. Here, using fMRI and short-term visual memory tasks optimized for univariate and multivariate analysis approaches, we report differential involvement of human retinotopic areas during memory encoding of the low-level visual feature orientation. All visual areas show weaker responses when memory encoding processes are interrupted, possibly due to effects in orientation-sensitive primary visual cortex (V1) propagating across extrastriate areas. Furthermore, intermediate areas in both dorsal (V3a/b) and ventral (LO1/2) streams are significantly more active during memory encoding compared with non-memory (active and passive) processing of the same stimulus material. These effects in intermediate visual cortex are also observed during memory encoding of a different stimulus feature (spatial frequency), suggesting that these areas are involved in encoding processes on a higher level of representation. Using pattern-classification techniques to probe the representational content in visual cortex during delay periods, we further demonstrate that simply initiating memory encoding is not sufficient to produce long-lasting memory traces. Rather, active maintenance appears to underlie the observed memory-specific patterns of information in retinotopic cortex.

Effect of feature-selective attention on neuronal responses in macaque area MT

Attention influences visual processing in striate and extrastriate cortex, which has been extensively studied for spatial-, object-, and feature-based attention. Most studies exploring neural signatures of feature-based attention have trained animals to attend to an object identified by a certain feature and ignore objects/displays identified by a different feature. Little is known about the effects of feature-selective attention, where subjects attend to one stimulus feature domain (e.g., color) of an object while features from different domains (e.g., direction of motion) of the same object are ignored. To study this type of feature-selective attention in area MT in the middle temporal sulcus, we trained macaque monkeys to either attend to and report the direction of motion of a moving sine wave grating (a feature for which MT neurons display strong selectivity) or attend to and report its color (a feature for which MT neurons have very limited selectivity). We hypothesized that neurons would upregulate their firing rate during attend-direction conditions compared with attend-color conditions. We found that feature-selective attention significantly affected 22% of MT neurons. Contrary to our hypothesis, these neurons did not necessarily increase firing rate when animals attended to direction of motion but fell into one of two classes. In one class, attention to color increased the gain of stimulus-induced responses compared with attend-direction conditions. The other class displayed the opposite effects. Feature-selective activity modulations occurred earlier in neurons modulated by attention to color compared with neurons modulated by attention to motion direction. Thus feature-selective attention influences neuronal processing in macaque area MT but often exhibited a mismatch between the preferred stimulus dimension (direction of motion) and the preferred attention dimension (attention to color).

Olfactory predictive codes and stimulus templates in piriform cortex

Neuroscientific models of sensory perception suggest that the brain utilizes predictive codes in advance of a stimulus encounter, enabling organisms to infer forthcoming sensory events. However, it is poorly understood how such mechanisms are implemented in the olfactory system. Combining high-resolution functional magnetic resonance imaging with multivariate (pattern-based) analyses, we examined the spatiotemporal evolution of odor perception in the human brain during an olfactory search task. Ensemble activity patterns in anterior piriform cortex (APC) and orbitofrontal cortex (OFC) reflected the attended odor target both before and after stimulus onset. In contrast, prestimulus ensemble representations of the odor target in posterior piriform cortex (PPC) gave way to poststimulus representations of the odor itself. Critically, the robustness of target-related patterns in PPC predicted subsequent behavioral performance. Our findings directly show that the brain generates predictive templates or "search images" in PPC, with physical correspondence to odor-specific pattern representations, to augment olfactory perception.

Attentional modulation in visual cortex is modified during perceptual learning

Practicing a visual task commonly results in improved performance. Often the improvement does not transfer well to a new retinal location, suggesting that it is mediated by changes occurring in early visual cortex, and indeed neuroimaging and neurophysiological studies both demonstrate that perceptual learning is associated with altered activity in visual cortex. Theoretical treatments tend to invoke neuroplasticity that refines early sensory processing. An alternative possibility is that performance is improved because of an altered attentional strategy and that the changes in early visual areas reflect locally altered top-down attentional modulation. To test this idea, we have used functional MRI to examine changes in attentional modulation in visual cortex while participants learn an orientation discrimination task. By examining activity in visual cortex during the preparatory period when the participant has been cued to attend to an upcoming stimulus, we isolated the top-down modulatory signal received by the visual cortex. We show that this signal changes as learning progresses, possibly reflecting gradual automation of the task. By manipulating task difficulty, we show that the change mirrors performance, occurring most quickly for easier stimuli. The effects were seen only at the retinal locus of the stimulus, ruling out a generalized change in alertness. The results suggest that spatial attention changes during perceptual learning and that this may account for some of the concomitant changes seen in visual cortex.

Tagging cortical networks in emotion: a topographical analysis

Viewing emotional pictures is associated with heightened perception and attention, indexed by a relative increase in visual cortical activity. Visual cortical modulation by emotion is hypothesized to reflect re-entrant connectivity originating in higher-order cortical and/or limbic structures. The present study used dense-array electroencephalography and individual brain anatomy to investigate functional coupling between the visual cortex and other cortical areas during affective picture viewing. Participants viewed pleasant, neutral, and unpleasant pictures that flickered at a rate of 10 Hz to evoke steady-state visual evoked potentials (ssVEPs) in the EEG. The spectral power of ssVEPs was quantified using Fourier transform, and cortical sources were estimated using beamformer spatial filters based on individual structural magnetic resonance images. In addition to lower-tier visual cortex, a network of occipito-temporal and parietal (bilateral precuneus, inferior parietal lobules) structures showed enhanced ssVEP power when participants viewed emotional (either pleasant or unpleasant), compared to neutral pictures. Functional coupling during emotional processing was enhanced between the bilateral occipital poles and a network of temporal (left middle/inferior temporal gyrus), parietal (bilateral parietal lobules), and frontal (left middle/inferior frontal gyrus) structures. These results converge with findings from hemodynamic analyses of emotional picture viewing and suggest that viewing emotionally engaging stimuli is associated with the formation of functional links between visual cortex and the cortical regions underlying attention modulation and preparation for action.

Subcortical mechanisms of feature-based attention

The degree to which spatial and feature-based attention are governed by similar control mechanisms is not clear. To explore this issue, I measured, during conditions of spatial or feature-based attention, activity in the human subcortical visual nuclei, which have precise retinotopic maps and are known to play important roles in the regulation of spatial attention but have limited selectivity of nonspatial features. Subjects attended to and detected changes in separate fields of moving or colored dots. When the fields were disjoint, spatially attending to one field enhanced hemodynamic responses in the superior colliculus (SC), lateral geniculate nucleus (LGN), and two retinotopic pulvinar nuclei. When the two dot fields were spatially overlapping, feature-based attention to the moving versus colored dots enhanced responses in the pulvinar nuclei and the majority of the LGN, including the magnocellular layers, and suppressed activity in some areas within the parvocellular layers; the SC was inconsistently modulated among subjects. The results demonstrate that feature-based attention operates throughout the visual system by prioritizing neurons encoding the attended information, including broadly tuned thalamic neurons. I conclude that spatial and feature-based attention operate via a common principle, but that spatial location is a special feature in that it is widely encoded in the brain, is used for overt orienting, and uses a specialized structure, the SC.

Effects of sleep deprivation on cortical activation during directed attention in the absence and presence of visual stimuli

Sleep deprivation (SD) can give rise to faltering attention but the mechanics underlying this remain uncertain. Using a covert attention task that required attention to a peripheral target location, we compared the effects of attention and SD on baseline activity prior to visual stimulation as well as on stimulus-evoked activity. Volunteers were studied after a night of normal sleep (RW) and a night of SD. Baseline signal elevations evoked by preparatory attention in the absence of visual stimulation were attenuated within rFEF, rIPS (sparing SEF) and all retinotopically mapped visual areas during SD, indicative of impaired endogenous attention. In response to visual stimuli, attention modulated activation in higher cortical areas and extrastriate cortex (hV4, ventral occipital areas) after RW. SD attenuated rFEF, rIPS, V3a and VO stimulus-evoked activation regardless of whether stimuli were attended. Notably, the modulation of stimulus-evoked activation by attention was not affected by SD unlike for the preparatory period, suggesting a reduced number, but still functional circuits during SD. Deficits in endogenous attention in SD dominate in the preparatory period, whereas changes in stimulus-related activation arise from an interaction between compromised fronto-parietal top-down control of attention and reduced sensitivity of extrastriate visual cortex to top-down or bottom-up inputs.

Attention does more than modulate suppressive interactions: attending to multiple items

Directing attention to a visual item enhances its representations, making it more likely to guide behavior (Corbetta et al. 1991). Attention is thought to produce this enhancement by biasing suppressive interactions among multiple items in visual cortex in favor of the attended item (e.g., Desimone and Duncan 1995; Reynolds and Heeger 2009). We ask whether target enhancement and modulation of suppressive interactions are in fact inextricably linked or whether they can be decoupled. In particular, we ask whether simultaneously directing attention to multiple items may be one means of dissociating the influence of attention-related enhancement from the effects of inter-item suppression. When multiple items are attended, suppressive interactions in visual cortex limit the effectiveness with which attention may act on their representations, presumably because "biasing" the interactions in favor of a single item is no longer possible (Scalf and Beck 2010). In this experiment, we directly investigate whether applying attention to multiple competing stimulus items has any influence on either their evoked signal or their suppressive interactions. Both BOLD signal evoked by the items in V4 and behavioral responses to those items were significantly compromised by simultaneous presentation relative to simultaneous presentation, indicating that when the items appeared at the same time, they interacted in a mutually suppressive manner that compromised their ability to guide behavior. Attention significantly enhanced signal in V4. The attentional status of the items, however, had no influence on the suppressive effects of simultaneous presentation. To our knowledge, these data are the first to explicitly decouple the effects of top-down attention from those of inter-item suppression.

Visual attention: the past 25 years

This review focuses on covert attention and how it alters early vision. I explain why attention is considered a selective process, the constructs of covert attention, spatial endogenous and exogenous attention, and feature-based attention. I explain how in the last 25 years research on attention has characterized the effects of covert attention on spatial filters and how attention influences the selection of stimuli of interest. This review includes the effects of spatial attention on discriminability and appearance in tasks mediated by contrast sensitivity and spatial resolution; the effects of feature-based attention on basic visual processes, and a comparison of the effects of spatial and feature-based attention. The emphasis of this review is on psychophysical studies, but relevant electrophysiological and neuroimaging studies and models regarding how and where neuronal responses are modulated are also discussed.

Modality-specific perceptual expectations selectively modulate baseline activity in auditory, somatosensory, and visual cortices

Valid expectations are known to improve target detection, but the preparatory attentional mechanisms underlying this perceptual facilitation remain an open issue. Using functional magnetic resonance imaging, we show here that expecting auditory, tactile, or visual targets, in the absence of stimulation, selectively increased baseline activity in corresponding sensory cortices and decreased activity in irrelevant ones. Regardless of sensory modality, expectancy activated bilateral premotor and posterior parietal areas, supplementary motor area as well as right anterior insula and right middle frontal gyrus. The bilateral putamen was sensitive to the modality specificity of expectations during the unexpected omission of targets. Thus, across modalities, detection improvement arising from selectively directing attention to a sensory modality appears mediated through transient changes in pretarget activity. This flexible advance modulation of baseline activity in sensory cortices resolves ambiguities among previous studies unable to discriminate modality-specific preparatory activity from attentional modulation of stimulus processing. Our results agree with predictive-coding models, which suggest that these expectancy-related changes reflect top-down biases--presumably originating from the observed supramodal frontoparietal network--that modulate signal-detection sensitivity by differentially modifying background activity (i.e., noise level) in different input channels. The putamen appears to code omission-related Bayesian "surprise" that depends on the specificity of predictions.

Imaging retinotopic maps in the human brain

A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.

Selective processing of multiple features in the human brain: effects of feature type and salience

Identifying targets in a stream of items at a given constant spatial location relies on selection of aspects such as color, shape, or texture. Such attended (target) features of a stimulus elicit a negative-going event-related brain potential (ERP), termed Selection Negativity (SN), which has been used as an index of selective feature processing. In two experiments, participants viewed a series of Gabor patches in which targets were defined as a specific combination of color, orientation, and shape. Distracters were composed of different combinations of color, orientation, and shape of the target stimulus. This design allows comparisons of items with and without specific target features. Consistent with previous ERP research, SN deflections extended between 160–300 ms. Data from the subsequent P3 component (300–450 ms post-stimulus) were also examined, and were regarded as an index of target processing. In Experiment A, predominant effects of target color on SN and P3 amplitudes were found, along with smaller ERP differences in response to variations of orientation and shape. Manipulating color to be less salient while enhancing the saliency of the orientation of the Gabor patch (Experiment B) led to delayed color selection and enhanced orientation selection. Topographical analyses suggested that the location of SN on the scalp reliably varies with the nature of the to-be-attended feature. No interference of non-target features on the SN was observed. These results suggest that target feature selection operates by means of electrocortical facilitation of feature-specific sensory processes, and that selective electrocortical facilitation is more effective when stimulus saliency is heightened.

Indexing the graded allocation of visuospatial attention using anticipatory alpha oscillations

Lateralization in the desynchronization of anticipatory occipitoparietal alpha (8-12 Hz) oscillations has been implicated in the allocation of selective visuospatial attention. Previous studies have demonstrated that small changes in the lateralization of alpha-band activity are predictive of behavioral performance but have not directly investigated how flexibly alpha lateralization is linked to top-down attentional goals. To address this question, we presented participants with cues providing varying degrees of spatial certainty about the location at which a target would appear. Time-frequency analysis of EEG data demonstrated that manipulating spatial certainty led to graded changes in the extent to which alpha oscillations were lateralized over the occipitoparietal cortex during the cue-target interval. We found that individual differences in alpha desynchronization contralateral to attention predicted reaction times, event-related potential measures of perceptual processing of targets, and beta-band (15-25 Hz) activity typically associated with response preparation. These results support the hypothesis that anticipatory alpha modulation is a plausible neural mechanism underlying the allocation of visuospatial attention and is under flexible top-down control.

Differential roles for frontal eye fields (FEFs) and intraparietal sulcus (IPS) in visual working memory and visual attention

Cortical activity was measured with functional magnetic resonance imaging to probe the involvement of the superior precentral sulcus (including putative human frontal eye fields, FEFs) and the intraparietal sulcus (IPS) in visual short-term memory and visual attention. In two experimental tasks, human subjects viewed two visual stimuli separated by a variable delay period. The tasks placed differential demands on short-term memory and attention, but the stimuli were visually identical until after the delay period. An earlier study (S. Offen, D. Schluppeck, & D. J. Heeger, 2009) had found a dissociation in early visual cortex that suggested different computational mechanisms underlying the two processes. In contrast, the results reported here show that the patterns of activation in prefrontal and parietal cortex were different from one another but were similar for the two tasks. In particular, the FEF showed evidence for sustained delay period activity for both the working memory and the attention task, while the IPS did not show evidence for sustained delay period activity for either task. The results imply differential roles for the FEF and IPS in these tasks; the results also suggest that feedback of sustained activity from frontal cortex to visual cortex might be gated by task demands.

The effect of attention on neuronal responses to high and low contrast stimuli

It remains unclear how attention affects the tuning of individual neurons in visual cerebral cortex. Some observations suggest that attention preferentially enhances responses to low contrast stimuli, whereas others suggest that attention proportionally affects responses to all stimuli. Resolving how attention affects responses to different stimuli is essential for understanding the mechanism by which it acts. To explore the effects of attention on stimuli of different contrasts, we recorded from individual neurons in the middle temporal visual area (MT) of rhesus monkeys while shifting their attention between preferred and nonpreferred stimuli within their receptive fields. This configuration results in robust attentional modulation that makes it possible to readily distinguish whether attention acts preferentially on low contrast stimuli. We found no evidence for greater enhancement of low contrast stimuli. Instead, the strong attentional modulations were well explained by a model in which attention proportionally enhances responses to stimuli of all contrasts. These data, together with observations on the effects of attention on responses to other stimulus dimensions, suggest that the primary effect of attention in visual cortex may be to simply increase the strength of responses to all stimuli by the same proportion.