Top-Down Attention Is Limited Within but Not Between Feature Dimensions

Division and spreading of attention across color

Biological systems must allocate limited perceptual resources to relevant elements in their environment. This often requires simultaneous selection of multiple elements from the same feature dimension (e.g. color). To establish the determinants of divided attentional selection of color, we conducted an experiment that used multicolored displays with four overlapping random dot kinematograms that differed only in hue. We manipulated (i) requirement to focus attention to a single color or divide it between two colors; (ii) distances of distractor hues from target hues in a perceptual color space. We conducted a behavioral and an electroencephalographic experiment, in which each color was tagged by a specific flicker frequency and driving its own steady-state visual evoked potential. Behavioral and neural indices of attention showed several major consistencies. Concurrent selection halved the neural signature of target enhancement observed for single targets, consistent with an approximately equal division of limited resources between two hue-selective foci. Distractors interfered with behavioral performance in a context-dependent fashion but their effects were asymmetric, indicating that perceptual distance did not adequately capture attentional distance. These asymmetries point towards an important role of higher-level mechanisms such as categorization and grouping-by-color in determining the efficiency of attentional allocation in complex, multicolored scenes.

Representational structures as a unifying framework for attention

Our visual system consciously processes only a subset of the incoming information. Selective attention allows us to prioritize relevant inputs, and can be allocated to features, locations, and objects. Recent advances in feature-based attention suggest that several selection principles are shared across these domains and that many differences between the effects of attention on perceptual processing can be explained by differences in the underlying representational structures. Moving forward, it can thus be useful to assess how attention changes the structure of the representational spaces over which it operates, which include the spatial organization, feature maps, and object-based coding in visual cortex. This will ultimately add to our understanding of how attention changes the flow of visual information processing more broadly.

The time course of feature-selective attention inside and outside the focus of spatial attention

Research on attentional selection of stimulus features has yielded seemingly contradictory results. On the one hand, many experiments in humans and animals have observed a "global" facilitation of attended features across the entire visual field, even when spatial attention is focused on a single location. On the other hand, several event-related potential studies in humans reported that attended features are enhanced at the attended location only. The present experiment demonstrates that these conflicting results can be explained by differences in the timing of attentional allocation inside and outside the spatial focus of attention. Participants attended to fields of either red or blue randomly moving dots on either the left or right side of fixation with the task of detecting brief coherent motion targets. Recordings of steady-state visual evoked potentials elicited by the flickering stimuli allowed concurrent measurement of the time course of feature-selective attention in visual cortex on both the attended and the unattended sides. The onset of feature-selective attentional modulation on the attended side occurred around 150 ms earlier than on the unattended side. This finding that feature-selective attention is not spatially global from the outset but extends to unattended locations after a temporal delay resolves previous contradictions between studies finding global versus hierarchical selection of features and provides insight into the fundamental relationship between feature-based and location-based (spatial) attention mechanisms.

Attentional Modulation in Early Visual Cortex: A Focused Reanalysis of Steady-state Visual Evoked Potential Studies

Steady-state visual evoked potentials (SSVEPs) are a powerful tool for investigating selective attention. Here, we conducted a combined reanalysis of multiple studies employing this technique in a variety of attentional experiments to, first, establish benchmark effect sizes of attention on amplitude and phase of SSVEPs and, second, harness the power of a large data set to test more specific hypotheses. Data of eight published SSVEP studies were combined, in which human participants (n = 135 in total) attended to flickering random dot stimuli based on their defining features (e.g., location, color, luminance, or orientation) or feature conjunctions. The reanalysis established that, in all the studies, attention reliably enhanced amplitudes, with color-based attention providing the strongest effect. In addition, the latency of SSVEPs elicited by attended stimuli was reduced by ∼4 msec. Next, we investigated the modulation of SSVEP amplitudes in a subset of studies where two different features were attended concurrently. Although most models assume that attentional effects of multiple features are combined additively, our results suggest that neuronal enhancement provided by concurrent attention is better described by multiplicative integration. Finally, we used the combined data set to demonstrate that the increase in trial-averaged SSVEP amplitudes with attention cannot be explained by increased synchronization of single-trial phases. Contrary to the prediction of the phase-locking account, the variance across trials of complex Fourier coefficients increases with attention, which is more consistent with boosting of a largely phase-locked signal embedded in non-phase-locked noise.

Early sensory gain control is dominated by obligatory and global feature-based attention in top-down shifts of combined spatial and feature-based attention

What are the dynamics of global feature-based and spatial attention, when deployed together? In an attentional shifting experiment, flanked by three control experiments, we investigated neural temporal dynamics of combined attentional shifts. For this purpose, orange- and blue-frequency-tagged spatially overlapping Random Dot Kinematograms were presented in the left and right visual hemifield to elicit continuous steady-state-visual-evoked-potentials. After being initially engaged in a fixation cross task, participants were at some point in time cued to shift attention to one of the Random Dot Kinematograms, to detect and respond to brief coherent motion events, while ignoring all such events in other Random Dot Kinematograms. The analysis of steady-state visual-evoked potentials allowed us to map time courses and dynamics of early sensory-gain modulations by attention. This revealed a time-invariant amplification of the to-be attended color both at the attended and the unattended side, followed by suppression for the to-be-ignored color at attended and unattended sides. Across all experiments, global and obligatory feature-based selection dominated early sensory gain modulations, whereas spatial attention played a minor modulatory role. However, analyses of behavior and neural markers such as alpha-band activity and event-related potentials to target- and distractor-event processing, revealed clear modulations by spatial attention.

Sustained selective attention to chromatic information enhances visuocortical gain at the population level

Prior work in selective attention research has shown that colour-selective attention enhances neural activity in visuocortical areas sensitive to the attended colour while suppressing activity in areas sensitive to ignored colours. However, it is currently unclear whether this effect is limited to attending to specific colour hues or extends to chromatic information more broadly. To investigate this question, we used steady-state visual evoked potentials (ssVEPs) frequency tagging to quantify participants' visuocortical responses to specific elements embedded in arrays of flickering, randomly moving mid-complex patterns. Participants were instructed to attend to either coloured or greyscale patterns while ignoring the others. We found that attending to either coloured or greyscale patterns produced robust increases in ssVEP amplitudes both compared to ignored stimuli and to baseline. There was however no evidence of suppressed responses to ignored patterns. These findings demonstrate that attentional selection based on the presence or absence of chromatic information prompts selectively enhanced visuocortical processing but this selective amplification is not accompanied by suppression of unattended stimuli. Findings are consistent with theoretical notions that predict strong competition between specific exemplars within a given feature dimension, such as red or green, but weak competition between broadly defined stimulus categories, such as chromatic versus non-chromatic.

Attentional modulation as a mechanism for enhanced facial emotion discrimination: The case of action video game players

Action video game players (AVGPs) outperform nonvideo game players (NVGPs) on a wide variety of attentional tasks, mediating benefits to perceptual and cognitive decision processes. A key issue in the literature is the extent to which such benefits transfer beyond cognition. Using steady-state visual evoked potentials (SSVEP) as a neural measure of attentional resource allocation, we investigated whether the attentional benefit of AVGPs generalizes to the processing of rapidly presented facial emotions. AVGPs (n = 36) and NVGPs (n = 32) performed a novel, attention-demanding emotion discrimination task, requiring the identification of a target emotion in one of two laterally presented streams of emotional faces. The emotional faces flickered at either 2.0 Hz or 2.5 Hz. AVGPs outperformed NVGPs at detecting the target emotions regardless of the type of emotion. Correspondingly, attentional modulation of the SSVEP at parieto-occipital recording sites was larger in AVGPs compared with NVGPs. This difference appeared to be driven by a larger response to attended information, as opposed to a reduced response to irrelevant distractor information. Exploratory analyses confirmed that this novel paradigm elicited the expected pattern of event-related potentials associated with target detection and error processing. These components did not, however, differ between groups. Overall, the results indicate enhanced discrimination of facial emotions in AVGPs arising from enhanced attentional processing of emotional information. This presents evidence for the attentional advantage of AVGPs to extend beyond perceptual and cognitive processes.

Global attentional selection of visual features is not associated with selective modulation of posterior alpha-band activity

Attending to a single feature, such as color or motion, leads to global modulation of neural processing associated with the representation of the attended features. Alpha-band modulations are hypothesized to be a marker (and even a mechanism) of the modulation of neural processing. By adopting a previously used attentional shifting paradigm, we examined whether alpha-band dynamics are linked to sustained Feature-Based-Attentional (FBA) selection. For this purpose, we presented task-irrelevant flickering random dot kinematograms (RDKs) in the periphery that either did or did not share the to-be-attended color of centrally presented task-relevant RDKs and should thus be subject to global FBA selection. Steady-state visual evoked potentials (SSVEPs) and alpha-band activity associated with these task-irrelevant RDKs were analyzed to quantify FBA modulation. Overall, the SSVEP results replicated previous findings: relative to a pre-cue baseline, SSVEP amplitudes for peripheral RDKs were significantly enhanced when these RDKs shared the to-be-attended color of the central RDKs and were not modulated when they shared the centrally to-be-ignored color. Nevertheless, there were no differences in alpha-band amplitude modulations between signals recorded contralateral to the RDKs sharing the centrally attended color and RDKs sharing the centrally ignored color. Hence, alpha-band modulations seem not to index the sustained global selection of attended over unattended feature values within the same feature dimension.

Attentional Enhancement of Tracked Stimuli in Early Visual Cortex Has Limited Capacity

Keeping track of the location of multiple moving objects is one of the well documented functions of visual attention. However, the mechanism of attentional selection that supports such continuous tracking is unclear. In particular, it has been proposed that target selection in early visual cortex occurs in parallel, with tracking errors arising because of attentional limitations at later processing stages. Here, we examine whether, instead, total attentional capacity for enhancement of early visual processing of tracked targets is shared between all attended stimuli. If the magnitude of attentional facilitation of multiple tracked targets was a key limiting factor of tracking ability, then one should expect it to drop systematically with increasing set-size of tracked targets. Human observers (male and female) were instructed to track two, four, or six moving objects among a pool of identical distractors. Steady-state visual evoked potentials (SSVEPs) recorded during the tracking period revealed that the processing of tracked targets was consistently amplified compared with the processing of the distractors. The magnitude of this amplification decreased with increasing set size, and at lateral occipital electrodes it closely followed inverse proportionality to the number of tracked items, suggesting that limited attentional resources must be shared among the tracked stimuli. Accordingly, the magnitude of attentional facilitation predicted the behavioral outcome at the end of the trial. Together, these findings demonstrate that the limitations of multiple object tracking (MOT) across set-sizes stem from the limitations of top-down selective attention already at the early stages of visual processing.SIGNIFICANCE STATEMENT The ability to selectively attend to relevant features or objects is the key to flexibility of perception and action in the continuously changing environment. This ability is demonstrated in the multiple object tracking (MOT) task where observers monitor multiple independently moving objects at different locations in the visual field. The role of early attentional enhancement in tracking was previously acknowledged in the literature, however, the limitations on tracking were thought to arise during later stages of processing. Here, we demonstrate that the strength of attentional facilitation depends on the number of tracked objects and predicts successful tracking performance. Thus, it is the limitations of attentional enhancement at the early stages of visual processing that determine behavioral performance limits.

Steady-State Visually Evoked Potentials and Feature-based Attention: Preregistered Null Results and a Focused Review of Methodological Considerations

Feature-based attention is the ability to selectively attend to a particular feature (e.g., attend to red but not green items while looking for the ketchup bottle in your refrigerator), and steady-state visually evoked potentials (SSVEPs) measured from the human EEG signal have been used to track the neural deployment of feature-based attention. Although many published studies suggest that we can use trial-by-trial cues to enhance relevant feature information (i.e., greater SSVEP response to the cued color), there is ongoing debate about whether participants may likewise use trial-by-trial cues to voluntarily ignore a particular feature. Here, we report the results of a preregistered study in which participants either were cued to attend or to ignore a color. Counter to prior work, we found no attention-related modulation of the SSVEP response in either cue condition. However, positive control analyses revealed that participants paid some degree of attention to the cued color (i.e., we observed a greater P300 component to targets in the attended vs. the unattended color). In light of these unexpected null results, we conducted a focused review of methodological considerations for studies of feature-based attention using SSVEPs. In the review, we quantify potentially important stimulus parameters that have been used in the past (e.g., stimulation frequency, trial counts) and we discuss the potential importance of these and other task factors (e.g., feature-based priming) for SSVEP studies.

The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli

Steady-state visual evoked potential (SSVEP) is a periodic response to a repetitive visual stimulus at a specific frequency. Currently, SSVEP is widely treated as an attention tag in cognitive activities and is used as an input signal for brain-computer interfaces (BCIs). However, whether SSVEP can be used as a reliable indicator has been a controversial issue. We focused on the independence of SSVEP from frequency allocation and number of stimuli. First, a cue-target paradigm was adopted to examine the interaction between SSVEPs evoked by two stimuli with different frequency allocations under different attention conditions. Second, we explored whether signal strength and the performance of SSVEP-based BCIs were affected by the number of stimuli. The results revealed that no significant interaction of SSVEP responses appeared between attended and unattended stimuli under various frequency allocations, regardless of their appearance in the fundamental or second-order harmonic. The amplitude of SSVEP suffered no significant gain or loss under different numbers of stimuli, but the performance of SSVEP-based BCIs varied along with duration of stimuli; that is, the recognition rate was not affected by the number of stimuli when the duration of stimuli was long enough, while the information transfer rate (ITR) presented the opposite trend. It can be concluded that SSVEP is a reliable tool for marking and monitoring multiple stimuli simultaneously in cognitive studies, but much caution should be taken when choosing a suitable duration and the number of stimuli, in order to achieve optimal utility of BCIs in the future.

In search of exogenous feature-based attention

Visual attention prioritizes the processing of sensory information at specific spatial locations (spatial attention; SA) or with specific feature values (feature-based attention; FBA). SA is well characterized in terms of behavior, brain activity, and temporal dynamics-for both top-down (endogenous) and bottom-up (exogenous) spatial orienting. FBA has been thoroughly studied in terms of top-down endogenous orienting, but much less is known about the potential of bottom-up exogenous influences of FBA. Here, in four experiments, we adapted a procedure used in two previous studies that reported exogenous FBA effects, with the goal of replicating and expanding on these findings, especially regarding its temporal dynamics. Unlike the two previous studies, we did not find significant effects of exogenous FBA. This was true (1) whether accuracy or RT was prioritized as the main measure, (2) with precues presented peripherally or centrally, (3) with cue-to-stimulus ISIs of varying durations, (4) with four or eight possible target locations, (5) at different meridians, (6) with either brief or long stimulus presentations, (7) and with either fixation contingent or noncontingent stimulus displays. In the last experiment, a postexperiment participant questionnaire indicated that only a small subset of participants, who mistakenly believed the irrelevant color of the precue indicated which stimulus was the target, exhibited benefits for valid exogenous FBA precues. Overall, we conclude that with the protocol used in the studies reporting exogenous FBA, the exogenous stimulus-driven influence of FBA is elusive at best, and that FBA is primarily a top-down, goal-driven process.

Parallel attentional facilitation of features and objects in early visual cortex

Selective attention can enhance the processing of attended features across the entire visual field. Attention also spreads within objects, enhancing all internal locations and task-irrelevant features of selected objects. Here, we examine the extent to which attentional enhancement of a feature spreads across attended and unattended objects. Two fully overlapping counter-rotating bicolored surfaces of light and dark random dots were presented on a gray background of intermediate luminance. This stimulus creates a percept of two separate semitransparent surfaces and allows the measurement of feature- and object-based selections while controlling spatial attention. On each trial, human participants attended to a subset of dots defined by feature (luminance polarity) and object (surface) in order to detect brief episodes of radial motion while ignoring any events in the unattended groups of dots. Attentional selection was assessed by means of steady-state visual evoked potentials (SSVEPs) and behavioral measures. SSVEP amplitudes recorded at medial occipital electrode sites were modulated both by surface-based and luminance polarity-based selection in a manner consistent with independent multiplicative enhancement of attentional effects in different dimensions in early visual cortex. This finding supports the view that feature-based attention spreads across object boundaries, at least at an early stage of processing. However, SSVEPs elicited at more lateral electrode sites showed a hierarchical pattern of selection, potentially reflecting the binding of surface-defining features with luminance features to enable surface-based attention.