Enhanced spatial focusing increases feature-based selection in unattended locations

Representational structures as a unifying framework for attention

Our visual system consciously processes only a subset of the incoming information. Selective attention allows us to prioritize relevant inputs, and can be allocated to features, locations, and objects. Recent advances in feature-based attention suggest that several selection principles are shared across these domains and that many differences between the effects of attention on perceptual processing can be explained by differences in the underlying representational structures. Moving forward, it can thus be useful to assess how attention changes the structure of the representational spaces over which it operates, which include the spatial organization, feature maps, and object-based coding in visual cortex. This will ultimately add to our understanding of how attention changes the flow of visual information processing more broadly.

The time course of feature-selective attention inside and outside the focus of spatial attention

Research on attentional selection of stimulus features has yielded seemingly contradictory results. On the one hand, many experiments in humans and animals have observed a "global" facilitation of attended features across the entire visual field, even when spatial attention is focused on a single location. On the other hand, several event-related potential studies in humans reported that attended features are enhanced at the attended location only. The present experiment demonstrates that these conflicting results can be explained by differences in the timing of attentional allocation inside and outside the spatial focus of attention. Participants attended to fields of either red or blue randomly moving dots on either the left or right side of fixation with the task of detecting brief coherent motion targets. Recordings of steady-state visual evoked potentials elicited by the flickering stimuli allowed concurrent measurement of the time course of feature-selective attention in visual cortex on both the attended and the unattended sides. The onset of feature-selective attentional modulation on the attended side occurred around 150 ms earlier than on the unattended side. This finding that feature-selective attention is not spatially global from the outset but extends to unattended locations after a temporal delay resolves previous contradictions between studies finding global versus hierarchical selection of features and provides insight into the fundamental relationship between feature-based and location-based (spatial) attention mechanisms.

Early sensory gain control is dominated by obligatory and global feature-based attention in top-down shifts of combined spatial and feature-based attention

What are the dynamics of global feature-based and spatial attention, when deployed together? In an attentional shifting experiment, flanked by three control experiments, we investigated neural temporal dynamics of combined attentional shifts. For this purpose, orange- and blue-frequency-tagged spatially overlapping Random Dot Kinematograms were presented in the left and right visual hemifield to elicit continuous steady-state-visual-evoked-potentials. After being initially engaged in a fixation cross task, participants were at some point in time cued to shift attention to one of the Random Dot Kinematograms, to detect and respond to brief coherent motion events, while ignoring all such events in other Random Dot Kinematograms. The analysis of steady-state visual-evoked potentials allowed us to map time courses and dynamics of early sensory-gain modulations by attention. This revealed a time-invariant amplification of the to-be attended color both at the attended and the unattended side, followed by suppression for the to-be-ignored color at attended and unattended sides. Across all experiments, global and obligatory feature-based selection dominated early sensory gain modulations, whereas spatial attention played a minor modulatory role. However, analyses of behavior and neural markers such as alpha-band activity and event-related potentials to target- and distractor-event processing, revealed clear modulations by spatial attention.

Sustained selective attention to chromatic information enhances visuocortical gain at the population level

Prior work in selective attention research has shown that colour-selective attention enhances neural activity in visuocortical areas sensitive to the attended colour while suppressing activity in areas sensitive to ignored colours. However, it is currently unclear whether this effect is limited to attending to specific colour hues or extends to chromatic information more broadly. To investigate this question, we used steady-state visual evoked potentials (ssVEPs) frequency tagging to quantify participants' visuocortical responses to specific elements embedded in arrays of flickering, randomly moving mid-complex patterns. Participants were instructed to attend to either coloured or greyscale patterns while ignoring the others. We found that attending to either coloured or greyscale patterns produced robust increases in ssVEP amplitudes both compared to ignored stimuli and to baseline. There was however no evidence of suppressed responses to ignored patterns. These findings demonstrate that attentional selection based on the presence or absence of chromatic information prompts selectively enhanced visuocortical processing but this selective amplification is not accompanied by suppression of unattended stimuli. Findings are consistent with theoretical notions that predict strong competition between specific exemplars within a given feature dimension, such as red or green, but weak competition between broadly defined stimulus categories, such as chromatic versus non-chromatic.

Distinct roles of theta and alpha oscillations in the process of contingent attentional capture

Introduction

Visual spatial attention can be captured by a salient color singleton that is contingent on the target feature. A previous study reported that theta (4-7 Hz) and alpha (8-14 Hz) oscillations were related to contingent attentional capture, but the corresponding attentional mechanisms of these oscillations remain unclear.

Methods

In this study, we analyzed the electroencephalogram data of our previous study to investigate the roles of capture-related theta and alpha oscillation activities. Different from the previous study that used color-changed placeholders as irrelevant cues, the present study adopted abrupt onsets of color singleton cues which tend to elicit phase-locked neural activities. In Experiment 1, participants completed a peripheral visual search task in which spatially uninformative color singleton cues were inside the spatial attentional window and a central rapid serial visual presentation (RSVP) task in which the same cues were outside the spatial attentional window. In Experiment 2, participants completed a color RSVP task and a size RSVP task in which the peripheral color singleton cues were contingent and not contingent on target feature, respectively.

Results

In Experiment 1, spatially uninformative color singleton cues elicited lateralized theta activities when they were contingent on target feature, irrespective of whether they were inside or outside the spatial attentional window. In contrast, the same color singleton cues elicited alpha lateralization only when they were inside the spatial attentional window. In Experiment 2, we further found that theta lateralization vanished if the color singleton cues were not contingent on target feature.

Discussion

These results suggest distinct roles of theta and alpha oscillations in the process of contingent attentional capture initiated by abrupt onsets of singleton cues. Theta activities may reflect global enhancement of target feature, while alpha activities may be related to attentional engagement to spatially relevant singleton cues. These lateralized neural oscillations, together with the distractor-elicited N2pc component, might consist of multiple stages of attentional processes during contingent attentional capture.

Attention to visual motion suppresses neuronal and behavioral sensitivity in nearby feature space

Background

Feature-based attention prioritizes the processing of the attended feature while strongly suppressing the processing of nearby ones. This creates a non-linearity or “attentional suppressive surround” predicted by the Selective Tuning model of visual attention. However, previously reported effects of feature-based attention on neuronal responses are linear, e.g., feature-similarity gain. Here, we investigated this apparent contradiction by neurophysiological and psychophysical approaches.

Results

Responses of motion direction-selective neurons in area MT/MST of monkeys were recorded during a motion task. When attention was allocated to a stimulus moving in the neurons’ preferred direction, response tuning curves showed its minimum for directions 60–90° away from the preferred direction, an attentional suppressive surround. This effect was modeled via the interaction of two Gaussian fields representing excitatory narrowly tuned and inhibitory widely tuned inputs into a neuron, with feature-based attention predominantly increasing the gain of inhibitory inputs. We further showed using a motion repulsion paradigm in humans that feature-based attention produces a similar non-linearity on motion discrimination performance.

Conclusions

Our results link the gain modulation of neuronal inputs and tuning curves examined through the feature-similarity gain lens to the attentional impact on neural population responses predicted by the Selective Tuning model, providing a unified framework for the documented effects of feature-based attention on neuronal responses and behavior.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12915-022-01428-7.

Updating the dual-mechanism model for cross-sensory attentional spreading: The influence of space-based visual selective attention

Selective attention to visual stimuli can spread cross‐modally to task‐irrelevant auditory stimuli through either the stimulus‐driven binding mechanism or the representation‐driven priming mechanism. The stimulus‐driven attentional spreading occurs whenever a task‐irrelevant sound is delivered simultaneously with a spatially attended visual stimulus, whereas the representation‐driven attentional spreading occurs only when the object representation of the sound is congruent with that of the to‐be‐attended visual object. The current study recorded event‐related potentials in a space‐selective visual object‐recognition task to examine the exact roles of space‐based visual selective attention in both the stimulus‐driven and representation‐driven cross‐modal attentional spreading, which remain controversial in the literature. Our results yielded that the representation‐driven auditory Nd component (200–400 ms after sound onset) did not differ according to whether the peripheral visual representations of audiovisual target objects were spatially attended or not, but was decreased when the auditory representations of target objects were presented alone. In contrast, the stimulus‐driven auditory Nd component (200–300 ms) was decreased but still prominent when the peripheral visual constituents of audiovisual nontarget objects were spatially unattended. These findings demonstrate not only that the representation‐driven attentional spreading is independent of space‐based visual selective attention and benefits in an all‐or‐nothing manner from object‐based visual selection for actually presented visual representations of target objects, but also that although the stimulus‐driven attentional spreading is modulated by space‐based visual selective attention, attending to visual modality per se is more likely to be the endogenous determinant of the stimulus‐driven attentional spreading.

Spatial and Feature-selective Attention Have Distinct, Interacting Effects on Population-level Tuning

Attention can be deployed in different ways: When searching for a taxi in New York City, we can decide where to attend (e.g., to the street) and what to attend to (e.g., yellow cars). Although we use the same word to describe both processes, nonhuman primate data suggest that these produce distinct effects on neural tuning. This has been challenging to assess in humans, but here we used an opportunity afforded by multivariate decoding of MEG data. We found that attending to an object at a particular location and attending to a particular object feature produced effects that interacted multiplicatively. The two types of attention induced distinct patterns of enhancement in occipital cortex, with feature-selective attention producing relatively more enhancement of small feature differences and spatial attention producing relatively larger effects for larger feature differences. An information flow analysis further showed that stimulus representations in occipital cortex were Granger-caused by coding in frontal cortices earlier in time and that the timing of this feedback matched the onset of attention effects. The data suggest that spatial and feature-selective attention rely on distinct neural mechanisms that arise from frontal-occipital information exchange, interacting multiplicatively to selectively enhance task-relevant information.

Attention expedites target selection by prioritizing the neural processing of distractor features

Whether doing the shopping, or driving the car – to navigate daily life, our brain has to rapidly identify relevant color signals among distracting ones. Despite a wealth of research, how color attention is dynamically adjusted is little understood. Previous studies suggest that the speed of feature attention depends on the time it takes to enhance the neural gain of cortical units tuned to the attended feature. To test this idea, we had human participants switch their attention on the fly between unpredicted target color alternatives, while recording the electromagnetic brain response to probes matching the target, a non-target, or a distracting alternative target color. Paradoxically, we observed a temporally prioritized processing of distractor colors. A larger neural modulation for the distractor followed by its stronger attenuation expedited target identification. Our results suggest that dynamic adjustments of feature attention involve the temporally prioritized processing and elimination of distracting feature representations.

In order to investigate underlying mechanisms of color attention, Bartsch et al measured electromagnetic brain responses in participants who were challenged to switch their attention in accordance with unpredicted target colors changes in the absence or presence of ‘distractor colors’. They demonstrated that dynamic adjustments of feature attention involve the temporally prioritized processing and elimination of distracting feature representations.

Feature-based attention is not confined by object boundaries: Spatially global enhancement of irrelevant features

Theories of visual attention differ in what they identify as the core unit of selection. Feature-based theories emphasize basic visual features (e.g., color, motion), demonstrated through enhancement of attended features throughout the visual field, while object-based theories propose that attention enhances all features belonging to the same object. These theories make distinct predictions about the processing of features that are not attended primarily: Object-based theories predict that such secondary, task-irrelevant features are enhanced within object boundaries, while feature-based theories predict enhancement of irrelevant features across locations, regardless of objecthood. To test these two accounts, we had participants attend a set of colored dots among distractor dots (moving coherently upward or downward) to detect brief luminance decreases, while simultaneously detecting speed changes in other sets of dots in the opposite visual field. In the first experiment, we demonstrate that participants have higher speed detection rates in the dot array that matched the motion direction of the attended color array, although motion direction was task-irrelevant. In a second experiment, we manipulated the probability that speed changes occurred in the matching motion direction and found that enhancement of the irrelevant motion direction persisted even when it was detrimental for task performance, suggesting that spatially global effects of feature-based attention cannot easily be flexibly adjusted. Overall, these results indicate that features that are not primarily attended are enhanced globally, surpassing object boundaries.

Distilling the distinct contralateral and ipsilateral attentional responses to lateral stimuli and the bilateral response to midline stimuli for upper and lower visual hemifield locations

A contralateral posterior negativity elicited by lateral oddballs (N2pc) and a bilateral posterior negativity elicited by vertical midline oddballs (bilateral N2) are ERP components reflecting attentional deployment that have been rarely compared. In different tasks, we explored to what extent they reflect similar underlying mechanisms of attention. We used a multiple-frame procedure to present pop-out color oddballs among distractors. A homogeneous condition contained only distractors (0 oddballs) and served as a control condition that was subtracted from oddball-present conditions to isolate attention effects. The number of oddballs and the vertical hemifield containing them (upper vs. lower) were two critical factors. For the lower hemifield, the signal amplitude increased with the number of oddballs, otherwise had similar effects and scalp distributions, suggesting the bilateral N2 acted as a bilateral N2pc and likely reflected similar underlying generators. For the upper hemifield, component amplitude also increased with the number of oddballs, but the scalp distributions were positive and more centered, suggesting inverted generators across the two vertical hemifields. An ipsilateral positivity occurred about 50 ms after a contralateral positivity, similar in magnitude, producing a biphasic contra-minus-ipsi difference wave. Previously reported smaller negative N2pc components for upper hemifield oddballs likely reflected a negative lobe artificially created by the subtraction of a lagged positive ipsilateral response. The results compel us to argue for a systematic separation of data for upper versus lower hemifields in studies of visuo-spatial attention, and the use of an experimental design permitting the separate estimation of contralateral and ipsilateral responses.

Topics and trends in artificial intelligence assisted human brain research

Artificial intelligence (AI) assisted human brain research is a dynamic interdisciplinary field with great interest, rich literature, and huge diversity. The diversity in research topics and technologies keeps increasing along with the tremendous growth in application scope of AI-assisted human brain research. A comprehensive understanding of this field is necessary to assess research efficacy, (re)allocate research resources, and conduct collaborations. This paper combines the structural topic modeling (STM) with the bibliometric analysis to automatically identify prominent research topics from the large-scale, unstructured text of AI-assisted human brain research publications in the past decade. Analyses on topical trends, correlations, and clusters reveal distinct developmental trends of these topics, promising research orientations, and diverse topical distributions in influential countries/regions and research institutes. These findings help better understand scientific and technological AI-assisted human brain research, provide insightful guidance for resource (re)allocation, and promote effective international collaborations.

Parallel attentional facilitation of features and objects in early visual cortex

Selective attention can enhance the processing of attended features across the entire visual field. Attention also spreads within objects, enhancing all internal locations and task-irrelevant features of selected objects. Here, we examine the extent to which attentional enhancement of a feature spreads across attended and unattended objects. Two fully overlapping counter-rotating bicolored surfaces of light and dark random dots were presented on a gray background of intermediate luminance. This stimulus creates a percept of two separate semitransparent surfaces and allows the measurement of feature- and object-based selections while controlling spatial attention. On each trial, human participants attended to a subset of dots defined by feature (luminance polarity) and object (surface) in order to detect brief episodes of radial motion while ignoring any events in the unattended groups of dots. Attentional selection was assessed by means of steady-state visual evoked potentials (SSVEPs) and behavioral measures. SSVEP amplitudes recorded at medial occipital electrode sites were modulated both by surface-based and luminance polarity-based selection in a manner consistent with independent multiplicative enhancement of attentional effects in different dimensions in early visual cortex. This finding supports the view that feature-based attention spreads across object boundaries, at least at an early stage of processing. However, SSVEPs elicited at more lateral electrode sites showed a hierarchical pattern of selection, potentially reflecting the binding of surface-defining features with luminance features to enable surface-based attention.

FSRFNet: Feature-Selective and Spatial Receptive Fields Networks

The attention mechanism plays a crucial role in the human visual experience. In the cognitive neuroscience community, the receptive field size of visual cortical neurons is regulated by the additive effect of feature-selective and spatial attention. We propose a novel architectural unit called a “Feature-selective and Spatial Receptive Fields” (FSRF) block that implements adaptive receptive field sizes of neurons through the additive effects of feature-selective and spatial attention. We show that FSRF blocks can be inserted into the architecture of existing convolutional neural networks to form an FSRF network architecture, and test its generalization capabilities on different datasets.