Competitive interactions of attentional resources in early visual cortex during sustained visuospatial attention within or between visual hemifields: evidence for the different-hemifield advantage

Willed Attentional Selection of Visual Features: An EEG Study

Visual selective attention studies generally tend to apply cuing paradigms to instructively direct observers' attention to certain locations, features or objects. However, in real situations, attention in humans often flows spontaneously without any specific instructions. Recently, a concept named "willed attention" was raised in visuospatial attention, in which participants are free to make volitional attention decisions. Several ERP components during willed attention were found, along with a perspective that ongoing alpha activity may bias the subsequent attentional choice. However, it remains unclear whether similar neural mechanisms exist in feature- or object-based willed attention. Here, we included choice cues and instruct cues in a feature-based selective attention paradigm, allowing participants to freely choose or to be instructed to attend a color for the subsequent target detection task. Pre-cue ongoing alpha oscillations, cue-evoked potentials and target-related steady-state visual evoked potentials (SSVEPs) were simultaneously measured as markers of attentional processing. As expected, SSVEP responses were similarly modulated by attention between choice and instruct cue trials. Similar to the case of spatial attention, a willed-attention component (Willed Attention Component, WAC) was isolated during the cue-related choice period by comparing choice and instruct cues. However, pre-cue ongoing alpha oscillations did not predict the color choice (yellow vs blue), as indicated by the chance level decoding accuracy (50%). Overall, our results revealed both similarities and differences between spatial and feature-based willed attention, and thus extended the understanding toward the neural mechanisms of volitional attention.

Distinct patterns of spatial attentional modulation of steady-state visual evoked magnetic fields (SSVEFs) in subdivisions of the human early visual cortex

In recent years, steady-state visual evoked potentials (SSVEPs) became an increasingly valuable tool to investigate neural dynamics of competitive attentional interactions and brain-computer interfaces. This is due to their good signal-to-noise ratio, allowing for single-trial analysis, and their ongoing oscillating nature that enables to analyze temporal dynamics of facilitation and suppression. Given the popularity of SSVEPs, it is surprising that only a few studies looked at the cortical sources of these responses. This is in particular the case when searching for studies that assessed the cortical sources of attentional SSVEP amplitude modulations. To address this issue, we used a typical spatial attention task and recorded neuromagnetic fields (MEG) while presenting frequency-tagged stimuli in the left and right visual fields, respectively. Importantly, we controlled for attentional deployment in a baseline period before the shifting cue. Subjects either attended to a central fixation cross or to two peripheral stimuli simultaneously. Results clearly showed that signal sources and attention effects were restricted to the early visual cortex: V1, V2, hMT+, precuneus, occipital-parietal, and inferior-temporal cortex. When subjects attended to central fixation first, shifting attention to one of the peripheral stimuli resulted in a significant activation increase for the to-be-attended stimulus with no activation decrease for the to-be-ignored stimulus in hMT+ and inferio-temporal cortex, but significant SSVEF decreases from V1 to occipito-parietal cortex. When attention was first deployed to both rings, shifting attention away from one ring basically resulted in a significant activation decrease in all areas for the then-to-be-ignored stimulus.

Tracking momentary fluctuations in human attention with a cognitive brain-machine interface

Selective attention produces systematic effects on neural states. It is unclear whether, conversely, momentary fluctuations in neural states have behavioral significance for attention. We investigated this question in the human brain with a cognitive brain-machine interface (cBMI) for tracking electrophysiological steady-state visually evoked potentials (SSVEPs) in real-time. Discrimination accuracy (d') was significantly higher when target stimuli were triggered at high, versus low, SSVEP power states. Target and distractor SSVEP power was uncorrelated across the hemifields, and target d' was unaffected by distractor SSVEP power states. Next, we trained participants on an auditory neurofeedback paradigm to generate biased, cross-hemispheric competitive interactions between target and distractor SSVEPs. The strongest behavioral effects emerged when competitive SSVEP dynamics unfolded at a timescale corresponding to the deployment of endogenous attention. In sum, SSVEP power dynamics provide a reliable readout of attentional state, a result with critical implications for tracking and training human attention.

Dynamics of attentional allocation to targets and distractors during visual search

There is much debate about the neural mechanisms that achieve suppression of salient distracting stimuli during visual search. The proactive suppression hypothesis asserts that if exposed to the same distractors repeatedly, these stimuli are actively inhibited before attention can be shifted to them. A contrasting proposal holds that attention is initially captured by salient distractors but is subsequently withdrawn. By concurrently measuring stimulus-driven and intrinsic brain potentials in 36 healthy human participants, we obtained converging evidence against early proactive suppression of distracting input. Salient distractors triggered negative event-related potentials (N1pc/N2pc), enhanced the steady-state visual evoked potential (SSVEP) relative to non-salient (filler) stimuli, and suppressed contralateral relative to ipsilateral alpha-band amplitudes-three electrophysiological measure associated with the allocation of attention-even though these distractors did not interfere with behavioral responses to the search targets. Furthermore, these measures indicated that both stimulus-driven and goal-driven allocations of attention occurred in conjunction with one another, with the goal-driven effect enhancing and prolonging the stimulus-driven effect. These results provide a new perspective on the traditional dichotomy between bottom-up and top-down attentional allocation. Control experiments revealed that continuous marking of the locations at which the search display items were presented resulted in a dramatic and unexpected conversion of the target-elicited N2pc into a shorter-latency N1pc in association with faster reaction times to the targets.

The neurovascular couplings between electrophysiological and hemodynamic activities in anticipatory selective attention

Selective attention is thought to involve target enhancement and distractor inhibition processes. Here, we recorded simultaneous electroencephalographic (EEG) and functional near-infrared spectroscopy (fNIRS) data from human adults when they were pre-cued by the visual field of coming target, distractor, or both of them. From the EEG data, we found alpha power relatively decreased contralaterally to the to-be-attended target, as reflected by the positive-going alpha modulation index. Late alpha power relatively increased contralaterally to the to-be-suppressed distractor, as reflected by the negative-going alpha modulation index. From the fNIRS data, we found enhancements of hemodynamic activity over the contralateral hemisphere in response to both the target and the distractor anticipation but within nonoverlapping posterior brain regions. More importantly, we described the specific neurovascular modulation between alpha power and oxygenated hemoglobin signal, which showed a positive coupling effect during target anticipation and a negative coupling effect during distractor anticipation. Such flexible neurovascular couplings between EEG oscillation and hemodynamic activity seem to play an essential role in the final behavioral outcomes. These results provide unique neurovascular evidence for the dissociation of the mechanisms of target enhancement and distractor inhibition. Individual behavioral differences can be related to individual differences in neurovascular coupling.

Preattentive facilitation of target trajectories in a dragonfly visual neuron

The ability to pursue targets in visually cluttered and distraction-rich environments is critical for predators such as dragonflies. Previously, we identified Centrifugal Small-Target Motion Detector 1 (CSTMD1), a dragonfly visual neuron likely involved in such target-tracking behaviour. CSTMD1 exhibits facilitated responses to targets moving along a continuous trajectory. Moreover, CSTMD1 competitively selects a single target out of a pair. Here, we conducted in vivo, intracellular recordings from CSTMD1 to examine the interplay between facilitation and selection, in response to the presentation of paired targets. We find that neuronal responses to both individual trajectories of simultaneous, paired targets are facilitated, rather than being constrained to the single, selected target. Additionally, switches in selection elicit suppression which is likely an important attribute underlying target pursuit. However, binocular experiments reveal these results are constrained to paired targets within the same visual hemifield, while selection of a target in one visual hemifield establishes ocular dominance that prevents facilitation or response to contralaterally presented targets. These results reveal that the dragonfly brain preattentively represents more than one target trajectory, to balance between attentional flexibility and resistance against distraction.

A dragonfly visual neuron independently facilitates responses to rival targets within the same visual field, mediating selective attention.

Emotional content overrides spatial attention

Spatial attention is our capacity to attend to or ignore particular regions of our spatial environment. However, some classes of stimuli may be able to override our efforts to ignore them. Here we assessed the relationship between involuntary attentional capture with emotional images and spatial attention at early stages of perceptual processing. Multiple scenes of unpleasant and neutral content were displayed in rapid serial visual presentation (RSVP) streams that elicited the steady-state visual evoked potential (SSVEP), a neural marker of selective attention at early visual areas. In a spatial cueing task, participants were cued to covertly attend to RSVP streams presented at 4 and 6 Hz presentation rates in the left and right visual hemifields. The task was to detect square targets occasionally displayed within the image streams, responding only to those appearing on the cued side. The RSVP streams were always neutral pictures in one visual hemifield but would unpredictably switch from neutral to aversive content in the other visual hemifield. We found that SSVEP amplitude was consistently modulated by a change in emotional valence of image streams, regardless of whether the change in content occurred in the attended or unattended spatial location, reflecting an automatic sensory amplification for affective stimuli. The present data provide further evidence in support that emotional images can attract visual processing resources independently of spatial attention allocation, and are consistent with sustained sensory facilitation of early visual areas through re-entrant feedback projections from higher-order cortical areas involved in the extraction of affective information.

Changes in visual cortical processing attenuate singleton distraction during visual search

The ability to suppress distractions is essential to successful completion of goal-directed behaviors. Several behavioral studies have recently provided strong evidence that learned suppression may be particularly efficient in reducing distractor interference. Expectations about a distractor's repeated location, color, or even presence are rapidly learned and used to attenuate interference. In this study, we use a visual search paradigm in which a color singleton, which is known to capture attention, occurs within blocks with high or low frequency. The behavioral results show reduced singleton interference during the high compared to the low frequency block (Won et al., 2019). The fMRI results provide evidence that the attenuation of distractor interference is supported by changes in singleton, target, and non-salient distractor representations within retinotopic visual cortex. These changes in visual cortex are accompanied by findings that singleton-present trials compared to non-singleton trials produce greater activation in bilateral parietal cortex, indicative of attentional capture, in low frequency, but not high frequency blocks. Together, these results suggest that the readout of saliency signals associated with an expected color singleton from visual cortex is suppressed, resulting in less competition for attentional priority in frontoparietal attentional control regions.

Development of multiple object tracking via multifocal attention

Multifocal attention is the ability to simultaneously attend to multiple objects, and is critical for typical functioning. Although adults are able to use multifocal attention, little is known about the development of this ability. In two experiments, we investigated multifocal attention in 6-8-year-old children and adults using a child-friendly, computerized multiple object tracking task designed to encourage the use of multifocal attention. We also investigated whether multifocal attention in children is deployed independently across left and right hemifields of vision, as in adults. Our results suggest that children's capacity for multifocal attention increases significantly across middle childhood. We also found evidence that at least one signature of hemifield-independent multifocal attention, the bilateral field advantage, can be observed in children. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Affective Bias without Hemispheric Competition: Evidence for Independent Processing Resources in Each Cortical Hemisphere

We assessed the extent of neural competition for attentional processing resources in early visual cortex between foveally presented task stimuli and peripheral emotional distracter images. Task-relevant and distracting stimuli were shown in rapid serial visual presentation (RSVP) streams to elicit the steady-state visual evoked potential, which serves as an electrophysiological marker of attentional resource allocation in early visual cortex. A task-related RSVP stream of symbolic letters was presented centrally at 15 Hz while distracting RSVP streams were displayed at 4 or 6 Hz in the left and right visual hemifields. These image streams always had neutral content in one visual field and would unpredictably switch from neutral to unpleasant content in the opposite visual field. We found that the steady-state visual evoked potential amplitude was consistently modulated as a function of change in emotional valence in peripheral RSVPs, indicating sensory gain in response to distracting affective content. Importantly, the facilitated processing for emotional content shown in one visual hemifield was not paralleled by any perceptual costs in response to the task-related processing in the center or the neutral image stream in the other visual hemifield. Together, our data provide further evidence for sustained sensory facilitation in favor of emotional distracters. Furthermore, these results are in line with previous reports of a “different hemifield advantage” with low-level visual stimuli and are suggestive of independent processing resources in each cortical hemisphere that operate beyond low-level visual cues, that is, with complex images that impact early stages of visual processing via reentrant feedback loops from higher order processing areas.

Spatial Attentional Selection Modulates Early Visual Stimulus Processing Independently of Visual Alpha Modulations

The capacity-limited human brain is constantly confronted with a huge amount of sensory information. Selective attention is needed for biasing neural processing towards relevant information and consequently allows meaningful interaction with the environment. Activity in the alpha-band has been proposed to be related to top-down modulation of neural inhibition and could thus represent a viable candidate to control the priority of stimulus processing. It is, however, unknown whether modulations in the alpha-band directly relate to changes in the sensory gain control of the early visual cortex. Here, we used a spatial cueing paradigm while simultaneously measuring ongoing alpha-band oscillations and steady-state visual evoked potentials (SSVEPs) as a marker of continuous early sensory processing in the human visual cortex. Thereby, the effects of spatial attention for both of these signals and their potential interactions were assessed. As expected, spatial attention modulated both alpha-band and SSVEP responses. However, their modulations were independent of each other and the corresponding activity profiles differed across task demands. Thus, our results challenge the view that modulations of alpha-band activity represent a mechanism that directly alters or controls sensory gain. The potential role of alpha-band oscillations beyond sensory processing will be discussed in light of the present results.

Hemifield Crossings during Multiple Object Tracking Affect Task Performance and Steady-State Visual Evoked Potentials

The ability to track multiple objects is important for daily life activities such as driving, but it is subject to some restrictions. One limitation concerns the hemifields in which objects move. A previous study showed that when subjects were restricted to the use of one hemifield, both the maximum number of tracked objects and the tracking accuracy were lower than when they were permitted to use both hemifields. However, daily life involves many tracked objects moving between hemifields. In this study, we investigated the effects of such hemifield crossings on behavioral performance (Behavioral experiment) and on the amplitudes and phase synchronization of steady-state visual evoked potentials (SSVEPs) (SSVEP experiment) by comparing the Within condition, in which tracked objects moved within their respective hemifields, and the Crossover condition, in which tracked objects moved between hemifields. In the Behavioral experiment, tracking performance was worse under the Crossover condition than under the Within condition. In the SSVEP experiment, SSVEP amplitudes for target and distractor frequencies differed under the Within condition but did not differ under the Crossover condition. However, phase synchronization between the left and right hemifields exhibited the opposite trend. This study provides evidence that attention to objects moving between hemifields is suppressed relative to attention to objects moving within hemifields and that Crossover tracking diminishes attentional modulation at an early sensory processing level while modulating interhemispheric functional connectivity.

Attentional Facilitation of Constituent Features of an Object Does Not Spread Automatically along Object-defining Cortical Boundaries

The integrated object account predicts that attention is spread across all features that constitute one object, regardless of their task relevance. We challenge that prediction with a novel stimulation technique that allows for simultaneous electrophysiological measurements of the allocation of attention to two distinct features within one object. A rotating square that flickers in different colors evoked two distinct steady-state visual evoked potentials (SSVEPs) for rotation and color, respectively. If the integrated object account were true, we would expect identical SSVEP amplitudes regardless of what feature participants attended. We found greater SSVEP amplitudes for the to-be-attended feature compared with the to-be-ignored feature. SSVEP amplitudes averaged across both features were significantly reduced when participants attended to both features, which was mirrored in behavioral costs, implying competitive interactions or a division of attentional resources. Surprisingly, this reduction in amplitude was mainly driven by the SSVEP amplitude elicited by color changes. In conclusion, our results challenge the integrated object account and highlight the extent to which color is "special" within feature space.

Sustained Splits of Attention within versus across Visual Hemifields Produce Distinct Spatial Gain Profiles

Visual attention can be focused concurrently on two stimuli at noncontiguous locations while intermediate stimuli remain ignored. Nevertheless, behavioral performance in multifocal attention tasks falters when attended stimuli fall within one visual hemifield as opposed to when they are distributed across left and right hemifields. This "different-hemifield advantage" has been ascribed to largely independent processing capacities of each cerebral hemisphere in early visual cortices. Here, we investigated how this advantage influences the sustained division of spatial attention. We presented six isoeccentric light-emitting diodes (LEDs) in the lower visual field, each flickering at a different frequency. Participants attended to two LEDs that were spatially separated by an intermediate LED and responded to synchronous events at to-be-attended LEDs. Task-relevant pairs of LEDs were either located in the same hemifield ("within-hemifield" conditions) or separated by the vertical meridian ("across-hemifield" conditions). Flicker-driven brain oscillations, steady-state visual evoked potentials (SSVEPs), indexed the allocation of attention to individual LEDs. Both behavioral performance and SSVEPs indicated enhanced processing of attended LED pairs during "across-hemifield" relative to "within-hemifield" conditions. Moreover, SSVEPs demonstrated effective filtering of intermediate stimuli in "across-hemifield" condition only. Thus, despite identical physical distances between LEDs of attended pairs, the spatial profiles of gain effects differed profoundly between "across-hemifield" and "within-hemifield" conditions. These findings corroborate that early cortical visual processing stages rely on hemisphere-specific processing capacities and highlight their limiting role in the concurrent allocation of visual attention to multiple locations.

Within-hemifield competition in early visual areas limits the ability to track multiple objects with attention

It is much easier to divide attention across the left and right visual hemifields than within the same visual hemifield. Here we investigate whether this benefit of dividing attention across separate visual fields is evident at early cortical processing stages. We measured the steady-state visual evoked potential, an oscillatory response of the visual cortex elicited by flickering stimuli, of moving targets and distractors while human observers performed a tracking task. The amplitude of responses at the target frequencies was larger than that of the distractor frequencies when participants tracked two targets in separate hemifields, indicating that attention can modulate early visual processing when it is divided across hemifields. However, these attentional modulations disappeared when both targets were tracked within the same hemifield. These effects were not due to differences in task performance, because accuracy was matched across the tracking conditions by adjusting target speed (with control conditions ruling out effects due to speed alone). To investigate later processing stages, we examined the P3 component over central-parietal scalp sites that was elicited by the test probe at the end of the trial. The P3 amplitude was larger for probes on targets than on distractors, regardless of whether attention was divided across or within a hemifield, indicating that these higher-level processes were not constrained by visual hemifield. These results suggest that modulating early processing stages enables more efficient target tracking, and that within-hemifield competition limits the ability to modulate multiple target representations within the hemifield maps of the early visual cortex.