Covert Attention Increases the Gain of Stimulus-Evoked Population Codes

Conflicting Sensory Information Sharpens the Neural Representations of Early Selective Visuospatial Attention

Adaptive behaviors require the ability to resolve conflicting information caused by the processing of incompatible sensory inputs. Prominent theories of attention have posited that early selective attention helps mitigate cognitive interference caused by conflicting sensory information by facilitating the processing of task-relevant sensory inputs and filtering out behaviorally irrelevant information. Surprisingly, many recent studies that investigated the role of early selective attention on conflict mitigation have failed to provide positive evidence. Here, we examined changes in the selectivity of early visuospatial attention in male and female human subjects performing an attention-cueing Eriksen flanker task, where they discriminated the shape of a visual target surrounded by congruent or incongruent distractors. We used the inverted encoding model to reconstruct spatial representations of visual selective attention from the topographical patterns of amplitude modulations in alpha band oscillations in scalp EEG (∼8-12 Hz). We found that the fidelity of the alpha-based spatial reconstruction was significantly higher in the incongruent compared with the congruent condition. Importantly, these conflict-related modulations in the reconstruction fidelity occurred at a much earlier time window than those of the lateralized posterior event-related potentials associated with target selection and distractor suppression processes, as well as conflict-related modulations in the frontocentral negative-going wave and midline-frontal theta oscillations (∼3-7 Hz), thought to track executive control functions. Taken together, our data suggest that conflict resolution is supported by the cascade of neural processes underlying early selective visuospatial attention and frontal executive functions that unfold over time.

Spatial attention alters visual cortical representation during target anticipation

Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features in preparation for responding to a stimulus. Using a concurrent psychophysics- fMRI experiment, we investigated how covert spatial attention affects responses in human visual cortex prior to target onset, and how it affects subsequent behavioral performance. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention, demonstrating a selective tradeoff in processing. Pre-target BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere, paralleling the behavioral results. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties throughout and across multiple visual field maps.

Dissociable Neural Mechanisms Underlie the Effects of Attention on Visual Appearance and Response Bias

A prominent theoretical framework spanning philosophy, psychology, and neuroscience holds that selective attention penetrates early stages of perceptual processing to alter the subjective visual experience of behaviorally relevant stimuli. For example, searching for a red apple at the grocery store might make the relevant color appear brighter and more saturated compared with seeing the exact same red apple while searching for a yellow banana. In contrast, recent proposals argue that data supporting attention-related changes in appearance reflect decision- and motor-level response biases without concurrent changes in perceptual experience. Here, we tested these accounts by evaluating attentional modulations of EEG responses recorded from male and female human subjects while they compared the perceived contrast of attended and unattended visual stimuli rendered at different levels of physical contrast. We found that attention enhanced the amplitude of the P1 component, an early evoked potential measured over visual cortex. A linking model based on signal detection theory suggests that response gain modulations of the P1 component track attention-induced changes in perceived contrast as measured with behavior. In contrast, attentional cues induced changes in the baseline amplitude of posterior alpha band oscillations (∼9-12 Hz), an effect that best accounts for cue-induced response biases, particularly when no stimuli are presented or when competing stimuli are similar and decisional uncertainty is high. The observation of dissociable neural markers that are linked to changes in subjective appearance and response bias supports a more unified theoretical account and demonstrates an approach to isolate subjective aspects of selective information processing.SIGNIFICANCE STATEMENT Does attention alter visual appearance, or does it simply induce response bias? In the present study, we examined these competing accounts using EEG and linking models based on signal detection theory. We found that response gain modulations of the visually evoked P1 component best accounted for attention-induced changes in visual appearance. In contrast, cue-induced baseline shifts in alpha band activity better explained response biases. Together, these results suggest that attention concurrently impacts visual appearance and response bias, and that these processes can be experimentally isolated.

EEG Phase Can Be Predicted with Similar Accuracy across Cognitive States after Accounting for Power and Signal-to-Noise Ratio

EEG phase is increasingly used in cognitive neuroscience, brain-computer interfaces, and closed-loop stimulation devices. However, it is unknown how accurate EEG phase prediction is across cognitive states. We determined the EEG phase prediction accuracy of parieto-occipital alpha waves across rest and task states in 484 participants over 11 public datasets. We were able to track EEG phase accurately across various cognitive conditions and datasets, especially during periods of high instantaneous alpha power and signal-to-noise ratio (SNR). Although resting states generally have higher accuracies than task states, absolute accuracy differences were small, with most of these differences attributable to EEG power and SNR. These results suggest that experiments and technologies using EEG phase should focus more on minimizing external noise and waiting for periods of high power rather than inducing a particular cognitive state.

Dynamic neural reconstructions of attended object location and features using EEG

Attention allows us to select relevant and ignore irrelevant information from our complex environments. What happens when attention shifts from one item to another? To answer this question, it is critical to have tools that accurately recover neural representations of both feature and location information with high temporal resolution. In the present study, we used human electroencephalography (EEG) and machine learning to explore how neural representations of object features and locations update across dynamic shifts of attention. We demonstrate that EEG can be used to create simultaneous time courses of neural representations of attended features (time point-by-time point inverted encoding model reconstructions) and attended location (time point-by-time point decoding) during both stable periods and across dynamic shifts of attention. Each trial presented two oriented gratings that flickered at the same frequency but had different orientations; participants were cued to attend one of them and on half of trials received a shift cue midtrial. We trained models on a stable period from Hold attention trials and then reconstructed/decoded the attended orientation/location at each time point on Shift attention trials. Our results showed that both feature reconstruction and location decoding dynamically track the shift of attention and that there may be time points during the shifting of attention when 1) feature and location representations become uncoupled and 2) both the previously attended and currently attended orientations are represented with roughly equal strength. The results offer insight into our understanding of attentional shifts, and the noninvasive techniques developed in the present study lend themselves well to a wide variety of future applications.NEW & NOTEWORTHY We used human EEG and machine learning to reconstruct neural response profiles during dynamic shifts of attention. Specifically, we demonstrated that we could simultaneously read out both location and feature information from an attended item in a multistimulus display. Moreover, we examined how that readout evolves over time during the dynamic process of attentional shifts. These results provide insight into our understanding of attention, and this technique carries substantial potential for versatile extensions and applications.

Perceptual Difficulty Regulates Attentional Gain Modulations in Human Visual Cortex

Perceptual difficulty is sometimes used to manipulate selective attention. However, these two factors are logically distinct. Selective attention is defined by priority given to specific stimuli based on their behavioral relevance, whereas perceptual difficulty is often determined by perceptual demands required to discriminate relevant stimuli. That said, both perceptual difficulty and selective attention are thought to modulate the gain of neural responses in early sensory areas. Previous studies found that selectively attending to a stimulus or increasing perceptual difficulty enhanced the gain of neurons in visual cortex. However, some other studies suggest that perceptual difficulty can have either a null or even reversed effect on gain modulations in visual cortex. According to Yerkes-Dodson's Law, it is possible that this discrepancy arises because of an interaction between perceptual difficulty and attentional gain modulations yielding a nonlinear inverted-U function. Here, we used EEG to measure modulations in the visual cortex of male and female human participants performing an attention-cueing task where we systematically manipulated perceptual difficulty across blocks of trials. The behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty: a focused-attention cue led to larger response gain in both neural and behavioral data at intermediate difficulty levels compared with when the task was more or less difficult. Moreover, difficulty-related changes in attentional gain positively correlated with those predicted by quantitative modeling of the behavioral data. These findings suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in human visual cortex.SIGNIFICANCE STATEMENT Both perceptual difficulty and selective attention are thought to influence perceptual performance by modulating response gain in early sensory areas. That said, less is known about how selective attention interacts with perceptual difficulty. Here, we measured neural gain modulations in the visual cortex of human participants performing an attention-cueing task where perceptual difficulty was systematically manipulated. Consistent with Yerkes-Dodson's Law, our behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty. These results suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in visual cortex, extending our understanding of the attentional operation under different levels of perceptual demands.

Suppression of top-down influence decreases both behavioral and V1 neuronal response sensitivity to stimulus orientations in cats

How top-down influence affects behavioral detection of visual signals and neuronal response sensitivity in the primary visual cortex (V1) remains poorly understood. This study examined both behavioral performance in stimulus orientation identification and neuronal response sensitivity to stimulus orientations in the V1 of cat before and after top-down influence of area 7 (A7) was modulated by non-invasive transcranial direct current stimulation (tDCS). Our results showed that cathode (c) but not sham (s) tDCS in A7 significantly increased the behavioral threshold in identifying stimulus orientation difference, which effect recovered after the tDCS effect vanished. Consistently, c-tDCS but not s-tDCS in A7 significantly decreased the response selectivity bias of V1 neurons for stimulus orientations, which effect could recover after withdrawal of the tDCS effect. Further analysis showed that c-tDCS induced reduction of V1 neurons in response selectivity was not resulted from alterations of neuronal preferred orientation, nor of spontaneous activity. Instead, c-tDCS in A7 significantly lowered the visually-evoked response, especially the maximum response of V1 neurons, which caused a decrease in response selectivity and signal-to-noise ratio. By contrast, s-tDCS exerted no significant effect on the responses of V1 neurons. These results indicate that top-down influence of A7 may enhance behavioral identification of stimulus orientations by increasing neuronal visually-evoked response and response selectivity in the V1.

Feature-Based Attention Multiplicatively Scales the fMRI-BOLD Contrast-Response Function

fMRI plays a key role in the study of attention. However, there remains a puzzling discrepancy between attention effects measured with fMRI and with electrophysiological methods. While electrophysiological studies find that attention increases sensory gain, amplifying stimulus-evoked neural responses by multiplicatively scaling the contrast-response function (CRF), fMRI appears to be insensitive to these multiplicative effects. Instead, fMRI studies typically find that attention produces an additive baseline shift in the BOLD signal. These findings suggest that attentional effects measured with fMRI reflect top-down inputs to visual cortex, rather than the modulation of sensory gain. If true, this drastically limits what fMRI can tell us about how attention improves sensory coding. Here, we examined whether fMRI is sensitive to multiplicative effects of attention using a feature-based attention paradigm designed to preclude any possible additive effects. We measured BOLD activity evoked by a probe stimulus in one visual hemifield while participants (6 male, 6 female) attended to the probe orientation (attended condition), or to an orthogonal orientation (unattended condition), in the other hemifield. To measure CRFs in visual areas V1-V3, we parametrically varied the contrast of the probe stimulus. In all three areas, feature-based attention increased contrast gain, improving sensitivity by shifting CRFs toward lower contrasts. In V2 and V3, we also found an increase in response gain, an increase in the responsivity of the CRF, that was greatest at inner eccentricities. These results provide clear evidence that the fMRI-BOLD signal is sensitive to multiplicative effects of attention.SIGNIFICANCE STATEMENT fMRI plays a central role in the study of attention because it allows researchers to precisely and noninvasively characterize the effects of attention throughout the brain. Electrophysiological studies have shown that attention increases sensory gain, amplifying stimulus-evoked neural responses. However, a growing body of work suggests that the BOLD signal that is measured with fMRI is not sensitive to these multiplicative effects of attention, calling into question what we can learn from fMRI about how attention improves sensory codes. Here, using a feature-based attention paradigm, we provide evidence that the BOLD signal can pick up multiplicative effects of attention.

Effects of top-down influence suppression on behavioral and V1 neuronal contrast sensitivity functions in cats

To explore the relative contributions of higher-order and primary visual cortex (V1) to visual perception, we compared cats' behavioral and V1 neuronal contrast sensitivity functions (CSF) and threshold versus external noise contrast (TvC) functions before and after top-down influence of area 7 (A7) was modulated with transcranial direct current stimulation (tDCS). We found that suppressing top-down influence of A7 with cathode-tDCS, but not sham-tDCS, reduced behavioral and neuronal contrast sensitivity in the same range of spatial frequencies and increased behavioral and neuronal contrast thresholds in the same range of external noise levels. The neuronal CSF and TvC functions were highly correlated with their behavioral counterparts both before and after the top-down suppression. Analysis of TvC functions using the Perceptual Template Model (PTM) indicated that top-down influence of A7 increased both behavioral and V1 neuronal contrast sensitivity by reducing internal additive noise and the impact of external noise.

•

Top-down suppression lowers both behavioral and V1 neuronal CSF functions

•

Top-down suppression raises both behavioral and V1 neuronal TvC functions

•

The neuronal CSFs and TvCs are highly correlated with their behavioral counterparts

•

Top-down influence lowers internal additive noise and impact of external noise in V1

Spatial and Feature-selective Attention Have Distinct, Interacting Effects on Population-level Tuning

Attention can be deployed in different ways: When searching for a taxi in New York City, we can decide where to attend (e.g., to the street) and what to attend to (e.g., yellow cars). Although we use the same word to describe both processes, nonhuman primate data suggest that these produce distinct effects on neural tuning. This has been challenging to assess in humans, but here we used an opportunity afforded by multivariate decoding of MEG data. We found that attending to an object at a particular location and attending to a particular object feature produced effects that interacted multiplicatively. The two types of attention induced distinct patterns of enhancement in occipital cortex, with feature-selective attention producing relatively more enhancement of small feature differences and spatial attention producing relatively larger effects for larger feature differences. An information flow analysis further showed that stimulus representations in occipital cortex were Granger-caused by coding in frontal cortices earlier in time and that the timing of this feedback matched the onset of attention effects. The data suggest that spatial and feature-selective attention rely on distinct neural mechanisms that arise from frontal-occipital information exchange, interacting multiplicatively to selectively enhance task-relevant information.

Suppression of top-down influence decreases neuronal excitability and contrast sensitivity in the V1 cortex of cat

How top-down influence affects neuronal activity and information encoding in the primary visual cortex (V1) remains elusive. This study examined changes of neuronal excitability and contrast sensitivity in cat V1 cortex after top-down influence of area 7 (A7) was modulated by transcranial direct current stimulation (tDCS). The neuronal excitability in V1 cortex was evaluated by visually evoked field potentials (VEPs), and contrast sensitivity (CS) was assessed by the inverse of threshold contrast of neurons in response to visual stimuli at different performance accuracy. We found that the amplitude of VEPs in V1 cortex lowered after top-down influence suppression with cathode-tDCS in A7, whereas VEPs in V1 did not change after sham-tDCS in A7 and nonvisual cortical area 5 (A5) or cathode-tDCS in A5 and lesioned A7. Moreover, the mean CS of V1 neurons decreased after cathode-tDCS but not sham-tDCS in A7, which could recover after tDCS effect vanished. Comparisons of neuronal contrast-response functions showed that cathode-tDCS increased the stimulus contrast required to generate the half-maximum response, with a weakly-correlated reduction in maximum response but not baseline response. Therefore, top-down influence of A7 enhanced neuronal excitability in V1 cortex and improved neuronal contrast sensitivity by both contrast gain and response gain.