A review of the mechanisms by which attentional feedback shapes visual selectivity

Spatial attention alters visual cortical representation during target anticipation

Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features in preparation for responding to a stimulus. Using a concurrent psychophysics- fMRI experiment, we investigated how covert spatial attention affects responses in human visual cortex prior to target onset, and how it affects subsequent behavioral performance. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention, demonstrating a selective tradeoff in processing. Pre-target BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere, paralleling the behavioral results. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties throughout and across multiple visual field maps.

Attention along the cortical hierarchy: Development matters

We build on the existing biased competition view to argue that attention is an emergent property of neural computations within and across hierarchically embedded and structurally connected cortical pathways. Critically then, one must ask, what is attention emergent from? Within this framework, developmental changes in the quality of sensory input and feedforward-feedback information flow shape the emergence and efficiency of attention. Several gradients of developing structural and functional cortical architecture across the caudal-to-rostral axis provide the substrate for attention to emerge. Neural activity within visual areas depends on neuronal density, receptive field size, tuning properties of neurons, and the location of and competition between features and objects in the visual field. These visual cortical properties highlight the information processing bottleneck attention needs to resolve. Recurrent feedforward and feedback connections convey sensory information through a series of steps at each level of the cortical hierarchy, integrating sensory information across the entire extent of the cortical hierarchy and linking sensory processing to higher-order brain regions. Higher-order regions concurrently provide input conveying behavioral context and goals. Thus, attention reflects the output of a series of complex biased competition neural computations that occur within and across hierarchically embedded cortical regions. Cortical development proceeds along the caudal-to-rostral axis, mirroring the flow in sensory information from caudal to rostral regions, and visual processing continues to develop into childhood. Examining both typical and atypical development will offer critical mechanistic insight not otherwise available in the adult stable state. This article is categorized under: Psychology > Attention.

Juvenile depletion of microglia reduces orientation but not high spatial frequency selectivity in mouse V1

Microglia contain multiple mechanisms that shape the synaptic landscape during postnatal development. Whether the synaptic changes mediated by microglia reflect the developmental refinement of neuronal responses in sensory cortices, however, remains poorly understood. In postnatal life, the development of increased orientation and spatial frequency selectivity of neuronal responses in primary visual cortex (V1) supports the emergence of high visual acuity. Here, we used the colony-stimulating factor 1 receptor (CSF1R) inhibitor PLX5622 to rapidly and durably deplete microglia in mice during the juvenile period in which increased orientation and spatial frequency selectivity emerge. Excitatory and inhibitory tuning properties were measured simultaneously using multi-photon calcium imaging in layer II/III of mouse V1. We found that microglia depletion generally increased evoked activity which, in turn, reduced orientation selectivity. Surprisingly, microglia were not required for the emergence of high spatial frequency tuned responses. In addition, microglia depletion did not perturb cortical binocularity, suggesting normal depth processing. Together, our finding that orientation and high spatial frequency selectivity in V1 are differentially supported by microglia reveal that microglia are required normal sensory processing, albeit selectively.

Selection history is relative

Visual attention can be tuned to specific features to aid in visual search. The way in which these search strategies are established and maintained is flexible, reflecting goal-directed attentional control, but can exert a persistent effect on selection that remains even when these strategies are no longer advantageous, reflecting an attentional bias driven by selection history. Apart from feature-specific search, recent studies have shown that attention can be tuned to target-nontarget relationships. Here we tested whether a relational search strategy continues to bias attention in a subsequent task, where the relationally better color and former target color both serve as distractors (Experiment 1) or as potential targets (Experiment 2). We demonstrate that a relational bias can persist in a subsequent task in which color serves as a task-irrelevant feature, both impairing and facilitating visual search performance. Our findings extend our understanding of the relational account of attentional control and the nature of selection history effects on attention.

How exogenous spatial attention affects visual representation

Orienting covert spatial attention to a target location enhances visual sensitivity and benefits performance in many visual tasks. How these attention-related improvements in performance affect the underlying visual representation of low-level visual features is not fully understood. Here we focus on characterizing how exogenous spatial attention affects the feature representations of orientation and spatial frequency. We asked observers to detect a vertical grating embedded in noise and performed psychophysical reverse correlation. Doing so allowed us to make comparisons with previous studies that utilized the same task and analysis to assess how endogenous attention and presaccadic modulations affect visual representations. We found that exogenous spatial attention improved performance and enhanced the gain of the target orientation without affecting orientation tuning width. Moreover, we found no change in spatial frequency tuning. We conclude that covert exogenous spatial attention alters performance by strictly boosting gain of orientation-selective filters, much like covert endogenous spatial attention.

Competing rhythmic neural representations of orientations during concurrent attention to multiple orientation features

When a feature is attended, all locations containing this feature are enhanced throughout the visual field. However, how the brain concurrently attends to multiple features remains unknown and cannot be easily deduced from classical attention theories. Here, we recorded human magnetoencephalography signals when subjects concurrently attended to two spatially overlapping orientations. A time-resolved multivariate inverted encoding model was employed to track the ongoing temporal courses of the neural representations of the attended orientations. We show that the two orientation representations alternate with each other and undergo a theta-band (~4 Hz) rhythmic fluctuation over time. Similar temporal profiles are also revealed in the orientation discrimination performance. Computational modeling suggests a tuning competition process between the two neuronal populations that are selectively tuned to one of the attended orientations. Taken together, our findings reveal for the first time a rhythm-based, time-multiplexing neural machinery underlying concurrent multi-feature attention.

The neural mechanisms for concurrently attending to multiple features in the visual stimuli are not well understood. Here, the authors show that the neural representations for two overlapping stimulus features alternate with each other at a ~4 Hz rhythm that was also observed in fluctuations in the task performance.

Functional MRI and EEG Index Complementary Attentional Modulations

Functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) are two noninvasive methods commonly used to study neural mechanisms supporting visual attention in humans. Studies using these tools, which have complementary spatial and temporal resolutions, implicitly assume they index similar underlying neural modulations related to external stimulus and internal attentional manipulations. Accordingly, they are often used interchangeably for constraining understanding about the impact of bottom-up and top-down factors on neural modulations. To test this core assumption, we simultaneously manipulated bottom-up sensory inputs by varying stimulus contrast and top-down cognitive modulations by changing the focus of spatial attention. Each of the male and female subjects participated in both fMRI and EEG sessions performing the same experimental paradigm. We found categorically different patterns of attentional modulation on fMRI activity in early visual cortex and early stimulus-evoked potentials measured via EEG (e.g., the P1 component and steady-state visually-evoked potentials): fMRI activation scaled additively with attention, whereas evoked EEG components scaled multiplicatively with attention. However, across longer time scales, a contralateral negative-going potential and oscillatory EEG signals in the alpha band revealed additive attentional modulation patterns like those observed with fMRI. These results challenge prior assumptions that fMRI and early stimulus-evoked potentials measured with EEG can be interchangeably used to index the same neural mechanisms of attentional modulations at different spatiotemporal scales. Instead, fMRI measures of attentional modulations are more closely linked with later EEG components and alpha-band oscillations. Considered together, hemodynamic and electrophysiological signals can jointly constrain understanding of the neural mechanisms supporting cognition.SIGNIFICANCE STATEMENT fMRI and EEG have been used as tools to measure the location and timing of attentional modulations in visual cortex and are often used interchangeably for constraining computational models under the assumption that they index similar underlying neural processes. However, by varying attentional and stimulus parameters, we found differential patterns of attentional modulations of fMRI activity in early visual cortex and commonly used stimulus-evoked potentials measured via EEG. Instead, across longer time scales, a contralateral negative-going potential and EEG oscillations in the alpha band exhibited attentional modulations similar to those observed with fMRI. Together, these results suggest that different physiological processes assayed by these complementary techniques must be jointly considered when making inferences about the neural underpinnings of cognitive operations.

The attentional template is shifted and asymmetrically sharpened by distractor context

Theories of attention hypothesize the existence of an "attentional template" that contains target features in working or long-term memory. It is often assumed that the template contents are veridical, but recent studies have found that this is not true when the distractor set is linearly separable from the target (e.g., all distractors are "yellower" than an orange-colored target). In such cases, the target representation in memory shifts away from distractor features (Navalpakkam & Itti, 2007) and develops a sharper boundary with distractors (Geng, DiQuattro, & Helm, 2017). These changes in the target template are presumed to increase the target-to-distractor psychological distinctiveness and lead to better attentional selection, but it remains unclear what characteristics of the distractor context produce shifting versus sharpening. Here, we tested the hypothesis that the template representation shifts whenever the distractor set (i.e., all of the distractors) is linearly separable from the target but asymmetrical sharpening occurs only when linearly separable distractors are highly target-similar. Our results were consistent, suggesting that template shifting and asymmetrical sharpening are 2 mechanisms that increase the representational distinctiveness of targets from expected distractors and improve visual search performance. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Age-related macular degeneration affects the optic radiation white matter projecting to locations of retinal damage

We investigated the impact of age-related macular degeneration (AMD) on visual acuity and the visual white matter. We combined an adaptive cortical atlas and diffusion-weighted magnetic resonance imaging (dMRI) and tractography to separate optic radiation (OR) projections to different retinal eccentricities in human primary visual cortex. We exploited the known anatomical organization of the OR and clinically relevant data to segment the OR into three primary components projecting to fovea, mid- and far-periphery. We measured white matter tissue properties-fractional anisotropy, linearity, planarity, sphericity-along the aforementioned three components of the optic radiation to compare AMD patients and controls. We found differences in white matter properties specific to OR white matter fascicles projecting to primary visual cortex locations corresponding to the location of retinal damage (fovea). Additionally, we show that the magnitude of white matter properties in AMD patients' correlates with visual acuity. In sum, we demonstrate a specific relation between visual loss, anatomical location of retinal damage and white matter damage in AMD patients. Importantly, we demonstrate that these changes are so profound that can be detected using magnetic resonance imaging data with clinical resolution. The conserved mapping between retinal and white matter damage suggests that retinal neurodegeneration might be a primary cause of white matter degeneration in AMD patients. The results highlight the impact of eye disease on brain tissue, a process that may become an important target to monitor during the course of treatment.

Inverted Encoding Models of Human Population Response Conflate Noise and Neural Tuning Width

Channel-encoding models offer the ability to bridge different scales of neuronal measurement by interpreting population responses, typically measured with BOLD imaging in humans, as linear sums of groups of neurons (channels) tuned for visual stimulus properties. Inverting these models to form predicted channel responses from population measurements in humans seemingly offers the potential to infer neuronal tuning properties. Here, we test the ability to make inferences about neural tuning width from inverted encoding models. We examined contrast invariance of orientation selectivity in human V1 (both sexes) and found that inverting the encoding model resulted in channel response functions that became broader with lower contrast, thus apparently violating contrast invariance. Simulations showed that this broadening could be explained by contrast-invariant single-unit tuning with the measured decrease in response amplitude at lower contrast. The decrease in response lowers the signal-to-noise ratio of population responses that results in poorer population representation of orientation. Simulations further showed that increasing signal to noise makes channel response functions less sensitive to underlying neural tuning width, and in the limit of zero noise will reconstruct the channel function assumed by the model regardless of the bandwidth of single units. We conclude that our data are consistent with contrast-invariant orientation tuning in human V1. More generally, our results demonstrate that population selectivity measures obtained by encoding models can deviate substantially from the behavior of single units because they conflate neural tuning width and noise and are therefore better used to estimate the uncertainty of decoded stimulus properties.SIGNIFICANCE STATEMENT It is widely recognized that perceptual experience arises from large populations of neurons, rather than a few single units. Yet, much theory and experiment have examined links between single units and perception. Encoding models offer a way to bridge this gap by explicitly interpreting population activity as the aggregate response of many single neurons with known tuning properties. Here we use this approach to examine contrast-invariant orientation tuning of human V1. We show with experiment and modeling that due to lower signal to noise, contrast-invariant orientation tuning of single units manifests in population response functions that broaden at lower contrast, rather than remain contrast-invariant. These results highlight the need for explicit quantitative modeling when making a reverse inference from population response profiles to single-unit responses.

Knowing where is different from knowing what: Distinct response time profiles and accuracy effects for target location, orientation, and color probability

When a location is cued, targets appearing at that location are detected more quickly. When a target feature is cued, targets bearing that feature are detected more quickly. These attentional cueing effects are only superficially similar. More detailed analyses find distinct temporal and accuracy profiles for the two different types of cues. This pattern parallels work with probability manipulations, where both feature and spatial probability are known to affect detection accuracy and reaction times. However, little has been done by way of comparing these effects. Are probability manipulations on space and features distinct? In a series of five experiments, we systematically varied spatial probability and feature probability along two dimensions (orientation or color). In addition, we decomposed response times into initiation and movement components. Targets appearing at the probable location were reported more quickly and more accurately regardless of whether the report was based on orientation or color. On the other hand, when either color probability or orientation probability was manipulated, response time and accuracy improvements were specific for that probable feature dimension. Decomposition of the response time benefits demonstrated that spatial probability only affected initiation times, whereas manipulations of feature probability affected both initiation and movement times. As detection was made more difficult, the two effects further diverged, with spatial probability disproportionally affecting initiation times and feature probability disproportionately affecting accuracy. In conclusion, all manipulations of probability, whether spatial or featural, affect detection. However, only feature probability affects perceptual precision, and precision effects are specific to the probable attribute.

Tuned by experience: How orientation probability modulates early perceptual processing

Probable stimuli are more often and more quickly detected. While stimulus probability is known to affect decision-making, it can also be explained as a perceptual phenomenon. Using spatial gratings, we have previously shown that probable orientations are also more precisely estimated, even while participants remained naive to the manipulation. We conducted an electrophysiological study to investigate the effect that probability has on perception and visual-evoked potentials. In line with previous studies on oddballs and stimulus prevalence, low-probability orientations were associated with a greater late positive 'P300' component which might be related to either surprise or decision-making. However, the early 'C1' component, thought to reflect V1 processing, was dampened for high-probability orientations while later P1 and N1 components were unaffected. Exploratory analyses revealed a participant-level correlation between C1 and P300 amplitudes, suggesting a link between perceptual processing and decision-making. We discuss how these probability effects could be indicative of sharpening of neurons preferring the probable orientations, due either to perceptual learning, or to feature-based attention.

A Multi-Factor Account of Degrees of Awareness

In this paper we argue that awareness comes in degrees, and we propose a novel multi-factor account that spans both subjective experiences and perceptual representations. At the subjective level, we argue that conscious experiences can be degraded by being fragmented, less salient, too generic, or flash-like. At the representational level, we identify corresponding features of perceptual representations-their availability for working memory, intensity, precision, and stability-and argue that the mechanisms that affect these features are what ultimately modulate the degree of awareness. We conclude the paper by demonstrating why the original interpretations of certain empirical findings that apparently pose problems for our account are, in fact, flawed.

Orientation Probability and Spatial Exogenous Cuing Improve Perceptual Precision and Response Speed by Different Mechanisms

We are faster and more accurate at detecting frequently occurring objects than infrequent ones, just as we are faster and more accurate at detecting objects that have been spatially cued. Does this behavioral similarity reflect similar processes? To evaluate this question we manipulated orientation probability and exogenous spatial cuing within a single perceptual estimation task. Both increased target probability and spatial cuing led to shorter response initiation times and more precise perceptual reports, but these effects were additive. Further, target probability changed the shape of the distribution of errors while spatial cuing did not. Different routes and independent mechanisms could lead to changes in behavioral measures that look similar to each other and to ‘attentional’ effects.

Stimulus competition mediates the joint effects of spatial and feature-based attention

Distinct attentional mechanisms enhance the sensory processing of visual stimuli that appear at task-relevant locations and have task-relevant features. We used a combination of psychophysics and computational modeling to investigate how these two types of attention--spatial and feature based--interact to modulate sensitivity when combined in one task. Observers monitored overlapping groups of dots for a target change in color saturation, which they had to localize as being in the upper or lower visual hemifield. Pre-cues indicated the target's most likely location (left/right), color (red/green), or both location and color. We measured sensitivity (d') for every combination of the location cue and the color cue, each of which could be valid, neutral, or invalid. When three competing saturation changes occurred simultaneously with the target change, there was a clear interaction: The spatial cueing effect was strongest for the cued color, and the color cueing effect was strongest at the cued location. In a second experiment, only the target dot group changed saturation, such that stimulus competition was low. The resulting cueing effects were statistically independent and additive: The color cueing effect was equally strong at attended and unattended locations. We account for these data with a computational model in which spatial and feature-based attention independently modulate the gain of sensory responses, consistent with measurements of cortical activity. Multiple responses then compete via divisive normalization. Sufficient competition creates interactions between the two cueing effects, although the attentional systems are themselves independent. This model helps reconcile seemingly disparate behavioral and physiological findings.