Neural basis of visual selective attention

Separate and overlapping mechanisms of statistical regularities and salience processing in the occipital cortex and dorsal attention network

Attention selects behaviorally relevant inputs for in-depth processing. Beside the role of traditional signals related to goal-directed and stimulus-driven control, a debate exists regarding the mechanisms governing the effect of statistical regularities on attentional selection, and how these are integrated with other control signals. Using a visuo-spatial search task under fMRI, we tested the joint effects of statistical regularities and stimulus-driven salience. We found that both types of signals modulated occipital activity in a spatially specific manner. Salience acted primarily by reducing the attention bias towards the target location when associated with irrelevant distractors, while statistical regularities reduced this attention bias when the target was presented at a low probability location, particularly at the lower levels of the visual hierarchy. In addition, we found that both statistical regularities and salience activated the dorsal frontoparietal network. Additional exploratory analyses of functional connectivity revealed that only statistical regularities modulated the inter-regional coupling between the posterior parietal cortex and the occipital cortex. These results show that statistical regularities and salience signals are both spatially represented at the occipital level, but that their integration into attentional processing priorities relies on dissociable brain mechanisms.

Dynamic attention signalling in V4: Relation to fast-spiking/non-fast-spiking cell class and population coupling

The computational role of a neuron during attention depends on its firing properties, neurotransmitter expression and functional connectivity. Neurons in the visual cortical area V4 are reliably engaged by selective attention but exhibit diversity in the effect of attention on firing rates and correlated variability. It remains unclear what specific neuronal properties shape these attention effects. In this study, we quantitatively characterised the distribution of attention modulation of firing rates across populations of V4 neurons. Neurons exhibited a continuum of time-varying attention effects. At one end of the continuum, neurons' spontaneous firing rates were slightly depressed with attention (compared to when unattended), whereas their stimulus responses were enhanced with attention. The other end of the continuum showed the converse pattern: attention depressed stimulus responses but increased spontaneous activity. We tested whether the particular pattern of time-varying attention effects that a neuron exhibited was related to the shape of their actions potentials (so-called 'fast-spiking' [FS] neurons have been linked to inhibition) and the strength of their coupling to the overall population. We found an interdependence among neural attention effects, neuron type and population coupling. In particular, we found neurons for which attention enhanced spontaneous activity but suppressed stimulus responses were less likely to be fast-spiking (more likely to be non-fast-spiking) and tended to have stronger population coupling, compared to neurons with other types of attention effects. These results add important information to our understanding of visual attention circuits at the cellular level.

Dynamic causal interactions between occipital and parietal cortex explain how endogenous spatial attention and stimulus-driven salience jointly shape the distribution of processing priorities in 2D visual space

Visuo-spatial attention prioritizes the processing of relevant inputs via different types of signals, including current goals and stimulus salience. Complex mixtures of these signals engage in everyday life situations, but little is known about how these signals jointly modulate distributed patterns of activity across the occipital regions that represent visual space. Here, we measured spatio-topic, quadrant-specific occipital activity during the processing of visual displays containing both task-relevant targets and salient color-singletons. We computed spatial bias vectors indexing the effect of attention in 2D space, as coded by distributed activity in the occipital cortex. We found that goal-directed spatial attention biased activity towards the target and that salience further modulated this endogenous effect: salient distractors decreased the spatial bias, while salient targets increased it. Analyses of effective connectivity revealed that the processing of salient distractors relied on the modulation of the bidirectional connectivity between the occipital and the posterior parietal cortex, as well as the modulation of the lateral interactions within the occipital cortex. These findings demonstrate that goal-directed attention and salience jointly contribute to shaping processing priorities in the occipital cortex and highlight that multiple functional paths determine how spatial information about these signals is distributed across occipital regions.

A causal role for the right frontal eye fields in value comparison

Recent studies have suggested close functional links between overt visual attention and decision making. This suggests that the corresponding mechanisms may interface in brain regions known to be crucial for guiding visual attention - such as the frontal eye field (FEF). Here, we combined brain stimulation, eye tracking, and computational approaches to explore this possibility. We show that inhibitory transcranial magnetic stimulation (TMS) over the right FEF has a causal impact on decision making, reducing the effect of gaze dwell time on choice while also increasing reaction times. We computationally characterize this putative mechanism by using the attentional drift diffusion model (aDDM), which reveals that FEF inhibition reduces the relative discounting of the non-fixated option in the comparison process. Our findings establish an important causal role of the right FEF in choice, elucidate the underlying mechanism, and provide support for one of the key causal hypotheses associated with the aDDM.

Statistical learning of target selection and distractor suppression shape attentional priority according to different timeframes

Recent findings suggest that attentional and oculomotor control is heavily affected by past experience, giving rise to selection and suppression history effects, so that target selection is facilitated if they appear at frequently attended locations, and distractor filtering is facilitated at frequently ignored locations. While selection history effects once instantiated seem to be long-lasting, whether suppression history is similarly durable is still debated. We assessed the permanence of these effects in a unique experimental setting investigating eye-movements, where the locations associated with statistical unbalances were exclusively linked with either target selection or distractor suppression. Experiment 1 and 2 explored the survival of suppression history in the long and in the short term, respectively, revealing that its lingering traces are relatively short lived. Experiment 3 showed that in the very same experimental context, selection history effects were long lasting. These results seem to suggest that different mechanisms support the learning-induced plasticity triggered by selection and suppression history. Specifically, while selection history may depend on lasting changes within stored representations of the visual space, suppression history effects hinge instead on a functional plasticity which is transient in nature, and involves spatial representations which are constantly updated and adaptively sustain ongoing oculomotor control.

A Temporal Sampling Basis for Visual Processing in Developmental Dyslexia

Knowledge of oscillatory entrainment and its fundamental role in cognitive and behavioral processing has increasingly been applied to research in the field of reading and developmental dyslexia. Growing evidence indicates that oscillatory entrainment to theta frequency spoken language in the auditory domain, along with cross-frequency theta-gamma coupling, support phonological processing (i.e., cognitive encoding of linguistic knowledge gathered from speech) which is required for reading. This theory is called the temporal sampling framework (TSF) and can extend to developmental dyslexia, such that inadequate temporal sampling of speech-sounds in people with dyslexia results in poor theta oscillatory entrainment in the auditory domain, and thus a phonological processing deficit which hinders reading ability. We suggest that inadequate theta oscillations in the visual domain might account for the many magno-dorsal processing, oculomotor control and visual deficits seen in developmental dyslexia. We propose two possible models of a magno-dorsal visual correlate to the auditory TSF: (1) A direct correlate that involves "bottom-up" magnocellular oscillatory entrainment of the visual domain that occurs when magnocellular populations phase lock to theta frequency fixations during reading and (2) an inverse correlate whereby attending to text triggers "top-down" low gamma signals from higher-order visual processing areas, thereby organizing magnocellular populations to synchronize to a theta frequency to drive the temporal control of oculomotor movements and capturing of letter images at a higher frequency.

Probing the Neural Mechanisms for Distractor Filtering and Their History-Contingent Modulation by Means of TMS

In visual search, the presence of a salient, yet task-irrelevant, distractor in the stimulus array interferes with target selection and slows down performance. Neuroimaging data point to a key role of the frontoparietal dorsal attention network in dealing with visual distractors; however, the respective roles of different nodes within the network and their hemispheric specialization are still unresolved. Here, we used transcranial magnetic stimulation (TMS) to evaluate the causal role of two key regions of the dorsal attention network in resisting attentional capture by a salient singleton distractor: the frontal eye field (FEF) and the cortex within the intraparietal sulcus (IPS). The task of the participants (male/female human volunteers) was to discriminate the pointing direction of a target arrow while ignoring a task-irrelevant salient distractor. Immediately after stimulus onset, triple-pulse 10 Hz TMS was delivered either to IPS or FEF on either side of the brain. Results indicated that TMS over the right FEF significantly reduced the behavioral cost engendered by the salient distractor relative to left FEF stimulation. No such effect was obtained with stimulation of IPS on either side of brain. Interestingly, this FEF-dependent reduction in distractor interference interacted with the contingent trial history, being maximal when no distractor was present on the previous trial relative to when there was one. Our results provide direct causal evidence that the right FEF houses key mechanisms for distractor filtering, pointing to a pivotal role of the frontal cortex of the right hemisphere in limiting interference from an irrelevant but attention-grabbing stimulus.SIGNIFICANCE STATEMENT Visually conspicuous stimuli attract our attention automatically and interfere with performance by diverting resources away from the main task. Here, we applied transcranial magnetic stimulation over four frontoparietal cortex locations (frontal eye field and intraparietal sulcus in each hemisphere) to identify regions of the dorsal attention network that help limit interference from task-irrelevant, salient distractors. Results indicate that the right FEF participates in distractor-filtering mechanisms that are recruited when a distracting stimulus is encountered. Moreover, right FEF implements adjustments in distraction-filtering mechanisms following recent encounters with distractors. Together, these findings indicate a different hemispheric contribution of the left versus right dorsal frontal cortex to distraction filtering. This study expands our understanding of how our brains select relevant targets in the face of task-irrelevant, salient distractors.

Representation of shape, space, and attention in monkey cortex

Attentional deficits are core to numerous developmental, neurological, and psychiatric disorders. At the single-cell level, much knowledge has been garnered from studies of shape and spatial properties, as well as from numerous demonstrations of attentional modulation of those properties. Despite this wealth of knowledge of single-cell responses across many brain regions, little is known about how these cellular characteristics relate to population level representations and how such representations relate to behavior; in particular, how these cellular responses relate to the representation of shape, space, and attention, and how these representations differ across cortical areas and streams. Here we will emphasize the role of population coding as a missing link for connecting single-cell properties with behavior. Using a data-driven intrinsic approach to population decoding, we show that both 'what' and 'where' cortical visual streams encode shape, space, and attention, yet demonstrate striking differences in these representations. We suggest that both pathways fully process shape and space, but that differences in representation may arise due to their differing functions and input and output constraints. Moreover, differences in the effects of attention on shape and spatial population representations in the two visual streams suggest two distinct strategies: in a ventral area, attention or task demands modulate the population representations themselves (perhaps to expand or enhance one part at the expense of other parts) while in a dorsal area, at a population representation level, attention effects are weak and nearly non-existent, perhaps in order to maintain veridical representations needed for visuomotor control. We show that an intrinsic approach, as opposed to theory-driven and labeled approaches, is useful for understanding how representations develop and differ across brain regions. Most importantly, these approaches help link cellular properties more tightly with behavior, a much-needed step to better understand and interpret cellular findings and key to providing insights to improve interventions in human disorders.

Revealing Dissociable Attention Biases in Chronic Smokers Through an Individual-Differences Approach

Addiction is accompanied by attentional biases (AB), wherein drug-related cues grab attention independently of their perceptual salience. AB have emerged in different flavours depending on the experimental approach, and their clinical relevance is still debated. In chronic smokers we sought evidence for dissociable attention abnormalities that may play distinct roles in the clinical manifestations of the disorder. Fifty smokers performed a modified visual probe-task measuring two forms of AB and their temporal dynamics, and data on their personality traits and smoking history/status were collected. Two fully dissociable AB effects were found: A Global effect, reflecting the overall impact of smoke cues on attention, and a Location-specific effect, indexing the impact of smoke cues on visuospatial orienting. Importantly, the two effects could be neatly separated from one another as they: (i) unfolded with dissimilar temporal dynamics, (ii) were accounted for by different sets of predictors associated with personality traits and smoking history and (iii) were not correlated with one another. Importantly, the relevance of each of these two components in the single individual depends on a complex blend of personality traits and smoking habits, a result that future efforts addressing the clinical relevance of addiction-related AB should take into careful consideration.

Functionally defined white matter of the macaque monkey brain reveals a dorso-ventral attention network

Classical studies of attention have identified areas of parietal and frontal cortex as sources of attentional control. Recently, a ventral region in the macaque temporal cortex, the posterior infero-temporal dorsal area PITd, has been suggested as a third attentional control area. This raises the question of whether and how spatially distant areas coordinate a joint focus of attention. Here we tested the hypothesis that parieto-frontal attention areas and PITd are directly interconnected. By combining functional MRI with ex-vivo high-resolution diffusion MRI, we found that PITd and dorsal attention areas are all directly connected through three specific fascicles. These results ascribe a new function, the communication of attention signals, to two known fiber-bundles, highlight the importance of vertical interactions across the two visual streams, and imply that the control of endogenous attention, hitherto thought to reside in macaque dorsal cortical areas, is exerted by a dorso-ventral network.

Cross-modal integration during value-driven attentional capture

A growing body of evidence suggests that reward may be a powerful determinant of attentional selection. To date, the study of value-based attentional capture has been mainly focused on the visual sensory modality. It is yet unknown how reward information is communicated and integrated across the different senses in order to resolve between competing choices during selective attention. Our study investigated the interference produced by an auditory reward-associated distractor when a semantically-related visual target was concurrently presented. We measured both manual and saccadic response times towards a target image (drum or trumpet), while an irrelevant sound (congruent or incongruent instrument) was heard. Each sound was previously associated with either a high or a low reward. We found that manual responses were slowed by a high-reward auditory distractor when sound and image were semantically congruent. A similar effect was observed for saccadic responses, but only for participants aware of the past reward contingencies. Auditory events associated with reward value were thus capable of involuntarily capturing attention in the visual modality. This reward effect can mitigate cross-modal semantic integration and appears to be differentially modulated by awareness for saccadic vs. manual responses. Together, our results extend previous work on value-driven attentional biases in perception by showing that these may operate across sensory modalities and override cross-modal integration for semantically-related stimuli. This study sheds new light on the potential implication of brain regions underlying value-driven attention across sensory modalities.

Feature predictiveness and selective attention in pigeons' categorization learning

Prior categorization studies have shown that pigeons reliably track features that are perfect predictors of category membership (Castro & Wasserman, 2014, 2016a). One might further ask whether pigeons would also track features that are relevant, but imperfect predictors of category membership. In our present project, pigeons had to categorize multiple exemplars from 2 different artificial categories, in which the exemplars were composed of 4 different features that were associated with 1 of 2 different report responses. Each exemplar contained 1 feature that perfectly predicted category membership; 1 feature that imperfectly predicted category membership; and, 2 irrelevant features that did not predict category membership. We monitored pigeons' choice accuracy as well as the location of their pecks to each of the 4 exemplar features to determine to which attributes the birds attended. As categorization accuracy rose, pecks to the perfect predictor of each category rose as well. Pigeons also showed evidence of attending more to the imperfect predictor than to the irrelevant features, but to a lesser degree. Overall, our results provide evidence of selective attention in pigeons' categorization behavior. (PsycINFO Database Record

Visual Working Memory Enhances the Neural Response to Matching Visual Input

Visual working memory (VWM) is used to maintain visual information available for subsequent goal-directed behavior. The content of VWM has been shown to affect the behavioral response to concurrent visual input, suggesting that visual representations originating from VWM and from sensory input draw upon a shared neural substrate (i.e., a sensory recruitment stance on VWM storage). Here, we hypothesized that visual information maintained in VWM would enhance the neural response to concurrent visual input that matches the content of VWM. To test this hypothesis, we measured fMRI BOLD responses to task-irrelevant stimuli acquired from 15 human participants (three males) performing a concurrent delayed match-to-sample task. In this task, observers were sequentially presented with two shape stimuli and a retro-cue indicating which of the two shapes should be memorized for subsequent recognition. During the retention interval, a task-irrelevant shape (the probe) was briefly presented in the peripheral visual field, which could either match or mismatch the shape category of the memorized stimulus. We show that this probe stimulus elicited a stronger BOLD response, and allowed for increased shape-classification performance, when it matched rather than mismatched the concurrently memorized content, despite identical visual stimulation. Our results demonstrate that VWM enhances the neural response to concurrent visual input in a content-specific way. This finding is consistent with the view that neural populations involved in sensory processing are recruited for VWM storage, and it provides a common explanation for a plethora of behavioral studies in which VWM-matching visual input elicits a stronger behavioral and perceptual response.SIGNIFICANCE STATEMENT Humans heavily rely on visual information to interact with their environment and frequently must memorize such information for later use. Visual working memory allows for maintaining such visual information in the mind's eye after termination of its retinal input. It is hypothesized that information maintained in visual working memory relies on the same neural populations that process visual input. Accordingly, the content of visual working memory is known to affect our conscious perception of concurrent visual input. Here, we demonstrate for the first time that visual input elicits an enhanced neural response when it matches the content of visual working memory, both in terms of signal strength and information content.

Temporally evolving gain mechanisms of attention in macaque area V4

Cognitive attention and perceptual saliency jointly govern our interaction with the environment. Yet, we still lack a universally accepted account of the interplay between attention and luminance contrast, a fundamental dimension of saliency. We measured the attentional modulation of V4 neurons' contrast response functions (CRFs) in awake, behaving macaque monkeys and applied a new approach that emphasizes the temporal dynamics of cell responses. We found that attention modulates CRFs via different gain mechanisms during subsequent epochs of visually driven activity: an early contrast-gain, strongly dependent on prestimulus activity changes (baseline shift); a time-limited stimulus-dependent multiplicative modulation, reaching its maximal expression around 150 ms after stimulus onset; and a late resurgence of contrast-gain modulation. Attention produced comparable time-dependent attentional gain changes on cells heterogeneously coding contrast, supporting the notion that the same circuits mediate attention mechanisms in V4 regardless of the form of contrast selectivity expressed by the given neuron. Surprisingly, attention was also sometimes capable of inducing radical transformations in the shape of CRFs. These findings offer important insights into the mechanisms that underlie contrast coding and attention in primate visual cortex and a new perspective on their interplay, one in which time becomes a fundamental factor.NEW & NOTEWORTHY We offer an innovative perspective on the interplay between attention and luminance contrast in macaque area V4, one in which time becomes a fundamental factor. We place emphasis on the temporal dynamics of attentional effects, pioneering the notion that attention modulates contrast response functions of V4 neurons via the sequential engagement of distinct gain mechanisms. These findings advance understanding of attentional influences on visual processing and help reconcile divergent results in the literature.

Primate Visual Perception: Motivated Attention in Naturalistic Scenes

Research has consistently revealed enhanced neural activation corresponding to attended cues coupled with suppression to unattended cues. This attention effect depends both on the spatial features of stimuli and internal task goals. However, a large majority of research supporting this effect involves circumscribed tasks that possess few ecologically relevant characteristics. By comparison, natural scenes have the potential to engage an evolved attention system, which may be characterized by supplemental neural processing and integration compared to mechanisms engaged during reduced experimental paradigms. Here, we describe recent animal and human studies of naturalistic scene viewing to highlight the specific impact of social and affective processes on the neural mechanisms of attention modulation.

The Emergence of Selective Attention through Probabilistic Associations between Stimuli and Actions

In this paper we show how a multilayer neural network trained to master a context-dependent task in which the action co-varies with a certain stimulus in a first context and with a second stimulus in an alternative context exhibits selective attention, i.e. filtering out of irrelevant information. This effect is rather robust and it is observed in several variations of the experiment in which the characteristics of the network as well as of the training procedure have been varied. Our result demonstrates how the filtering out of irrelevant information can originate spontaneously as a consequence of the regularities present in context-dependent training set and therefore does not necessarily depend on specific architectural constraints. The post-evaluation of the network in an instructed-delay experimental scenario shows how the behaviour of the network is consistent with the data collected in neuropsychological studies. The analysis of the network at the end of the training process indicates how selective attention originates as a result of the effects caused by relevant and irrelevant stimuli mediated by context-dependent and context-independent bidirectional associations between stimuli and actions that are extracted by the network during the learning.

Testing sensory evidence against mnemonic templates

Most perceptual decisions require comparisons between current input and an internal template. Classic studies propose that templates are encoded in sustained activity of sensory neurons. However, stimulus encoding is itself dynamic, tracing a complex trajectory through activity space. Which part of this trajectory is pre-activated to reflect the template? Here we recorded magneto- and electroencephalography during a visual target-detection task, and used pattern analyses to decode template, stimulus, and decision-variable representation. Our findings ran counter to the dominant model of sustained pre-activation. Instead, template information emerged transiently around stimulus onset and quickly subsided. Cross-generalization between stimulus and template coding, indicating a shared neural representation, occurred only briefly. Our results are compatible with the proposal that template representation relies on a matched filter, transforming input into task-appropriate output. This proposal was consistent with a signed difference response at the perceptual decision stage, which can be explained by a simple neural model.

DOI:http://dx.doi.org/10.7554/eLife.09000.001

Imagine searching for your house keys on a cluttered desk. Your eyes scan different items until they eventually find the keys you are looking for. How the brain represents an internal template of the target of your search (the keys, in this example) has been a much-debated topic in neuroscience for the past 30 years. Previous research has indicated that neurons specialized for detecting the sought-after object when it is in view are also pre-activated when we are seeking it. This would mean that these ‘template’ neurons are active the entire time that we are searching.

Myers et al. recorded brain activity from human volunteers using a non-invasive technique called magnetoencephalography (MEG) as they tried to detect when a particular shape appeared on a computer screen. The patterns of brain activity could be analyzed to identify the template that observers had in mind, and to trace when it became active. This revealed that the template was only activated around the time when a target was likely to appear, after which the activation pattern quickly subsided again.

Myers et al. also found that holding a template in mind largely activated different groups of neurons to those activated when seeing the same shape appear on a computer screen. This is contrary to the idea that the same cells are responsible both for maintaining a template and for perceiving its presence in our surroundings.

The brief activation of the template suggests that templates may come online mainly to filter new sensory evidence to detect targets. This mechanism could be advantageous because it lowers the amount of neural activity (and hence energy) needed for the task. Although this points to a more efficient way in which the brain searches for targets, these findings need to be replicated using other methods and task settings to confirm whether the brain generally uses templates in this way.

DOI:http://dx.doi.org/10.7554/eLife.09000.002

Visual selective attention is impaired in children prenatally exposed to opioid agonist medication

AIMS

To examine whether prenatal exposure to opioid agonist medication is associated with visual selective attention and general attention problems in early childhood.

METHOD

Twenty-two children (mean age = 52.17 months, SD = 1.81) prenatally exposed to methadone, 9 children (mean age = 52.41 months, SD = 1.42) prenatally exposed to buprenorphine and 25 nonexposed comparison children (mean age = 51.44 months, SD = 1.31) were tested. Visual selective attention was measured with a Tobii 1750 Eye Tracker using a spatial negative priming paradigm. Attention problems were measured using the Child Behavior Checklist.

RESULTS

The comparison group demonstrated a larger spatial negative priming effect (mean = 23.50, SD = 45.50) than the exposed group [mean = -6.84, SD = 86.39, F(1,50) = 5.91, p = 0.019, η(2) = 0.11]. No difference in reported attention problems was found [F(1,51) = 1.63, p = 0.21, η(2) = 0.03]. Neonatal abstinence syndrome and prenatal exposure to marijuana were found to predict slower saccade latencies in the exposed group (b = 54.55, SE = 23.56, p = 0.03 and b = 88.86, SE = 32.07, p = 0.01, respectively).

CONCLUSION

Although exposed children did not appear to have attention deficits in daily life, lower performance on the SNP task indicates subtle alteration in the attention system.

Altering spatial priority maps via reward-based learning

Spatial priority maps are real-time representations of the behavioral salience of locations in the visual field, resulting from the combined influence of stimulus driven activity and top-down signals related to the current goals of the individual. They arbitrate which of a number of (potential) targets in the visual scene will win the competition for attentional resources. As a result, deployment of visual attention to a specific spatial location is determined by the current peak of activation (corresponding to the highest behavioral salience) across the map. Here we report a behavioral study performed on healthy human volunteers, where we demonstrate that spatial priority maps can be shaped via reward-based learning, reflecting long-lasting alterations (biases) in the behavioral salience of specific spatial locations. These biases exert an especially strong influence on performance under conditions where multiple potential targets compete for selection, conferring competitive advantage to targets presented in spatial locations associated with greater reward during learning relative to targets presented in locations associated with lesser reward. Such acquired biases of spatial attention are persistent, are nonstrategic in nature, and generalize across stimuli and task contexts. These results suggest that reward-based attentional learning can induce plastic changes in spatial priority maps, endowing these representations with the "intelligent" capacity to learn from experience.