The neurobiology of visual attention: finding sources

The use of the eye-fixation-related potential to investigate visual perception in professional domains with high attentional demand: a literature review

INTRODUCTION

Visual attention is a cognitive skill related to visual perception and neural activity, and also moderated by expertise, in time-constrained professional domains (e.g., aviation, driving, sport, surgery). However, the contribution of both perceptual and neural processes on performance has been studied separately in the literature.

DEVELOPMENT

We defend an integration of visual and neural signals to offer a more complete picture of the visual attention displayed by professionals of different skill levels when performing free-viewing tasks. Specifically, we propose to zoom the analysis in data related to the quiet eye and P300 component jointly, as a novel signal processing approach to evaluate professionals' visual attention.

CONCLUSION

This review highlights the advantages of using portable eye trackers and electroencephalogram systems altogether, as a promising technique for a better understanding of early cognitive components related to attentional processes. Altogether, the eye-fixation-related potentials method may provide a better understanding of the cognitive mechanisms employed by the participants in natural settings, revealing what visual information is of interest for participants and distinguishing the neural bases of visual attention between targets and non-targets whenever they perceive a stimulus during free viewing experiments.

A proposed attention-based model for spatial memory formation and retrieval

Animals use sensory information and memory to build internal representations of space. It has been shown that such representations extend beyond the geometry of an environment and also encode rich sensory experiences usually referred to as context. In mammals, contextual inputs from sensory cortices appear to be converging on the hippocampus as a key area for spatial representations and memory. How metric and external sensory inputs (e.g., visual context) are combined into a coherent and stable place representation is not fully understood. Here, I review the evidence of attentional effects along the ventral visual pathway and in the medial temporal lobe and propose an attention-based model for the integration of visual context in spatial representations. I further suggest that attention-based retrieval of spatial memories supports a feedback mechanism that allows consolidation of old memories and new sensory experiences related to the same place, thereby contributing to the stability of spatial representations. The resulting model has the potential to generate new hypotheses to explain complex responses of spatial cells such as place cells in the hippocampus.

Emotional faces interfere with saccadic inhibition and attention re-orientation: An fMRI study

Modulation of reflex responses is crucial to adapt our behavior and cognition, and this is especially difficult when biological relevant stimuli are present such as emotional faces. The aim of this study was to identify the effect of peripherally presented happy and angry facial expressions in reflexive saccades and saccadic inhibition/re-orientation of attention. Behavior through eye-tracking technique and fMRI event-related BOLD signals activations were evaluated in adult males during the performance of an antisaccade task. fMRI signals obtained during task performance were compared to a baseline. Results showed that antisaccades had a lower percentage of correct responses and higher latency onsets than prosaccades. At the activation brain level, differences between both emotions and the baseline were found during stimuli presentation. Prosaccades for happy and angry faces recruited larger clusters with higher Z values mainly in occipito-parietal and temporal regions related to visual basic and integration processing, as well as regions of the oculomotor network. Meanwhile, when compared to the baseline, antisaccades recruited similar areas but a lower number of clusters with lower Z values as expected for peripheral processing of faces. At antisaccades, happy faces recruited parieto-occipital, temporal and cerebellar regions, while the angry faces added activation of orbital and ventrolateral prefrontal cortex related to emotional regulation. These results suggest that emotional facial expressions are being processed outside of the focus of attention. Particularly, angry expressions recruit a wider brain network in order to inhibit automatic behavior and re-orientate voluntary attention efficiently that may be due to its biological relevance.

Differential attentional control mechanisms by two distinct noradrenergic coeruleo-frontal cortical pathways

The attentional control of behavior is a higher-order cognitive function that operates through attention and response inhibition. The locus coeruleus (LC), the main source of norepinephrine in the brain, is considered to be involved in attentional control by modulating the neuronal activity of the prefrontal cortex (PFC). However, evidence for the causal role of LC activity in attentional control remains elusive. Here, by using behavioral and optogenetic techniques, we investigate the effect of LC neuron activation or inhibition in operant tests measuring attention and response inhibition (i.e., a measure of impulsive behavior). We show that LC neuron stimulation increases goal-directed attention and decreases impulsivity, while its suppression exacerbates distractibility and increases impulsive responding. Remarkably, we found that attention and response inhibition are under the control of two divergent projections emanating from the LC: one to the dorso-medial PFC and the other to the ventro-lateral orbitofrontal cortex, respectively. These findings are especially relevant for those pathological conditions characterized by attention deficits and elevated impulsivity.

Changes in eye movement parameters in the presence of an artificial central scotoma

BACKGROUND

Central vision loss, such as in the case of age-related macular degeneration (AMD), has a a major negative impact on patients' quality of life. However, some patients have shown spontaneous adaptive strategies development, mostly relying on their peripheral vision.

OBJECTIVE

This study assesses eye movement and eccentric visual function adaptive behaviors of a healthy population in the presence of simulated central vision loss. We wished to determine how central vision loss affects eye movements, specifically the foveal-target alignment.

METHODS

Fifteen healthy participants (7 females, M = 21.69, SD = 2.13) discriminated the orientation of a Gabor relative to the vertical located at 12 deg of eccentricity to the right of fixation, in the presence of a gaze-contingent artificial central scotoma either visible or invisible. The artificial central scotoma was 4° diameter in order to simulate an earlier stage of degenerative disease while still impairing foveal vision. The target's orientation varied between 10° counter-clockwise and 10° clockwise. Each participant performed four blocks of 75 trials each per day over 10 days, the first day being a baseline without scotoma.

RESULTS

We found changes in the endpoints of the 1st saccade over the practice days. The most common pattern was a gradual upward shift. We also observed a significant increase in discrimination performance over the 9 days of practice. We did not find any difference linked to the scotoma types.

CONCLUSIONS

These findings suggest that the presence of an artificial central scotoma combined with a challenging discrimination task induces both changes in saccade planning mechanisms, resulting in a new eccentric-target alignment, and improvements in eccentric visual functions. This demonstrates the potential of this research paradigm to understand and potentially improve visual function in patients with central vision loss.

The interdependence of attention, working memory and gaze control: behavior and neural circuitry

Visual attention, visual working memory, and gaze control are basic functions that all select a subset of visual input to guide immediate or subsequent behavior. In this review, we focus on the relationship between these three functions and describe evidence, both at the behavioral and neural circuit levels that they are heavily interdependent. We start with the demonstration that gaze control - or saccade preparation in particular - leads to spatial attention. Next, we show that spatial attention and working memory interact at the behavioral level and rely on a common set of neural mechanisms. Next, we discuss the evidence that gaze control mechanisms are involved in spatial working memory. Lastly, we highlight the links between gaze control and non-spatial memory.

Social-valence-related increased attention in rett syndrome cynomolgus monkeys: An eye-tracking study

The cognitive phenotypes of Rett syndrome (RTT) remain unclarified compared with the well-defined genetic etiology. Recent clinical studies suggest the eye-tracking method as a promising avenue to quantify the visual phenotypes of the syndrome. The present study explored various aspects of visual attention of the methyl-CpG-binding protein 2 gene mutant RTT monkeys with the eye-tracking procedure. Comprehensive testing paradigms, including social valence comparison (SVC), visual paired comparison (VPC), and social recognition memory (SRM), were utilized to investigate their attentional features to social stimuli with differential valence, the novelty preferences, and short-term recognition memory, respectively. To explore the neurobiological mechanisms underlying the eye-tracking findings, we assessed changes of the brain subregion volumes and neurotransmitter concentrations. Compared with control monkeys, RTT monkeys demonstrated increased viewing on the more salient stare faces than profile faces in the SVC test, and increased viewing on the whole presented images composed of monkey faces in the VPC and SRM tests. Brain imaging revealed reduced bilateral occipital gyrus in RTT monkeys. The exploratory neurotransmitter analyses revealed no significant changes of various neurotransmitter concentrations in the cerebrospinal fluid and blood of RTT monkeys. The eye-tracking results suggested social-valence-related increased attention in RTT monkeys, supplementing the cognitive phenotypes associated with the syndrome. Further investigations from broader perspectives are required to uncover the underlying neurobiological mechanisms. Autism Res 2019, 00: 1-13. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Altered expressions of the methyl-CpG-binding protein 2 (MECP2) gene are usually associated with neurodevelopmental disorders, such as autism spectrum disorders, Rett syndrome (RTT), and so forth. The present eye-tracking study found social-valence-related increased attention in our firstly established MECP2 mutant RTT monkeys. The novel findings supplement the cognitive phenotypes and potentially benefit the behavioral interventions of the RTT syndrome.

Loss of Adaptive Myelination Contributes to Methotrexate Chemotherapy-Related Cognitive Impairment

Activity-dependent myelination is thought to contribute to adaptive neurological function. However, the mechanisms by which activity regulates myelination and the extent to which myelin plasticity contributes to non-motor cognitive functions remain incompletely understood. Using a mouse model of chemotherapy-related cognitive impairment (CRCI), we recently demonstrated that methotrexate (MTX) chemotherapy induces complex glial dysfunction for which microglial activation is central. Here, we demonstrate that remote MTX exposure blocks activity-regulated myelination. MTX decreases cortical Bdnf expression, which is restored by microglial depletion. Bdnf-TrkB signaling is a required component of activity-dependent myelination. Oligodendrocyte precursor cell (OPC)-specific TrkB deletion in chemotherapy-naive mice results in impaired cognitive behavioral performance. A small-molecule TrkB agonist rescues both myelination and cognitive impairment after MTX chemotherapy. This rescue after MTX depends on intact TrkB expression in OPCs. Taken together, these findings demonstrate a molecular mechanism required for adaptive myelination that is aberrant in CRCI due to microglial activation.

Structure and function of dual-source cholinergic modulation in early vision

Behavioral states such as arousal and attention have profound effects on sensory processing, determining how-even whether-a stimulus is perceived. This state-dependence is believed to arise, at least in part, in response to inputs from subcortical structures that release neuromodulators such as acetylcholine, often nonsynaptically. The mechanisms that underlie the interaction between these nonsynaptic signals and the more point-to-point synaptic cortical circuitry are not well understood. This review highlights the state of the field, with a focus on cholinergic action in early visual processing. Key anatomical and physiological features of both the cholinergic and the visual systems are discussed. Furthermore, presenting evidence of cholinergic modulation in visual thalamus and primary visual cortex, we explore potential functional roles of acetylcholine and its effects on the processing of visual input over the sleep-wake cycle, sensory gain control during wakefulness, and consider evidence for cholinergic support of visual attention.

Control networks and hubs

Executive control functions are associated with frontal, parietal, cingulate, and insular brain regions that interact through distributed large-scale networks. Here, we discuss how fMRI functional connectivity can shed light on the organization of control networks and how they interact with other parts of the brain. In the first section of our review, we present convergent evidence from fMRI functional connectivity, activation, and lesion studies that there are multiple dissociable control networks in the brain with distinct functional properties. In the second section, we discuss how graph theoretical concepts can help illuminate the mechanisms by which control networks interact with other brain regions to carry out goal-directed functions, focusing on the role of specialized hub regions for mediating cross-network interactions. Again, we use a combination of functional connectivity, lesion, and task activation studies to bolster this claim. We conclude that a large-scale network perspective provides important neurobiological constraints on the neural underpinnings of executive control, which will guide future basic and translational research into executive function and its disruption in disease.

Sites of overt and covert attention define simultaneous spatial reference centers for visuomotor response

The site of overt attention (fixation point) defines a spatial reference center that affects visuomotor response as indicated by the stimulus-response-compatibility (SRC) effect: When subjects press, e.g., a left key to report stimuli, their reaction time is shorter when stimuli appear to the left than to the right of the fixation. Covert attention to a peripheral site appears to define a similar reference center but previous studies did not control for confounding spatiotemporal factors or investigate the relationship between overt- and covert-attention-defined centers. Using an eye tracker to monitor fixation, we found an SRC effect relative to the site of covert attention induced by a flashed cue dot, and a concurrent reduction, but not elimination, of the overt-attention SRC effect. The two SRC effects jointly determined the overall motor reaction time. Since trials with different cue locations were randomly interleaved, the integration of the two reference centers must be updated online. When the cue was invalid and diminished covert attention, the covert-attention SRC effect disappeared and the overt-attention SRC effect retained full strength, excluding non-attention-based interpretations. We conclude that both covert- and overt-attention sites define visual reference centers that simultaneously contribute to motor response.

Competition Effects in Visual Cortex Between Emotional Distractors and a Primary Task in Remitted Depression

BACKGROUND

Attentional biases, particularly difficulty inhibiting attention to negative stimuli, are implicated in risk for major depressive disorder (MDD). The current study examined a neural measure of attentional bias using a continuous index of visuocortical engagement (steady-state visual evoked potentials [SSVEPs]) before and after a negative mood induction in a population at high-risk for MDD recurrence due to a recently remitted MDD (rMDD) episode. Additionally, we examined working memory (WM) capacity as a potential moderator of the link between rMDD and visuocortical responses.

METHODS

Our sample consisted of 27 women with rMDD and 28 never-depressed women. To assess attentional inhibition to emotional stimuli, we measured frequency-tagged SSVEPs evoked from spatially superimposed task-relevant stimuli and emotional distractors (facial displays of emotion) oscillating at distinct frequencies. WM capacity was assessed during a visuospatial memory task.

RESULTS

Women with rMDD, relative to never-depressed women, displayed difficulty inhibiting attention to all emotional distractors before a negative mood induction, with the strongest effect for negative distractors (sad faces). Following the mood induction, rMDD women's attention to emotional distractors remained largely unchanged. Among women with rMDD, lower WM capacity predicted greater difficulty inhibiting attention to negative and neutral distractors.

CONCLUSIONS

By exploiting the phenomenon of oscillatory resonance in the visual cortex, we tracked competition in neural responses for spatially superimposed stimuli differing in valence. Results demonstrated that women with rMDD display impaired attentional inhibition of emotional distractors independent of state mood and that this bias is strongest among those with lower WM capacity.

Feedforward and feedback frequency-dependent interactions in a large-scale laminar network of the primate cortex

Interactions between top-down and bottom-up processes in the cerebral cortex hold the key to understanding attentional processes, predictive coding, executive control, and a gamut of other brain functions. However, the underlying circuit mechanism remains poorly understood and represents a major challenge in neuroscience. We approached this problem using a large-scale computational model of the primate cortex constrained by new directed and weighted connectivity data. In our model, the interplay between feedforward and feedback signaling depends on the cortical laminar structure and involves complex dynamics across multiple (intralaminar, interlaminar, interareal, and whole cortex) scales. The model was tested by reproducing, as well as providing insights into, a wide range of neurophysiological findings about frequency-dependent interactions between visual cortical areas, including the observation that feedforward pathways are associated with enhanced gamma (30 to 70 Hz) oscillations, whereas feedback projections selectively modulate alpha/low-beta (8 to 15 Hz) oscillations. Furthermore, the model reproduces a functional hierarchy based on frequency-dependent Granger causality analysis of interareal signaling, as reported in recent monkey and human experiments, and suggests a mechanism for the observed context-dependent hierarchy dynamics. Together, this work highlights the necessity of multiscale approaches and provides a modeling platform for studies of large-scale brain circuit dynamics and functions.

Model-Free Estimation of Tuning Curves and Their Attentional Modulation, Based on Sparse and Noisy Data

Tuning curves are the functions that relate the responses of sensory neurons to various values within one continuous stimulus dimension (such as the orientation of a bar in the visual domain or the frequency of a tone in the auditory domain). They are commonly determined by fitting a model e.g. a Gaussian or other bell-shaped curves to the measured responses to a small subset of discrete stimuli in the relevant dimension. However, as neuronal responses are irregular and experimental measurements noisy, it is often difficult to determine reliably the appropriate model from the data. We illustrate this general problem by fitting diverse models to representative recordings from area MT in rhesus monkey visual cortex during multiple attentional tasks involving complex composite stimuli. We find that all models can be well-fitted, that the best model generally varies between neurons and that statistical comparisons between neuronal responses across different experimental conditions are affected quantitatively and qualitatively by specific model choices. As a robust alternative to an often arbitrary model selection, we introduce a model-free approach, in which features of interest are extracted directly from the measured response data without the need of fitting any model. In our attentional datasets, we demonstrate that data-driven methods provide descriptions of tuning curve features such as preferred stimulus direction or attentional gain modulations which are in agreement with fit-based approaches when a good fit exists. Furthermore, these methods naturally extend to the frequent cases of uncertain model selection. We show that model-free approaches can identify attentional modulation patterns, such as general alterations of the irregular shape of tuning curves, which cannot be captured by fitting stereotyped conventional models. Finally, by comparing datasets across different conditions, we demonstrate effects of attention that are cell- and even stimulus-specific. Based on these proofs-of-concept, we conclude that our data-driven methods can reliably extract relevant tuning information from neuronal recordings, including cells whose seemingly haphazard response curves defy conventional fitting approaches.

Huntington's Disease (HD): Neurodegeneration of Brodmann's Primary Visual Area 17 (BA17)

Huntington's disease (HD), an autosomal dominantly inherited polyglutamine or CAG repeat disease along with somatomotor, oculomotor, psychiatric and cognitive symptoms, presents clinically with impairments of elementary and complex visual functions as well as altered visual-evoked potentials (VEPs). Previous volumetric and pathoanatomical post-mortem investigations pointed to an involvement of Brodmann's primary visual area 17 (BA17) in HD. Because the involvement of BA17 could be interpreted as an early onset brain neurodegeneration, we further characterized this potential primary cortical site of HD-related neurodegeneration neuropathologically and performed an unbiased estimation of the absolute nerve cell number in thick gallocyanin-stained frontoparallel tissue sections through the striate area of seven control individuals and seven HD patients using Cavalieri's principle for volume and the optical disector for nerve and glial cell density estimations. This investigation showed a reduction of the estimated absolute nerve cell number of BA17 in the HD patients (71,044,037 ± 12,740,515 nerve cells) of 32% in comparison with the control individuals (104,075,067 ± 9,424,491 nerve cells) (Mann-Whitney U-test; P < 0.001). Additional pathoanatomical studies showed that nerve cell loss was most prominent in the outer pyramidal layer III, the inner granular layers IVa and IVc as well as in the multiform layer VI of BA17 of the HD patients. Our neuropathological results in BA17 confirm and extend previous post-mortem, biochemical and in vivo neuroradiological HD findings and offer suitable explanations for the elementary and complex visual dysfunctions, as well as for the altered VEP observed in HD patients.

Attentional trade-offs maintain the tracking of moving objects across saccades

In many situations like playing sports or driving a car, we keep track of moving objects, despite the frequent eye movements that drastically interrupt their retinal motion trajectory. Here we report evidence that transsaccadic tracking relies on trade-offs of attentional resources from a tracked object's motion path to its remapped location. While participants covertly tracked a moving object, we presented pulses of coherent motion at different locations to probe the allocation of spatial attention along the object's entire motion path. Changes in the sensitivity for these pulses showed that during fixation attention shifted smoothly in anticipation of the tracked object's displacement. However, just before a saccade, attentional resources were withdrawn from the object's current motion path and reflexively drawn to the retinal location the object would have after saccade. This finding demonstrates the predictive choice the visual system makes to maintain the tracking of moving objects across saccades.

Preferential encoding of behaviorally relevant predictions revealed by EEG

Statistical regularities in the environment guide perceptual processing; however, some predictions are bound to be more important than others. In this electroencephalogram (EEG) study, we test how task relevance influences the way predictions are learned from the statistics of visual input, and exploited for behavior. We developed a novel task in which participants are simply instructed to respond to a designated target stimulus embedded in a serial stream of non-target stimuli. Presentation probabilities were manipulated such that a designated target cue stimulus predicted the target onset with 70% validity. We also included a corresponding control contingency: a pre-designated control cue predicted a specific non-target stimulus with 70% validity. Participants were not informed about these contingencies. This design allowed us to examine the neural response to task-relevant predictive (cue) and predicted stimuli (target), relative to task-irrelevant predictive (control cue) and predicted stimuli (control non-target). The behavioral results confirmed that participants learned and exploited task-relevant predictions even when not explicitly defined. The EEG results further showed that target-relevant predictions are coded more strongly than statistically equivalent regularities between non-target stimuli. There was a robust modulation of the response for predicted targets associated with learning, enhancing the response to cued stimuli just after 200 ms post-stimulus in central and posterior electrodes, but no corresponding effects for predicted non-target stimuli. These effects of target prediction were preceded by a sustained frontal negativity following presentation of the predictive cue stimulus. These results show that task relevance critically influences how the brain extracts predictive structure from the environment, and exploits these regularities for optimized behavior.

Visual spatial attention has opposite effects on bidirectional plasticity in the human motor cortex

Long-term potentiation (LTP) and long-term depression (LTD) are key mechanisms of synaptic plasticity that are thought to act in concert to shape neural connections. Here we investigated the influence of visual spatial attention on LTP-like and LTD-like plasticity in the human motor cortex. Plasticity was induced using paired associative stimulation (PAS), which involves repeated pairing of peripheral nerve stimulation and transcranial magnetic stimulation to alter functional responses in the thumb area of the primary motor cortex. PAS-induced changes in cortical excitability were assessed using motor-evoked potentials. During plasticity induction, participants directed their attention to one of two visual stimulus streams located adjacent to each hand. When participants attended to visual stimuli located near the left thumb, which was targeted by PAS, LTP-like increases in excitability were significantly enhanced, and LTD-like decreases in excitability reduced, relative to when they attended instead to stimuli located near the right thumb. These differential effects on (bidirectional) LTP-like and LTD-like plasticity suggest that voluntary visual attention can exert an important influence on the functional organization of the motor cortex. Specifically, attention acts to both enhance the strengthening and suppress the weakening of neural connections representing events that fall within the focus of attention.

Context-dependent computation by recurrent dynamics in prefrontal cortex

Prefrontal cortex is thought to have a fundamental role in flexible, context-dependent behaviour, but the exact nature of the computations underlying this role remains largely unknown. In particular, individual prefrontal neurons often generate remarkably complex responses that defy deep understanding of their contribution to behaviour. Here we study prefrontal cortex activity in macaque monkeys trained to flexibly select and integrate noisy sensory inputs towards a choice. We find that the observed complexity and functional roles of single neurons are readily understood in the framework of a dynamical process unfolding at the level of the population. The population dynamics can be reproduced by a trained recurrent neural network, which suggests a previously unknown mechanism for selection and integration of task-relevant inputs. This mechanism indicates that selection and integration are two aspects of a single dynamical process unfolding within the same prefrontal circuits, and potentially provides a novel, general framework for understanding context-dependent computations.

Attention and predictions: control of spatial attention beyond the endogenous-exogenous dichotomy

The mechanisms of attention control have been extensively studied with a variety of methodologies in animals and in humans. Human studies using non-invasive imaging techniques highlighted a remarkable difference between the pattern of responses in dorsal fronto-parietal regions vs. ventral fronto-parietal (vFP) regions, primarily lateralized to the right hemisphere. Initially, this distinction at the neuro-physiological level has been related to the distinction between cognitive processes associated with strategic/endogenous vs. stimulus-driven/exogenous of attention control. Nonetheless, quite soon it has become evident that, in almost any situation, attention control entails a complex combination of factors related to both the current sensory input and endogenous aspects associated with the experimental context. Here, we review several of these aspects first discussing the joint contribution of endogenous and stimulus-driven factors during spatial orienting in complex environments and, then, turning to the role of expectations and predictions in spatial re-orienting. We emphasize that strategic factors play a pivotal role for the activation of the ventral system during stimulus-driven control, and that the dorsal system makes use of stimulus-driven signals for top-down control. We conclude that both the dorsal and the vFP networks integrate endogenous and exogenous signals during spatial attention control and that future investigations should manipulate both these factors concurrently, so as to reveal to full extent of these interactions.

A hierarchy of attentional priority signals in human frontoparietal cortex

Humans can voluntarily attend to a variety of visual attributes to serve behavioral goals. Voluntary attention is believed to be controlled by a network of dorsal frontoparietal areas. However, it is unknown how neural signals representing behavioral relevance (attentional priority) for different attributes are organized in this network. Computational studies have suggested that a hierarchical organization reflecting the similarity structure of the task demands provides an efficient and flexible neural representation. Here we examined the structure of attentional priority using functional magnetic resonance imaging. Participants were cued to attend to location, color, or motion direction within the same stimulus. We found a hierarchical structure emerging in frontoparietal areas, such that multivoxel patterns for attending to spatial locations were most distinct from those for attending to features, and the latter were further clustered into different dimensions (color vs motion). These results provide novel evidence for the organization of the attentional control signals at the level of distributed neural activity. The hierarchical organization provides a computationally efficient scheme to support flexible top-down control.

Multimodal representation of limb endpoint position in the posterior parietal cortex

Understanding the neural representation of limb position is important for comprehending the control of limb movements and the maintenance of body schema, as well as for the development of neuroprosthetic systems designed to replace lost limb function. Multiple subcortical and cortical areas contribute to this representation, but its multimodal basis has largely been ignored. Regarding the parietal cortex, previous results suggest that visual information about arm position is not strongly represented in area 5, although these results were obtained under conditions in which animals were not using their arms to interact with objects in their environment, which could have affected the relative weighting of relevant sensory signals. Here we examined the multimodal basis of limb position in the superior parietal lobule (SPL) as monkeys reached to and actively maintained their arm position at multiple locations in a frontal plane. On half of the trials both visual and nonvisual feedback of the endpoint of the arm were available, while on the other trials visual feedback was withheld. Many neurons were tuned to arm position, while a smaller number were modulated by the presence/absence of visual feedback. Visual modulation generally took the form of a decrease in both firing rate and variability with limb vision and was associated with more accurate decoding of position at the population level under these conditions. These findings support a multimodal representation of limb endpoint position in the SPL but suggest that visual signals are relatively weakly represented in this area, and only at the population level.

Prefrontal cortex organization: dissociating effects of temporal abstraction, relational abstraction, and integration with FMRI

The functions of the prefrontal cortex (PFC) underlie higher-level cognition. Varying proposals suggest that the PFC is organized along a rostral-caudal gradient of abstraction with more abstract representations/processes associated with more rostral areas. However, the operational definition of abstraction is unclear. Here, we contrasted 2 prominent theories of abstraction--temporal and relational--using fMRI. We further examined whether integrating abstract rules--a function common to each theory--recruited the PFC independently of other abstraction effects. While robust effects of relational abstraction were present in the PFC, temporal abstraction effects were absent. Instead, we found activations specific to the integration of relational rules in areas previously shown to be associated with temporal abstraction. We suggest that previous effects of temporal abstraction were due to confounds with integration demands. We propose an integration framework to understand the functions of the PFC that resolves discrepancies in prior data.

A meta-analysis of executive components of working memory

Working memory (WM) enables the online maintenance and manipulation of information and is central to intelligent cognitive functioning. Much research has investigated executive processes of WM in order to understand the operations that make WM "work." However, there is yet little consensus regarding how executive processes of WM are organized. Here, we used quantitative meta-analysis to summarize data from 36 experiments that examined executive processes of WM. Experiments were categorized into 4 component functions central to WM: protecting WM from external distraction (distractor resistance), preventing irrelevant memories from intruding into WM (intrusion resistance), shifting attention within WM (shifting), and updating the contents of WM (updating). Data were also sorted by content (verbal, spatial, object). Meta-analytic results suggested that rather than dissociating into distinct functions, 2 separate frontal regions were recruited across diverse executive demands. One region was located dorsally in the caudal superior frontal sulcus and was especially sensitive to spatial content. The other was located laterally in the midlateral prefrontal cortex and showed sensitivity to nonspatial content. We propose that dorsal-"where"/ventral-"what" frameworks that have been applied to WM maintenance also apply to executive processes of WM. Hence, WM can largely be simplified to a dual selection model.

Neuronal correlates of visual time perception at brief timescales

Successful interaction with the world depends on accurate perception of the timing of external events. Neurons at early stages of the primate visual system represent time-varying stimuli with high precision. However, it is unknown whether this temporal fidelity is maintained in the prefrontal cortex, where changes in neuronal activity generally correlate with changes in perception. One reason to suspect that it is not maintained is that humans experience surprisingly large fluctuations in the perception of time. To investigate the neuronal correlates of time perception, we recorded from neurons in the prefrontal cortex and midbrain of monkeys performing a temporal-discrimination task. Visual time intervals were presented at a timescale relevant to natural behavior (<500 ms). At this brief timescale, neuronal adaptation--time-dependent changes in the size of successive responses--occurs. We found that visual activity fluctuated with timing judgments in the prefrontal cortex but not in comparable midbrain areas. Surprisingly, only response strength, not timing, predicted task performance. Intervals perceived as longer were associated with larger visual responses and shorter intervals with smaller responses, matching the dynamics of adaptation. These results suggest that the magnitude of prefrontal activity may be read out to provide temporal information that contributes to judging the passage of time.

Persistent spatial information in the frontal eye field during object-based short-term memory

Spatial attention is known to gate entry into visual short-term memory, and some evidence suggests that spatial signals may also play a role in binding features or protecting object representations during memory maintenance. To examine the persistence of spatial signals during object short-term memory, the activity of neurons in the frontal eye field (FEF) of macaque monkeys was recorded during an object-based delayed match-to-sample task. In this task, monkeys were trained to remember an object image over a brief delay, regardless of the locations of the sample or target presentation. FEF neurons exhibited visual, delay, and target period activity, including selectivity for sample location and target location. Delay period activity represented the sample location throughout the delay, despite the irrelevance of spatial information for successful task completion. Furthermore, neurons continued to encode sample position in a variant of the task in which the matching stimulus never appeared in their response field, confirming that FEF maintains sample location independent of subsequent behavioral relevance. FEF neurons also exhibited target-position-dependent anticipatory activity immediately before target onset, suggesting that monkeys predicted target position within blocks. These results show that FEF neurons maintain spatial information during short-term memory, even when that information is irrelevant for task performance.

Attention deficits without cortical neuronal deficits

The ability to selectively process relevant stimuli is a fundamental function of the primate visual system. The best understood correlate of this function is the enhanced response of neurons in visual cortex to attended stimuli^1,2. However, recent results show that the superior colliculus (SC), a midbrain structure, also plays a crucial role in visual attention^3–5. It has been assumed that the SC acts through the same well-known mechanisms in visual cortex^3,5. Here we tested this hypothesis by transiently inactivating the SC during a motion-change detection task and measuring responses in two visual cortical areas. We found that despite large deficits in visual attention, the enhanced responses of neurons in visual cortex to attended stimuli were unchanged. These results show that the SC contributes to visual attention through mechanisms that are independent of the classic effects in visual cortex, demonstrating that other processes must play a major role in visual attention.

Exploring the relationship between perceptual learning and top-down attentional control

Here, we review the role of top-down attention in both the acquisition and the expression of perceptual learning, as well as the role of learning in more efficiently guiding attentional modulations. Although attention often mediates learning at the outset of training, many of the characteristic behavioral and neural changes associated with learning can be observed even when stimuli are task irrelevant and ignored. However, depending on task demands, attention can override the effects of perceptual learning, suggesting that even if top-down factors are not strictly necessary to observe learning, they play a critical role in determining how learning-related changes in behavior and neural activity are ultimately expressed. In turn, training may also act to optimize the effectiveness of top-down attentional control by improving the efficiency of sensory gain modulations, regulating intrinsic noise, and altering the read-out of sensory information.

Dissociable frontal-striatal and frontal-parietal networks involved in updating hierarchical contexts in working memory

Recent theories propose that the prefrontal cortex (PFC) is organized in a hierarchical fashion with more abstract, higher level information represented in anterior regions and more concrete, lower level information represented in posterior regions. This hierarchical organization affords flexible adjustments of action plans based on the context. Computational models suggest that such hierarchical organization in the PFC is achieved through interactions with the basal ganglia (BG) wherein the BG gate relevant contexts into the PFC. Here, we tested this proposal using functional magnetic resonance imaging (fMRI). Participants were scanned while updating working memory (WM) with 2 levels of hierarchical contexts. Consistent with PFC abstraction proposals, higher level context updates involved anterior portions of the PFC (BA 46), whereas lower level context updates involved posterior portions of the PFC (BA 6). Computational models were only partially supported as the BG were sensitive to higher, but not lower level context updates. The posterior parietal cortex (PPC) showed the opposite pattern. Analyses examining changes in functional connectivity confirmed dissociable roles of the anterior PFC-BG during higher level context updates and posterior PFC-PPC during lower level context updates. These results suggest that hierarchical contexts are organized by distinct frontal-striatal and frontal-parietal networks.

Attentional modulation of neuromagnetic evoked responses in early human visual cortex and parietal lobe following a rank-order rule

Top-down voluntary attention modulates the amplitude of magnetic evoked fields in the human visual cortex. Whether such modulation is flexible enough to adapt to the demands of complex tasks in which abstract rules must be applied to select a target in the presence of distracters remains unclear. We recorded brain neuromagnetic activity using whole-head magnetoencephalography in 14 human subjects during a rule-guided target selection task, and applied event-related Synthetic Aperture Magnetometry to image instantaneous changes in neuromagnetic source activity throughout the brain. During the task subjects selected one of two stimuli (the target) and ignored the other (the distracter) based on a color-rank rule (color 1 > color 2 > color 3). Our results revealed that in early visual color-sensitive areas and the parietal cortex visual stimuli evoke activity that scaled following the rank-order rule. This effect was stronger and occurred later in the parietal lobe (~200 ms after target/distracter onset) relative to early visual areas (~180 ms). Moreover, we found that transient changes in the target's motion direction evoked stronger responses relative to similar changes in the distracter at ~180 ms from change onset in contralateral areas hMT+/V5. These results suggest that during target selection and allocation of attention to a stimulus, top-down signals adjust their intensity following complex selection rules according to the organism's priorities, thereby differentially modulating neuromagnetic activity across visual cortical areas.

Interaction between bottom-up saliency and top-down control: how saliency maps are created in the human brain

Whether an object captures our attention depends on its bottom-up salience, that is, how different it is compared with its neighbors, and top-down control, that is, our current inner goals. At which neuronal stage they interact to guide behavior is still unknown. In a functional magnetic resonance imaging study, we found evidence for a hierarchy of saliency maps in human early visual cortex (V1 to hV4) and identified where bottom-up saliency interacts with top-down control: V1 represented pure bottom-up signals, V2 was only responsive to top-down modulations, and in hV4 bottom-up saliency and top-down control converged. Two distinct cerebral networks exerted top-down control: distractor suppression engaged the left intraparietal sulcus, while target enhancement involved the frontal eye field and lateral occipital cortex. Hence, attentional selection is implemented in integrated maps in visual cortex, which provide precise topographic information about target-distractor locations thus allowing for successful visual search.

Shape effects on reflexive spatial attention are driven by the dorsal stream

In a modified reflexive spatial attention paradigm, when the cue and the target are at the same spatial location, processing of the target is faster when the cue and the target have different shapes compared to same (shape effect). Recent physiological findings suggest distinct population level encoding of shape in ventral versus dorsal cortical visual streams in monkeys. In human observers, we tested whether the effect of shape on reflexive spatial attention could be attributed to ventral and/or dorsal stream encoding of shape. In the modified reflexive spatial attention paradigm, we varied the shapes of the cue and target. Based on data from monkey physiology (Lehky & Sereno, 2007), we selected four pairs of cue and target shapes. In some pairs, cue and target were similarly encoded (similar encoding distance) by a population of cells in the lateral intraparietal cortex, a dorsal stream area, but more dissimilarly encoded (having a greater encoding distance) by a population of cells in the anterior inferotemporal cortex (AIT), a ventral stream area. In other pairs, cue and target were similarly encoded in AIT and had greater dissimilarity in LIP encoding. We found that pairs of cue and target with greater dissimilarity in LIP encoding produced larger and more consistent shape effects up to a cue to target onset asynchrony (CTOA) of 450 ms. The shape effects for cue and target pairs with greater dissimilarity in AIT encoding were smaller and inconsistent, suggesting that shape effects in reflexive spatial attention are largely driven by the dorsal stream.

The role of neuromodulators in selective attention

Several classes of neurotransmitters exert modulatory effects on a broad and diverse population of neurons throughout the brain. Some of these neuromodulators, especially acetylcholine and dopamine, have long been implicated in the neural control of selective attention. We review recent evidence and evolving ideas about the importance of these neuromodulatory systems in attention, particularly visual selective attention. We conclude that, although our understanding of their role in the neural circuitry of selective attention remains rudimentary, recent research has begun to suggest unique contributions of neuromodulators to different forms of attention, such as bottom-up and top-down attention.

Parietofrontal circuits in goal-oriented behaviour

Parietal and frontal cortical areas play important roles in the control of goal-oriented behaviour. This review examines how signal processing in the parietal and frontal eye fields is involved in coding and storing space, directing attention and processing the sensorimotor transformation for saccades. After a survey of the functional specialization of these areas in monkeys, we discuss homologous regions in the human brain in terms of topographic organization, storage capacity, target selection, spatial remapping, reference frame transformations and effector specificity. The overall picture suggests that bottom-up sensory, top-down cognitive signals and efferent motor signals are integrated in dynamic sensorimotor maps as part of a functionally flexible parietofrontal network. Neuronal synchronization in these maps may be instrumental in amplifying behaviourally relevant representations and setting up a functional pathway to route information in this parietofrontal circuit.

Spatial attention, feature-based attention, and saccades: three sides of one coin?

The last three decades has seen a steady growth of neuroscience research aimed at understanding the functions and sources of top-down attentional modulation in the brain. This correlates with recognition that attention may be a necessary component of sensory systems to support natural behaviors in natural environments. Complexity and clutter are two of the most recognizable hallmarks of natural environments, which can simultaneously contain vitally important and completely irrelevant stimuli. Attention serves as an adaptive filter providing each sensory modality preferential processing routes for important stimuli while suppressing responses to distracters, thus optimizing use of limited neural resources. In other words, attention is the family of mechanisms by which organisms are able to effectively and selectively allocate limited neural resources to achieve specific behavioral goals. This review provides some historical context for considering attentional frameworks and modern neurophysiological attention research, focusing on visual attention. A taxonomy of common attentional effects and neural mechanisms is provided, along with consideration of the specific relationship between attention and saccade planning. We examine the validity of premotor theories of attention, which posit that attention and saccade planning are one and the same. While there is strong evidence that attention and oculomotor planning are similar, with shared neural substrates, there is also evidence that these two functions are not synonymous. Finally, we examine neurophysiological explanations for dysfunction in attention-deficit/hyperactivity disorder and the hypothesis that social impairment in autism spectrum disorders is partially attributable to perturbations of attentional control circuitry.

Selective attention from voluntary control of neurons in prefrontal cortex

Animals can learn to voluntarily control neuronal activity within various brain areas through operant conditioning, but the relevance of that control to cognitive functions is unknown. We found that rhesus monkeys can control the activity of neurons within the frontal eye field (FEF), an oculomotor area of the prefrontal cortex. However, operantly driven FEF activity was primarily associated with selective visual attention, and not oculomotor preparation. Attentional effects were untrained and were observed both behaviorally and neurophysiologically. Furthermore, selective attention correlated with voluntary, but not spontaneous, fluctuations in FEF activity. Our results reveal a specific association of voluntarily driven neuronal activity with "top-down" attention and suggest a basis for the use of neurofeedback training to treat disorders of attention.

Neural basis of visual selective attention

Attentional modulation along the object-recognition pathway of the cortical visual system of primates has been shown to consist of enhanced representation of the retinal input at a specific location in space, or of objects located anywhere in the visual field which possess a critical object feature. Moreover, selective attention mechanisms allow the visual system to resolve competition among multiple objects in a crowded scene in favor of the object that is relevant for the current behavior. Finally, selective attention affects the spontaneous activity of neurons as well as their visually driven responses, and it does so not only by modulating the spiking activity of individual neurons, but also by modulating the degree of coherent firing within the critical neuronal populations. WIREs Cogni Sci 2011 2 392-407 DOI: 10.1002/wcs.117 For further resources related to this article, please visit the WIREs website.

Spatially distributed encoding of covert attentional shifts in human thalamus

Spatial attention modulates signal processing within visual nuclei of the thalamus—but do other nuclei govern the locus of attention in top-down mode? We examined functional MRI (fMRI) data from three subjects performing a task requiring covert attention to 1 of 16 positions in a circular array. Target position was cued after stimulus offset, requiring subjects to perform target detection from iconic visual memory. We found positionally specific responses at multiple thalamic sites, with individual voxels activating at more than one direction of attentional shift. Voxel clusters at anatomically equivalent sites across subjects revealed a broad range of directional tuning at each site, with little sign of contralateral bias. By reference to a thalamic atlas, we identified the nuclear correspondence of the four most reliably activated sites across subjects: mediodorsal/central-intralaminar (oculomotor thalamus), caudal intralaminar/parafascicular, suprageniculate/limitans, and medial pulvinar/lateral posterior. Hence, the cortical network generating a top-down control signal for relocating attention acts in concert with a spatially selective thalamic apparatus—the set of active nuclei mirroring the thalamic territory of cortical “eye-field” areas, thus supporting theories which propose the visuomotor origins of covert attentional selection.

Lateralized Frontal Eye Field Activity Precedes Occipital Activity Shortly before Saccades: Evidence for Cortico-cortical Feedback as a Mechanism Underlying Covert Attention Shifts

When an eye movement is prepared, attention is shifted toward the saccade end-goal. This coupling of eye movements and spatial attention is thought to be mediated by cortical connections between the FEFs and the visual cortex. Here, we present evidence for the existence of these connections. A visual discrimination task was performed while recording the EEG. Discrimination performance was significantly improved when the discrimination target and the saccade target matched. EEG results show that frontal activity precedes occipital activity contralateral to saccade direction when the saccade is prepared but not yet executed; these effects were absent in fixation conditions. This is consistent with the idea that the FEF exerts a direct modulatory influence on the visual cortex and enhances perception at the saccade end-goal.

Neurophysiological and computational principles of cortical rhythms in cognition

Synchronous rhythms represent a core mechanism for sculpting temporal coordination of neural activity in the brain-wide network. This review focuses on oscillations in the cerebral cortex that occur during cognition, in alert behaving conditions. Over the last two decades, experimental and modeling work has made great strides in elucidating the detailed cellular and circuit basis of these rhythms, particularly gamma and theta rhythms. The underlying physiological mechanisms are diverse (ranging from resonance and pacemaker properties of single cells to multiple scenarios for population synchronization and wave propagation), but also exhibit unifying principles. A major conceptual advance was the realization that synaptic inhibition plays a fundamental role in rhythmogenesis, either in an interneuronal network or in a reciprocal excitatory-inhibitory loop. Computational functions of synchronous oscillations in cognition are still a matter of debate among systems neuroscientists, in part because the notion of regular oscillation seems to contradict the common observation that spiking discharges of individual neurons in the cortex are highly stochastic and far from being clocklike. However, recent findings have led to a framework that goes beyond the conventional theory of coupled oscillators and reconciles the apparent dichotomy between irregular single neuron activity and field potential oscillations. From this perspective, a plethora of studies will be reviewed on the involvement of long-distance neuronal coherence in cognitive functions such as multisensory integration, working memory, and selective attention. Finally, implications of abnormal neural synchronization are discussed as they relate to mental disorders like schizophrenia and autism.

Top-down control of visual attention

Top-down visual attention improves perception of selected stimuli and that improvement is reflected in the neural activity at many stages throughout the visual system. Recent studies of top-down attention have elaborated on the signatures of its effects within visual cortex and have begun identifying its causal basis. Evidence from these studies suggests that the correlates of spatial attention exhibited by neurons within the visual system originate from a distributed network of structures involved in the programming of saccadic eye movements. We summarize this evidence and discuss its relationship to the neural mechanisms of spatial working memory.

Studying the role of human parietal cortex in visuospatial attention with concurrent TMS-fMRI

Combining transcranial magnetic stimulation (TMS) with concurrent functional magnetic resonance imaging (fMRI) allows study of how local brain stimulation may causally affect activity in remote brain regions. Here, we applied bursts of high- or low-intensity TMS over right posterior parietal cortex, during a task requiring sustained covert visuospatial attention to either the left or right hemifield, or in a neutral control condition, while recording blood oxygenation-level–dependent signal with a posterior MR surface coil. As expected, the active attention conditions activated components of the well-described “attention network,” as compared with the neutral baseline. Also as expected, when comparing left minus right attention, or vice versa, contralateral occipital visual cortex was activated. The critical new finding was that the impact of high- minus low-intensity parietal TMS upon these visual regions depended on the currently attended side. High- minus low-intensity parietal TMS increased the difference between contralateral versus ipsilateral attention in right extrastriate visual cortex. A related albeit less pronounced pattern was found for left extrastriate visual cortex. Our results confirm that right human parietal cortex can exert attention-dependent influences on occipital visual cortex and provide a proof of concept for the use of concurrent TMS–fMRI in studying how remote influences can vary in a purely top–down manner with attentional demands.