The neural basis of visual attention

Spatial Attention Reduces Burstiness in Macaque Visual Cortical Area MST

Visual attention modulates the firing rate of neurons in many primate cortical areas. In V4, a cortical area in the ventral visual pathway, spatial attention has also been shown to reduce the tendency of neurons to fire closely separated spikes (burstiness). A recent model proposes that a single mechanism accounts for both the firing rate enhancement and the burstiness reduction in V4, but this has not been empirically tested. It is also unclear if the burstiness reduction by spatial attention is found in other visual areas and for other attentional types. We therefore recorded from single neurons in the medial superior temporal area (MST), a key motion-processing area along the dorsal visual pathway, of two rhesus monkeys while they performed a task engaging both spatial and feature-based attention. We show that in MST, spatial attention is associated with a clear reduction in burstiness that is independent of the concurrent enhancement of firing rate. In contrast, feature-based attention enhances firing rate but is not associated with a significant reduction in burstiness. These results establish burstiness reduction as a widespread effect of spatial attention. They also suggest that in contrast to the recently proposed model, the effects of spatial attention on burstiness and firing rate emerge from different mechanisms.

With or without you: predictive coding and Bayesian inference in the brain

Two theoretical ideas have emerged recently with the ambition to provide a unifying functional explanation of neural population coding and dynamics: predictive coding and Bayesian inference. Here, we describe the two theories and their combination into a single framework: Bayesian predictive coding. We clarify how the two theories can be distinguished, despite sharing core computational concepts and addressing an overlapping set of empirical phenomena. We argue that predictive coding is an algorithmic/representational motif that can serve several different computational goals of which Bayesian inference is but one. Conversely, while Bayesian inference can utilize predictive coding, it can also be realized by a variety of other representations. We critically evaluate the experimental evidence supporting Bayesian predictive coding and discuss how to test it more directly.

Task-specific, dimension-based attentional shaping of motion processing in monkey area MT

Nonspatially selective attention is based on the notion that specific features or objects in the visual environment are effectively prioritized in cortical visual processing. Feature-based attention (FBA), in particular, is a well-studied process that dynamically and selectively addresses neurons preferentially processing the attended feature attribute (e.g., leftward motion). In everyday life, however, behavior may require high sensitivity for an entire feature dimension (e.g., motion), but experimental evidence for a feature dimension-specific attentional modulation on a cellular level is lacking. Therefore, we investigated neuronal activity in macaque motion-selective mediotemporal area (MT) in an experimental setting requiring the monkeys to detect either a motion change or a color change. We hypothesized that neural activity in MT is enhanced when the task requires perceptual sensitivity to motion. In line with this, we found that mean firing rates were higher in the motion task and that response variability and latency were lower compared with values in the color task, despite identical visual stimulation. This task-specific, dimension-based modulation of motion processing emerged already in the absence of visual input, was independent of the relation between the attended and stimulating motion direction, and was accompanied by a spatially global reduction of neuronal variability. The results provide single-cell support for the hypothesis of a feature dimension-specific top-down signal emphasizing the processing of an entire feature class.NEW & NOTEWORTHY Cortical processing serving visual perception prioritizes information according to current task requirements. We provide evidence in favor of a dimension-based attentional mechanism addressing all neurons that process visual information in the task-relevant feature domain. Behavioral tasks required monkeys to attend either color or motion, causing modulations of response strength, variability, latency, and baseline activity of motion-selective monkey area MT neurons irrespective of the attended motion direction but specific to the attended feature dimension.

Impaired Activation of Visual Attention Network for Motion Salience Is Accompanied by Reduced Functional Connectivity between Frontal Eye Fields and Visual Cortex in Strabismic Amblyopia

Strabismic amblyopia is now acknowledged to be more than a simple loss of acuity and to involve alterations in visually driven attention, though whether this applies to both stimulus-driven and goal-directed attention has not been explored. Hence we investigated monocular threshold performance during a motion salience-driven attention task involving detection of a coherent dot motion target in one of four quadrants in adult controls and those with strabismic amblyopia. Psychophysical motion thresholds were impaired for the strabismic amblyopic eye, requiring longer inspection time and consequently slower target speed for detection compared to the fellow eye or control eyes. We compared fMRI activation and functional connectivity between four ROIs of the occipital-parieto-frontal visual attention network [primary visual cortex (V1), motion sensitive area V5, intraparietal sulcus (IPS) and frontal eye fields (FEF)], during a suprathreshold version of the motion-driven attention task, and also a simple goal-directed task, requiring voluntary saccades to targets randomly appearing along a horizontal line. Activation was compared when viewed monocularly by controls and the amblyopic and its fellow eye in strabismics. BOLD activation was weaker in IPS, FEF and V5 for both tasks when viewing through the amblyopic eye compared to viewing through the fellow eye or control participants' non-dominant eye. No difference in V1 activation was seen between the amblyopic and fellow eye, nor between the two eyes of control participants during the motion salience task, though V1 activation was significantly less through the amblyopic eye than through the fellow eye and control group non-dominant eye viewing during the voluntary saccade task. Functional correlations of ROIs within the attention network were impaired through the amblyopic eye during the motion salience task, whereas this was not the case during the voluntary saccade task. Specifically, FEF showed reduced functional connectivity with visual cortical nodes during the motion salience task through the amblyopic eye, despite suprathreshold detection performance. This suggests that the reduced ability of the amblyopic eye to activate the frontal components of the attention networks may help explain the aberrant control of visual attention and eye movements in amblyopes.

Differential Contribution of Low- and High-level Image Content to Eye Movements in Monkeys and Humans

Oculomotor selection exerts a fundamental impact on our experience of the environment. To better understand the underlying principles, researchers typically rely on behavioral data from humans, and electrophysiological recordings in macaque monkeys. This approach rests on the assumption that the same selection processes are at play in both species. To test this assumption, we compared the viewing behavior of 106 humans and 11 macaques in an unconstrained free-viewing task. Our data-driven clustering analyses revealed distinct human and macaque clusters, indicating species-specific selection strategies. Yet, cross-species predictions were found to be above chance, indicating some level of shared behavior. Analyses relying on computational models of visual saliency indicate that such cross-species commonalities in free viewing are largely due to similar low-level selection mechanisms, with only a small contribution by shared higher level selection mechanisms and with consistent viewing behavior of monkeys being a subset of the consistent viewing behavior of humans.

Using Eye Tracking to Understand Infants' Attentional Bias for Faces

Infants have a natural tendency to look at adults' faces, possibly to help initiate vital interactions with caregivers during sensitive periods of development. Recent studies using eye-tracking technologies have identified the mechanisms that underlie infants' capacity to orient and hold attention on faces. These studies have shown that the bias for faces is weak in young infants, but becomes more robust and resistant to distraction during the second half of the 1st year. This development is apparently related to more general changes in infants' attention and control of eye movement. As a tractable and reproducible aspect of infant behavior, the attention bias for faces can be used to examine the neural correlates of attention and may be a way to monitor early neurodevelopment in infants.

Effects of Alzheimer's Disease on Visual Target Detection: A "Peripheral Bias"

Visual exploration is an omnipresent activity in everyday life, and might represent an important determinant of visual attention deficits in patients with Alzheimer's Disease (AD). The present study aimed at investigating visual search performance in AD patients, in particular target detection in the far periphery, in daily living scenes. Eighteen AD patients and 20 healthy controls participated in the study. They were asked to freely explore a hemispherical screen, covering ±90°, and to respond to targets presented at 10°, 30°, and 50° eccentricity, while their eye movements were recorded. Compared to healthy controls, AD patients recognized less targets appearing in the center. No difference was found in target detection in the periphery. This pattern was confirmed by the fixation distribution analysis. These results show a neglect for the central part of the visual field for AD patients and provide new insights by mean of a search task involving a larger field of view.

Reduced posterior parietal cortex activation after training on a visual search task

Gaining experience on a cognitive task improves behavioral performance and is thought to enhance brain efficiency. Despite the body of literature already published on the effects of training on brain activation, less research has been carried out on visual search attention processes under well controlled conditions. Thirty-six healthy adults divided into trained and control groups completed a pre-post letter-based visual search task fMRI study in one day. Twelve letters were used as targets and ten as distractors. The trained group completed a training session (840 trials) with half the targets between scans. The effects of training were studied at the behavioral and brain levels by controlling for repetition effects using both between-subjects (trained vs. control groups) and within-subject (trained vs. untrained targets) controls. The trained participants reduced their response speed by 31% as a result of training, maintaining their accuracy scores, whereas the control group hardly changed. Neural results revealed that brain changes associated with visual search training were circumscribed to reduced activation in the posterior parietal cortex (PPC) when controlling for group, and they included inferior occipital areas when controlling for targets. The observed behavioral and brain changes are discussed in relation to automatic behavior development. The observed training-related decreases could be associated with increased neural efficiency in specific key regions for task performance.

Sensory Prioritization in Rats: Behavioral Performance and Neuronal Correlates

Operating with some finite quantity of processing resources, an animal would benefit from prioritizing the sensory modality expected to provide key information in a particular context. The present study investigated whether rats dedicate attentional resources to the sensory modality in which a near-threshold event is more likely to occur. We manipulated attention by controlling the likelihood with which a stimulus was presented from one of two modalities. In a whisker session, 80% of trials contained a brief vibration stimulus applied to whiskers and the remaining 20% of trials contained a brief change of luminance. These likelihoods were reversed in a visual session. When a stimulus was presented in the high-likelihood context, detection performance increased and was faster compared with the same stimulus presented in the low-likelihood context. Sensory prioritization was also reflected in neuronal activity in the vibrissal area of primary somatosensory cortex: single units responded differentially to the whisker vibration stimulus when presented with higher probability compared with lower probability. Neuronal activity in the vibrissal cortex displayed signatures of multiplicative gain control and enhanced response to vibration stimuli during the whisker session. In conclusion, rats allocate priority to the more likely stimulus modality and the primary sensory cortex may participate in the redistribution of resources.

SIGNIFICANCE STATEMENT

Detection of low-amplitude events is critical to survival; for example, to warn prey of predators. To formulate a response, decision-making systems must extract minute neuronal signals from the sensory modality that provides key information. Here, we identify the behavioral and neuronal correlates of sensory prioritization in rats. Rats were trained to detect whisker vibrations or visual flickers. Stimuli were embedded in two contexts in which either visual or whisker modality was more likely to occur. When a stimulus was presented in the high-likelihood context, detection was faster and more reliable. Neuronal recording from the vibrissal cortex revealed enhanced representation of vibrations in the prioritized context. These results establish the rat as an alternative model organism to primates for studying attention.

A field study on the effects of digital billboards on glance behavior during highway driving

Developments in lighting technologies have allowed more dynamic digital billboards in locations visible from the roadway. Decades of laboratory research have shown that rapidly changing or moving stimuli presented in peripheral vision tends to 'capture' covert attention. We report naturalistic glance and driving behavior of a large sample of drivers who were exposed to two digital billboards on a segment of highway largely free from extraneous signage. Results show a significant shift in the number and length of glances toward the billboards and an increased percentage of time glancing off road in their presence. Findings were particularly evident at the time the billboards transitioned between advertisements. Since rapidly changing stimuli are difficult to ignore, the planned increase in episodically changing digital displays near the roadway may be argued to be a potential safety concern. The impact of digital billboards on driver safety and the need for continued research are discussed.

Attention-Related Eye Vergence Measured in Children with Attention Deficit Hyperactivity Disorder

Recent evidence shows a novel role for eye vergence in orienting attention in adult subjects. Here we investigated whether such modulation in eye vergence by attention is present in children and whether it is altered in children with ADHD compared to control subjects. We therefore measured the angle of eye vergence in children previously diagnosed with ADHD while performing a cue task and compared the results to those from age-matched controls. We observed a strong modulation in the angle of vergence in the control group and a weak modulation in the ADHD group. In addition, in the control group the modulation in eye vergence was different between the informative cue and uninformative cue condition. This difference was less noticeable in the ADHD group. Our study supports the observation of deficient binocular vision in ADHD children. We argue that the observed disruption in vergence modulation in ADHD children is manifest of altered cognitive processing of sensory information. Our work may provide new insights into attention disorders, like ADHD.

Neuronal Mechanisms of Visual Attention

Advances on several fronts have refined our understanding of the neuronal mechanisms of attention. This review focuses on recent progress in understanding visual attention through single-neuron recordings made in behaving subjects. Simultaneous recordings from populations of individual cells have shown that attention is associated with changes in the correlated firing of neurons that can enhance the quality of sensory representations. Other work has shown that sensory normalization mechanisms are important for explaining many aspects of how visual representations change with attention, and these mechanisms must be taken into account when evaluating attention-related neuronal modulations. Studies comparing different brain structures suggest that attention is composed of several cognitive processes, which might be controlled by different brain regions. Collectively, these and other recent findings provide a clearer picture of how representations in the visual system change when attention shifts from one target to another.

Modulation of Neuronal Responses by Exogenous Attention in Macaque Primary Visual Cortex

Visual perception is influenced by attention deployed voluntarily or triggered involuntarily by salient stimuli. Modulation of visual cortical processing by voluntary or endogenous attention has been extensively studied, but much less is known about how involuntary or exogenous attention affects responses of visual cortical neurons. Using implanted microelectrode arrays, we examined the effects of exogenous attention on neuronal responses in the primary visual cortex (V1) of awake monkeys. A bright annular cue was flashed either around the receptive fields of recorded neurons or in the opposite visual field to capture attention. A subsequent grating stimulus probed the cue-induced effects. In a fixation task, when the cue-to-probe stimulus onset asynchrony (SOA) was <240 ms, the cue induced a transient increase of neuronal responses to the probe at the cued location during 40-100 ms after the onset of neuronal responses to the probe. This facilitation diminished and disappeared after repeated presentations of the same cue but recurred for a new cue of a different color. In another task to detect the probe, relative shortening of monkey's reaction times for the validly cued probe depended on the SOA in a way similar to the cue-induced V1 facilitation, and the behavioral and physiological cueing effects remained after repeated practice. Flashing two cues simultaneously in the two opposite visual fields weakened or diminished both the physiological and behavioral cueing effects. Our findings indicate that exogenous attention significantly modulates V1 responses and that the modulation strength depends on both novelty and task relevance of the stimulus. Significance statement: Visual attention can be involuntarily captured by a sudden appearance of a conspicuous object, allowing rapid reactions to unexpected events of significance. The current study discovered a correlate of this effect in monkey primary visual cortex. An abrupt, salient, flash enhanced neuronal responses, and shortened the animal's reaction time, to a subsequent visual probe stimulus at the same location. However, the enhancement of the neural responses diminished after repeated exposures to this flash if the animal was not required to react to the probe. Moreover, a second, simultaneous, flash at another location weakened the neuronal and behavioral effects of the first one. These findings revealed, beyond the observations reported so far, the effects of exogenous attention in the brain.

Evaluation of local field potential signals in decoding of visual attention

In the field of brain research, attention as one of the main issues in cognitive neuroscience is an important mechanism to be studied. The complicated structure of the brain cannot process all the information it receives at any moment. Attention, in fact, is considered as a possible useful mechanism in which brain concentrates on the processing of important information which is required at any certain moment. The main goal of this study is decoding the location of visual attention from local field potential signals recorded from medial temporal (MT) area of a macaque monkey. To this end, feature extraction and feature selection are applied in both the time and the frequency domains. After applying feature extraction methods such as the short time Fourier transform, continuous wavelet transform (CWT), and wavelet energy (scalogram), feature selection methods are evaluated. Feature selection methods used here are T-test, Entropy, receiver operating characteristic, and Bhattacharyya. Subsequently, different classifiers are utilized in order to decode the location of visual attention. At last, the performances of the employed classifiers are compared. The results show that the maximum information about the visual attention in area MT exists in the low frequency features. Interestingly, low frequency features over all the time-axis and all of the frequency features at the initial time interval in the spectrogram domain contain the most valuable information related to the decoding of spatial attention. In the CWT and scalogram domains, this information exists in the low frequency features at the initial time interval. Furthermore, high performances are obtained for these features in both the time and the frequency domains. Among different employed classifiers, the best achieved performance which is about 84.5 % belongs to the K-nearest neighbor classifier combined with the T-test method for feature selection in the time domain. Additionally, the best achieved result (82.9 %) is related to the spectrogram with the least number of selected features as large as 200 features using the T-test method and SVM classifier in the time-frequency domain.

Attention in Active Vision: A Perspective on Perceptual Continuity Across Saccades

Alfred L. Yarbus was among the first to demonstrate that eye movements actively serve our perceptual and cognitive goals, a crucial recognition that is at the heart of today's research on active vision. He realized that not the changes in fixation stick in memory but the changes in shifts of attention. Indeed, oculomotor control is tightly coupled to functions as fundamental as attention and memory. This tight relationship offers an intriguing perspective on transsaccadic perceptual continuity, which we experience despite the fact that saccades cause rapid shifts of the image across the retina. Here, I elaborate this perspective based on a series of psychophysical findings. First, saccade preparation shapes the visual system's priorities; it enhances visual performance and perceived stimulus intensity at the targets of the eye movement. Second, before saccades, the deployment of visual attention is updated, predictively facilitating perception at those retinal locations that will be relevant once the eyes land. Third, saccadic eye movements strongly affect the contents of visual memory, highlighting their crucial role for which parts of a scene we remember or forget. Together, these results provide insights on how attentional processes enable the visual system to cope with the retinal consequences of saccades.

Remapping, Spatial Stability, and Temporal Continuity: From the Pre-Saccadic to Postsaccadic Representation of Visual Space in LIP

As our eyes move, we have a strong percept that the world is stable in space and time; however, the signals in cortex coming from the retina change with each eye movement. It is not known how this changing input produces the visual percept we experience, although the predictive remapping of receptive fields has been described as a likely candidate. To explain how remapping accounts for perceptual stability, we examined responses of neurons in the lateral intraparietal area while animals performed a visual foraging task. When a stimulus was brought into the response field of a neuron that exhibited remapping, the onset of the postsaccadic representation occurred shortly after the saccade ends. Whenever a stimulus was taken out of the response field, the presaccadic representation abruptly ended shortly after the eyes stopped moving. In the 38% (20/52) of neurons that exhibited remapping, there was no more than 30 ms between the end of the presaccadic representation and the start of the postsaccadic representation and, in some neurons, and the population as a whole, it was continuous. We conclude by describing how this seamless shift from a presaccadic to postsaccadic representation could contribute to spatial stability and temporal continuity.

A hard-wired priority map in the superior colliculus shaped by asymmetric inhibitory circuitry

The mammalian superior colliculus (SC) is a laminar midbrain structure that translates visual signals into commands to shift the focus of attention and gaze. The SC plays an integral role in selecting targets and ultimately generating rapid eye movements to those targets. In all mammals studied to date, neurons in the SC are arranged topographically such that the location of visual stimuli and the endpoints of orienting movements form organized maps in superficial and deeper layers, respectively. The organization of these maps is thought to underlie attentional priority by assessing which regions of the visual field contain behaviorally relevant information. Using voltage imaging and patch-clamp recordings in parasagittal SC slices from the rat, we found the synaptic circuitry of the visuosensory map in the SC imposes a strong bias. Voltage imaging of responses to electrical stimulation revealed more spread in the caudal direction than the rostral direction. Pharmacological experiments demonstrated that this asymmetry arises from GABAA receptor activation rostral to the site of stimulation. Patch-clamp recordings confirmed this rostrally directed inhibitory circuit and showed that it is contained within the visuosensory layers of the SC. Stimulation of two sites showed that initial stimulation of a caudal site can take priority over subsequent stimulation of a rostral site. Taken together, our data indicate that the circuitry of the visuosensory SC is hard-wired to give higher priority to more peripheral targets, and this property is conferred by a uniquely structured, dedicated inhibitory circuit.

There's Waldo! A Normalization Model of Visual Search Predicts Single-Trial Human Fixations in an Object Search Task

When searching for an object in a scene, how does the brain decide where to look next? Visual search theories suggest the existence of a global "priority map" that integrates bottom-up visual information with top-down, target-specific signals. We propose a mechanistic model of visual search that is consistent with recent neurophysiological evidence, can localize targets in cluttered images, and predicts single-trial behavior in a search task. This model posits that a high-level retinotopic area selective for shape features receives global, target-specific modulation and implements local normalization through divisive inhibition. The normalization step is critical to prevent highly salient bottom-up features from monopolizing attention. The resulting activity pattern constitues a priority map that tracks the correlation between local input and target features. The maximum of this priority map is selected as the locus of attention. The visual input is then spatially enhanced around the selected location, allowing object-selective visual areas to determine whether the target is present at this location. This model can localize objects both in array images and when objects are pasted in natural scenes. The model can also predict single-trial human fixations, including those in error and target-absent trials, in a search task involving complex objects.

A decisional account of subjective inflation of visual perception at the periphery

Human peripheral vision appears vivid compared to foveal vision; the subjectively perceived level of detail does not seem to drop abruptly with eccentricity. This compelling impression contrasts with the fact that spatial resolution is substantially lower at the periphery. A similar phenomenon occurs in visual attention, in which subjects usually overestimate their perceptual capacity in the unattended periphery. We have previously shown that at identical eccentricity, low spatial attention is associated with liberal detection biases, which we argue may reflect inflated subjective perceptual qualities. Our computational model suggests that this subjective inflation occurs because under the lack of attention, the trial-by-trial variability of the internal neural response is increased, resulting in more frequent surpassing of a detection criterion. In the current work, we hypothesized that the same mechanism may be at work in peripheral vision. We investigated this possibility in psychophysical experiments in which participants performed a simultaneous detection task at the center and at the periphery. Confirming our hypothesis, we found that participants adopted a conservative criterion at the center and liberal criterion at the periphery. Furthermore, an extension of our model predicts that detection bias will be similar at the center and at the periphery if the periphery stimuli are magnified. A second experiment successfully confirmed this prediction. These results suggest that, although other factors contribute to subjective inflation of visual perception in the periphery, such as top-down filling-in of information, the decision mechanism may be relevant too.

Spatial attention enhances object coding in local and distributed representations of the lateral occipital complex

The modulation of neural activity in visual cortex is thought to be a key mechanism of visual attention. The investigation of attentional modulation in high-level visual areas, however, is hampered by the lack of clear tuning or contrast response functions. In the present functional magnetic resonance imaging study we therefore systematically assessed how small voxel-wise biases in object preference across hundreds of voxels in the lateral occipital complex were affected when attention was directed to objects. We found that the strength of attentional modulation depended on a voxel's object preference in the absence of attention, a pattern indicative of an amplificatory mechanism. Our results show that such attentional modulation effectively increased the mutual information between voxel responses and object identity. Further, these local modulatory effects led to improved information-based object readout at the level of multi-voxel activation patterns and to an increased reproducibility of these patterns across repeated presentations. We conclude that attentional modulation enhances object coding in local and distributed object representations of the lateral occipital complex.

The role of eye movement driven attention in functional strabismic amblyopia

Strabismic amblyopia “blunt vision” is a developmental anomaly that affects binocular vision and results in lowered visual acuity. Strabismus is a term for a misalignment of the visual axes and is usually characterized by impaired ability of the strabismic eye to take up fixation. Such impaired fixation is usually a function of the temporally and spatially impaired binocular eye movements that normally underlie binocular shifts in visual attention. In this review, we discuss how abnormal eye movement function in children with misaligned eyes influences the development of normal binocular visual attention and results in deficits in visual function such as depth perception. We also discuss how eye movement function deficits in adult amblyopia patients can also lead to other abnormalities in visual perception. Finally, we examine how the nonamblyopic eye of an amblyope is also affected in strabismic amblyopia.

Impaired oculo-motor behaviour affects both reading and scene perception in neglect patients

Unilateral spatial neglect (USN) is a common neuropsychological disorder following a right-sided brain lesion. Although USN is mostly characterized by symptoms involving the left hemispace, other symptoms are not left lateralized. Recently, it was shown that patients with neglect dyslexia, a reading disturbance that affects about 40% of USN patients, manifest a non-lateralized impairment of eye movement behaviour in association with their reading deficit when they read aloud and perform non-verbal saccadic tasks (Primativo et al., 2013). In the present paper, we aimed to demonstrate that the eye movement impairment shown by some USN patients reflects a more general oculo-motor disorder that is not confined to orthographic material, the horizontal axis or constrained saccadic tasks. We conjectured that inaccurate oculo-motor behaviour in USN patients indicates the presence of a reading deficit. With this aim we evaluated 20 patients, i.e., 10 right-sided brain-damaged patients without neglect and 10 patients affected by USN. On the basis of the patients' eye movement patterns during a scene exploration task, we found that 4 out of the 10 USN patients presented an abnormal oculo-motor pattern. These same four patients (but not the others) also failed in performing 5 different saccadic tasks and produced neglect dyslexia reading errors in both single words and texts. First, we show that a large proportion of USN patients have inaccurate eye movement behaviour in non-reading tasks. Second, we demonstrate that this exploratory deficit is predictive of the reading impairment. Thus, we conclude that the eye movement deficit prevents reading and impairs the performance on many other perceptual tests, including scene exploration. The large percentage of patients with impaired eye-movement pattern suggests that particular attention should be paid to eye movement behaviour during the diagnostic phase in order to program the best rehabilitation strategy for each patient.

Attentional trade-offs maintain the tracking of moving objects across saccades

In many situations like playing sports or driving a car, we keep track of moving objects, despite the frequent eye movements that drastically interrupt their retinal motion trajectory. Here we report evidence that transsaccadic tracking relies on trade-offs of attentional resources from a tracked object's motion path to its remapped location. While participants covertly tracked a moving object, we presented pulses of coherent motion at different locations to probe the allocation of spatial attention along the object's entire motion path. Changes in the sensitivity for these pulses showed that during fixation attention shifted smoothly in anticipation of the tracked object's displacement. However, just before a saccade, attentional resources were withdrawn from the object's current motion path and reflexively drawn to the retinal location the object would have after saccade. This finding demonstrates the predictive choice the visual system makes to maintain the tracking of moving objects across saccades.

Vision in avian emberizid foragers: maximizing both binocular vision and fronto-lateral visual acuity

Avian species vary in their visual system configuration, but previous studies have often compared single visual traits between 2-3 distantly related species. However, birds use different visual dimensions that cannot be maximized simultaneously to meet different perceptual demands, potentially leading to trade-offs between visual traits. We studied the degree of inter-specific variation in multiple visual traits related to foraging and anti-predator behaviors in nine species of closely related emberizid sparrows, controlling for phylogenetic effects. Emberizid sparrows maximize binocular vision, even seeing their bill tips, which may enhance the detection of prey and facilitate food handling. Sparrows have a single retinal center of acute vision (i.e., fovea) projecting fronto-laterally (but not into the binocular field). The foveal projection close to the edge of the binocular field may shorten the time to gather and process both monocular and binocular visual information from the foraging substrate. Contrary to previous work, we found that species with larger visual fields had higher visual acuity, which may compensate for larger blind spots (i.e., pectens) above the center of acute vision, enhancing predator detection. Finally, species with a steeper change in ganglion cell density across the retina had higher eye movement amplitude likely due to a more pronounced reduction in visual resolution away from the fovea, which would need to be moved around more frequently. The visual configuration of emberizid passive prey foragers is substantially different from that of previously studied avian groups (e.g., sit-and-wait and tactile foragers).

Disentangling the Role of Cortico-Basal Ganglia Loops in Top-Down and Bottom-Up Visual Attention: An Investigation of Attention Deficits in Parkinson Disease

It is solidly established that top-down (goal-driven) and bottom-up (stimulus-driven) attention mechanisms depend on distributed cortical networks, including prefrontal and frontoparietal regions. On the other hand, it is less clear whether the BG also contribute to one or the other of these mechanisms, or to both. The current study was principally undertaken to clarify this issue. Parkinson disease (PD), a neurodegenerative disorder primarily affecting the BG, has proven to be an effective model for investigating the contribution of the BG to different brain functions; therefore, we set out to investigate deficits of top-down and bottom-up attention in a selected cohort of PD patients. With this objective in mind, we compared the performance on three computerized tasks of two groups of 12 parkinsonian patients (assessed without any treatment), one otherwise pharmacologically treated and the other also surgically treated, with that of a group of controls. The main behavioral tool for our study was an attentional capture task, which enabled us to tap the competition between top-down and bottom-up mechanisms of visual attention. This task was suitably combined with a choice RT and a simple RT task to isolate any specific deficit of attention from deficits in motor response selection and initiation. In the two groups of patients, we found an equivalent increase of attentional capture but also comparable delays in target selection in the absence of any salient distractor (reflecting impaired top-down mechanisms) and movement initiation compared with controls. In contrast, motor response selection processes appeared to be prolonged only in the operated patients. Our results confirm that the BG are involved in both motor and cognitive domains. Specifically, damage to the BG, as it occurs in PD, leads to a distinct deficit of top-down control of visual attention, and this can account, albeit indirectly, for the enhancement of attentional capture, reflecting weakened ability of top-down mechanisms to antagonize bottom-up control.

Non-holistic coding of objects in lateral occipital complex with and without attention

A fundamental issue in visual cognition is whether high-level visual areas code objects in a part-based or a view-based (holistic) format. Previous behavioral and neuroimaging studies that examined the viewpoint invariance of object recognition have yielded ambiguous results, providing evidence for either type of representational format. A critical factor distinguishing the two formats could be the availability of attentional resources, as a number of priming studies have found greater viewpoint invariance for attended compared to unattended objects. It has therefore been suggested that the activation of part-based representations requires attention, whereas the activation of holistic representations occurs automatically irrespective of attention. Using functional magnetic resonance imaging in combination with a novel multivariate pattern analysis approach, the present study probed the format of object representations in human lateral occipital complex and its dependence on attention. We presented human participants with intact and half-split versions of objects that were either attended or unattended. Cross-classifying between intact and split objects, we found that the object-related information coded in activation patterns of intact objects is fully preserved in the patterns of split objects and vice versa. Importantly, the generalization between intact and split objects did not depend on attention. We conclude that lateral occipital complex codes objects in a non-holistic format, both in the presence and absence of attention.

Individual variation in cone photoreceptor density in house sparrows: implications for between-individual differences in visual resolution and chromatic contrast

Between-individual variation has been documented in a wide variety of taxa, especially for behavioral characteristics; however, intra-population variation in sensory systems has not received similar attention in wild animals. We measured a key trait of the visual system, the density of retinal cone photoreceptors, in a wild population of house sparrows (Passer domesticus). We tested whether individuals differed from each other in cone densities given within-individual variation across the retina and across eyes. We further tested whether the existing variation could lead to individual differences in two aspects of perception: visual resolution and chromatic contrast. We found consistent between-individual variation in the densities of all five types of avian cones, involved in chromatic and achromatic vision. Using perceptual modeling, we found that this degree of variation translated into significant between-individual differences in visual resolution and the chromatic contrast of a plumage signal that has been associated with mate choice and agonistic interactions. However, there was no evidence for a relationship between individual visual resolution and chromatic contrast. The implication is that some birds may have the sensory potential to perform "better" in certain visual tasks, but not necessarily in both resolution and contrast simultaneously. Overall, our findings (a) highlight the need to consider multiple individuals when characterizing sensory traits of a species, and (b) provide some mechanistic basis for between-individual variation in different behaviors (i.e., animal personalities) and for testing the predictions of several widely accepted hypotheses (e.g., honest signaling).

Identification of a brainstem circuit regulating visual cortical state in parallel with locomotion

Sensory processing is dependent upon behavioral state. In mice, locomotion is accompanied by changes in cortical state and enhanced visual responses. Although recent studies have begun to elucidate intrinsic cortical mechanisms underlying this effect, the neural circuits that initially couple locomotion to cortical processing are unknown. The mesencephalic locomotor region (MLR) has been shown to be capable of initiating running and is associated with the ascending reticular activating system. Here, we find that optogenetic stimulation of the MLR in awake, head-fixed mice can induce both locomotion and increases in the gain of cortical responses. MLR stimulation below the threshold for overt movement similarly changed cortical processing, revealing that MLR's effects on cortex are dissociable from locomotion. Likewise, stimulation of MLR projections to the basal forebrain also enhanced cortical responses, suggesting a pathway linking the MLR to cortex. These studies demonstrate that the MLR regulates cortical state in parallel with locomotion.

Descending control of neural bias and selectivity in a spatial attention network: rules and mechanisms

The brain integrates stimulus-driven (exogenous) activity with internally generated (endogenous) activity to compute the highest priority stimulus for gaze and attention. Little is known about how this computation is accomplished neurally. We explored the underlying functional logic in a critical component of the spatial attention network, the optic tectum (OT, superior colliculus in mammals), in awake barn owls. We found that space-specific endogenous influences, evoked by activating descending forebrain pathways, bias competition among exogenous influences, and substantially enhance the quality of the categorical neural pointer to the highest priority stimulus. These endogenous influences operate across sensory modalities. Biologically grounded modeling revealed that the observed effects on network bias and selectivity require a simple circuit mechanism: endogenously driven gain modulation of feedback inhibition among competing channels. Our findings reveal fundamental principles by which internal and external information combine to guide selection of the next target for gaze and attention.

Neural correlates associated with superior tactile symmetry perception in the early blind

Symmetry is an organizational principle that is ubiquitous throughout the visual world. However, this property can also be detected through non-visual modalities such as touch. The role of prior visual experience on detecting tactile patterns containing symmetry remains unclear. We compared the behavioral performance of early blind and sighted (blindfolded) controls on a tactile symmetry detection task. The tactile patterns used were similar in design and complexity as in previous visual perceptual studies. The neural correlates associated with this behavioral task were identified with functional magnetic resonance imaging (fMRI). In line with growing evidence demonstrating enhanced tactile processing abilities in the blind, we found that early blind individuals showed significantly superior performance in detecting tactile symmetric patterns compared to sighted controls. Furthermore, comparing patterns of activation between these two groups identified common areas of activation (e.g. superior parietal cortex) but key differences also emerged. In particular, tactile symmetry detection in the early blind was also associated with activation that included peri-calcarine cortex, lateral occipital (LO), and middle temporal (MT) cortex, as well as inferior temporal and fusiform cortex. These results contribute to the growing evidence supporting superior behavioral abilities in the blind, and the neural correlates associated with crossmodal neuroplasticity following visual deprivation.

Altering spatial priority maps via reward-based learning

Spatial priority maps are real-time representations of the behavioral salience of locations in the visual field, resulting from the combined influence of stimulus driven activity and top-down signals related to the current goals of the individual. They arbitrate which of a number of (potential) targets in the visual scene will win the competition for attentional resources. As a result, deployment of visual attention to a specific spatial location is determined by the current peak of activation (corresponding to the highest behavioral salience) across the map. Here we report a behavioral study performed on healthy human volunteers, where we demonstrate that spatial priority maps can be shaped via reward-based learning, reflecting long-lasting alterations (biases) in the behavioral salience of specific spatial locations. These biases exert an especially strong influence on performance under conditions where multiple potential targets compete for selection, conferring competitive advantage to targets presented in spatial locations associated with greater reward during learning relative to targets presented in locations associated with lesser reward. Such acquired biases of spatial attention are persistent, are nonstrategic in nature, and generalize across stimuli and task contexts. These results suggest that reward-based attentional learning can induce plastic changes in spatial priority maps, endowing these representations with the "intelligent" capacity to learn from experience.

Spatial patterns of fixation-switch behavior in strabismic monkeys

PURPOSE

Patients with strabismus perceptually suppress information from one eye to avoid double vision. Mechanisms of visual suppression likely lead to fixation-switch behavior wherein the subject acquires targets with a specific eye depending on target location in space. The purpose of this study was to investigate spatial patterns of fixation-switch behavior in strabismic monkeys.

METHODS

Eye movements were acquired in three exotropic and one esotropic monkey in a binocular viewing saccade task. Spatial patterns of fixation were analyzed by calculating incidence of using either eye to fixate targets presented at various gaze locations.

RESULTS

Broadly, spatial fixation patterns and fixation-switch behavior followed expectations if a portion of the temporal retina was suppressed in exotropia and a portion of the nasal retina was suppressed in esotropia. Fixation-switch occurred for horizontal target locations that were approximately greater than halfway between the lines of sight of the foveating and strabismic eyes. Surprisingly, the border between right eye and left eye fixation zones was not sharply defined and there was a significant extent (>10°) over which the monkeys could acquire a target with either eye.

CONCLUSIONS

We propose that spatial fixation patterns in strabismus can be accounted for in a decision framework wherein the oculomotor system has access to retinal error information from each eye and the brain chooses between them to prepare a saccade. For target locations approximately midway between the two foveae, strength of retinal error representations from each eye is almost equal, leading to trial-to-trial variability in choice of fixating eye.

Effect of microstimulation of the superior colliculus on visual space attention

We investigated the effect of microstimulation of the superficial layers of the superior colliculus (SC) on the performance of animals in a peripheral detection paradigm while maintaining fixation. In a matching-to-sample paradigm, a sample stimulus was presented at one location followed by a brief test stimulus at that (relevant) location and a distractor at another (irrelevant) location. While maintaining fixation, the monkey indicated whether the sample and the test stimulus matched, ignoring the distractor. The relevant and irrelevant locations were switched from trial to trial. Cells in the superficial layers of SC gave enhanced responses when the attended test stimulus was inside the receptive field compared with when the (physically identical) distractor was inside the field. These effects were found only in an "automatic" attentional cueing paradigm, in which a peripheral stimulus explicitly cued the animal as to the relevant location in the receptive field. No attentional effects were found with block of trials. The transient enhancement to the attended stimulus was observed at the onset and not at the offset of the stimulus. Electrical stimulation at the site corresponding to the irrelevant distractor location in the SC causes it to gain control over attention, causing impaired performance of the task at the relevant location. Stimulation at unattended sites without the presence of a distractor stimulus causes little or no impairment in performance. The effect of stimulation decays with successive stimulations. The animals learn to ignore the stimulation unless the parameters of the task are varied.

Brain white matter microstructure alterations in adolescent rhesus monkeys exposed to early life stress: associations with high cortisol during infancy

BACKGROUND

Early adverse experiences, especially those involving disruption of the mother-infant relationship, are detrimental for proper socioemotional development in primates. Humans with histories of childhood maltreatment are at high risk for developing psychopathologies including depression, anxiety, substance abuse, and behavioral disorders. However, the underlying neurodevelopmental alterations are not well understood. Here we used a nonhuman primate animal model of infant maltreatment to study the long-term effects of this early life stress on brain white matter integrity during adolescence, its behavioral correlates, and the relationship with early levels of stress hormones.

METHODS

Diffusion tensor imaging and tract based spatial statistics were used to investigate white matter integrity in 9 maltreated and 10 control animals during adolescence. Basal plasma cortisol levels collected at one month of age (when abuse rates were highest) were correlated with white matter integrity in regions with group differences. Total aggression was also measured and correlated with white matter integrity.

RESULTS

We found significant reductions in white matter structural integrity (measured as fractional anisotropy) in the corpus callosum, occipital white matter, external medullary lamina, as well as in the brainstem of adolescent rhesus monkeys that experienced maternal infant maltreatment. In most regions showing fractional anisotropy reductions, opposite effects were detected in radial diffusivity, without changes in axial diffusivity, suggesting that the alterations in tract integrity likely involve reduced myelin. Moreover, in most regions showing reduced white matter integrity, this was associated with elevated plasma cortisol levels early in life, which was significantly higher in maltreated than in control infants. Reduced fractional anisotropy in occipital white matter was also associated with increased social aggression.

CONCLUSIONS

These findings highlight the long-term impact of infant maltreatment on brain white matter structural integrity, particularly in tracts involved in visual processing, emotional regulation, and somatosensory and motor integration. They also suggest a relationship between elevations in stress hormones detected in maltreated animals during infancy and long-term brain white matter structural effects.

Spatial representation and cognitive modulation of response variability in the lateral intraparietal area priority map

The lateral intraparietal area (LIP) in the macaque contains a priority-based representation of the visual scene. We previously showed that the mean spike rate of LIP neurons is strongly influenced by spatially wide-ranging surround suppression in a manner that effectively sharpens the priority map. Reducing response variability can also improve the precision of LIP's priority map. We show that when a monkey plans a visually guided delayed saccade with an intervening distractor, variability (measured by the Fano factor) decreases both for neurons representing the saccade goal and for neurons representing the broad spatial surround. The reduction in Fano factor is maximal for neurons representing the saccade goal and steadily decreases for neurons representing more distant locations. LIP Fano factor changes are behaviorally significant: increasing expected reward leads to lower variability for the LIP representation of both the target and distractor locations, and trials with shorter latency saccades are associated with lower Fano factors in neurons representing the surround. Thus, the LIP Fano factor reflects both stimulus and behavioral engagement. Quantitative modeling shows that the interaction between mean spike count and target-receptive field (RF) distance in the surround during the predistractor epoch is multiplicative: the Fano factor increases more steeply with mean spike count further away from the RF. A negative-binomial model for LIP spike counts captures these findings quantitatively, suggests underlying mechanisms based on trial-by-trial variations in mean spike rate or burst-firing patterns, and potentially provides a principled framework to account simultaneously for the previously observed unsystematic relationships between spike rate and variability in different brain areas.

The relationship between self-awareness of attentional status, behavioral performance and oscillatory brain rhythms

High-level cognitive factors, including self-awareness, are believed to play an important role in human visual perception. The principal aim of this study was to determine whether oscillatory brain rhythms play a role in the neural processes involved in self-monitoring attentional status. To do so we measured cortical activity using magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) while participants were asked to self-monitor their internal status, only initiating the presentation of a stimulus when they perceived their attentional focus to be maximal. We employed a hierarchical Bayesian method that uses fMRI results as soft-constrained spatial information to solve the MEG inverse problem, allowing us to estimate cortical currents in the order of millimeters and milliseconds. Our results show that, during self-monitoring of internal status, there was a sustained decrease in power within the 7-13 Hz (alpha) range in the rostral cingulate motor area (rCMA) on the human medial wall, beginning approximately 430 msec after the trial start (p < 0.05, FDR corrected). We also show that gamma-band power (41-47 Hz) within this area was positively correlated with task performance from 40–640 msec after the trial start (r = 0.71, p < 0.05). We conclude: (1) the rCMA is involved in processes governing self-monitoring of internal status; and (2) the qualitative differences between alpha and gamma activity are reflective of their different roles in self-monitoring internal states. We suggest that alpha suppression may reflect a strengthening of top-down interareal connections, while a positive correlation between gamma activity and task performance indicates that gamma may play an important role in guiding visuomotor behavior.

Evidence for differential top-down and bottom-up suppression in posterior parietal cortex

When searching for an object, we usually avoid items that are visually different from the target and objects or places that have been searched already. Previous studies have shown that neural activity in the lateral intraparietal area (LIP) can be used to guide this behaviour; responses to task irrelevant stimuli or to stimuli that have been fixated previously in the trial are reduced compared with responses to potential targets. Here, we test the hypothesis that these reduced responses have a different genesis. Two animals were trained on a visual foraging task, in which they had to find a target among a number of physically identical potential targets (T) and task irrelevant distractors. We recorded neural activity and local field potentials (LFPs) in LIP while the animals performed the task. We found that LFP power was similar for potential targets and distractors but was greater in the alpha and low beta bands when a previously fixated T was in the response field. We interpret these data to suggest that the reduced single-unit response to distractors is a bottom-up feed-forward result of processing in earlier areas and the reduced response to previously fixated Ts is a result of active top-down suppression.

Neural representations of contextual guidance in visual search of real-world scenes

Exploiting scene context and object-object co-occurrence is critical in guiding eye movements and facilitating visual search, yet the mediating neural mechanisms are unknown. We used functional magnetic resonance imaging while observers searched for target objects in scenes and used multivariate pattern analyses (MVPA) to show that the lateral occipital complex (LOC) can predict the coarse spatial location of observers' expectations about the likely location of 213 different targets absent from the scenes. In addition, we found weaker but significant representations of context location in an area related to the orienting of attention (intraparietal sulcus, IPS) as well as a region related to scene processing (retrosplenial cortex, RSC). Importantly, the degree of agreement among 100 independent raters about the likely location to contain a target object in a scene correlated with LOC's ability to predict the contextual location while weaker but significant effects were found in IPS, RSC, the human motion area, and early visual areas (V1, V3v). When contextual information was made irrelevant to observers' behavioral task, the MVPA analysis of LOC and the other areas' activity ceased to predict the location of context. Thus, our findings suggest that the likely locations of targets in scenes are represented in various visual areas with LOC playing a key role in contextual guidance during visual search of objects in real scenes.

Localization of the primary taste cortex by contrasting passive and attentive conditions

The primary taste cortex is located in the insula. However, exactly where in the insula the human primary taste cortex is located remains a controversial issue. Human neuroimaging studies have shown prominent variation concerning the location of taste-responsive activation within the insula. A standard protocol for gustatory testing in neuroimaging studies has not been developed, which might underlie such variations. In order to localize the primary taste cortex in an fMRI experiment, we used a taste delivery system to suppress non-taste stimuli and psychological effects. Then, we compared brain response to taste solution during a passive tasting task condition and a taste quality identification task condition to verify whether this cognitive task affected the location of taste-responsive activation within the insula. To examine which part of insula is the primary taste area, we performed dynamic causal modeling (DCM) to verify the neural network of the taste coding-related region and random-effects Bayesian model selection (BMS) at the family level to reveal the optimal input region. Passive tasting resulted in activation of the right middle insula (MI), and the most favorable model selected by DCM analysis showed that taste effect directly influenced the MI. Additionally, BMS results at the family level suggested that the taste inputs entered into the MI. Taken together, our results suggest that the human primary taste cortex is located in the MI.

Sensory adaptation as optimal resource allocation

Visual adaptation is expected to improve visual performance in the new environment. This expectation has been contradicted by evidence that adaptation sometimes decreases sensitivity for the adapting stimuli, and sometimes it changes sensitivity for stimuli very different from the adapting ones. We hypothesize that this pattern of results can be explained by a process that optimizes sensitivity for many stimuli, rather than changing sensitivity only for those stimuli whose statistics have changed. To test this hypothesis, we measured visual sensitivity across a broad range of spatiotemporal modulations of luminance, while varying the distribution of stimulus speeds. The manipulation of stimulus statistics caused a large-scale reorganization of visual sensitivity, forming the orderly pattern of sensitivity gains and losses. This pattern is predicted by a theory of distribution of receptive field characteristics in the visual system.

A shared inhibitory circuit for both exogenous and endogenous control of stimulus selection

The mechanisms by which the brain suppresses distracting stimuli to control the locus of attention are unknown. We found that focal, reversible inactivation of a single inhibitory circuit in the barn owl midbrain tegmentum, the nucleus isthmi pars magnocellularis (Imc), abolished both stimulus-driven (exogenous) and internally-driven (endogenous) competitive interactions in the optic tectum (superior colliculus in mammals), which are vital to the selection of a target among distracters in behaving animals. Imc neurons transformed spatially precise multisensory and endogenous input into powerful inhibitory output that suppressed competing representations across the entire tectal space map. We identified a small, but highly potent, circuit that is employed by both exogenous and endogenous signals to exert competitive suppression in the midbrain selection network. Our findings reveal, for the first time, a neural mechanism for the construction of a priority map that is critical for the selection of the most important stimulus for gaze and attention.

A role of eye vergence in covert attention

Covert spatial attention produces biases in perceptual and neural responses in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. Here we report the relation between fixational eye movements, namely eye vergence, and covert attention. Visual stimuli modulate the angle of eye vergence as a function of their ability to capture attention. This illustrates the relation between eye vergence and bottom-up attention. In visual and auditory cue/no-cue paradigms, the angle of vergence is greater in the cue condition than in the no-cue condition. This shows a top-down attention component. In conclusion, observations reveal a close link between covert attention and modulation in eye vergence during eye fixation. Our study suggests a basis for the use of eye vergence as a tool for measuring attention and may provide new insights into attention and perceptual disorders.