The neural basis of visual attention

Saccadic momentum and facilitation of return saccades contribute to an optimal foraging strategy

The interest in saccadic IOR is funneled by the hypothesis that it serves a clear functional purpose in the selection of fixation points: the facilitation of foraging. In this study, we arrive at a different interpretation of saccadic IOR. First, we find that return saccades are performed much more often than expected from the statistical properties of saccades and saccade pairs. Second, we find that fixation durations before a saccade are modulated by the relative angle of the saccade, but return saccades show no sign of an additional temporal inhibition. Thus, we do not find temporal saccadic inhibition of return. Interestingly, we find that return locations are more salient, according to empirically measured saliency (locations that are fixated by many observers) as well as stimulus dependent saliency (defined by image features), than regular fixation locations. These results and the finding that return saccades increase the match of individual trajectories with a grand total priority map evidences the return saccades being part of a fixation selection strategy that trades off exploration and exploitation.

Sometimes humans look at the same location twice. To appreciate the importance of this inconspicuous statement you have to consider that we move our eyes several billion (10⁹) times during our lives and that looking at something is a necessary condition to enable conscious visual awareness. Thus, understanding why and how we move our eyes provides a window into our mental life. Here we investigate one heavily discussed aspect of human's fixation selection strategy: whether it inhibits returning to previously fixated locations. We analyze a large data set (more than 550,000 fixations from 235 subjects) and find that, returning to previously fixated locations happens much more often than expected from the statistical properties of eye-movement trajectories. Furthermore, those locations that we return to are not ordinary – they are more salient than locations that we do not return to. Thus, the inconspicuous statement that we look at the same locations twice reveals an important aspect of our strategy to select fixation points: That we trade off exploring our environment against making sure that we have fully comprehended the relevant parts of our environment.

Complementary hemispheric specialization for language production and visuospatial attention

Language production and spatial attention are the most salient lateralized cerebral functions, and their complementary specialization has been observed in the majority of the population. To investigate whether the complementary specialization has a causal origin (the lateralization of one function causes the opposite lateralization of the other) or rather is a statistical phenomenon (different functions lateralize independently), we determined the lateralization for spatial attention in a group of individuals with known atypical right hemispheric (RH) lateralization for speech production, based on a previous large-scale screening of left-handers. We show that all 13 participants with RH language dominance have left-hemispheric dominance for spatial attention, and all but one of 16 participants with left-hemispheric language dominance are RH dominant for spatial attention. Activity was observed in the dorsal fronto-parietal pathway of attention, including the inferior parietal sulcus and superior parietal lobule, the frontal eye-movement field, and the inferior frontal sulcus/gyrus, and these regions functionally colateralized in the hemisphere dominant for attention, independently of the side of lateralization. Our results clearly support the Causal hypothesis about the complementary specialization, and we speculate that it derives from a longstanding evolutionary origin. We also suggest that the conclusions about lateralization based on an unselected sample of the population and laterality assessment using coarse functional transcranial Doppler sonography should be interpreted with more caution.

Tracking blue cone signals in the primate brain

In this paper, we review the path taken by signals originating from the short wavelength sensitive cones (S-cones) in Old World and New World primates. Two types of retinal ganglion cells (RGCs) carrying S-cone signals (blue-On and blue-Off cells) project to the dorsal lateral geniculate nucleus (dLGN) in the thalamus. In all primates, these S-cone signals are relayed through the 'dust-like' (konis in classical Greek) dLGN cells. In New World primates such as common marmoset, these very small cells are known to form distinct and spatially extensive, koniocellular layers. Although in Old World primates, such as macaques, koniocellular layers tend to be very thin, the adjacent parvocellular layers contain distinct koniocellular extensions. It appears that all S-cone signals are relayed through such konio cells, whether they are in the main koniocellular layers or in their colonies within the parvocellular layers of the dLGN. In the primary visual cortex, these signals begin to merge with the signals carried by the other two principal parallel channels, namely the magnocellular and parvocellular channels. This article will also review the possible routes taken by the S-cone signals to reach one of the topographically organised extrastriate visual cortical areas, the middle temporal area (area MT). This area is the major conduit for signals reaching the parietal cortex. Alternative visual inputs to area MT not relayed via the primary visual cortex area (V1) may provide the neurological basis for the phenomenon of 'blindsight' observed in human and non-human primates, who have partial or complete damage to the primary visual cortex. Short wavelength sensitive cone (S-cone) signals to area MT may also play a role in directing visual attention with possible implications for understanding the pathology in dyslexia and some of its treatment options.

Emotions and personality traits as high-level factors in visual attention: a review

The visual sense has outstanding significance for human perception and behavior, and visual attention plays a central role in the processing of the sensory input. Thereby, multiple low- and high-level factors contribute to the guidance of attention. The present review focuses on two neglected high-level factors: emotion and personality. The review starts with an overview of different models of attention, providing a conceptual framework and illustrating the nature of low- and high-level factors in visual attention. Then, the ambiguous concept of emotion is described, and recommendations are made for the experimental practice. In the following, we present several studies showing the influence of emotion on overt attention, whereby the distinction between internally and externally located emotional impacts are emphasized. We also provide evidence showing that emotional stimuli influence perceptual processing outside of the focus of attention, whereby results in this field are mixed. Then, we present some detached studies showing the reversed causal effect: attention can also affect emotional responses. The final section on emotion–attention interactions addresses the interplay on the neuronal level, which has been neglected for a long time in neuroscience. In this context, several conceptual recommendations for future research are made. Finally, based on findings showing inter-individual differences in human sensitivity to emotional items, we introduce the wide range of time-independent personality traits that also influence attention, and in this context we try to raise awareness of the consideration of inter-individual differences in the field of neuroscience.

State-related changes in MEG functional connectivity reveal the task-positive sensorimotor network

Functional connectivity measures applied to magnetoencephalography (MEG) data have the capacity to elucidate neuronal networks. However, the task-related modulation of these measures is essential to identifying the functional relevance of the identified network. In this study, we provide evidence for the efficacy of measuring "state-related" (i.e., task vs. rest) changes in MEG functional connectivity for revealing a sensorimotor network. We investigate changes in functional connectivity, measured as cortico-cortical coherence (CCC), between rest blocks and the performance of a visually directed motor task in a healthy cohort. Task-positive changes in CCC were interpreted in the context of any concomitant modulations in spectral power. Task-related increases in whole-head CCC relative to the resting state were identified between areas established as part of the sensorimotor network as well as frontal eye fields and prefrontal cortices, predominantly in the beta and gamma frequency bands. This study provides evidence for the use of MEG to identify task-specific functionally connected sensorimotor networks in a non-invasive, patient friendly manner.

A common neural mechanism for preventing and terminating the allocation of attention

Much is known about the mechanisms by which attention is focused to facilitate perception, but little is known about what happens to attention after perception of the attended object is complete. One possibility is that the focus of attention passively fades. A second possibility is that attention is actively terminated after the completion of perception so that the brain can be prepared for the next target. The present study investigated this issue with event-related potentials in humans, focusing on the N2pc component (a neural measure of attentional deployment) and the Pd component (a neural measure of attentional suppression). We found that active suppression occurred both to prevent the allocation of attention to known distractors and to terminate attention after the perception of an attended object was complete. In addition, the neural measure of active suppression was correlated with a behavioral measure of trial-to-trial variations in the allocation of attention. Active suppression therefore appears to be a general-purpose mechanism that both prevents and terminates the allocation of attention.

Feature-independent neural coding of target detection during search of natural scenes

Visual search requires humans to detect a great variety of target objects in scenes cluttered by other objects or the natural environment. It is unknown whether there is a general purpose neural detection mechanism in the brain that codes the presence of a wide variety of categories of objects embedded in natural scenes. We provide evidence for a feature-independent coding mechanism for detecting behaviorally relevant targets in natural scenes in the dorsal frontoparietal network. Pattern classifiers using single-trial fMRI responses in the dorsal frontoparietal network reliably predicted the presence of 368 different target objects and also the observer's choices. Other vision-related areas such as the primary visual cortex, lateral occipital complex, the parahippocampal, and the fusiform gyri did not predict target presence, while high-level association areas related to general purpose decision making, including the dorsolateral prefrontal cortex and anterior cingulate, did. Activity in the intraparietal sulcus, a main area in the dorsal frontoparietal network, correlated with observers' decision confidence and with the task difficulty of individual images. These results cannot be explained by physical differences across images or eye movements. Thus, the dorsal frontoparietal network detects behaviorally relevant targets in natural scenes independent of their defining visual features and may be the human analog of the priority map in monkey lateral intraparietal cortex.

Prism adaptation for spatial neglect after stroke: translational practice gaps

Spatial neglect increases hospital morbidity and costs in around 50% of the 795,000 people per year in the USA who survive stroke, and an urgent need exists to reduce the care burden of this condition. However, effective acute treatment for neglect has been elusive. In this article, we review 48 studies of a treatment of intense neuroscience interest: prism adaptation training. Due to its effects on spatial motor 'aiming', prism adaptation training may act to reduce neglect-related disability. However, research failed, first, to suggest methods to identify the 50-75% of patients who respond to treatment; second, to measure short-term and long-term outcomes in both mechanism-specific and functionally valid ways; third, to confirm treatment utility during the critical first 8 weeks poststroke; and last, to base treatment protocols on systematic dose-response data. Thus, considerable investment in prism adaptation research has not yet touched the fundamentals needed for clinical implementation. We suggest improved standards and better spatial motor models for further research, so as to clarify when, how and for whom prism adaptation should be applied.

Similar effects of feature-based attention on motion perception and pursuit eye movements at different levels of awareness

Feature-based attention enhances visual processing and improves perception, even for visual features that we are not aware of. Does feature-based attention also modulate motor behavior in response to visual information that does or does not reach awareness? Here we compare the effect of feature-based attention on motion perception and smooth-pursuit eye movements in response to moving dichoptic plaids--stimuli composed of two orthogonally drifting gratings, presented separately to each eye--in human observers. Monocular adaptation to one grating before the presentation of both gratings renders the adapted grating perceptually weaker than the unadapted grating and decreases the level of awareness. Feature-based attention was directed to either the adapted or the unadapted grating's motion direction or to both (neutral condition). We show that observers were better at detecting a speed change in the attended than the unattended motion direction, indicating that they had successfully attended to one grating. Speed change detection was also better when the change occurred in the unadapted than the adapted grating, indicating that the adapted grating was perceptually weaker. In neutral conditions, perception and pursuit in response to plaid motion were dissociated: While perception followed one grating's motion direction almost exclusively (component motion), the eyes tracked the average of both gratings (pattern motion). In attention conditions, perception and pursuit were shifted toward the attended component. These results suggest that attention affects perception and pursuit similarly even though only the former reflects awareness. The eyes can track an attended feature even if observers do not perceive it.

Top-down versus bottom-up attentional control: a failed theoretical dichotomy

Prominent models of attentional control assert a dichotomy between top-down and bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. This theoretical dichotomy, however, fails to explain a growing number of cases in which neither current goals nor physical salience can account for strong selection biases. For example, equally salient stimuli associated with reward can capture attention, even when this contradicts current selection goals. Thus, although 'top-down' sources of bias are sometimes defined as those that are not due to physical salience, this conception conflates distinct--and sometimes contradictory--sources of selection bias. We describe an alternative framework, in which past selection history is integrated with current goals and physical salience to shape an integrated priority map.

Nonspatial Cueing of Tactile STM Causes Shift of Spatial Attention

The focus of attention can be flexibly altered in mnemonic representations of past sensory events. We investigated the neural mechanisms of selection in tactile STM by applying vibrotactile sample stimuli of different intensities to both hands, followed by a symmetrically shaped visual retro-cue. The retro-cue indicated whether the weak or strong sample was relevant for subsequent comparison with a single tactile test stimulus. Locations of tactile stimuli were randomized, and the required response did not depend upon the spatial relation between cued sample and test stimulus. Selection between spatially segregated items in tactile STM was mirrored in lateralized activity following visual retro-cues (N2pc) and influenced encoding of task-irrelevant tactile probe stimuli (N140). Our findings support four major conclusions. First, retrospective selection results in transient shifts of spatial attention. Second, retrospective selection is functionally dissociable from attention-based rehearsal of locations. Third, selection mechanisms are linked across processing stages, as attention shifts in STM influence encoding of sensory signals. Fourth, selection in tactile STM recruits attentional control mechanisms that are, at least partially, supramodal.

Divisive normalization and neuronal oscillations in a single hierarchical framework of selective visual attention

Divisive normalization models of covert attention commonly use spike rate modulations as indicators of the effect of top-down attention. In addition, an increasing number of studies have shown that top-down attention increases the synchronization of neuronal oscillations as well, particularly in gamma-band frequencies (25–100 Hz). Although modulations of spike rate and synchronous oscillations are not mutually exclusive as mechanisms of attention, there has thus far been little effort to integrate these concepts into a single framework of attention. Here, we aim to provide such a unified framework by expanding the normalization model of attention with a multi-level hierarchical structure and a time dimension; allowing the simulation of a recently reported backward progression of attentional effects along the visual cortical hierarchy. A simple cascade of normalization models simulating different cortical areas is shown to cause signal degradation and a loss of stimulus discriminability over time. To negate this degradation and ensure stable neuronal stimulus representations, we incorporate a kind of oscillatory phase entrainment into our model that has previously been proposed as the “communication-through-coherence” (CTC) hypothesis. Our analysis shows that divisive normalization and oscillation models can complement each other in a unified account of the neural mechanisms of selective visual attention. The resulting hierarchical normalization and oscillation (HNO) model reproduces several additional spatial and temporal aspects of attentional modulation and predicts a latency effect on neuronal responses as a result of cued attention.

Evidence for a link between the experiential allocation of saccade preparation and visuospatial attention

Whether a link exists between the two orienting processes of saccade preparation and visuospatial attention has typically been studied by using either sensory cues or predetermined rules that instruct subjects where to allocate these limited resources. In the real world, explicit instructions are not always available and presumably expectations shaped by previous experience play an important role in the allocation of these processes. Here we examined whether manipulating two experiential factors that clearly influence saccade preparation--the probability and timing of saccadic responses--also influences the allocation of visuospatial attention. Occasionally, a visual probe was presented whose spatial location and time of presentation varied relative to those of the saccade target. The proportion of erroneous saccades directed toward this probe indexed saccade preparation, and the proportion of correct discriminations of probe orientation indexed visuospatial attention. Overall, preparation and attention were significantly correlated to each other across these manipulations of saccade probability and timing. Saccade probability influenced both preparation and attention processes, whereas saccade timing influenced only preparation processes. Unexpectedly, discrimination ability was not improved in those trials in which the probe triggered an erroneous saccade despite particularly heightened levels of saccade preparation. To account for our results, we propose a conceptual dual-purpose threshold model based on neurophysiological considerations that link the processes of saccade preparation and visuospatial attention. The threshold acts both as the minimum activity level required for eliciting saccades and a maximum level for which neural activity can provide attentional benefits.

The role of neuromodulators in selective attention

Several classes of neurotransmitters exert modulatory effects on a broad and diverse population of neurons throughout the brain. Some of these neuromodulators, especially acetylcholine and dopamine, have long been implicated in the neural control of selective attention. We review recent evidence and evolving ideas about the importance of these neuromodulatory systems in attention, particularly visual selective attention. We conclude that, although our understanding of their role in the neural circuitry of selective attention remains rudimentary, recent research has begun to suggest unique contributions of neuromodulators to different forms of attention, such as bottom-up and top-down attention.

Mechanisms for generating and compensating for the smallest possible saccades

Microsaccades are small eye movements that occur during gaze fixation. Although taking place only when we attempt to stabilize gaze position, microsaccades can be understood by relating them to the larger voluntary saccades, which abruptly shift gaze position. Starting from this approach to microsaccade analysis, I show how it can lead to significant insight about the generation and functional role of these eye movements. Like larger saccades, microsaccades are now known to be generated by brainstem structures involved not only in compiling motor commands for eye movements, but also in identifying and selecting salient target locations in the visual environment. In addition, these small eye movements both influence and are influenced by sensory and cognitive processes in various areas of the brain, and in a manner that is similar to the interactions between larger saccades and sensory or cognitive processes. By approaching the study of microsaccades from the perspective of what has been learned about their larger counterparts, we are now in a position to make greater strides in our understanding of the function of the smallest possible saccadic eye movements.

Control from below: the role of a midbrain network in spatial attention

Spatial attention enables the brain to analyse and evaluate information selectively from a specific location in space, a capacity essential for any animal to behave adaptively in a complex world. We usually think of spatial attention as being controlled by a frontoparietal network in the forebrain. However, emerging evidence shows that a midbrain network also plays a critical role in controlling spatial attention. Moreover, the highly differentiated, retinotopic organization of the midbrain network, especially in birds, makes it amenable to detailed analysis with modern techniques that can elucidate circuit, cellular and synaptic mechanisms of attention. The following review discusses the role of the midbrain network in controlling attention, the neural circuits that support this role and current knowledge about the computations performed by these circuits.

Attentional modulation of binocular rivalry

Ever since Wheatstone initiated the scientific study of binocular rivalry, it has been debated whether the phenomenon is under attentional control. In recent years, the issue of attentional modulation of binocular rivalry has seen a revival. Here we review the classical studies as well as recent advances in the study of attentional modulation of binocular rivalry. We show that (1) voluntary control over binocular rivalry is possible, yet limited, (2) both endogenous and exogenous attention influence perceptual dominance during rivalry, (3) diverting attention from rival displays does not arrest perceptual alternations, and that (4) rival targets by themselves can also attract attention. From a theoretical perspective, we suggest that attention affects binocular rivalry by modulating the effective contrast of the images in competition. This contrast enhancing effect of top-down attention is counteracted by a response attenuating effect of neural adaptation at early levels of visual processing, which weakens the response to the dominant image. Moreover, we conclude that although frontal and parietal brain areas involved in both binocular rivalry and visual attention overlap, an adapting reciprocal inhibition arrangement at early visual cortex is sufficient to trigger switches in perceptual dominance independently of a higher-level "selection" mechanisms. Both of these processes are reciprocal and therefore self-balancing, with the consequence that complete attentional control over binocular rivalry can never be realized.

The role of a midbrain network in competitive stimulus selection

A midbrain network interacts with the well-known frontoparietal forebrain network to select stimuli for gaze and spatial attention. The midbrain network, containing the superior colliculus (SC; optic tectum, OT, in non-mammalian vertebrates) and the isthmic nuclei, helps evaluate the relative priorities of competing stimuli and encodes them in a topographic map of space. Behavioral experiments in monkeys demonstrate an essential contribution of the SC to stimulus selection when the relative priorities of competing stimuli are similar. Neurophysiological results from the owl OT demonstrate a neural correlate of this essential contribution of the SC/OT. The multi-layered, spatiotopic organization of the midbrain network lends itself to the analysis and modeling of the mechanisms underlying stimulus selection for gaze and spatial attention.

The role of diffusion tensor imaging in the study of cognitive aging

This chapter gives an overview of the role that diffusion tensor MRI (DTI) can play in the study of cognitive decline that is associated with advancing age. A brief overview of biological injury processes that impinge on the aging brain is provided, and their overall effect on the integrity of neural architecture is described. Cognitive decline associated with aging, and white matter connectivity degradation as a biological substrate for that decline, is then described. We then briefly describe the technology of DTI as a means for in vivo, non-invasive interrogation of white matter connectivity, and relate it to FLAIR, a more traditional MRI method for assessing white matter injury. We then survey the existing findings on relationships between aging-associated neuropathological processes and DTI measurements on one hand; and relationships between DTI measurements and late-life cognitive function on the other. We conclude with a summary of current research directions in relation to DTI studies of cognitive aging.

Recurrent antitopographic inhibition mediates competitive stimulus selection in an attention network

Topographically organized neurons represent multiple stimuli within complex visual scenes and compete for subsequent processing in higher visual centers. The underlying neural mechanisms of this process have long been elusive. We investigate an experimentally constrained model of a midbrain structure: the optic tectum and the reciprocally connected nucleus isthmi. We show that a recurrent antitopographic inhibition mediates the competitive stimulus selection between distant sensory inputs in this visual pathway. This recurrent antitopographic inhibition is fundamentally different from surround inhibition in that it projects on all locations of its input layer, except to the locus from which it receives input. At a larger scale, the model shows how a focal top-down input from a forebrain region, the arcopallial gaze field, biases the competitive stimulus selection via the combined activation of a local excitation and the recurrent antitopographic inhibition. Our findings reveal circuit mechanisms of competitive stimulus selection and should motivate a search for anatomical implementations of these mechanisms in a range of vertebrate attentional systems.