State dependent activity in monkey visual cortex. I. Single cell activity in V1 and V4 on visual tasks

Differential cortical and subcortical visual processing with eyes shut

Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar blood oxygenation level-dependent (BOLD) responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitatively distinct pattern of visual processing when the eyes are closed-one that is not simply an overall attenuation but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserve information about stimuli but are then gated off downstream in visual cortex.NEW & NOTEWORTHY When we close our eyes coarse luminance information is still accessible by the visual system. Using functional magnetic resonance imaging, we examined whether eyelid closure plays a unique role in visual processing. We discovered that while the LGN and V1 show equivalent responses when the eyes are open or closed, extrastriate cortex exhibited attenuated responses with eye closure. This suggests that when the eyes are closed, downstream visual processing is blind to this information.

Paying attention to natural scenes in area V1

Natural scene responses in the primary visual cortex are modulated simultaneously by attention and by contextual signals about scene statistics stored across the connectivity of the visual processing hierarchy. We hypothesized that attentional and contextual signals interact in V1 in a manner that primarily benefits the representation of natural stimuli, rich in high-order statistical structure. Recording from two macaques engaged in a spatial attention task, we found that attention enhanced the decodability of stimulus identity from population responses evoked by natural scenes, but not by synthetic stimuli lacking higher-order statistical regularities. Population analysis revealed that neuronal responses converged to a low-dimensional subspace only for natural stimuli. Critically, we determined that the attentional enhancement in stimulus decodability was captured by the natural-scene subspace, indicating an alignment between the attentional and natural stimulus variance. These results suggest that attentional and contextual signals interact in V1 in a manner optimized for natural vision.

Differential cortical and subcortical visual processing with eyes shut

Closing our eyes largely shuts down our ability to see. That said, our eyelids still pass some light, allowing our visual system to coarsely process information about visual scenes, such as changes in luminance. However, the specific impact of eye closure on processing within the early visual system remains largely unknown. To understand how visual processing is modulated when eyes are shut, we used functional magnetic resonance imaging (fMRI) to measure responses to a flickering visual stimulus at high (100%) and low (10%) temporal contrasts, while participants viewed the stimuli with their eyes open or closed. Interestingly, we discovered that eye closure produced a qualitatively distinct pattern of effects across the visual thalamus and visual cortex. We found that with eyes open, low temporal contrast stimuli produced smaller responses, across the lateral geniculate nucleus (LGN), primary (V1) and extrastriate visual cortex (V2). However, with eyes closed, we discovered that the LGN and V1 maintained similar BOLD responses as the eyes open condition, despite the suppressed visual input through the eyelid. In contrast, V2 and V3 had strongly attenuated BOLD response when eyes were closed, regardless of temporal contrast. Our findings reveal a qualitative distinct pattern of visual processing when the eyes are closed - one that is not simply an overall attenuation, but rather reflects distinct responses across visual thalamocortical networks, wherein the earliest stages of processing preserves information about stimuli but is then gated off downstream in visual cortex.

Visuomotor control in mice and primates

We conduct a comparative evaluation of the visual systems from the retina to the muscles of the mouse and the macaque monkey noting the differences and similarities between these two species. The topics covered include (1) visual-field overlap, (2) visual spatial resolution, (3) V1 cortical point-image [i.e., V1 tissue dedicated to analyzing a unit receptive field], (4) object versus motion encoding, (5) oculomotor range, (6) eye, head, and body movement coordination, and (7) neocortical and cerebellar function. We also discuss blindsight in rodents and primates which provides insights on how the neocortex mediates conscious vision in these species. This review is timely because the field of visuomotor neurophysiology is expanding beyond the macaque monkey to include the mouse; there is therefore a need for a comparative analysis between these two species on how the brain generates visuomotor responses.

Top-Down Modulation of Early Visual Processing in V1: Dissociable Neurophysiological Effects of Spatial Attention, Attentional Load and Task-Relevance

Until today, there is an ongoing discussion if attention processes interact with the information processing stream already at the level of the C1, the earliest visual electrophysiological response of the cortex. We used two highly powered experiments (each N = 52) and examined the effects of task relevance, spatial attention, and attentional load on individual C1 amplitudes for the upper or lower visual hemifield. Bayesian models revealed evidence for the absence of load effects but substantial modulations by task-relevance and spatial attention. When the C1-eliciting stimulus was a task-irrelevant, interfering distracter, we observed increased C1 amplitudes for spatially unattended stimuli. For spatially attended stimuli, different effects of task-relevance for the two experiments were found. Follow-up exploratory single-trial analyses revealed that subtle but systematic deviations from the eye-gaze position at stimulus onset between conditions substantially influenced the effects of attention and task relevance on C1 amplitudes, especially for the upper visual field. For the subsequent P1 component, attentional modulations were clearly expressed and remained unaffected by these deviations. Collectively, these results suggest that spatial attention, unlike load or task relevance, can exert dissociable top-down modulatory effects at the C1 and P1 levels.

Visual Functions of Primate Area V4

Area V4-the focus of this review-is a mid-level processing stage along the ventral visual pathway of the macaque monkey. V4 is extensively interconnected with other visual cortical areas along the ventral and dorsal visual streams, with frontal cortical areas, and with several subcortical structures. Thus, it is well poised to play a broad and integrative role in visual perception and recognition-the functional domain of the ventral pathway. Neurophysiological studies in monkeys engaged in passive fixation and behavioral tasks suggest that V4 responses are dictated by tuning in a high-dimensional stimulus space defined by form, texture, color, depth, and other attributes of visual stimuli. This high-dimensional tuning may underlie the development of object-based representations in the visual cortex that are critical for tracking, recognizing, and interacting with objects. Neurophysiological and lesion studies also suggest that V4 responses are important for guiding perceptual decisions and higher-order behavior.

Limited interactions between space- and feature-based attention in visually sparse displays

Top-down visual attention selectively filters sensory input so relevant information receives preferential processing. Feature-based attention (FBA) enhances the representation of relevant low-level features, whereas space-based attention (SBA) enhances information at relevant location(s). The present study investigates whether the unique influences of SBA and FBA combine to facilitate behavior in a perceptually demanding discrimination task. We first demonstrated that, independently, both color and location pre-cues could effectively direct attention to facilitate perceptual decision making of a target. We then examined the combined effects of SBA and FBA in the same design by deploying a predictive color arrow pre-cue. Only SBA effects were observed in performance accuracy and reaction time. However, we detected a reaction time cost when a valid spatial cue was paired with a feature cue. A computational perceptual decision-making model largely provided converging evidence that contributions from FBA were restricted to facilitating the speed with which the relevant item was identified. Our results suggest that both selection mechanisms can be used in isolation to resolve a perceptually challenging target in a sparse display, but with little additive perceptual benefit when cued simultaneously. We conclude that there is at least some higher order interdependence between space-based and feature-based selection during decision making under specific conditions.

Emotion schemas are embedded in the human visual system

Theorists have suggested that emotions are canonical responses to situations ancestrally linked to survival. If so, then emotions may be afforded by features of the sensory environment. However, few computational models describe how combinations of stimulus features evoke different emotions. Here, we develop a convolutional neural network that accurately decodes images into 11 distinct emotion categories. We validate the model using more than 25,000 images and movies and show that image content is sufficient to predict the category and valence of human emotion ratings. In two functional magnetic resonance imaging studies, we demonstrate that patterns of human visual cortex activity encode emotion category-related model output and can decode multiple categories of emotional experience. These results suggest that rich, category-specific visual features can be reliably mapped to distinct emotions, and they are coded in distributed representations within the human visual system.

Spiking Suppression Precedes Cued Attentional Enhancement of Neural Responses in Primary Visual Cortex

Attending to a visual stimulus increases its detectability, even if gaze is directed elsewhere. This covert attentional selection is known to enhance spiking across many brain areas, including the primary visual cortex (V1). Here we investigate the temporal dynamics of attention-related spiking changes in V1 of macaques performing a task that separates attentional selection from the onset of visual stimulation. We found that preceding attentional enhancement there was a sharp, transient decline in spiking following presentation of an attention-guiding cue. This disruption of V1 spiking was not observed in a task-naïve subject that passively observed the same stimulus sequence, suggesting that sensory activation is insufficient to cause suppression. Following this suppression, attended stimuli evoked more spiking than unattended stimuli, matching previous reports of attention-related activity in V1. Laminar analyses revealed a distinct pattern of activation in feedback-associated layers during both the cue-induced suppression and subsequent attentional enhancement. These findings suggest that top-down modulation of V1 spiking can be bidirectional and result in either suppression or enhancement of spiking responses.

Idiosyncratic representation of peripersonal space depends on the success of one's own motor actions, but also the successful actions of others!

Peripersonal space is a multisensory representation of the environment around the body in relation to the motor system, underlying the interactions with the physical and social world. Although changing body properties and social context have been shown to alter the functional processing of space, little is known about how changing the value of objects influences the representation of peripersonal space. In two experiments, we tested the effect of modifying the spatial distribution of reward-yielding targets on manual reaching actions and peripersonal space representation. Before and after performing a target-selection task consisting of manually selecting a set of targets on a touch-screen table, participants performed a two-alternative forced-choice reachability-judgment task. In the target-selection task, half of the targets were associated with a reward (change of colour from grey to green, providing 1 point), the other half being associated with no reward (change of colour from grey to red, providing no point). In Experiment 1, the target-selection task was performed individually with the aim of maximizing the point count, and the distribution of the reward-yielding targets was either 50%, 25% or 75% in the proximal and distal spaces. In Experiment 2, the target-selection task was performed in a social context involving cooperation between two participants to maximize the point count, and the distribution of the reward-yielding targets was 50% in the proximal and distal spaces. Results showed that changing the distribution of the reward-yielding targets or introducing the social context modified concurrently the amplitude of self-generated manual reaching actions and the representation of peripersonal space. Moreover, a decrease of the amplitude of manual reaching actions caused a reduction of peripersonal space when resulting from the distribution of reward-yielding targets, while this effect was not observed in a social interaction context. In that case, the decreased amplitude of manual reaching actions was accompanied by an increase of peripersonal space representation, which was not due to the mere presence of a confederate (control experiment). We conclude that reward-dependent modulation of objects values in the environment modifies the representation of peripersonal space, when resulting from either self-generated motor actions or observation of motor actions performed by a confederate.

Spatial working memory alters the efficacy of input to visual cortex

Prefrontal cortex modulates sensory signals in extrastriate visual cortex, in part via its direct projections from the frontal eye field (FEF), an area involved in selective attention. We find that working memory-related activity is a dominant signal within FEF input to visual cortex. Although this signal alone does not evoke spiking responses in areas V4 and MT during memory, the gain of visual responses in these areas increases, and neuronal receptive fields expand and shift towards the remembered location, improving the stimulus representation by neuronal populations. These results provide a basis for enhancing the representation of working memory targets and implicate persistent FEF activity as a basis for the interdependence of working memory and selective attention.

Frontal eye field (FEF) is a visual prefrontal area involved in top-down attention. Here the authors report that FEF neurons projecting to V4/MT are persistently active during spatial working memory, and V4/MT neurons show changes in receptive field and gain at the location held in working memory.

Novel response patterns during repeated presentation of affective and neutral stimuli

Repeated stimulus presentations are commonly used in social and affective neuroimaging tasks, but much remains to be known about how the brain processes such repetitions. Using functional magnetic resonance imaging, we found three groups of brain regions with distinct response patterns during repeated presentations of natural scene images. One group consisted of several limbic, paralimbic, frontoparietal and medial prefrontal areas and showed a habituation-like response across pleasant, unpleasant, and neutral image categories. A second group of occipital and adjacent posterior cortical regions showed a pattern of diminishing responses with repeated presentations of affective images but not for neutral images, and also plateaued to activation levels above baseline for all image categories. A third group involved bilateral frontopolar areas and the precuneus and exhibited a novel, non-monotonic response pattern. Activity was low on the first presentation, peaked upon the second presentation (first repetition) and subsequently diminished. These findings indicate that the transition from novel to increasingly familiar, and also arousing to less arousing, involves a broad array of neural mechanisms alluding to both passive learning and active inference strategies.

From Behavior to Neural Dynamics: An Integrated Theory of Attention

The brain has a limited capacity and therefore needs mechanisms to selectively enhance the information most relevant to one's current behavior. We refer to these mechanisms as "attention." Attention acts by increasing the strength of selected neural representations and preferentially routing them through the brain's large-scale network. This is a critical component of cognition and therefore has been a central topic in cognitive neuroscience. Here we review a diverse literature that has studied attention at the level of behavior, networks, circuits, and neurons. We then integrate these disparate results into a unified theory of attention.

Modulation of Neuronal Responses by Exogenous Attention in Macaque Primary Visual Cortex

Visual perception is influenced by attention deployed voluntarily or triggered involuntarily by salient stimuli. Modulation of visual cortical processing by voluntary or endogenous attention has been extensively studied, but much less is known about how involuntary or exogenous attention affects responses of visual cortical neurons. Using implanted microelectrode arrays, we examined the effects of exogenous attention on neuronal responses in the primary visual cortex (V1) of awake monkeys. A bright annular cue was flashed either around the receptive fields of recorded neurons or in the opposite visual field to capture attention. A subsequent grating stimulus probed the cue-induced effects. In a fixation task, when the cue-to-probe stimulus onset asynchrony (SOA) was <240 ms, the cue induced a transient increase of neuronal responses to the probe at the cued location during 40-100 ms after the onset of neuronal responses to the probe. This facilitation diminished and disappeared after repeated presentations of the same cue but recurred for a new cue of a different color. In another task to detect the probe, relative shortening of monkey's reaction times for the validly cued probe depended on the SOA in a way similar to the cue-induced V1 facilitation, and the behavioral and physiological cueing effects remained after repeated practice. Flashing two cues simultaneously in the two opposite visual fields weakened or diminished both the physiological and behavioral cueing effects. Our findings indicate that exogenous attention significantly modulates V1 responses and that the modulation strength depends on both novelty and task relevance of the stimulus. Significance statement: Visual attention can be involuntarily captured by a sudden appearance of a conspicuous object, allowing rapid reactions to unexpected events of significance. The current study discovered a correlate of this effect in monkey primary visual cortex. An abrupt, salient, flash enhanced neuronal responses, and shortened the animal's reaction time, to a subsequent visual probe stimulus at the same location. However, the enhancement of the neural responses diminished after repeated exposures to this flash if the animal was not required to react to the probe. Moreover, a second, simultaneous, flash at another location weakened the neuronal and behavioral effects of the first one. These findings revealed, beyond the observations reported so far, the effects of exogenous attention in the brain.

Attention enhances contrast appearance via increased input baseline of neural responses

Covert spatial attention increases the perceived contrast of stimuli at attended locations, presumably via enhancement of visual neural responses. However, the relation between perceived contrast and the underlying neural responses has not been characterized. In this study, we systematically varied stimulus contrast, using a two-alternative, forced-choice comparison task to probe the effect of attention on appearance across the contrast range. We modeled performance in the task as a function of underlying neural contrast-response functions. Fitting this model to the observed data revealed that an increased input baseline in the neural responses accounted for the enhancement of apparent contrast with spatial attention.

A distinct contribution of the frontal eye field to the visual representation of saccadic targets

The responses of neurons within posterior visual cortex are enhanced when response field (RF) stimuli are targeted with saccadic eye movements. Although the motor-related activity within oculomotor structures seems a likely source of the enhancement, the origin of the modulation is unknown. We tested the role of the frontal eye field (FEF) in driving presaccadic modulation in area V4 by inactivating FEF neurons at retinotopically corresponding sites within the macaque monkey (Macaca mulatta) brain. As previously observed, FEF inactivation produced profound, and spatially specific, deficits in memory-guided saccades, and increased the latency, scatter, and duration of visually guided saccades. Despite the clear behavioral deficits, we found that rather than being eliminated or reduced by FEF inactivation, presaccadic enhancement of V4 activity was increased. FEF inactivation nonetheless diminished the stimulus discriminability of V4 visual responses both during fixation and in the presaccadic period. Thus, without input from the FEF, V4 neurons signaled more about the direction of saccades and less about the features of the saccadic target. In addition, FEF inactivation significantly increased the suppressive effects of non-RF stimuli on V4 activity. These results reveal multiple sources of presaccadic modulation in V4 and suggest that the FEF contributes uniquely to the presaccadic specification of visual target features.

Hold the future, let the past go: attention prefers the features of future targets

Previous studies have shown that attention can be captured by task-irrelevant distractors under the guidance of attentional control settings. However, it is unknown whether people can establish an attentional control setting (ACS) for a sequence of distinct events. The present study tested that question by asking observers to expect a sequence of two colored targets in a specific order. The results show that irrelevant distractors that matched either the color of the first expected target or that of the second target captured attention. Thus observers are unable to temporarily suppress the color of the future target in their ACS. However, the temporal order of targets is still useful for guiding attention: Observers were able to abandon the color of the first target and maintain an ACS for the second one as long as there was a sufficient time interval between the two targets.

Guided Search 2.0 A revised model of visual search

An important component of routine visual behavior is the ability to find one item in a visual world filled with other, distracting items. This ability to performvisual search has been the subject of a large body of research in the past 15 years. This paper reviews the visual search literature and presents a model of human search behavior. Built upon the work of Neisser, Treisman, Julesz, and others, the model distinguishes between a preattentive, massively parallel stage that processes information about basic visual features (color, motion, various depth cues, etc.) across large portions of the visual field and a subsequent limited-capacity stage that performs other, more complex operations (e.g., face recognition, reading, object identification) over a limited portion of the visual field. The spatial deployment of the limited-capacity process is under attentional control. The heart of the guided search model is the idea that attentional deployment of limited resources isguided by the output of the earlier parallel processes. Guided Search 2.0 (GS2) is a revision of the model in which virtually all aspects of the model have been made more explicit and/or revised in light of new data. The paper is organized into four parts: Part 1 presents the model and the details of its computer simulation. Part 2 reviews the visual search literature on preattentive processing of basic features and shows how the GS2 simulation reproduces those results. Part 3 reviews the literature on the attentional deployment of limited-capacity processes in conjunction and serial searches and shows how the simulation handles those conditions. Finally, Part 4 deals with shortcomings of the model and unresolved issues.

Individual differences in attention strategies during detection, fine discrimination, and coarse discrimination

Interacting with the environment requires the ability to flexibly direct attention to relevant features. We examined the degree to which individuals attend to visual features within and across Detection, Fine Discrimination, and Coarse Discrimination tasks. Electroencephalographic (EEG) responses were measured to an unattended peripheral flickering (4 or 6 Hz) grating while individuals (n = 33) attended to orientations that were offset by 0°, 10°, 20°, 30°, 40°, and 90° from the orientation of the unattended flicker. These unattended responses may be sensitive to attentional gain at the attended spatial location, since attention to features enhances early visual responses throughout the visual field. We found no significant differences in tuning curves across the three tasks in part due to individual differences in strategies. We sought to characterize individual attention strategies using hierarchical Bayesian modeling, which grouped individuals into families of curves that reflect attention to the physical target orientation ("on-channel") or away from the target orientation ("off-channel") or a uniform distribution of attention. The different curves were related to behavioral performance; individuals with "on-channel" curves had lower thresholds than individuals with uniform curves. Individuals with "off-channel" curves during Fine Discrimination additionally had lower thresholds than those assigned to uniform curves, highlighting the perceptual benefits of attending away from the physical target orientation during fine discriminations. Finally, we showed that a subset of individuals with optimal curves ("on-channel") during Detection also demonstrated optimal curves ("off-channel") during Fine Discrimination, indicating that a subset of individuals can modulate tuning optimally for detection and discrimination.

Feature attention evokes task-specific pattern selectivity in V4 neurons

A hallmark of visual cortical neurons is their selectivity for stimulus pattern features, such as color, orientation, or shape. In most cases this feature selectivity is hard-wired, with selectivity manifest from the beginning of the response. Here we show that when a task requires that a monkey distinguish between patterns, V4 develops a selectivity for the sought-after pattern, which it does not manifest in a task that does not require the monkey to distinguish between patterns. When a monkey looks for a target object among an array of distractors, V4 neurons become selective for the target ∼50 ms after the visual latency independent of the impending saccade direction. However, when the monkey has to only make a saccade to the spatial location of the same objects without discriminating their pattern, V4 neurons do not distinguish the search target from the distractors. This selectivity for stimulus pattern develops roughly 40 ms after the same neurons' selectivity for basic pattern features like orientation or color. We suggest that this late-developing selectivity is related to the phenomenon of feature attention and may contribute to the mechanisms by which the brain finds the target in visual search.

Out of control: attentional selection for orientation is thwarted by properties of the underlying neural mechanisms

To avoid sensory overload, people are able to selectively attend to a particular color or direction of motion while ignoring irrelevant stimuli that differ from the desired one. We show here for the first time that it is also possible to selectively attend to a specific line orientation-but with an important caveat: orientations that are perpendicular to the target orientation cannot be suppressed. This effect reflects properties of the neural mechanisms selective for orientation and reveals the extent to which contingent capture is constrained not only by one's top-down goals but also by feature preferences of visual neurons.

Gain control in the response of human visual cortex to plaids

A recent intrinsic signal optical imaging study in tree shrew showed, surprisingly, that the population response of V1 to plaid patterns comprising grating components of equal contrast is predicted by the average of the responses to the individual components (MacEvoy SP, Tucker TR, Fitzpatrick D. Nat Neurosci 12: 637-645, 2009). This prompted us to compare responses to plaids and gratings in human visual cortex as a function of contrast and orientation. We found that the functional MRI (fMRI) blood oxygenation level-dependent (BOLD) responses of areas V1-V3 to a plaid comprising superposed grating components of equal contrast are significantly higher than the responses to a single component. Furthermore, the orientation response profile of a plaid is poorly predicted from a linear combination of the responses to its components. Together, these results indicate that the model of MacEvoy et al. (2009) cannot, without modification, account for the fMRI BOLD response to plaids in human visual cortex.

Spikes, BOLD, attention, and awareness: a comparison of electrophysiological and fMRI signals in V1

Early fMRI studies comparing results from fMRI and electrophysiological experiments support the notion that the blood oxygen level-dependent (BOLD) signal reliably follows the spiking activity of an underlying neuronal population averaged across a small region in space and a brief period in time. However, more recent studies focusing on higher level cognitive factors such as attention and visual awareness report striking discrepancies between the fMRI response in humans and electrophysiological signals in macaque early visual areas. Four hypotheses are discussed that can explain the discrepancies between the two methods: (1) the BOLD signal follows local field potential (LFP) signals closer than spikes, and only the LFP is modulated by top-down factors, (2) the BOLD signal is reflecting electrophysiological signals that are occurring later in time due to feedback delay, (3) the BOLD signal is more sensitive than traditional electrophysiological methods due to massive pooling by the hemodynamic coupling process, and finally (4) there is no real discrepancy, and instead, weak but reliable effects on firing rates may be obscured by differences in experimental design and interpretation of results across methods.

The Role of Alpha-Band Brain Oscillations as a Sensory Suppression Mechanism during Selective Attention

Evidence has amassed from both animal intracranial recordings and human electrophysiology that neural oscillatory mechanisms play a critical role in a number of cognitive functions such as learning, memory, feature binding and sensory gating. The wide availability of high-density electrical and magnetic recordings (64-256 channels) over the past two decades has allowed for renewed efforts in the characterization and localization of these rhythms. A variety of cognitive effects that are associated with specific brain oscillations have been reported, which range in spectral, temporal, and spatial characteristics depending on the context. Our laboratory has focused on investigating the role of alpha-band oscillatory activity (8-14 Hz) as a potential attentional suppression mechanism, and this particular oscillatory attention mechanism will be the focus of the current review. We discuss findings in the context of intersensory selective attention as well as intrasensory spatial and feature-based attention in the visual, auditory, and tactile domains. The weight of evidence suggests that alpha-band oscillations can be actively invoked within cortical regions across multiple sensory systems, particularly when these regions are involved in processing irrelevant or distracting information. That is, a central role for alpha seems to be as an attentional suppression mechanism when objects or features need to be specifically ignored or selected against.

Cholinergic control of cortical network interactions enables feedback-mediated attentional modulation

Attention increases our ability to detect behaviorally relevant stimuli. At the neuronal level this is supported by increased firing rates of neurons representing the attended object. In primary visual cortex an attention-mediated activity increase depends on the presence of the neuromodulator acetylcholine. Using a spiking network model of visual cortex we have investigated how acetylcholine interacts with biased feedback to enable attentional processing. Although acetylcholine affects cortical processing in a multitude of manners, we restricted our analysis to four of its main established actions. These were (i) a reduction in firing rate adaptation by reduction in M-currents (muscarinic), (ii) an increase in thalamocortical synaptic efficacy by nicotinic presynaptic receptors, (iii) a reduction in lateral interactions by muscarinic presynaptic receptors, and (iv) an increase in inhibitory drive by muscarinic receptors located on inhibitory interneurons. We found that acetylcholine contributes to feedback-mediated attentional modulation, mostly by reducing intracortical interactions and also to some extent by increasing the inhibitory drive. These findings help explain why acetylcholine is necessary for top-down-driven attentional modulation, and suggest a close interdependence of cholinergic and feedback drive in mediating cognitive function.

Spatial attention, feature-based attention, and saccades: three sides of one coin?

The last three decades has seen a steady growth of neuroscience research aimed at understanding the functions and sources of top-down attentional modulation in the brain. This correlates with recognition that attention may be a necessary component of sensory systems to support natural behaviors in natural environments. Complexity and clutter are two of the most recognizable hallmarks of natural environments, which can simultaneously contain vitally important and completely irrelevant stimuli. Attention serves as an adaptive filter providing each sensory modality preferential processing routes for important stimuli while suppressing responses to distracters, thus optimizing use of limited neural resources. In other words, attention is the family of mechanisms by which organisms are able to effectively and selectively allocate limited neural resources to achieve specific behavioral goals. This review provides some historical context for considering attentional frameworks and modern neurophysiological attention research, focusing on visual attention. A taxonomy of common attentional effects and neural mechanisms is provided, along with consideration of the specific relationship between attention and saccade planning. We examine the validity of premotor theories of attention, which posit that attention and saccade planning are one and the same. While there is strong evidence that attention and oculomotor planning are similar, with shared neural substrates, there is also evidence that these two functions are not synonymous. Finally, we examine neurophysiological explanations for dysfunction in attention-deficit/hyperactivity disorder and the hypothesis that social impairment in autism spectrum disorders is partially attributable to perturbations of attentional control circuitry.

Feature-based attention involuntarily and simultaneously improves visual performance across locations

Selective attention can selectively increase sensitivity to particular visual features in order to prioritize behaviorally relevant stimuli. Moreover, neural responses to attended feature values are boosted even at ignored locations. We provide behavioral evidence for involuntary and simultaneous effects of this "global" feature-based attention on visual performance. Observers were cued to attend to dots moving in a particular direction at one location (the primary task), while discriminating which of two groups of moving dots on the other side of the screen contained coherent motion (the secondary task). An analogous experiment tested selective attention to orientation. The secondary tasks did not require observers to discriminate or selectively attend to the particular feature values present. Nonetheless, sensitivity was highest when the direction or orientation happened to match the one cued in the primary task. By comparing performance to a neutral condition, we revealed more enhancement of attended feature values than suppression of others.

Analyzing vision at the complexity level

The general problem of visual search can be shown to be computationally intractable in a formal, complexity-theoretic sense, yet visual search is extensively involved in everyday perception, and biological systems manage to perform it remarkably well. Complexity level analysis may resolve this contradiction. Visual search can be reshaped into tractability through approximations and by optimizing the resources devoted to visual processing. Architectural constraints can be derived using the minimum cost principle to rule out a large class of potential solutions. The evidence speaks strongly against bottom-up approaches to vision. In particular, the constraints suggest an attentional mechanism that exploits knowledge of the specific problem being solved. This analysis of visual search performance in terms of attentional influences on visual information processing and complexity satisfaction allows a large body of neurophysiological and psychological evidence to be tied together.

Functional specialization in the lower and upper visual fields in humans: Its ecological origins and neurophysiological implications

Functional specialization in the lower and upper visual fields in humans is analyzed in relation to the origins of the primate visual system. Processing differences between the vertical hemifields are related to the distinction between near (peripersonal) and far (extrapersonal) space, which are biased toward the lower and upper visual fields, respectively. Nonlinear/global processing is required in the lower visual field in order to pergeive the optically degraded and diplopic images in near vision, whereas objects in far vision are searched for and recognized primarily using linear/local perceptual mechanisms. The functional differences between near and far visual space are correlated with their disproportionate representations in the dorsal and ventral divisions of visual association cortex, respectively, and in the magnocellular and parvocellular pathways that project to them. Advances in far visual capabilities and forelimb manipulatory skills may have led to a significant enhancement of these functional specializations.

Delayed effects of attention in visual cortex as measured with fMRI

To what extent does attention modulate neural activity in early visual areas? fMRI measurements of attentional modulation in primary visual cortex (V1) show large effects, while single unit recordings show much smaller ones. This discrepancy suggests that fMRI measures of attention may be inflated, perhaps by activity related to other processes. To test whether effects measured with fMRI actually reflect attentional enhancement, we used a rapid acquisition protocol to determine their timing. Subjects were presented with two stimuli on either side of fixation and were cued to attend one and ignore the other. Attended stimuli showed a greater magnitude of response in V1, but this increase was delayed, by roughly one second in time, relative to both unattended responses and response increases due to boosting stimulus contrast. These results suggest that fMRI measurements of attention may primarily depend upon other processes that take a relatively long time to feed back to V1. Our results demonstrate the importance of using the fine timing information available in the fMRI response.

Specifying the attentional selection that moderates the fearlessness of psychopathic offenders

Our previous research demonstrated that psychopathy-related fear deficits involve abnormalities in attention that undermine sensitivity to peripheral information. In the present study, we specified this attention-mediated abnormality in a new sample of 87 prisoners assessed with Hare's Psychopathy Checklist-Revised (Hare, 2003). We measured fear-potentiated startle (FPS) under four conditions that crossed attentional focus (threat vs. alternative) with early versus late presentation of threat cues. The psychopathic deficit in FPS was apparent only in the early-alternative-focus condition, in which threat cues were presented after the alternative goal-directed focus was established. Furthermore, psychopathy interacted with working memory capacity in the late-alternative-focus condition, which suggests that individuals high in psychopathy and working memory capacity were able to maintain a set-related alternative focus that reduced FPS. The results not only provide new evidence that attention moderates the fearlessness of psychopathic individuals, but also implicate an early attention bottleneck as a proximal mechanism for deficient response modulation in psychopathy.

The prefrontal cortex modulates category selectivity in human extrastriate cortex

Different categories of visual objects evoke distinct stimulus-evoked sensory responses in extrastriate visual cortex. Although numerous lines of evidence support a distinct representational neural architecture, the mechanisms underlying the modulation of the category selectivity by top-down influences remains uncertain. In this study, we investigate the causal role of the PFC in the modulation of evoked activity to face and scene stimuli in the extrastriate cortex. We used two experimental approaches to disrupt prefrontal cortical function-repetitive TMS to PFC in healthy participants (Experiment 1) and focal PFC lesions in stroke patients (Experiment 2). After these perturbations to normal PFC function (pre- vs. post-TMS and lesion vs. intact hemisphere), stimulus-evoked activity in extrastriate cortex exhibited less distinct category selectivity to faces and scenes. These two experiments provide convergent evidence highlighting a direct role of PFC in the top-down modulation of bottom-up visual signals.

Functional connectivity during top-down modulation of visual short-term memory representations

Recent evidence has revealed that short-lived internal representations held in visual short-term memory (VSTM) can be modulated by top-down control via retrospective attention which impacts subsequent behavioral performance. However, the functional inter-regional interactions underlying these top-down modulatory effects are not fully characterized. Here we used event-related functional magnetic imaging to investigate whether the strength of functional connectivity between the frontal cortex and posterior visual areas varies with the efficacy of top-down modulation of memory traces. Top-down modulation was manipulated by the timing of retro-cuing (early or late) in a VSTM task. Univariate analyses revealed that more effective top-down modulation (early cueing vs. late cueing) increased activity in early visual areas. Importantly, coherency analyses revealed that top-down modulation produced stronger functional connectivity between frontal and posterior occipital regions. Also, participants with stronger functional connectivity exhibit better memory performance. These results suggest that augmented functional connectivity between frontal and posterior visual areas strengthens the VSTM representations of importance to behavioral goals.