Multifocal attention filters targets from distracters within and beyond primate MT neurons' receptive field boundaries

Visual Attention in the Prefrontal Cortex

Voluntary attention selects behaviorally relevant signals for further processing while filtering out distracter signals. Neural correlates of voluntary visual attention have been reported across multiple areas of the primate visual processing streams, with the earliest and strongest effects isolated in the prefrontal cortex. In this article, I review evidence supporting the hypothesis that signals guiding the allocation of voluntary attention emerge in areas of the prefrontal cortex and reach upstream areas to modulate the processing of incoming visual information according to its behavioral relevance. Areas located anterior and dorsal to the arcuate sulcus and the frontal eye fields produce signals that guide the allocation of spatial attention. Areas located anterior and ventral to the arcuate sulcus produce signals for feature-based attention. Prefrontal microcircuits are particularly suited to supporting voluntary attention because of their ability to generate attentional template signals and implement signal gating and their extensive connectivity with the rest of the brain. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Eye and hand movements disrupt attentional control

Voluntary attentional control is the ability to selectively focus on a subset of visual information in the presence of other competing stimuli–a marker of cognitive control enabling flexible, goal-driven behavior. To test its robustness, we contrasted attentional control with the most common source of attentional orienting in daily life: attention shifts prior to goal-directed eye and hand movements. In a multi-tasking paradigm, human participants attended at a location while planning eye or hand movements elsewhere. Voluntary attentional control suffered with every simultaneous action plan, even under reduced task difficulty and memory load–factors known to interfere with attentional control. Furthermore, the performance cost was limited to voluntary attention: We observed simultaneous attention benefits at two movement targets without attentional competition between them. This demonstrates that the visual system allows for the concurrent representation of multiple attentional foci. Since attentional control is extremely fragile and dominated by premotor attention shifts, we propose that action-driven selection plays the superordinate role for visual selection.

Prefrontal Control of Proactive and Reactive Mechanisms of Visual Suppression

In everyday life, we are continuously struggling at focusing on our current goals while at the same time avoiding distractions. Attention is the neuro-cognitive process devoted to the selection of behaviorally relevant sensory information while at the same time preventing distraction by irrelevant information. Distraction can be prevented proactively, by strategically prioritizing task-relevant information at the expense of irrelevant information, or reactively, by suppressing the ongoing processing of distractors. The distinctive neuronal signature of these suppressive mechanisms is still largely unknown. Thanks to machine-learning decoding methods applied to prefrontal cortical activity, we monitor the dynamic spatial attention with an unprecedented spatial and temporal resolution. We first identify independent behavioral and neuronal signatures for long-term (learning-based spatial prioritization) and short-term (dynamic spatial attention) mechanisms. We then identify distinct behavioral and neuronal signatures for proactive and reactive suppression mechanisms. We find that while distracting task-relevant information is suppressed proactively, task-irrelevant information is suppressed reactively. Critically, we show that distractor suppression, whether proactive or reactive, strongly depends on the implementation of both long-term and short-term mechanisms of selection. Overall, we provide a unified neuro-cognitive framework describing how the prefrontal cortex deals with distractors in order to flexibly optimize behavior in dynamic environments.

Revisiting Persistent Neuronal Activity During Covert Spatial Attention

Persistent activity has been observed in the prefrontal cortex (PFC), in particular during the delay periods of visual attention tasks. Classical approaches based on the average activity over multiple trials have revealed that such an activity encodes the information about the attentional instruction provided in such tasks. However, single-trial approaches have shown that activity in this area is rather sparse than persistent and highly heterogeneous not only within the trials but also between the different trials. Thus, this observation raised the question of how persistent the actually persistent attention-related prefrontal activity is and how it contributes to spatial attention. In this paper, we review recent evidence of precisely deconstructing the persistence of the neural activity in the PFC in the context of attention orienting. The inclusion of machine-learning methods for decoding the information reveals that attention orienting is a highly dynamic process, possessing intrinsic oscillatory dynamics working at multiple timescales spanning from milliseconds to minutes. Dimensionality reduction methods further show that this persistent activity dynamically incorporates multiple sources of information. This novel framework reflects a high complexity in the neural representation of the attention-related information in the PFC, and how its computational organization predicts behavior.

Single trial neuronal activity dynamics of attentional intensity in monkey visual area V4

Understanding how activity of visual neurons represents distinct components of attention and their dynamics that account for improved visual performance remains elusive because single-unit experiments have not isolated the intensive aspect of attention from attentional selectivity. We isolated attentional intensity and its single trial dynamics as determined by spatially non-selective attentional performance in an orientation discrimination task while recording from neurons in monkey visual area V4. We found that attentional intensity is a distinct cognitive signal that can be distinguished from spatial selectivity, reward expectations and motor actions. V4 spiking on single trials encodes a combination of sensory and cognitive signals on different time scales. Attentional intensity and the detection of behaviorally relevant sensory signals are well represented, but immediate reward expectation and behavioral choices are poorly represented in V4 spiking. These results provide a detailed representation of perceptual and cognitive signals in V4 that are crucial for attentional performance.

The neural bases of spatial attention and perceptual rhythms

Attentional processes allow the brain to overcome its processing capacities limitations by enhancing relevant visual information and suppressing irrelevant information. Thus attention plays a critical role, shaping our perception of the world. Several models have been proposed to describe the neuronal bases of attention and its mechanistic underlyings. Recent electrophysiological evidence show that attentional processes rely on oscillatory brain activities that correlate with rhythmic changes in cognitive performance. In the present review, we first take a historical perspective on how attention is viewed, from the initial spotlight theory of attention to the recent dynamic view of attention selection and we review their supporting psychophysical evidence. Based on recent prefrontal electrophysiological evidence, we refine the most recent models of attention sampling by proposing a rhythmic and continuous model of attentional sampling. In particular, we show that attention involves a continuous exploration of space, shifting within and across visual hemifield at specific alpha and theta rhythms, independently of the current attentional load. In addition, we show that this prefrontal attentional spotlight implements conjointly selection and suppression mechanisms, and is captured by salient incoming items. Last, we argue that this attention spotlight implements a highly flexible alternation of attentional exploration and exploitation epochs, depending on ongoing task contingencies. In a last part, we review the local and network oscillatory mechanisms that correlate with rhythmic attentional sampling, describing multiple rhythmic generators and complex network interactions.

Wireless recording from unrestrained monkeys reveals motor goal encoding beyond immediate reach in frontoparietal cortex

System neuroscience of motor cognition regarding the space beyond immediate reach mandates free, yet experimentally controlled movements. We present an experimental environment (Reach Cage) and a versatile visuo-haptic interaction system (MaCaQuE) for investigating goal-directed whole-body movements of unrestrained monkeys. Two rhesus monkeys conducted instructed walk-and-reach movements towards targets flexibly positioned in the cage. We tracked 3D multi-joint arm and head movements using markerless motion capture. Movements show small trial-to-trial variability despite being unrestrained. We wirelessly recorded 192 broad-band neural signals from three cortical sensorimotor areas simultaneously. Single unit activity is selective for different reach and walk-and-reach movements. Walk-and-reach targets could be decoded from premotor and parietal but not motor cortical activity during movement planning. The Reach Cage allows systems-level sensorimotor neuroscience studies with full-body movements in a configurable 3D spatial setting with unrestrained monkeys. We conclude that the primate frontoparietal network encodes reach goals beyond immediate reach during movement planning.

Attention strengthens across-trial pre-stimulus phase coherence in visual cortex, enhancing stimulus processing

Attention selectively routes the most behaviorally relevant information from the stream of sensory inputs through the hierarchy of cortical areas. Previous studies have shown that visual attention depends on the phase of oscillatory brain activities. These studies mainly focused on the stimulus presentation period, rather than the pre-stimulus period. Here, we hypothesize that selective attention controls the phase of oscillatory neural activities to efficiently process relevant information. We document an attentional modulation of pre-stimulus inter-trial phase coherence (a measure of deviation between instantaneous phases of trials) of low frequency local field potentials (LFP) in visual area MT of macaque monkeys. Our data reveal that phase coherence increases following a spatial cue deploying attention towards the receptive field of the recorded neural population. We further show that the attentional enhancement of phase coherence is positively correlated with the modulation of the stimulus-induced firing rate, and importantly, a higher phase coherence is associated with a faster behavioral response. These results suggest a functional utilization of intrinsic neural oscillatory activities for an enhanced processing of upcoming stimuli.

The Effects of Methylphenidate (Ritalin) on the Neurophysiology of the Monkey Caudal Prefrontal Cortex

Methylphenidate (MPH), commonly known as Ritalin, is the most widely prescribed drug worldwide to treat patients with attention deficit disorders. Although MPH is thought to modulate catecholamine neurotransmission in the brain, it remains unclear how these neurochemical effects influence neuronal activity and lead to attentional enhancements. Studies in rodents overwhelmingly point to the lateral prefrontal cortex (LPFC) as a main site of action of MPH. To understand the mechanism of action of MPH in a primate brain, we recorded the responses of neuronal populations using chronic multielectrode arrays implanted in the caudal LPFC of two macaque monkeys while the animals performed an attention task (N = 2811 neuronal recordings). Over different recording sessions (N = 55), we orally administered either various doses of MPH or a placebo to the animals. Behavioral analyses revealed positive effects of MPH on task performance at specific doses. However, analyses of individual neurons activity, noise correlations, and neuronal ensemble activity using machine learning algorithms revealed no effects of MPH. Our results suggest that the positive behavioral effects of MPH observed in primates (including humans) may not be mediated by changes in the activity of caudal LPFC neurons. MPH may enhance cognitive performance by modulating neuronal activity in other regions of the attentional network in the primate brain.

A Normalization Circuit Underlying Coding of Spatial Attention in Primate Lateral Prefrontal Cortex

Lateral prefrontal cortex (LPFC) neurons signal the allocation of voluntary attention; however, the neural computations underlying this function remain unknown. To investigate this, we recorded from neuronal ensembles in the LPFC of two Macaca fascicularis performing a visuospatial attention task. LPFC neural responses to a single stimulus were normalized when additional stimuli/distracters appeared across the visual field and were well-characterized by an averaging computation. Deploying attention toward an individual stimulus surrounded by distracters shifted neural activity from an averaging regime toward a regime similar to that when the attended stimulus was presented in isolation (winner-take-all; WTA). However, attentional modulation is both qualitatively and quantitatively dependent on a neuron's visuospatial tuning. Our results show that during attentive vision, LPFC neuronal ensemble activity can be robustly read out by downstream areas to generate motor commands, and/or fed back into sensory areas to filter out distracter signals in favor of target signals.

Distracter suppression dominates attentional modulation of responses to multiple stimuli inside the receptive fields of middle temporal neurons

Single-cell studies in macaques have shown that attending to one of two stimuli, positioned inside a visual neuron's receptive field (RF), modulates the neuron's response to reflect the features of the attended stimulus. Such a modulation has been described as a 'push-pull' effect relative to a reference response: a neuron's response increases when attention is directed to a preferred stimulus, and decreases when attention is directed to a non-preferred stimulus. It has been further suggested that the response increase when attending to a preferred stimulus is the predominant effect. Here, we show that the observed attentional modulation depends on the reference response. We recorded neuronal responses in motion processing area middle temporal (MT) of macaques to two moving random dot patterns positioned inside neurons' RF. One pattern always moved in the neuron's antipreferred direction (null pattern), while the other moved in one of 12 directions (tuning pattern). At the beginning of a trial, a cue indicated the location and direction of the target. The animal was required to release a lever when a change in the target direction occurred, and to ignore changes in the distracter. Relative to neurons' initial responses to the dual stimuli (when attention was less likely to modulate responses), attending to the tuning pattern did not significantly modulate responses over time. However, attending to the null pattern progressively decreased responses over time. These results were quantitatively described by filter and input gain models, characterising a predominant response suppression relative to a reference response, rather than response enhancement.

Standardized automated training of rhesus monkeys for neuroscience research in their housing environment

Teaching nonhuman primates the complex cognitive behavioral tasks that are central to cognitive neuroscience research is an essential and challenging endeavor. It is crucial for the scientific success that the animals learn to interpret the often complex task rules and reliably and enduringly act accordingly. To achieve consistent behavior and comparable learning histories across animals, it is desirable to standardize training protocols. Automatizing the training can significantly reduce the time invested by the person training the animal. In addition, self-paced training schedules with individualized learning speeds based on automatic updating of task conditions could enhance the animals’ motivation and welfare. We developed a training paradigm for across-task unsupervised training (AUT) of successively more complex cognitive tasks to be administered through a stand-alone housing-based system optimized for rhesus monkeys in neuroscience research settings (Calapai A, Berger M, Niessing M, Heisig K, Brockhausen R, Treue S, Gail A. Behav Res Methods 5: 1–11, 2016). The AUT revealed interindividual differences in long-term learning progress between animals, helping to characterize learning personalities, and commonalities, helping to identify easier and more difficult learning steps in the training protocol. Our results demonstrate that 1) rhesus monkeys stay engaged with the AUT over months despite access to water and food outside the experimental sessions but with lower numbers of interaction compared with conventional fluid-controlled training; 2) with unsupervised training across sessions and task levels, rhesus monkeys can learn tasks of sufficient complexity for state-of-the-art cognitive neuroscience in their housing environment; and 3) AUT learning progress is primarily determined by the number of interactions with the system rather than the mere exposure time.

NEW & NOTEWORTHY We demonstrate that highly structured training of behavioral tasks, as used in neuroscience research, can be achieved in an unsupervised fashion over many sessions and task difficulties in a monkey housing environment. Employing a predefined training strategy allows for an observer-independent comparison of learning between animals and of training approaches. We believe that self-paced standardized training can be utilized for pretraining and animal selection and can contribute to animal welfare in a neuroscience research environment.

Local field potentials are induced by visually evoked spiking activity in macaque cortical area MT

Local field potentials (LFP) have been the focus of many recent studies in systems neuroscience. However, the exact neural basis of these signals remains unclear. To address this question, we determined the relationship between LFP signals and another, much better understood, signature of neural activity: action potentials. Specifically, we focused on the relationship between the amplitude of stimulus-induced LFPs and the magnitude of spiking activity in visual cortex of non-human primates. Our trial-by-trial correlation analyses between these two components of extracellular signals in macaque visual cortex show that the spike rate is coupled to the LFP amplitude with a surprisingly long latency, typically 50 ms. Our analysis shows that the neural spike rate is a significant predictor of the LFP amplitude. This limits the functional interpretation of LFP signals beyond that based on spiking activities.

A cage-based training, cognitive testing and enrichment system optimized for rhesus macaques in neuroscience research

In neurophysiological studies with awake non-human primates (NHP), it is typically necessary to train the animals over a prolonged period of time on a behavioral paradigm before the actual data collection takes place. Rhesus monkeys (Macaca mulatta) are the most widely used primate animal models in system neuroscience. Inspired by existing joystick- or touch-screen-based systems designed for a variety of monkey species, we built and successfully employed a stand-alone cage-based training and testing system for rhesus monkeys (eXperimental Behavioral Intrument, XBI). The XBI is mobile and easy to handle by both experts and non-experts; animals can work with only minimal physical restraints, yet the ergonomic design successfully encourages stereotypical postures with a consistent positioning of the head relative to the screen. The XBI allows computer-controlled training of the monkeys with a large variety of behavioral tasks and reward protocols typically used in systems and cognitive neuroscience research.

Graded Neuronal Modulations Related to Visual Spatial Attention

Studies of visual attention in monkeys typically measure neuronal activity when the stimulus event to be detected occurs at a cued location versus when it occurs at an uncued location. But this approach does not address how neuronal activity changes relative to conditions where attention is unconstrained by cueing. Human psychophysical studies have used neutral cueing conditions and found that neutrally cued behavioral performance is generally intermediate to that of cued and uncued conditions (Posner et al., 1978; Mangun and Hillyard, 1990; Montagna et al., 2009). To determine whether the neuronal correlates of visual attention during neutral cueing are similarly intermediate, we trained macaque monkeys to detect changes in stimulus orientation that were more likely to occur at one location (cued) than another (uncued), or were equally likely to occur at either stimulus location (neutral). Consistent with human studies, performance was best when the location was cued, intermediate when both locations were neutrally cued, and worst when the location was uncued. Neuronal modulations in visual area V4 were also graded as a function of cue validity and behavioral performance. By recording from both hemispheres simultaneously, we investigated the possibility of switching attention between stimulus locations during neutral cueing. The results failed to support a unitary "spotlight" of attention. Overall, our findings indicate that attention-related changes in V4 are graded to accommodate task demands.

SIGNIFICANCE STATEMENT

Studies of the neuronal correlates of attention in monkeys typically use visual cues to manipulate where attention is focused ("cued" vs "uncued"). Human psychophysical studies often also include neutrally cued trials to study how attention naturally varies between points of interest. But the neuronal correlates of this neutral condition are unclear. We measured behavioral performance and neuronal activity in cued, uncued, and neutrally cued blocks of trials. Behavioral performance and neuronal responses during neutral cueing were intermediate to those of the cued and uncued conditions. We found no signatures of a single mechanism of attention that switches between stimulus locations. Thus, attention-related changes in neuronal activity are largely hemisphere-specific and graded according to task demands.

Attentional Modulation of Neuronal Activity Depends on Neuronal Feature Selectivity

Attention exerts a powerful influence on visual perception. The impact of attention on neuronal activity manifests at early visual information processing stages and progressively increases throughout the visual cortical hierarchy. However, the neuronal mechanisms of attention are unresolved. In particular, the rules governing attentional modulation of individual neurons, whether they are facilitated by or suppressed by attention, are not known. To obtain a more granular or neuron- and circuit-level understanding of the mechanisms of attention and to directly test the feature similarity gain model in V1, we compared attentional modulation with neuronal feature selectivity across a large population of V1 neurons in alert and behaving macaque monkeys trained on an attention-demanding contrast-change detection task. We utilized emerging multi-electrode array technology to record simultaneously from V1 neurons spanning all six cortical layers so that we could characterize the laminar position and physiological response properties of diverse V1 neuronal populations. We found significant relationships between attentional modulation and neuronal position within the cortical hierarchy, neuronal physiology, and neuronal feature selectivity. Our results support the feature similarity gain model and further suggest that attentional modulation depends critically upon the match between neuronal feature selectivity and the features required for the task.

Attention to Multiple Objects Facilitates Their Integration in Prefrontal and Parietal Cortex

Selective attention is known to interact with perceptual organization. In visual scenes, individual objects that are distinct and discriminable may occur on their own, or in groups such as a stack of books. The main objective of this study is to probe the neural interaction that occurs between individual objects when attention is directed toward one or more objects. Here we record steady-state visual evoked potentials via electrocorticography to directly assess the responses to individual stimuli and to their interaction. When human participants attend to two adjacent stimuli, prefrontal and parietal cortex shows a selective enhancement of only the neural interaction between stimuli, but not the responses to individual stimuli. When only one stimulus is attended, the neural response to that stimulus is selectively enhanced in prefrontal and parietal cortex. In contrast, early visual areas generally manifest responses to individual stimuli and to their interaction regardless of attentional task, although a subset of the responses is modulated similarly to prefrontal and parietal cortex. Thus, the neural representation of the visual scene as one progresses up the cortical hierarchy becomes more highly task-specific and represents either individual stimuli or their interaction, depending on the behavioral goal. Attention to multiple objects facilitates an integration of objects akin to perceptual grouping.SIGNIFICANCE STATEMENT Individual objects in a visual scene are seen as distinct entities or as parts of a whole. Here we examine how attention to multiple objects affects their neural representation. Previous studies measured single-cell or fMRI responses and obtained only aggregate measures that combined the activity to individual stimuli as well as their potential interaction. Here, we directly measure electrocorticographic steady-state responses corresponding to individual objects and to their interaction using a frequency-tagging technique. Attention to two stimuli increases the interaction component that is a hallmark for perceptual integration of stimuli. Furthermore, this stimulus-specific interaction is represented in prefrontal and parietal cortex in a task-dependent manner.

Neurons in Primate Visual Cortex Alternate between Responses to Multiple Stimuli in Their Receptive Field

A fundamental question concerning representation of the visual world in our brain is how a cortical cell responds when presented with more than a single stimulus. We find supportive evidence that most cells presented with a pair of stimuli respond predominantly to one stimulus at a time, rather than a weighted average response. Traditionally, the firing rate is assumed to be a weighted average of the firing rates to the individual stimuli (response-averaging model) (Bundesen et al., 2005). Here, we also evaluate a probability-mixing model (Bundesen et al., 2005), where neurons temporally multiplex the responses to the individual stimuli. This provides a mechanism by which the representational identity of multiple stimuli in complex visual scenes can be maintained despite the large receptive fields in higher extrastriate visual cortex in primates. We compare the two models through analysis of data from single cells in the middle temporal visual area (MT) of rhesus monkeys when presented with two separate stimuli inside their receptive field with attention directed to one of the two stimuli or outside the receptive field. The spike trains were modeled by stochastic point processes, including memory effects of past spikes and attentional effects, and statistical model selection between the two models was performed by information theoretic measures as well as the predictive accuracy of the models. As an auxiliary measure, we also tested for uni- or multimodality in interspike interval distributions, and performed a correlation analysis of simultaneously recorded pairs of neurons, to evaluate population behavior.

Eye fixation during multiple object attention is based on a representation of discrete spatial foci

We often look at and attend to several objects at once. How the brain determines where to point our eyes when we do this is poorly understood. Here we devised a novel paradigm to discriminate between different models of spatial selection guiding fixation. In contrast to standard static attentional tasks where the eye remains fixed at a predefined location, observers selected their own preferred fixation position while they tracked static targets that were arranged in specific geometric configurations and which changed identity over time. Fixations were best predicted by a representation of discrete spatial foci, not a polygonal grouping, simple 2-foci division of attention or a circular spotlight. Moreover, attentional performance was incompatible with serial selection. Together with previous studies, our findings are compatible with a view that attentional selection and fixation rely on shared spatial representations and suggest a more nuanced definition of overt vs. covert attention.

Attention enhances stimulus representations in macaque visual cortex without affecting their signal-to-noise level

The magnitude of the attentional modulation of neuronal responses in visual cortex varies with stimulus contrast. Whether the strength of these attentional influences is similarly dependent on other stimulus properties is unknown. Here we report the effect of spatial attention on responses in the medial-temporal area (MT) of macaque visual cortex to moving random dots pattern of various motion coherences, i.e. signal-to-noise ratios. Our data show that allocating spatial attention causes a gain change in MT neurons. The magnitude of this attentional modulation is independent of the attended stimulus’ motion coherence, creating a multiplicative scaling of the neuron’s coherence-response function. This is consistent with the characteristics of gain models of attentional modulation and suggests that attention strengthens the neuronal representation of behaviorally relevant visual stimuli relative to unattended stimuli, but without affecting their signal-to-noise ratios.

Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex

Cognitive functions rely on the coordinated activity of neurons in many brain regions, but the interactions between cortical areas are not yet well understood. Here we investigated whether low-frequency (α) and high-frequency (γ) oscillations characterize different directions of information flow in monkey visual cortex. We recorded from all layers of the primary visual cortex (V1) and found that γ-waves are initiated in input layer 4 and propagate to the deep and superficial layers of cortex, whereas α-waves propagate in the opposite direction. Simultaneous recordings from V1 and downstream area V4 confirmed that γ- and α-waves propagate in the feedforward and feedback direction, respectively. Microstimulation in V1 elicited γ-oscillations in V4, whereas microstimulation in V4 elicited α-oscillations in V1, thus providing causal evidence for the opposite propagation of these rhythms. Furthermore, blocking NMDA receptors, thought to be involved in feedback processing, suppressed α while boosting γ. These results provide new insights into the relation between brain rhythms and cognition.

Differential neuronal representation of spatial attention dependent on relative target locations during multiple object tracking

Humans can simultaneously track multiple moving objects with attention. The number of objects that can be tracked is known to be larger when visual stimuli are presented bilaterally rather than presented unilaterally. To elucidate the underlying neuronal mechanism, we trained monkeys to covertly track a single or multiple object(s). We found that neurons in the lateral prefrontal cortex exhibited greater activity for the target passing through the receptive field (RF) than for distractors. During multiple-object tracking, response enhancement for one target presented in the RF was stronger when the other target was located in the opposite than the same visual hemifield. Because the neuronal modulation did not differ depending on relative target locations with respect to upper and lower visual hemifields, the distance between the targets does not explain the results. We propose that inherent, anatomical separation of visual processing for contralateral and ipsilateral visual fields might constrain cognitive capacity.

A review of the mechanisms by which attentional feedback shapes visual selectivity

The glut of information available for the brain to process at any given moment necessitates an efficient attentional system that can 'pick and choose' what information receives prioritized processing. A growing body of work, spanning numerous methodologies and species, reveals that one powerful way in which attending to an item separates the wheat from the chaff is by altering a basic response property in the brain: neuronal selectivity. Selectivity is a cornerstone response property, largely dictating our ability to represent and interact with the environment. Although it is likely that selectivity is altered throughout many brain areas, here we focus on how directing attention to an item affects selectivity in the visual system, where this response property is generally more well characterized. First, we review the neural architecture supporting selectivity, and then discuss the various changes that could occur in selectivity for an attended item. In a survey of the literature, spanning neurophysiology, neuroimaging and psychophysics, we reveal that there is general convergence regarding the manner with which selectivity is shaped by attentional feedback. In a nutshell, the literature suggests that the type of changes in selectivity that manifest appears to depend on the type of attention being deployed: whereas directing spatial attention towards an item only alters spatial selectivity, directing feature-based attention can alter the selectivity of attended features.

A unifying mechanistic model of selective attention in spiking neurons

Visuospatial attention produces myriad effects on the activity and selectivity of cortical neurons. Spiking neuron models capable of reproducing a wide variety of these effects remain elusive. We present a model called the Attentional Routing Circuit (ARC) that provides a mechanistic description of selective attentional processing in cortex. The model is described mathematically and implemented at the level of individual spiking neurons, with the computations for performing selective attentional processing being mapped to specific neuron types and laminar circuitry. The model is used to simulate three studies of attention in macaque, and is shown to quantitatively match several observed forms of attentional modulation. Specifically, ARC demonstrates that with shifts of spatial attention, neurons may exhibit shifting and shrinking of receptive fields; increases in responses without changes in selectivity for non-spatial features (i.e. response gain), and; that the effect on contrast-response functions is better explained as a response-gain effect than as contrast-gain. Unlike past models, ARC embodies a single mechanism that unifies the above forms of attentional modulation, is consistent with a wide array of available data, and makes several specific and quantifiable predictions.

At a given moment, a tremendous amount of visual information falls on the retinae, far more than the brain is capable of processing. By directing attention to a spatial location, stimuli at that position can be selectively processed, while irrelevant information from non-attended locations can be largely ignored. We present a detailed model that describes the mechanisms by which visual spatial attention may be implemented in the brain. Using this model, we simulated three previous studies of spatial attention in primates, and analysed the simulation data using the same methods as in the original experiments. Across these simulations, and without altering model parameters, our model produces results that are statistically indistinguishable from those recorded in primates. Unlike previous work, our model provides greater biological detail of how the brain performs selective visual processing, while also accurately demonstrating numerous forms of selective attention. Our results suggest that these seemingly different forms of attentional effects may result from a single mechanism for selectively processing attended stimuli.

Different neuronal computations of spatial working memory for multiple locations within versus across visual hemifields

Spatial working memory is one of the most studied cognitive functions, serving as a model system to decipher computational principles of the brain. Although neuronal mechanisms for remembering a single location have been well elucidated, little is known about memory for multiple locations. Here, we examined the activities of prefrontal neurons during monkeys remembered positions of one or two visual cue(s). When the two cues were presented across the left and right visual fields, neurons exhibited a comparable response to the activity for the preferred cue presented alone. When the two cues were presented within the same hemifield, neurons exhibited an intermediate response between those to the individual cues. Subsequent computer simulations predicted a lower signal-to-noise ratio in the latter condition, which was further verified by behavioral experiments. Considering the separation of contralateral and ipsilateral visual processing, the lateral inhibition in local circuits might implicitly determine different neuronal computations and memory capacities for bilateral and unilateral displays.

Long-term memory guidance of visuospatial attention in a change-detection paradigm

Visual task performance is generally stronger in familiar environments. One reason for this familiarity benefit is that we learn where to direct our visual attention and effective attentional deployment enhances performance. Visual working memory plays a central role in supporting long-term memory guidance of visuospatial attention. We modified a change detection task to create a new paradigm for investigating long-term memory guidance of attention. During the training phase, subjects viewed images in a flicker paradigm and were asked to detect between one and three changes in the images. The test phase required subjects to detect a single change in a one-shot change detection task in which they held all possible locations of changes in visual working memory and deployed attention to those locations to determine if a change occurred. Subjects detected significantly more changes in images for which they had been trained to detect the changes, demonstrating that memory of the images guided subjects in deploying their attention. Moreover, capacity to detect changes was greater for images that had multiple changes during the training phase. In Experiment 2, we observed that capacity to detect changes for the 3-studied change condition increased significantly with more study exposures and capacity was significantly higher than 1, indicating that subjects were able to attend to more than one location. Together, these findings suggest memory and attentional systems interact via working memory such that long-term memory can be used to direct visual spatial attention to multiple locations based on previous experience.

Modulation of early cortical processing during divided attention to non-contiguous locations

We often face the challenge of simultaneously attending to multiple non-contiguous regions of space. There is ongoing debate as to how spatial attention is divided under these situations. Whereas, for several years, the predominant view was that humans could divide the attentional spotlight, several recent studies argue in favor of a unitary spotlight that rhythmically samples relevant locations. Here, this issue was addressed by the use of high-density electrophysiology in concert with the multifocal m-sequence technique to examine visual evoked responses to multiple simultaneous streams of stimulation. Concurrently, we assayed the topographic distribution of alpha-band oscillatory mechanisms, a measure of attentional suppression. Participants performed a difficult detection task that required simultaneous attention to two stimuli in contiguous (undivided) or non-contiguous parts of space. In the undivided condition, the classic pattern of attentional modulation was observed, with increased amplitude of the early visual evoked response and increased alpha amplitude ipsilateral to the attended hemifield. For the divided condition, early visual responses to attended stimuli were also enhanced, and the observed multifocal topographic distribution of alpha suppression was in line with the divided attention hypothesis. These results support the existence of divided attentional spotlights, providing evidence that the corresponding modulation occurs during initial sensory processing time-frames in hierarchically early visual regions, and that suppressive mechanisms of visual attention selectively target distracter locations during divided spatial attention.

Spatio-temporal Patterns of Brain Activity Distinguish Strategies of Multiple-object Tracking

Human observers can readily track up to four independently moving items simultaneously, even in the presence of moving distractors. Here we combined EEG and magnetoencephalography recordings to investigate the neural processes underlying this remarkable capability. Participants were instructed to track four of eight independently moving items for 3 sec. When the movement ceased a probe stimulus consisting of four items with a higher luminance was presented. The location of the probe items could correspond fully, partly, or not at all with the tracked items. Participants reported whether the probe items fully matched the tracked items or not. About half of the participants showed slower RTs and higher error rates with increasing correspondence between tracked items and the probe. The other half, however, showed faster RTs and lower error rates when the probe fully matched the tracked items. This latter behavioral pattern was associated with enhanced probe-evoked neural activity that was localized to the lateral occipital cortex in the time range 170–210 msec. This enhanced response in the object-selective lateral occipital cortex suggested that these participants performed the tracking task by visualizing the overall shape configuration defined by the vertices of the tracked items, thereby producing a behavioral advantage on full-match trials. In a later time range (270–310 msec) probe-evoked neural activity increased monotonically as a function of decreasing target–probe correspondence in all participants. This later modulation, localized to superior parietal cortex, was proposed to reflect the degree of mismatch between the probe and the automatically formed visual STM representation of the tracked items.

Perceptual modulation of motor--but not visual--responses in the frontal eye field during an urgent-decision task

Neuronal activity in the frontal eye field (FEF) ranges from purely motor (related to saccade production) to purely visual (related to stimulus presence). According to numerous studies, visual responses correlate strongly with early perceptual analysis of the visual scene, including the deployment of spatial attention, whereas motor responses do not. Thus, functionally, the consensus is that visually responsive FEF neurons select a target among visible objects, whereas motor-related neurons plan specific eye movements based on such earlier target selection. However, these conclusions are based on behavioral tasks that themselves promote a serial arrangement of perceptual analysis followed by motor planning. So, is the presumed functional hierarchy in FEF an intrinsic property of its circuitry or does it reflect just one possible mode of operation? We investigate this in monkeys performing a rapid-choice task in which, crucially, motor planning always starts ahead of task-critical perceptual analysis, and the two relevant spatial locations are equally informative and equally likely to be target or distracter. We find that the choice is instantiated in FEF as a competition between oculomotor plans, in agreement with model predictions. Notably, although perception strongly influences the motor neurons, it has little if any measurable impact on the visual cells; more generally, the more dominant the visual response, the weaker the perceptual modulation. The results indicate that, contrary to expectations, during rapid saccadic choices perceptual information may directly modulate ongoing saccadic plans, and this process is not contingent on prior selection of the saccadic goal by visually driven FEF responses.

Attention maps in the brain

Over 20 distinct cerebral cortical areas contain spatial map representations of the visual field. These retinotopic, or visuotopic, cortical areas occur not only in the occipital lobe but also in the parietal, temporal, and frontal lobes. The cognitive influences of visuospatial attention operate via these cortical maps and can support selection of multiple objects at the same time. In early visual cortical areas, spatial attention enhances responses of selected items and diminishes the responses to distracting items. In higher order cortex, the maps support a spatial indexing role, keeping track of the items to be attended. These maps also support visual short-term memory (VSTM) representations. In each hemisphere, all the known maps respond selectively to stimuli presented within the contralateral visual field. However, a hemispheric asymmetry emerges when the attentional or VSTM demands of a task become significant. In the parietal lobe, the right hemisphere visuotopic maps switch from coding only contralateral visual targets to coding memory and attention targets across the entire visual field. This emergent asymmetry has important implications for understanding hemispatial neglect syndrome, and supports a dynamic network form of the representational model of neglect. WIREs Cogn Sci 2013, 4:327-340. doi: 10.1002/wcs.1230 This article is categorized under: Psychology > Attention Neuroscience > Cognition.

Temporal dynamics of divided spatial attention

In naturalistic settings, observers often have to monitor multiple objects dispersed throughout the visual scene. However, the degree to which spatial attention can be divided across spatially noncontiguous objects has long been debated, particularly when those objects are in close proximity. Moreover, the temporal dynamics of divided attention are unclear: is the process of dividing spatial attention gradual and continuous, or does it onset in a discrete manner? To address these issues, we recorded steady-state visual evoked potentials (SSVEPs) as subjects covertly monitored two flickering targets while ignoring an intervening distractor that flickered at a different frequency. All three stimuli were clustered within either the lower left or the lower right quadrant, and our dependent measure was SSVEP power at the target and distractor frequencies measured over time. In two experiments, we observed a temporally discrete increase in power for target- vs. distractor-evoked SSVEPs extending from ∼350 to 150 ms prior to correct (but not incorrect) responses. The divergence in SSVEP power immediately prior to a correct response suggests that spatial attention can be divided across noncontiguous locations, even when the targets are closely spaced within a single quadrant. In addition, the division of spatial attention appears to be relatively discrete, as opposed to slow and continuous. Finally, the predictive relationship between SSVEP power and behavior demonstrates that these neurophysiological measures of divided attention are meaningfully related to cognitive function.

A mixture distribution of spatial attention

Although it may seem paradoxical, the unified-focus and multiple-foci theories of spatial selective attention are both well supported by experimental evidence. However, the apparent contradiction is illusory and the two competing views may be reconciled by a closer examination of the spatial mechanisms involved. We propose that the deployment of attention may be modeled as a mixture of individual distributions of attention and we tested this hypothesis in two experiments. Participants had to identify targets among distractors, with the targets presented at various distances from the cued locations. Experiment 1 confirmed that the distribution of attention may be described by a mixture of individual distributions, each centered at a cued location. Experiment 2 showed that cue separation is an important determinant of whether spatial attention is divided or not.

Anatomical constraints on attention: hemifield independence is a signature of multifocal spatial selection

Previous studies have shown independent attentional selection of targets in the left and right visual hemifields during attentional tracking (Alvarez & Cavanagh, 2005) but not during a visual search (Luck, Hillyard, Mangun, & Gazzaniga, 1989). Here we tested whether multifocal spatial attention is the critical process that operates independently in the two hemifields. It is explicitly required in tracking (attend to a subset of object locations, suppress the others) but not in the standard visual search task (where all items are potential targets). We used a modified visual search task in which observers searched for a target within a subset of display items, where the subset was selected based on location (Experiments 1 and 3A) or based on a salient feature difference (Experiments 2 and 3B). The results show hemifield independence in this subset visual search task with location-based selection but not with feature-based selection; this effect cannot be explained by general difficulty (Experiment 4). Combined, these findings suggest that hemifield independence is a signature of multifocal spatial attention and highlight the need for cognitive and neural theories of attention to account for anatomical constraints on selection mechanisms.