Receptive field shift and shrinkage in macaque middle temporal area through attentional gain modulation

Common neural mechanisms supporting spatial working memory, attention and motor intention

The prefrontal cortex (PFC) and posterior parietal cortex (PPC) are critical neural substrates for working memory. Neural activity persists in these regions during the maintenance of a working memory representation. Persistent activity, therefore, may be the neural mechanism by which information is temporarily maintained. However, the nature of the representation or what is actually being represented by this persistent activity is not well understood. In this review, we summarize the recent functional magnetic resonance imaging (fMRI) studies conducted in our laboratory that test hypotheses about the nature of persistent activity during a variety of spatial cognition tasks. We find that the same areas in the PFC and PPC that show persistent activity during the maintenance of a working memory representation also show persistent activity during the maintenance of spatial attention and the maintenance of motor intention. Therefore, we conclude that persistent activity is not specific to working memory, but instead, carries information that can be used generally to support a variety of cognitions. Specifically, activity in topographically organized maps of prioritized space in PFC and PPC could be read out to guide attention allocation, spatial memory, and motor planning.

Spatial perception during pursuit initiation

Spatial perception is modulated by eye movements. During smooth pursuit, perceived locations are shifted in the direction of the eye movement. During active fixation, visual space is perceptually compressed towards the fovea. In our present study, we were interested to determine the time course of spatial localization during pursuit initiation, i.e. the transition period from fixation to steady-state pursuit. Human observers had to localize briefly flashed targets around the time of pursuit initiation. Our data clearly show that pursuit-like mislocalization starts well before the onset of the eye movement. Our results point towards corollary-discharge as neural source for the observed perceptual effect.

The neural basis of visual attention

Visual attention is the mechanism the nervous system uses to highlight specific locations, objects or features within the visual field. This can be accomplished by making an eye movement to bring the object onto the fovea (overt attention) or by increased processing of visual information in neurons representing more peripheral regions of the visual field (covert attention). This review will examine two aspects of visual attention: the changes in neural responses within visual cortices due to the allocation of covert attention; and the neural activity in higher cortical areas involved in guiding the allocation of attention. The first section will highlight processes that occur during visual spatial attention and feature-based attention in cortical visual areas and several related models that have recently been proposed to explain this activity. The second section will focus on the parietofrontal network thought to be involved in targeting eye movements and allocating covert attention. It will describe evidence that the lateral intraparietal area, frontal eye field and superior colliculus are involved in the guidance of visual attention, and describe the priority map model, which is thought to operate in at least several of these areas.

Spatial attention improves the quality of population codes in human visual cortex

Selective attention enables sensory input from behaviorally relevant stimuli to be processed in greater detail, so that these stimuli can more accurately influence thoughts, actions, and future goals. Attention has been shown to modulate the spiking activity of single feature-selective neurons that encode basic stimulus properties (color, orientation, etc.). However, the combined output from many such neurons is required to form stable representations of relevant objects and little empirical work has formally investigated the relationship between attentional modulations on population responses and improvements in encoding precision. Here, we used functional MRI and voxel-based feature tuning functions to show that spatial attention induces a multiplicative scaling in orientation-selective population response profiles in early visual cortex. In turn, this multiplicative scaling correlates with an improvement in encoding precision, as evidenced by a concurrent increase in the mutual information between population responses and the orientation of attended stimuli. These data therefore demonstrate how multiplicative scaling of neural responses provides at least one mechanism by which spatial attention may improve the encoding precision of population codes. Increased encoding precision in early visual areas may then enhance the speed and accuracy of perceptual decisions computed by higher-order neural mechanisms.

The spatial profile of macaque MT neurons is consistent with Gaussian sampling of logarithmically coordinated visual representation

Neurons in extrastriate visual areas have large receptive fields (RFs) compared with those in primary visual cortex (V1), suggesting extensive spatial integration. To examine the spatial integration of neurons in area MT, we modeled the RFs of MT neurons based on a symmetrical (Gaussian) integration of V1 outputs and tested the model using single-unit recording in two fixating macaque monkeys. Because visual representation in V1 is logarithmically compressed along eccentricity, the resulting RF model is log-Gaussian along the radial axis in polar coordinates. To test the log-Gaussian model, the RF of each neuron was mapped on a 5 x 5 grid using a small patch of random dots drifting at the preferred velocity of the neuron. The majority of MT neurons had RFs with a steeper slope near the fovea and a shallower slope away from the fovea. Among various two-dimensional Gaussian models fitted to the RFs, the log-Gaussian model provided the best description. The fitted parameters revealed that the range of sampling by MT neurons has no systematic relationship with eccentricities, consistent with a recent study for V4 neurons. Our results suggest that MT neurons integrate inputs from constant-sized patches of V1 cortex.

Top-down control of visual attention

Top-down visual attention improves perception of selected stimuli and that improvement is reflected in the neural activity at many stages throughout the visual system. Recent studies of top-down attention have elaborated on the signatures of its effects within visual cortex and have begun identifying its causal basis. Evidence from these studies suggests that the correlates of spatial attention exhibited by neurons within the visual system originate from a distributed network of structures involved in the programming of saccadic eye movements. We summarize this evidence and discuss its relationship to the neural mechanisms of spatial working memory.

The spatial distribution of receptive field changes in a model of peri-saccadic perception: predictive remapping and shifts towards the saccade target

At the time of an impending saccade receptive fields (RFs) undergo dynamic changes, that is, their spatial profile is altered. This phenomenon has been observed in several monkey visual areas. Although their link to eye movements is obvious, neither the exact pattern nor their function is fully clear. Several RF shifts have been interpreted in terms of predictive remapping mediating visual stability. In particular, even prior to saccade onset some cells become responsive to stimuli presented in their future, post-saccadic RF. In visual area V4, however, the overall effect of RF dynamics consists of a shrinkage and shift of RFs towards the saccade target. These observations have been linked to a pre-saccadically enhanced processing of the future fixation. In order to better understand these seemingly different outcomes, we analyzed the RF shifts predicted by a recently proposed computational model of peri-saccadic perception (Hamker, Zirnsak, Calow, & Lappe, 2008). This model unifies peri-saccadic compression, pre-saccadic attention shifts, and peri-saccadic receptive field dynamics in a common framework of oculomotor reentry signals in extrastriate visual cortical maps. According to the simulations that we present in the current paper, a spatially selective oculomotor feedback signal leads to RF dynamics which are both consistent with the observations made in studies aiming to investigate predictive remapping and saccade target shifts. Thus, the seemingly distinct experimental observations could be grounded in the same neural mechanism leading to different RF dynamics dependent on the location of the RF in visual space.

Adaptive allocation of attentional gain

Humans are adept at distinguishing between stimuli that are very similar, an ability that is particularly crucial when the outcome is of serious consequence (e.g., for a surgeon or air-traffic controller). Traditionally, selective attention was thought to facilitate perception by increasing the gain of sensory neurons tuned to the defining features of a behaviorally relevant object (e.g., color, orientation, etc.). In contrast, recent mathematical models counterintuitively suggest that, in many cases, attentional gain should be applied to neurons that are tuned away from relevant features, especially when discriminating highly similar stimuli. Here we used psychophysical methods to critically evaluate these "ideal observer" models. The data demonstrate that attention enhances the gain of the most informative sensory neurons, even when these neurons are tuned away from the behaviorally relevant target feature. Moreover, the degree to which an individual adopted optimal attentional gain settings by the end of testing predicted success rates on a difficult visual discrimination task, as well as the amount of task improvement that occurred across repeated testing sessions (learning). Contrary to most traditional accounts, these observations suggest that the primary function of attentional gain is not to enhance the representation of target features per se, but instead to optimize performance on the current perceptual task. Additionally, individual differences in gain suggest that the operating characteristics of low-level attentional phenomena are not stable trait-like attributes and that variability in how attention is deployed may play an important role in determining perceptual abilities.

Attention directed by expectations enhances receptive fields in cortical area MT

Expectations, especially those formed on the basis of extensive training, can substantially enhance visual performance. However, it is not clear that the physiological mechanisms underlying this enhancement are identical to those examined by experiments in which attention is directed by explicit instructions rather than strong expectations. To study the changes in visual representations associated with strong expectations, we trained animals to detect a brief motion pulse that was embedded in noise. Because the nature of the pulse and the statistics of its appearance were well known to the animals, they formed strong expectations which determined their behavioral performance. We used white-noise methods to infer the receptive field structure of single neurons in area MT while they were performing this task. Incorporating non-linearities, we compared receptive fields during periods of time when the animals were expecting the motion pulse with periods of time when they were not. We found receptive field changes consistent with an increased reliability in signaling pulse occurrence. Moreover, these changes were not consistent with a simple gain modulation. The results suggest that strong expectations can create very specific changes in the visual representations at a cellular level to enhance performance.

Combining spatial and feature-based attention within the receptive field of MT neurons

This study investigates the effects of feature-based attention on responses of direction-selective neurons in the middle temporal area (MT) of macaque visual cortex to attended stimuli inside the receptive field. Redirecting attention between the preferred and null direction of transparent random dot motion patterns caused a mean modulation of responses of approximately 32%, about half of what was observed when the two directions of motion in the receptive field were spatially separated allowing feature-based and spatial attention to work in concert. This is consistent with models of visual attention that interpret the attentional modulation of a neuron as the combination of all attentional influences, treating stimulus location simply as another feature.

Task difficulty and performance induce diverse adaptive patterns in gain and shape of primary auditory cortical receptive fields

Attention is essential for navigating complex acoustic scenes, when the listener seeks to extract a foreground source while suppressing background acoustic clutter. This study explored the neural correlates of this perceptual ability by measuring rapid changes of spectrotemporal receptive fields (STRFs) in primary auditory cortex during detection of a target tone embedded in noise. Compared with responses in the passive state, STRF gain decreased during task performance in most cells. By contrast, STRF shape changes were excitatory and specific, and were strongest in cells with best frequencies near the target tone. The net effect of these adaptations was to accentuate the representation of the target tone relative to the noise by enhancing responses of near-target cells to the tone during high-signal-to-noise ratio (SNR) tasks while suppressing responses of far-from-target cells to the masking noise in low-SNR tasks. These adaptive STRF changes were largest in high-performance sessions, confirming a close correlation with behavior.

Attention reshapes center-surround receptive field structure in macaque cortical area MT

Directing spatial attention to a location inside the classical receptive field (cRF) of a neuron in macaque medial temporal area (MT) shifts the center of the cRF toward the attended location. Here we investigate the influence of spatial attention on the profile of the inhibitory surround present in many MT neurons. Two monkeys attended to the fixation point or to 1 of 2 random dot patterns (RDPs) placed inside or next to the cRF, whereas a third RDP (the probe) was briefly presented in quick succession across the cRF and surround. The probe presentation responses were used to compute a map of the excitatory receptive field and its inhibitory surround. Attention systematically reshapes the receptive field profile, independently shifting both center and surround toward the attended location. Furthermore, cRF size is changed as a function of relative distance to the attentional focus: attention inside the cRF shrinks it, whereas directing attention next to the cRF expands it. In addition, we find systematic changes in surround inhibition and cRF amplitude. This nonmultiplicative push-pull modulation of the receptive field's center-surround structure optimizes processing at and near the attentional focus to strengthen the representation of the attended stimulus while reducing influences from distractors.