Representation of the visual field in the lateral intraparietal area of macaque monkeys: a quantitative receptive field analysis

Tactile representation of the head and shoulders assessed by fMRI in the nonhuman primate

In nonhuman primates, tactile representation at the cortical level has mostly been studied using single-cell recordings targeted to specific cortical areas. In this study, we explored the representation of tactile information delivered to the face or the shoulders at the whole brain level, using functional magnetic resonance imaging (fMRI) in the nonhuman primate. We used air puffs delivered to the center of the face, the periphery of the face, or the shoulders. These stimulations elicited activations in numerous cortical areas, encompassing the primary and secondary somatosensory areas, prefrontal and premotor areas, and parietal, temporal, and cingulate areas as well as low-level visual cortex. Importantly, a specific parieto-temporo-prefrontal network responded to the three stimulations but presented a marked preference for air puffs directed to the center of the face. This network corresponds to areas that are also involved in near-space representation, as well as in the multisensory integration of information at the interface between this near space and the skin of the face, and is probably involved in the construction of a peripersonal space representation around the head.

Organization and evolution of parieto-frontal processing streams in macaque monkeys and humans

The functional organization of the parieto-frontal system is crucial for understanding cognitive-motor behavior and provides the basis for interpreting the consequences of parietal lesions in humans from a neurobiological perspective. The parieto-frontal connectivity defines some main information streams that, rather than being devoted to restricted functions, underlie a rich behavioral repertoire. Surprisingly, from macaque to humans, evolution has added only a few, new functional streams, increasing however their complexity and encoding power. In fact, the characterization of the conduction times of parietal and frontal areas to different target structures has recently opened a new window on cortical dynamics, suggesting that evolution has amplified the probability of dynamic interactions between the nodes of the network, thanks to communication patterns based on temporally-dispersed conduction delays. This might allow the representation of sensory-motor signals within multiple neural assemblies and reference frames, as to optimize sensory-motor remapping within an action space characterized by different and more complex demands across evolution.

Cortical Connections of the Caudal Portion of Posterior Parietal Cortex in Prosimian Galagos

Posterior parietal cortex (PPC) of prosimian galagos includes a rostral portion (PPCr) where electrical stimulation evokes different classes of complex movements from different subregions, and a caudal portion (PPCc) where such stimulation fails to evoke movements in anesthetized preparations ( Stepniewska, Fang et al. 2009). We placed tracer injections into PPCc to reveal patterns of its cortical connections. There were widespread connections within PPCc as well as connections with PPCr and extrastriate visual areas, including V2 and V3. Weaker connections were with dorsal premotor cortex, and the frontal eye field. The connections of different parts of PPCc with visual areas were roughly retinotopic such that injections to dorsal PPCc labeled more neurons in the dorsal portions of visual areas, representing lower visual quadrant, and injections to ventral PPCc labeled more neurons in ventral portions of these visual areas, representing the upper visual quadrant. We conclude that much of the PPCc contains a crude representation of the contralateral visual hemifield, with inputs largely, but not exclusively, from higher-order visual areas that are considered part of the dorsal visuomotor processing stream. As in galagos, the caudal half of PPC was likely visual in early primates, with the rostral PPC half mediating sensorimotor functions.

Differential dynamics of spatial attention, position, and color coding within the parietofrontal network

Despite an ever growing knowledge on how parietal and prefrontal neurons encode low-level spatial and color information or higher-level information, such as spatial attention, an understanding of how these cortical regions process neuronal information at the population level is still missing. A simple assumption would be that the function and temporal response profiles of these neuronal populations match that of its constituting individual cells. However, several recent studies suggest that this is not necessarily the case and that the single-cell approach overlooks dynamic changes in how information is distributed over the neuronal population. Here, we use a time-resolved population pattern analysis to explore how spatial position, spatial attention and color information are differentially encoded and maintained in the macaque monkey prefrontal (frontal eye fields) and parietal cortex (lateral intraparietal area). Overall, our work brings about three novel observations. First, we show that parietal and prefrontal populations operate in two distinct population regimens for the encoding of sensory and cognitive information: a stationary mode and a dynamic mode. Second, we show that the temporal dynamics of a heterogeneous neuronal population brings about complementary information to that of its functional subpopulations. Thus, both need to be investigated in parallel. Last, we show that identifying the neuronal configuration in which a neuronal population encodes given information can serve to reveal this same information in a different context. All together, this work challenges common views on neural coding in the parietofrontal network.

Effective connectivity of depth-structure-selective patches in the lateral bank of the macaque intraparietal sulcus

Extrastriate cortical areas are frequently composed of subpopulations of neurons encoding specific features or stimuli, such as color, disparity, or faces, and patches of neurons encoding similar stimulus properties are typically embedded in interconnected networks, such as the attention or face-processing network. The goal of the current study was to examine the effective connectivity of subsectors of neurons in the same cortical area with highly similar neuronal response properties. We first recorded single- and multi-unit activity to identify two neuronal patches in the anterior part of the macaque intraparietal sulcus (IPS) showing the same depth structure selectivity and then employed electrical microstimulation during functional magnetic resonance imaging in these patches to determine the effective connectivity of these patches. The two IPS subsectors we identified-with the same neuronal response properties and in some cases separated by only 3 mm-were effectively connected to remarkably distinct cortical networks in both dorsal and ventral stream in three macaques. Conversely, the differences in effective connectivity could account for the known visual-to-motor gradient within the anterior IPS. These results clarify the role of the anterior IPS as a pivotal brain region where dorsal and ventral visual stream interact during object analysis. Thus, in addition to the anatomical connectivity of cortical areas and the properties of individual neurons in these areas, the effective connectivity provides novel key insights into the widespread functional networks that support behavior.

The effects of short-term and long-term learning on the responses of lateral intraparietal neurons to visually presented objects

The lateral intraparietal area (LIP) is thought to play an important role in the guidance of where to look and pay attention. LIP can also respond selectively to differently shaped objects. We sought to understand to what extent short-term and long-term experience with visual orienting determines the responses of LIP to objects of different shapes. We taught monkeys to arbitrarily associate centrally presented objects of various shapes with orienting either toward or away from a preferred spatial location of a neuron. The training could last for less than a single day or for several months. We found that neural responses to objects are affected by such experience, but that the length of the learning period determines how this neural plasticity manifests. Short-term learning affects neural responses to objects, but these effects are only seen relatively late after visual onset; at this time, the responses to newly learned objects resemble those of familiar objects that share their meaning or arbitrary association. Long-term learning affects the earliest bottom-up responses to visual objects. These responses tend to be greater for objects that have been associated with looking toward, rather than away from, LIP neurons' preferred spatial locations. Responses to objects can nonetheless be distinct, although they have been similarly acted on in the past and will lead to the same orienting behavior in the future. Our results therefore indicate that a complete experience-driven override of LIP object responses may be difficult or impossible. We relate these results to behavioral work on visual attention.

Monkey cortex through fMRI glasses

In 1998 several groups reported the feasibility of fMRI experiments in monkeys, with the goal to bridge the gap between invasive nonhuman primate studies and human functional imaging. These studies yielded critical insights in the neuronal underpinnings of the BOLD signal. Furthermore, the technology has been successful in guiding electrophysiological recordings and identifying focal perturbation targets. Finally, invaluable information was obtained concerning human brain evolution. We here provide a comprehensive overview of awake monkey fMRI studies mainly confined to the visual system. We review the latest insights about the topographic organization of monkey visual cortex and discuss the spatial relationships between retinotopy and category- and feature-selective clusters. We briefly discuss the functional layout of parietal and frontal cortex and continue with a summary of some fascinating functional and effective connectivity studies. Finally, we review recent comparative fMRI experiments and speculate about the future of nonhuman primate imaging.

Selective visual attention to drive cognitive brain-machine interfaces: from concepts to neurofeedback and rehabilitation applications

Brain–machine interfaces (BMIs) using motor cortical activity to drive an external effector like a screen cursor or a robotic arm have seen enormous success and proven their great rehabilitation potential. An emerging parallel effort is now directed to BMIs controlled by endogenous cognitive activity, also called cognitive BMIs. While more challenging, this approach opens new dimensions to the rehabilitation of cognitive disorders. In the present work, we focus on BMIs driven by visuospatial attention signals and we provide a critical review of these studies in the light of the accumulated knowledge about the psychophysics, anatomy, and neurophysiology of visual spatial attention. Importantly, we provide a unique comparative overview of the several studies, ranging from non-invasive to invasive human and non-human primates studies, that decode attention-related information from ongoing neuronal activity. We discuss these studies in the light of the challenges attention-driven cognitive BMIs have to face. In a second part of the review, we discuss past and current attention-based neurofeedback studies, describing both the covert effects of neurofeedback onto neuronal activity and its overt behavioral effects. Importantly, we compare neurofeedback studies based on the amplitude of cortical activity to studies based on the enhancement of cortical information content. Last, we discuss several lines of future research and applications for attention-driven cognitive brain-computer interfaces (BCIs), including the rehabilitation of cognitive deficits, restored communication in locked-in patients, and open-field applications for enhanced cognition in normal subjects. The core motivation of this work is the key idea that the improvement of current cognitive BMIs for therapeutic and open field applications needs to be grounded in a proper interdisciplinary understanding of the physiology of the cognitive function of interest, be it spatial attention, working memory or any other cognitive signal.

Topographic organization in the brain: searching for general principles

The neurons comprising many cortical areas have long been known to be arranged topographically such that nearby neurons have receptive fields at nearby locations in the world. Although this type of organization may be universal in primary sensory and motor cortex, in this review we demonstrate that associative cortical areas may not represent the external world in a complete and continuous fashion. After reviewing evidence for novel principles of topographic organization in macaque lateral intraparietal area (LIP) - one of the most-studied associative areas in the parietal cortex - we explore the implications of these new principles for brain function.

Prefrontal neurons of opposite spatial preference display distinct target selection dynamics

Neurons in the primate dorsolateral prefrontal cortex (dlPFC) of one hemisphere are selective for the location of attended targets in both visual hemifields. Whether dlPFC neurons with selectivity for opposite hemifields directly compete with each other for target selection or instead play distinct roles during the allocation of attention remains unclear. We explored this issue by recording neuronal responses in the right dlPFC of two macaques while they allocated attention to a target in one hemifield and ignored a distracter on the opposite side. Forty-nine percent of the recorded neurons were target location selective. Neurons selective for contralateral targets (58%) systematically discriminated targets from distracters faster than neurons selective for ipsilateral targets (42%). Additionally, during trials in which sensory stimulation remained the same but both stimuli were task irrelevant and animals were required to detect a change in the color of a fixation spot, contralateral neurons still reliably discriminated the putative target from the distracter, whereas ipsilateral neurons did not. The latter result indicates that target-distracter discrimination by contralateral neurons could occur independently of discrimination by ipsilateral cells; thus, the two cell types may represent two different components of the prefrontal circuitry underlying the allocation of attention to targets in the presence of distracters. Moreover, the response of both contralateral and ipsilateral neurons to a single target was substantially reduced by the presence of a distracter in the contralateral hemifield. This result suggests that the presence of the distracter triggered inhibitory interactions within the dlPFC circuitry that suppressed responses to the attended target.

A low-frequency oscillatory neural signal in humans encodes a developing decision variable

We often make decisions based on sensory evidence that is accumulated over a period of time. How the evidence for such decisions is represented in the brain and how such a neural representation is used to guide a subsequent action are questions of considerable interest to decision sciences. The neural correlates of developing perceptual decisions have been thoroughly investigated in the oculomotor system of macaques who communicated their decisions using an eye movement. It has been found that the evidence informing a decision to make an eye movement is in part accumulated within the same oculomotor circuits that signal the upcoming eye movement. Recent evidence suggests that the somatomotor system may exhibit an analogous property for choices made using a hand movement. To investigate this possibility, we engaged humans in a decision task in which they integrated discrete quanta of sensory information over a period of time and signaled their decision using a hand movement or an eye movement. The discrete form of the sensory evidence allowed us to infer the decision variable on which subjects base their decision on each trial and to assess the neural processes related to each quantum of the incoming decision evidence. We found that a low-frequency electrophysiological signal recorded over centroparietal regions strongly encodes the decision variable inferred in this task, and that it does so specifically for hand movement choices. The signal ramps up with a rate that is proportional to the decision variable, remains graded by the decision variable throughout the delay period, reaches a common peak shortly before a hand movement, and falls off shortly after the hand movement. Furthermore, the signal encodes the polarity of each evidence quantum, with a short latency, and retains the response level over time. Thus, this neural signal shows properties of evidence accumulation. These findings suggest that the decision-related effects observed in the oculomotor system of the monkey during eye movement choices may share the same basic properties with the decision-related effects in the somatomotor system of humans during hand movement choices.

Multimodal convergence within the intraparietal sulcus of the macaque monkey

The parietal cortex is highly multimodal and plays a key role in the processing of objects and actions in space, both in human and nonhuman primates. Despite the accumulated knowledge in both species, we lack the following: (1) a general description of the multisensory convergence in this cortical region to situate sparser lesion and electrophysiological recording studies; and (2) a way to compare and extrapolate monkey data to human results. Here, we use functional magnetic resonance imaging (fMRI) in the monkey to provide a bridge between human and monkey studies. We focus on the intraparietal sulcus (IPS) and specifically probe its involvement in the processing of visual, tactile, and auditory moving stimuli around and toward the face. We describe three major findings: (1) the visual and tactile modalities are strongly represented and activate mostly nonoverlapping sectors within the IPS. The visual domain occupies its posterior two-thirds and the tactile modality its anterior one-third. The auditory modality is much less represented, mostly on the medial IPS bank. (2) Processing of the movement component of sensory stimuli is specific to the fundus of the IPS and coincides with the anatomical definition of monkey ventral intraparietal area (VIP). (3) A cortical sector within VIP processes movement around and toward the face independently of the sensory modality. This amodal representation of movement may be a key component in the construction of peripersonal space. Overall, our observations highlight strong homologies between macaque and human VIP organization.

Independent category and spatial encoding in parietal cortex

The posterior parietal cortex plays a central role in spatial functions, such as spatial attention and saccadic eye movements. However, recent work has increasingly focused on the role of parietal cortex in encoding nonspatial cognitive factors such as visual categories, learned stimulus associations, and task rules. The relationship between spatial encoding and nonspatial cognitive signals in parietal cortex, and whether cognitive signals are robustly encoded in the presence of strong spatial neuronal responses, is unknown. We directly compared nonspatial cognitive and spatial encoding in the lateral intraparietal (LIP) area by training monkeys to perform a visual categorization task during which they made saccades toward or away from LIP response fields (RFs). Here we show that strong saccade-related responses minimally influence robustly encoded category signals in LIP. This suggests that cognitive and spatial signals are encoded independently in LIP and underscores the role of parietal cortex in nonspatial cognitive functions.

Maps of space in human frontoparietal cortex

Prefrontal cortex (PFC) and posterior parietal cortex (PPC) are neural substrates for spatial cognition. We here review studies in which we tested the hypothesis that human frontoparietal cortex may function as a priority map. According to priority map theory, objects or locations in the visual world are represented by neural activity that is proportional to their attentional priority. Using functional magnetic resonance imaging (fMRI), we first identified topographic maps in PFC and PPC as candidate priority maps of space. We then measured fMRI activity in candidate priority maps during the delay periods of a covert attention task, a spatial working memory task, and a motor planning task to test whether the activity depended on the particular spatial cognition. Our hypothesis was that some, but not all, candidate priority maps in PFC and PPC would be agnostic with regard to what was being prioritized, in that their activity would reflect the location in space across tasks rather than a particular kind of spatial cognition (e.g., covert attention). To test whether patterns of delay period activity were interchangeable during the spatial cognitive tasks, we used multivariate classifiers. We found that decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on the other tasks (e.g., covert attention and motor planning) in superior precentral sulcus (sPCS) and in a region of intraparietal sulcus (IPS2), suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make sPCS in frontal cortex and IPS2 in parietal cortex viable priority map candidates, and suggest that these areas may be the human homologs of the monkey frontal eye field (FEF) and lateral intraparietal area (LIP).

Where one hand meets the other: limb-specific and action-dependent movement plans decoded from preparatory signals in single human frontoparietal brain areas

Planning object-directed hand actions requires successful integration of the movement goal with the acting limb. Exactly where and how this sensorimotor integration occurs in the brain has been studied extensively with neurophysiological recordings in nonhuman primates, yet to date, because of limitations of non-invasive methodologies, the ability to examine the same types of planning-related signals in humans has been challenging. Here we show, using a multivoxel pattern analysis of functional MRI (fMRI) data, that the preparatory activity patterns in several frontoparietal brain regions can be used to predict both the limb used and hand action performed in an upcoming movement. Participants performed an event-related delayed movement task whereby they planned and executed grasp or reach actions with either their left or right hand toward a single target object. We found that, although the majority of frontoparietal areas represented hand actions (grasping vs reaching) for the contralateral limb, several areas additionally coded hand actions for the ipsilateral limb. Notable among these were subregions within the posterior parietal cortex (PPC), dorsal premotor cortex (PMd), ventral premotor cortex, dorsolateral prefrontal cortex, presupplementary motor area, and motor cortex, a region more traditionally implicated in contralateral movement generation. Additional analyses suggest that hand actions are represented independently of the intended limb in PPC and PMd. In addition to providing a unique mapping of limb-specific and action-dependent intention-related signals across the human cortical motor system, these findings uncover a much stronger representation of the ipsilateral limb than expected from previous fMRI findings.

Functional organization of human posterior parietal cortex: grasping- and reaching-related activations relative to topographically organized cortex

The act of reaching to grasp an object requires the coordination between transporting the arm and shaping the hand. Neurophysiological, neuroimaging, neuroanatomic, and neuropsychological studies in macaque monkeys and humans suggest that the neural networks underlying grasping and reaching acts are at least partially separable within the posterior parietal cortex (PPC). To better understand how these neural networks have evolved in primates, we characterized the relationship between grasping- and reaching-related responses and topographically organized areas of the human intraparietal sulcus (IPS) using functional MRI. Grasping-specific activation was localized to the left anterior IPS, partially overlapping with the most anterior topographic regions and extending into the postcentral sulcus. Reaching-specific activation was localized to the left precuneus and superior parietal lobule, partially overlapping with the medial aspects of the more posterior topographic regions. Although the majority of activity within the topographic regions of the IPS was nonspecific with respect to movement type, we found evidence for a functional gradient of specificity for reaching and grasping movements spanning posterior-medial to anterior-lateral PPC. In contrast to the macaque monkey, grasp- and reach-specific activations were largely located outside of the human IPS.

The lateral intraparietal area codes the location of saccade targets and not the dimension of the saccades that will be made to acquire them

Activity in the lateral intraparietal area (LIP) represents a priority map that can be used to direct attention and guide eye movements. However, it is not known whether this activity represents the location of saccade targets or the actual eye movement made to acquire them. We recorded single neurons from rhesus macaques (Macaca mulatta) while they performed memory-guided delayed saccades to characterize the response profiles of LIP cells. We then separated the saccade target from the saccade end point by saccadic adaptation, a method that induces a change in the gain of the oculomotor system. We plotted LIP activity for all three epochs of the memory-guided delayed-response task (visual, delay period, and presaccadic responses) as a function of target location and saccade end point. We found that under saccadic adaptation the response profile for all three epochs was unchanged as a function of target location. We conclude that neurons in LIP reliably represent the locations of saccade targets, not the amplitude of the saccade required to acquire those targets. Although LIP transmits target information to the motor system, that information represents the location of the target and not the amplitude of the saccade that the monkey will make.

Prioritized maps of space in human frontoparietal cortex

Priority maps are theorized to be composed of large populations of neurons organized topographically into a map of gaze-centered space whose activity spatially tags salient and behaviorally relevant information. Here, we identified four priority map candidates along human posterior intraparietal sulcus (IPS0-IPS3) and two along the precentral sulcus (PCS) that contained reliable retinotopically organized maps of contralateral visual space. Persistent activity increased from posterior-to-anterior IPS areas and from inferior-to-superior PCS areas during the maintenance of a working memory representation, the maintenance of covert attention, and the maintenance of a saccade plan. Moreover, decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on other tasks (e.g., attention) in superior PCS and IPS2, suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make these two areas in frontal and parietal cortex viable priority map candidates.

Lesions of cortical area LIP affect reach onset only when the reach is accompanied by a saccade, revealing an active eye-hand coordination circuit

The circuits that drive visually guided eye and arm movements transform generic visual inputs into effector-specific motor commands. As part of the effort to elucidate these circuits, the primate lateral intraparietal area (LIP) has been interpreted as a priority map for saccades (oculomotor-specific) or a salience map of space (not effector-specific). It has also been proposed as a locus for eye-hand coordination. We reversibly inactivated LIP while monkeys performed memory-guided saccades and reaches. Coordinated saccade and reach reaction times were similarly impaired, consistent with a nonspecific role. However, reaches made without an accompanying saccade remained intact, and the relative temporal coupling of saccades and reaches was unchanged. These results suggest that LIP contributes to saccade planning but not to reach planning. Coordinated reaches are delayed as a result of an eye-hand coordination mechanism, located outside of LIP, that actively delays reaches until shortly after the onset of an associated saccade. We conclude with a discussion of how to reconcile specificity for saccades with a possible role in directing attention.

Gamma-band activity in human prefrontal cortex codes for the number of relevant items maintained in working memory

Previous studies in electrophysiology have provided consistent evidence for a relationship between neural oscillations in different frequency bands and the maintenance of information in working memory (WM). While the amplitude and cross-frequency coupling of neural oscillations have been shown to be modulated by the number of items retained during WM, interareal phase synchronization has been associated with the integration of distributed activity during WM maintenance. Together, these findings provided important insights into the oscillatory dynamics of cortical networks during WM. However, little is known about the cortical regions and frequencies that underlie the specific maintenance of behaviorally relevant information in WM. In the current study, we addressed this question with magnetoencephalography and a delayed match-to-sample task involving distractors in 25 human participants. Using spectral analysis and beamforming, we found a WM load-related increase in the gamma band (60-80 Hz) that was localized to the right intraparietal lobule and left Brodmann area 9 (BA9). WM-load related changes were also detected at alpha frequencies (10-14 Hz) in Brodmann area 6, but did not covary with the number of relevant WM-items. Finally, we decoded gamma-band source activity with a linear discriminant analysis and found that gamma-band activity in left BA9 predicted the number of target items maintained in WM. While the present data show that WM maintenance involves activity in the alpha and gamma band, our results highlight the specific contribution of gamma band delay activity in prefrontal cortex for the maintenance of behaviorally relevant items.

Suppressive surrounds of receptive fields in monkey frontal eye field

A critical step in determining how a neuron contributes to visual processing is determining its visual receptive field (RF). While recording from neurons in frontal eye field (FEF) of awake monkeys (Macaca mulatta), we probed the visual field with small spots of light and found excitatory RFs that decreased in strength from RF center to periphery. However, presenting stimuli with different diameters centered on the RF revealed suppressive surrounds that overlapped the previously determined excitatory RF and reduced responses by 84%, on average. Consequently, in that overlap area, stimulation produced excitation or suppression, depending on the stimulus. Strong stimulation of the RF periphery with annular stimuli allowed us to quantify this effect. A modified difference of gaussians model that independently varied center and surround activation accounted for the nonlinear activity in the overlap area. Our results suggest that (1) the suppressive surrounds found in FEF are fundamentally the same as those in V1 except for the size and strength of excitatory and suppressive mechanisms, (2) methodically assaying suppressive surrounds in FEF is essential for correctly interpreting responses to large and/or peripheral stimuli and therefore understanding the effects of stimulus context, and (3) regulating the relative strength of the surround clearly changes neuronal responses and may therefore play a significant part in the neuronal changes resulting from visual attention and stimulus salience.

Apparent motion from outside the visual field, retinotopic cortices may register extra-retinal positions

Observers made a saccade between two fixation markers while a probe was flashed sequentially at two locations on a side screen. The first probe was presented in the far periphery just within the observer's visual field. This target was extinguished and the observers made a large saccade away from the probe, which would have left it far outside the visual field if it had still been present. The second probe was then presented, displaced from the first in the same direction as the eye movement and by about the same distance as the saccade step. Because both eyes and probes shifted by similar amounts, there was little or no shift between the first and second probe positions on the retina. Nevertheless, subjects reported seeing motion corresponding to the spatial displacement not the retinal displacement. When the second probe was presented, the effective location of the first probe lay outside the visual field demonstrating that apparent motion can be seen from a location outside the visual field to a second location inside the visual field. Recent physiological results suggest that target locations are “remapped” on retinotopic representations to correct for the effects of eye movements. Our results suggest that the representations on which this remapping occurs include locations that fall beyond the limits of the retina.

Cortical regions involved in the observation of bimanual actions

Although we are beginning to understand how observed actions performed by conspecifics with a single hand are processed and how bimanual actions are controlled by the motor system, we know very little about the processing of observed bimanual actions. We used fMRI to compare the observation of bimanual manipulative actions with their unimanual components, relative to visual control conditions equalized for visual motion. Bimanual action observation did not activate any region specialized for processing visual signals related to this more elaborated action. On the contrary, observation of bimanual and unimanual actions activated similar occipito-temporal, parietal and premotor networks. However, whole-brain as well as region of interest (ROI) analyses revealed that this network functions differently under bimanual and unimanual conditions. Indeed, in bimanual conditions, activity in the network was overall more bilateral, especially in parietal cortex. In addition, ROI analyses indicated bilateral parietal activation patterns across hand conditions distinctly different from those at other levels of the action-observation network. These activation patterns suggest that while occipito-temporal and premotor levels are involved with processing the kinematics of the observed actions, the parietal cortex is more involved in the processing of static, postural aspects of the observed action. This study adds bimanual cooperation to the growing list of distinctions between parietal and premotor cortex regarding factors affecting visual processing of observed actions.

Differential effects of parietal and frontal inactivations on reaction times distributions in a visual search task

The posterior parietal cortex participates to numerous cognitive functions, from perceptual to attentional and decisional processes. However, the same functions have also been attributed to the frontal cortex. We previously conducted a series of reversible inactivations of the lateral intraparietal area (LIP) and of the frontal eye field (FEF) in the monkey which showed impairments in covert visual search performance, characterized mainly by an increase in the mean reaction time (RT) necessary to detect a contralesional target. Only subtle differences were observed between the inactivation effects in both areas. In particular, the magnitude of the deficit was dependant of search task difficulty for LIP, but not for FEF. In the present study, we re-examine these data in order to try to dissociate the specific involvement of these two regions, by considering the entire RT distribution instead of mean RT. We use the LATER model to help us interpret the effects of the inactivations with regard to information accumulation rate and decision processes. We show that: (1) different search strategies can be used by monkeys to perform visual search, either by processing the visual scene in parallel, or by combining parallel and serial processes; (2) LIP and FEF inactivations have very different effects on the RT distributions in the two monkeys. Although our results are not conclusive with regards to the exact functional mechanisms affected by the inactivations, the effects we observe on RT distributions could be accounted by an involvement of LIP in saliency representation or decision-making, and an involvement of FEF in attentional shifts and perception. Finally, we observe that the use of the LATER model is limited in the context of a visual search as it cannot fit all the behavioral strategies encountered. We propose that the diversity in search strategies observed in our monkeys also exists in individual human subjects and should be considered in future experiments.

Asymmetric Influence of Egocentric Representation onto Allocentric Perception

Objects in the visual world can be represented in both egocentric and allocentric coordinates. Previous studies have found that allocentric representation can affect the accuracy of spatial judgment relative to an egocentric frame, but not vice versa. Here we asked whether egocentric representation influenced the processing speed of allocentric perception. We measured the manual reaction time of human subjects in a position discrimination task in which the behavioral response purely relied on the target's allocentric location, independent of its egocentric position. We used two conditions of stimulus location: the compatible condition-allocentric left and egocentric left or allocentric right and egocentric right; the incompatible condition-allocentric left and egocentric right or allocentric right and egocentric left. We found that egocentric representation markedly influenced allocentric perception in three ways. First, in a given egocentric location, allocentric perception was significantly faster in the compatible condition than in the incompatible condition. Second, as the target became more eccentric in the visual field, the speed of allocentric perception gradually slowed down in the incompatible condition but remained unchanged in the compatible condition. Third, egocentric-allocentric incompatibility slowed allocentric perception more in the left egocentric side than the right egocentric side. These results cannot be explained by interhemispheric visuomotor transformation and stimulus-response compatibility theory. Our findings indicate that each hemisphere preferentially processes and integrates the contralateral egocentric and allocentric spatial information, and the right hemisphere receives more ipsilateral egocentric inputs than left hemisphere does.

Decoding effector-dependent and effector-independent movement intentions from human parieto-frontal brain activity

Our present understanding of the neural mechanisms and sensorimotor transformations that govern the planning of arm and eye movements predominantly come from invasive parieto-frontal neural recordings in nonhuman primates. While functional MRI (fMRI) has motivated investigations on much of these same issues in humans, the highly distributed and multiplexed organization of parieto-frontal neurons necessarily constrain the types of intention-related signals that can be detected with traditional fMRI analysis techniques. Here we employed multivoxel pattern analysis (MVPA), a multivariate technique sensitive to spatially distributed fMRI patterns, to provide a more detailed understanding of how hand and eye movement plans are coded in human parieto-frontal cortex. Subjects performed an event-related delayed movement task requiring that a reach or saccade be planned and executed toward one of two spatial target positions. We show with MVPA that, even in the absence of signal amplitude differences, the fMRI spatial activity patterns preceding movement onset are predictive of upcoming reaches and saccades and their intended directions. Within certain parieto-frontal regions we show that these predictive activity patterns reflect a similar spatial target representation for the hand and eye. Within some of the same regions, we further demonstrate that these preparatory spatial signals can be discriminated from nonspatial, effector-specific signals. In contrast to the largely graded effector- and direction-related planning responses found with fMRI subtraction methods, these results reveal considerable consensus with the parieto-frontal network organization suggested from primate neurophysiology and specifically show how predictive spatial and nonspatial movement information coexists within single human parieto-frontal areas.

Parietofrontal circuits in goal-oriented behaviour

Parietal and frontal cortical areas play important roles in the control of goal-oriented behaviour. This review examines how signal processing in the parietal and frontal eye fields is involved in coding and storing space, directing attention and processing the sensorimotor transformation for saccades. After a survey of the functional specialization of these areas in monkeys, we discuss homologous regions in the human brain in terms of topographic organization, storage capacity, target selection, spatial remapping, reference frame transformations and effector specificity. The overall picture suggests that bottom-up sensory, top-down cognitive signals and efferent motor signals are integrated in dynamic sensorimotor maps as part of a functionally flexible parietofrontal network. Neuronal synchronization in these maps may be instrumental in amplifying behaviourally relevant representations and setting up a functional pathway to route information in this parietofrontal circuit.

Reward value-based gain control: divisive normalization in parietal cortex

The representation of value is a critical component of decision making. Rational choice theory assumes that options are assigned absolute values, independent of the value or existence of other alternatives. However, context-dependent choice behavior in both animals and humans violates this assumption, suggesting that biological decision processes rely on comparative evaluation. Here we show that neurons in the monkey lateral intraparietal cortex encode a relative form of saccadic value, explicitly dependent on the values of the other available alternatives. Analogous to extra-classical receptive field effects in visual cortex, this relative representation incorporates target values outside the response field and is observed in both stimulus-driven activity and baseline firing rates. This context-dependent modulation is precisely described by divisive normalization, indicating that this standard form of sensory gain control may be a general mechanism of cortical computation. Such normalization in decision circuits effectively implements an adaptive gain control for value coding and provides a possible mechanistic basis for behavioral context-dependent violations of rationality.

Representation of comparison signals in cortical area MT during a delayed direction discrimination task

Visually guided behavior often involves decisions that are based on evaluating stimuli in the context of those observed previously. Such decisions are made by monkeys comparing two consecutive stimuli, sample and test, moving in the same or opposite directions. We examined whether responses in the motion processing area MT during the comparison phase of this task (test) are modulated by the direction of the preceding stimulus (sample). This modulation, termed comparison signal, was measured by comparing responses to identical test stimuli on trials when it was preceded by sample moving in the same direction (S-trials) with trials when it was preceded by sample moving in a different direction (D-trials). The test always appeared in the neuron's receptive field (RF), whereas sample could appear in the RF or in the contralateral visual field (remote sample). With sample in-RF, we found three types of modulation carried by different sets of neurons: early suppression on S-trials and late enhancement, one on S-trials, and the other on D-trials. Under these conditions, many neurons with and without comparison effects exhibited significant, choice-related activity. Response modulation was also present following the remote sample, even though the information about its direction could only reach MT indirectly via top-down influences. However, unlike on trials with in-RF sample, these signals were dominated by response suppression, shedding light on the contribution of top-down influences to the comparison effects. These results demonstrate that during the task requiring monkeys to compare two directions of motion, MT responses during the comparison phase of this task reflect similarities and differences between the two stimuli, suggesting participation in sensory comparisons. The nature of these signals provides insights into the operation of bottom-up and top-down influences involved in this process.

Action observation circuits in the macaque monkey cortex

In both monkeys and humans, the observation of actions performed by others activates cortical motor areas. An unresolved question concerns the pathways through which motor areas receive visual information describing motor acts. Using functional magnetic resonance imaging (fMRI), we mapped the macaque brain regions activated during the observation of grasping actions, focusing on the superior temporal sulcus region (STS) and the posterior parietal lobe. Monkeys viewed either videos with only the grasping hand visible or videos with the whole actor visible. Observation of both types of grasping videos activated elongated regions in the depths of both lower and upper banks of STS, as well as parietal areas PFG and anterior intraparietal (AIP). The correlation of fMRI data with connectional data showed that visual action information, encoded in the STS, is forwarded to ventral premotor cortex (F5) along two distinct functional routes. One route connects the upper bank of the STS with area PFG, which projects, in turn, to the premotor area F5c. The other connects the anterior part of the lower bank of the STS with premotor areas F5a/p via AIP. Whereas the first functional route emphasizes the agent and may relay visual information to the parieto-frontal mirror circuit involved in understanding the agent's intentions, the second route emphasizes the object of the action and may aid in understanding motor acts with respect to their immediate goal.

Visuotopic organization of macaque posterior parietal cortex: a functional magnetic resonance imaging study

Macaque anatomy and physiology studies have revealed multiple visual areas in posterior parietal cortex (PPC). While many response properties of PPC neurons have been probed, little is known about PPC's large-scale functional topography-specifically related to visuotopic organization. Using high-resolution functional magnetic resonance imaging at 3 T with a phase-encoded retinotopic mapping paradigm in the awake macaque, a large-scale visuotopic organization along lateral portions of PPC anterior to area V3a and extending into the lateral intraparietal sulcus (LIP) was found. We identify two new visual field maps anterior to V3a within caudal PPC, referred to as caudal intraparietal-1 (CIP-1) and CIP-2. The polar angle representation in CIP-1 extends from regions near the upper vertical meridian (that is the shared border with V3a and dorsal prelunate) to those within the lower visual field (that is the shared border with CIP-2). The polar angle representation in CIP-2 is a mirror reversal of the CIP-1 representation. CIP-1 and CIP-2 share a representation of central space on the lateral border. Anterior to CIP-2, a third polar angle representation was found within LIP, referred to as visuotopic LIP. The polar angle representation in LIP extends from regions near the upper vertical meridian (that is the shared border with CIP-2) to those near the lower vertical meridian. Representations of central visual space were identified within dorsal portions of LIP with peripheral representations in ventral portions. We also consider the topographic large-scale organization found within macaque PPC relative to that observed in human PPC.

Population coding of visual space: modeling

We examine how the representation of space is affected by receptive field (RF) characteristics of the encoding population. Spatial responses were defined by overlapping Gaussian RFs. These responses were analyzed using multidimensional scaling to extract the representation of global space implicit in population activity. Spatial representations were based purely on firing rates, which were not labeled with RF characteristics (tuning curve peak location, for example), differentiating this approach from many other population coding models. Because responses were unlabeled, this model represents space using intrinsic coding, extracting relative positions amongst stimuli, rather than extrinsic coding where known RF characteristics provide a reference frame for extracting absolute positions. Two parameters were particularly important: RF diameter and RF dispersion, where dispersion indicates how broadly RF centers are spread out from the fovea. For large RFs, the model was able to form metrically accurate representations of physical space on low-dimensional manifolds embedded within the high-dimensional neural population response space, suggesting that in some cases the neural representation of space may be dimensionally isomorphic with 3D physical space. Smaller RF sizes degraded and distorted the spatial representation, with the smallest RF sizes (present in early visual areas) being unable to recover even a topologically consistent rendition of space on low-dimensional manifolds. Finally, although positional invariance of stimulus responses has long been associated with large RFs in object recognition models, we found RF dispersion rather than RF diameter to be the critical parameter. In fact, at a population level, the modeling suggests that higher ventral stream areas with highly restricted RF dispersion would be unable to achieve positionally-invariant representations beyond this narrow region around fixation.

Population coding of visual space: comparison of spatial representations in dorsal and ventral pathways

Although the representation of space is as fundamental to visual processing as the representation of shape, it has received relatively little attention from neurophysiological investigations. In this study we characterize representations of space within visual cortex, and examine how they differ in a first direct comparison between dorsal and ventral subdivisions of the visual pathways. Neural activities were recorded in anterior inferotemporal cortex (AIT) and lateral intraparietal cortex (LIP) of awake behaving monkeys, structures associated with the ventral and dorsal visual pathways respectively, as a stimulus was presented at different locations within the visual field. In spatially selective cells, we find greater modulation of cell responses in LIP with changes in stimulus position. Further, using a novel population-based statistical approach (namely, multidimensional scaling), we recover the spatial map implicit within activities of neural populations, allowing us to quantitatively compare the geometry of neural space with physical space. We show that a population of spatially selective LIP neurons, despite having large receptive fields, is able to almost perfectly reconstruct stimulus locations within a low-dimensional representation. In contrast, a population of AIT neurons, despite each cell being spatially selective, provide less accurate low-dimensional reconstructions of stimulus locations. They produce instead only a topologically (categorically) correct rendition of space, which nevertheless might be critical for object and scene recognition. Furthermore, we found that the spatial representation recovered from population activity shows greater translation invariance in LIP than in AIT. We suggest that LIP spatial representations may be dimensionally isomorphic with 3D physical space, while in AIT spatial representations may reflect a more categorical representation of space (e.g., "next to" or "above").

Proprioceptive pathways to posterior parietal areas MIP and LIPv from the dorsal column nuclei and the postcentral somatosensory cortex

The posterior parietal cortex (PPC) serves as an interface between sensory and motor cortices by integrating multisensory signals with motor-related information. Sensorimotor transformation of somatosensory signals is crucial for the generation and updating of body representations and movement plans. Using retrograde transneuronal transfer of rabies virus in combination with a conventional tracer, we identified direct and polysynaptic somatosensory pathways to two posterior parietal areas, the ventral lateral intraparietal area (LIPv) and the rostral part of the medial intraparietal area (MIP) in macaque monkeys. In addition to direct projections from somatosensory areas 2v and 3a, respectively, we found that LIPv and MIP receive disynaptic inputs from the dorsal column nuclei as directly as these somatosensory areas, via a parallel channel. LIPv is the target of minor neck muscle-related projections from the cuneate (Cu) and the external cuneate nuclei (ECu), and direct projections from area 2v, that likely carry kinesthetic/vestibular/optokinetic-related signals. In contrast, MIP receives major arm and shoulder proprioceptive inputs disynaptically from the rostral Cu and ECu, and trisynaptically (via area 3a) from caudal portions of these nuclei. These findings have important implications for the understanding of the influence of proprioceptive information on movement control operations of the PPC and the formation of body representations. They also contribute to explain the specific deficits of proprioceptive guidance of movement associated to optic ataxia.

Spatial and non-spatial functions of the parietal cortex

Although the parietal cortex is traditionally associated with spatial attention and sensorimotor integration, recent evidence also implicates it in higher order cognitive functions. We review relevant results from neuron recording studies showing that inferior parietal neurons integrate information regarding target location with a variety of non-spatial signals. Some of these signals are modulatory and alter a stimulus-evoked response according to the action, category, or reward associated with the stimulus. Other non-spatial inputs act independently, encoding the context or rules of a task even before the presentation of a specific target. Despite the ubiquity of non-spatial information in individual neurons, reversible inactivation of the parietal lobe affects only spatial orienting of attention and gaze, but not non-spatial aspects of performance. This suggests that non-spatial signals contribute to an underlying spatial computation, possibly allowing the brain to determine which targets are worthy of attention or action in a given task context.

Microstimulation of posterior parietal cortex biases the selection of eye movement goals during search

People can find objects in a visual scene fast and effortlessly. It is thought that this may be accomplished by creating a map of the outside world that incorporates bottom-up sensory and top-down cognitive inputs--a priority map. Eye movements are made toward the location represented by the highest activity on the priority map. We hypothesized that the lateral intraparietal area (LIP) of posterior parietal cortex acts as such a map. To test this, we performed low current microstimulation on animals trained to perform a foraging task and asked whether we could bias the animals to make a saccade to a particular stimulus, by creating an artificial peak of activity at the location representing that stimulus on the map. We found that microstimulation slightly biased the animals to make saccades to visual stimuli at the stimulated location, without actively generating saccades. The magnitude of this effect was small, but it appeared to be similar for all visual stimuli. We interpret these results to mean that microstimulation slightly biased saccade goal selection to the object represented at the stimulated location in LIP.

Cerebellar inputs to intraparietal cortex areas LIP and MIP: functional frameworks for adaptive control of eye movements, reaching, and arm/eye/head movement coordination

Using retrograde transneuronal transfer of rabies virus in combination with a conventional tracer (cholera toxin B), we studied simultaneously direct (thalamocortical) and polysynaptic inputs to the ventral lateral intraparietal area (LIPv) and the medial intraparietal area (MIP) in nonhuman primates. We found that these areas receive major disynaptic inputs from specific portions of the cerebellar nuclei, the ventral dentate (D), and ventrolateral interpositus posterior (IP). Area LIPv receives inputs from oculomotor domains of the caudal D and IP. Area MIP is the target of projections from the ventral D (mainly middle third), and gaze- and arm-related domains of IP involved in reaching and arm/eye/head coordination. We also showed that cerebellar cortical "output channels" to MIP predominantly stem from posterior cerebellar areas (paramedian lobe/Crus II posterior, dorsal paraflocculus) that have the required connectivity for adaptive control of visual and proprioceptive guidance of reaching, arm/eye/head coordination, and prism adaptation. These findings provide important insight about the interplay between the posterior parietal cortex and the cerebellum regarding visuospatial adaptation mechanisms and visual and proprioceptive guidance of movement. They also have potential implications for clinical approaches to optic ataxia and neglect rehabilitation.

Representation of the ipsilateral visual field by neurons in the macaque lateral intraparietal cortex depends on the forebrain commissures

Our eyes are constantly moving, allowing us to attend to different visual objects in the environment. With each eye movement, a given object activates an entirely new set of visual neurons, yet we perceive a stable scene. One neural mechanism that may contribute to visual stability is remapping. Neurons in several brain regions respond to visual stimuli presented outside the receptive field when an eye movement brings the stimulated location into the receptive field. The stored representation of a visual stimulus is remapped, or updated, in conjunction with the saccade. Remapping depends on neurons being able to receive visual information from outside the classic receptive field. In previous studies, we asked whether remapping across hemifields depends on the forebrain commissures. We found that, when the forebrain commissures are transected, behavior dependent on accurate spatial updating is initially impaired but recovers over time. Moreover, neurons in lateral intraparietal cortex (LIP) continue to remap information across hemifields in the absence of the forebrain commissures. One possible explanation for the preserved across-hemifield remapping in split-brain animals is that neurons in a single hemisphere could represent visual information from both visual fields. In the present study, we measured receptive fields of LIP neurons in split-brain monkeys and compared them with receptive fields in intact monkeys. We found a small number of neurons with bilateral receptive fields in the intact monkeys. In contrast, we found no such neurons in the split-brain animals. We conclude that bilateral representations in area LIP following forebrain commissures transection cannot account for remapping across hemifields.

Repetition suppression dissociates spatial frames of reference in human saccade generation

The path from perception to action involves the transfer of information across various reference frames. Here we applied a functional magnetic resonance imaging (fMRI) repetition suppression paradigm to determine the reference frame(s) in which the cortical activity is coded at several phases of the sensorimotor transformation for a saccade, including sensory processing, saccade planning, and saccade execution. We distinguished between retinal (eye-centered) and nonretinal (e.g., head-centered) coding frames in three key regions: the intraparietal sulcus (IPS), frontal eye field (FEF), and supplementary eye field (SEF). Subjects (n = 18) made delayed saccades to one of five possible peripheral targets, separated at intervals of 9° visual angle. Target locations were chosen pseudorandomly, based on a 2 × 2 factorial design, with factors retinal and nonretinal coordinates and levels novel and repeated. In all three regions, analysis of the blood oxygenation level dependent dynamics revealed an attenuation of the fMRI signal in trials repeating the location of the target in retinal coordinates. The amount of retinal suppression varied across the three phases of the trial, with the strongest suppression during saccade planning. The paradigm revealed only weak traces of nonretinal coding in these regions. Further analyses showed an orderly representation of the retinal target location, as expressed by a contralateral bias of activation, in the IPS and FEF, but not in the SEF. These results provide evidence that the sensorimotor processing in these centers reflects saccade generation in eye-centered coordinates, irrespective of their topographic organization.

The spatial profile of macaque MT neurons is consistent with Gaussian sampling of logarithmically coordinated visual representation

Neurons in extrastriate visual areas have large receptive fields (RFs) compared with those in primary visual cortex (V1), suggesting extensive spatial integration. To examine the spatial integration of neurons in area MT, we modeled the RFs of MT neurons based on a symmetrical (Gaussian) integration of V1 outputs and tested the model using single-unit recording in two fixating macaque monkeys. Because visual representation in V1 is logarithmically compressed along eccentricity, the resulting RF model is log-Gaussian along the radial axis in polar coordinates. To test the log-Gaussian model, the RF of each neuron was mapped on a 5 x 5 grid using a small patch of random dots drifting at the preferred velocity of the neuron. The majority of MT neurons had RFs with a steeper slope near the fovea and a shallower slope away from the fovea. Among various two-dimensional Gaussian models fitted to the RFs, the log-Gaussian model provided the best description. The fitted parameters revealed that the range of sampling by MT neurons has no systematic relationship with eccentricities, consistent with a recent study for V4 neurons. Our results suggest that MT neurons integrate inputs from constant-sized patches of V1 cortex.

Space representation for eye movements is more contralateral in monkeys than in humans

Contralateral hemispheric representation of sensory inputs (the right visual hemifield in the left hemisphere and vice versa) is a fundamental feature of primate sensorimotor organization, in particular the visuomotor system. However, many higher-order cognitive functions in humans show an asymmetric hemispheric lateralization--e.g., right brain specialization for spatial processing--necessitating a convergence of information from both hemifields. Electrophysiological studies in monkeys and functional imaging in humans have investigated space and action representations at different stages of visuospatial processing, but the transition from contralateral to unified global spatial encoding and the relationship between these encoding schemes and functional lateralization are not fully understood. Moreover, the integration of data across monkeys and humans and elucidation of interspecies homologies is hindered, because divergent findings may reflect actual species differences or arise from discrepancies in techniques and measured signals (electrophysiology vs. imaging). Here, we directly compared spatial cue and memory representations for action planning in monkeys and humans using event-related functional MRI during a working-memory oculomotor task. In monkeys, cue and memory-delay period activity in the frontal, parietal, and temporal regions was strongly contralateral. In putative human functional homologs, the contralaterality was significantly weaker, and the asymmetry between the hemispheres was stronger. These results suggest an inverse relationship between contralaterality and lateralization and elucidate similarities and differences in human and macaque cortical circuits subserving spatial awareness and oculomotor goal-directed actions.