Reaching activity in parietal area V6A of macaque: eye influence on arm activity or retinocentric coding of reaching movements?

Position- and scale-invariant object-centered spatial localization in monkey frontoparietal cortex dynamically adapts to cognitive demand

Egocentric encoding is a well-known property of brain areas along the dorsal pathway. Different to previous experiments, which typically only demanded egocentric spatial processing during movement preparation, we designed a task where two male rhesus monkeys memorized an on-the-object target position and then planned a reach to this position after the object re-occurred at variable location with potentially different size. We found allocentric (in addition to egocentric) encoding in the dorsal stream reach planning areas, parietal reach region and dorsal premotor cortex, which is invariant with respect to the position, and, remarkably, also the size of the object. The dynamic adjustment from predominantly allocentric encoding during visual memory to predominantly egocentric during reach planning in the same brain areas and often the same neurons, suggests that the prevailing frame of reference is less a question of brain area or processing stream, but more of the cognitive demands.

Dynamic spatial coding in parietal cortex mediates tactile-motor transformation

Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike.

The posterior parietal area V6A: an attentionally-modulated visuomotor region involved in the control of reach-toF-grasp action

In the macaque, the posterior parietal area V6A is involved in the control of all phases of reach-to-grasp actions: the transport phase, given that reaching neurons are sensitive to the direction and amplitude of arm movement, and the grasping phase, since reaching neurons are also sensitive to wrist orientation and hand shaping. Reaching and grasping activity are corollary discharges which, together with the somatosensory and visual signals related to the same movement, allow V6A to act as a state estimator that signals discrepancies during the motor act in order to maintain consistency between the ongoing movement and the desired one. Area V6A is also able to encode the target of an action because of gaze-dependent visual neurons and real-position cells. Here, we advance the hypothesis that V6A also uses the spotlight of attention to guide goal-directed movements of the hand, and hosts a priority map that is specific for the guidance of reaching arm movement, combining bottom-up inputs such as visual responses with top-down signals such as reaching plans.

Lower visual field preference for the visuomotor control of limb movements in the human dorsomedial parietal cortex

Visual cues coming from the lower visual field (VF) play an important role in the visual guidance of upper and lower limb movements. A recently described region situated in the dorsomedial parietal cortex, area hPEc (Pitzalis et al. in NeuroImage 202:116092, 2019), might have a role in integrating visually derived information with somatomotor signals to guide limb interaction with the environment. In macaque, it has been demonstrated that PEc receives visual information mostly from the lower visual field but, to date, there has been no systematic investigation of VF preference in the newly defined human homologue of macaque area PEc (hPEc). Here we examined the VF preferences of hPEc while participants performed a visuomotor task implying spatially directed delayed eye-, hand- and foot-movements towards different spatial locations within the VF. By analyzing data as a function of the different target locations towards which upcoming movements were planned (and then executed), we observed the presence of asymmetry in the vertical dimension of VF in area hPEc, being this area more strongly activated by limb movements directed towards visual targets located in the lower compared to the upper VF. This result confirms the view, first advanced in macaque monkey, that PEc is involved in processing visual information to guide body interaction with the external environment, including locomotion. We also observed a contralateral dominance for the lower VF preference in the foot selective somatomotor cortex anterior to hPEc. This result might reflect the role of this cortex (which includes areas PE and S-I) in providing highly topographically organized signals, likely useful to achieve an appropriate foot posture during locomotion.

Transcranial Magnetic Stimulation Over the Human Medial Posterior Parietal Cortex Disrupts Depth Encoding During Reach Planning

Accumulating evidence supports the view that the medial part of the posterior parietal cortex (mPPC) is involved in the planning of reaching, but while plenty of studies investigated reaching performed toward different directions, only a few studied different depths. Here, we investigated the causal role of mPPC (putatively, human area V6A-hV6A) in encoding depth and direction of reaching. Specifically, we applied single-pulse transcranial magnetic stimulation (TMS) over the left hV6A at different time points while 15 participants were planning immediate, visually guided reaching by using different eye-hand configurations. We found that TMS delivered over hV6A 200 ms after the Go signal affected the encoding of the depth of reaching by decreasing the accuracy of movements toward targets located farther with respect to the gazed position, but only when they were also far from the body. The effectiveness of both retinotopic (farther with respect to the gaze) and spatial position (far from the body) is in agreement with the presence in the monkey V6A of neurons employing either retinotopic, spatial, or mixed reference frames during reach plan. This work provides the first causal evidence of the critical role of hV6A in the planning of visually guided reaching movements in depth.

Mixed Selectivity in Macaque Medial Parietal Cortex during Eye-Hand Reaching

The activity of neurons of the medial posterior parietal area V6A in macaque monkeys is modulated by many aspects of reach task. In the past, research was mostly focused on modulating the effect of single parameters upon the activity of V6A cells. Here, we used Generalized Linear Models (GLMs) to simultaneously test the contribution of several factors upon V6A cells during a fix-to-reach task. This approach resulted in the definition of a representative “functional fingerprint” for each neuron. We first studied how the features are distributed in the population. Our analysis highlighted the virtual absence of units strictly selective for only one factor and revealed that most cells are characterized by “mixed selectivity.” Then, exploiting our GLM framework, we investigated the dynamics of spatial parameters encoded within V6A. We found that the tuning is not static, but changed along the trial, indicating the sequential occurrence of visuospatial transformations helpful to guide arm movement.

•

The parietal cortex integrates a variety of sensorimotor inputs to guide reaching

•

GLM disentangled the effect of various reaching parameters upon cell activity

•

V6A neurons were not functionally clustered, but characterized by mixed selectivity

•

Spatial selectivity was dynamic and reached its peak during the movement phase

Neural coding of action in three dimensions: Task- and time-invariant reference frames for visuospatial and motor-related activity in parietal area V6A

Goal-directed movements involve a series of neural computations that compare the sensory representations of goal location and effector position, and transform these into motor commands. Neurons in posterior parietal cortex (PPC) control several effectors (e.g., eye, hand, foot) and encode goal location in a variety of spatial coordinate systems, including those anchored to gaze direction, and to the positions of the head, shoulder, or hand. However, there is little evidence on whether reference frames depend also on the effector and/or type of motor response. We addressed this issue in macaque PPC area V6A, where previous reports using a fixate-to-reach in depth task, from different starting arm positions, indicated that most units use mixed body/hand-centered coordinates. Here, we applied singular value decomposition and gradient analyses to characterize the reference frames in V6A while the animals, instead of arm reaching, performed a nonspatial motor response (hand lift). We found that most neurons used mixed body/hand coordinates, instead of "pure" body-, or hand-centered coordinates. During the task progress the effect of hand position on activity became stronger compared to target location. Activity consistent with body-centered coding was present only in a subset of neurons active early in the task. Applying the same analyses to a population of V6A neurons recorded during the fixate-to-reach task yielded similar results. These findings suggest that V6A neurons use consistent reference frames between spatial and nonspatial motor responses, a functional property that may allow the integration of spatial awareness and movement control.

Eye position signals in the dorsal pulvinar during fixation and goal-directed saccades

Sensorimotor cortical areas contain eye position information thought to ensure perceptual stability across saccades and underlie spatial transformations supporting goal-directed actions. One pathway by which eye position signals could be relayed to and across cortical areas is via the dorsal pulvinar. Several studies have demonstrated saccade-related activity in the dorsal pulvinar, and we have recently shown that many neurons exhibit postsaccadic spatial preference. In addition, dorsal pulvinar lesions lead to gaze-holding deficits expressed as nystagmus or ipsilesional gaze bias, prompting us to investigate the effects of eye position. We tested three starting eye positions (−15°, 0°, 15°) in monkeys performing a visually cued memory saccade task. We found two main types of gaze dependence. First, ~50% of neurons showed dependence on static gaze direction during initial and postsaccadic fixation, and might be signaling the position of the eyes in the orbit or coding foveal targets in a head/body/world-centered reference frame. The population-derived eye position signal lagged behind the saccade. Second, many neurons showed a combination of eye-centered and gaze-dependent modulation of visual, memory, and saccadic responses to a peripheral target. A small subset showed effects consistent with eye position-dependent gain modulation. Analysis of reference frames across task epochs from visual cue to postsaccadic fixation indicated a transition from predominantly eye-centered encoding to representation of final gaze or foveated locations in nonretinocentric coordinates. These results show that dorsal pulvinar neurons carry information about eye position, which could contribute to steady gaze during postural changes and to reference frame transformations for visually guided eye and limb movements.

NEW & NOTEWORTHY Work on the pulvinar focused on eye-centered visuospatial representations, but position of the eyes in the orbit is also an important factor that needs to be taken into account during spatial orienting and goal-directed reaching. We show that dorsal pulvinar neurons are influenced by eye position. Gaze direction modulated ongoing firing during stable fixation, as well as visual and saccade responses to peripheral targets, suggesting involvement of the dorsal pulvinar in spatial coordinate transformations.

Eye-head-hand coordination during visually guided reaches in head-unrestrained macaques

Nonhuman primates have been used extensively to study eye-head coordination and eye-hand coordination, but the combination-eye-head-hand coordination-has not been studied. Our goal was to determine whether reaching influences eye-head coordination (and vice versa) in rhesus macaques. Eye, head, and hand motion were recorded in two animals with search coil and touch screen technology, respectively. Animals were seated in a customized "chair" that allowed unencumbered head motion and reaching in depth. In the reach condition, animals were trained to touch a central LED at waist level while maintaining central gaze and were then rewarded if they touched a target appearing at 1 of 15 locations in a 40° × 20° (visual angle) array. In other variants, initial hand or gaze position was varied in the horizontal plane. In similar control tasks, animals were rewarded for gaze accuracy in the absence of reach. In the Reach task, animals made eye-head gaze shifts toward the target followed by reaches that were accompanied by prolonged head motion toward the target. This resulted in significantly higher head velocities and amplitudes (and lower eye-in-head ranges) compared with the gaze control condition. Gaze shifts had shorter latencies and higher velocities and were more precise, despite the lack of gaze reward. Initial hand position did not influence gaze, but initial gaze position influenced reach latency. These results suggest that eye-head coordination is optimized for visually guided reach, first by quickly and accurately placing gaze at the target to guide reach transport and then by centering the eyes in the head, likely to improve depth vision as the hand approaches the target.NEW & NOTEWORTHY Eye-head and eye-hand coordination have been studied in nonhuman primates but not the combination of all three effectors. Here we examined the timing and kinematics of eye-head-hand coordination in rhesus macaques during a simple reach-to-touch task. Our most novel finding was that (compared with hand-restrained gaze shifts) reaching produced prolonged, increased head rotation toward the target, tending to center the binocular field of view on the target/hand.

Mixed Spatial and Movement Representations in the Primate Posterior Parietal Cortex

The posterior parietal cortex (PPC) of humans and non-human primates plays a key role in the sensory and motor transformations required to guide motor actions to objects of interest in the environment. Despite decades of research, the anatomical and functional organization of this region is still a matter of contention. It is generally accepted that specialized parietal subregions and their functional counterparts in the frontal cortex participate in distinct segregated networks related to eye, arm and hand movements. However, experimental evidence obtained primarily from single neuron recording studies in non-human primates has demonstrated a rich mixing of signals processed by parietal neurons, calling into question ideas for a strict functional specialization. Here, we present a brief account of this line of research together with the basic trends in the anatomical connectivity patterns of the parietal subregions. We review, the evidence related to the functional communication between subregions of the PPC and describe progress towards using parietal neuron activity in neuroprosthetic applications. Recent literature suggests a role for the PPC not as a constellation of specialized functional subdomains, but as a dynamic network of sensorimotor loci that combine multiple signals and work in concert to guide motor behavior.

Preparatory activity for purposeful arm movements in the dorsomedial parietal area V6A: Beyond the online guidance of movement

Over the years, electrophysiological recordings in macaque monkeys performing visuomotor tasks brought about accumulating evidence for the expression of neuronal properties (e.g., selectivity in the visuospatial and somatosensory domains, encoding of visual affordances and motor cues) in the posterior parietal area V6A that characterize it as an ideal neural substrate for online control of prehension. Interestingly, neuroimaging studies suggested a role of putative human V6A also in action preparation; moreover, pre-movement population activity in monkey V6A has been recently shown to convey grip-related information for upcoming grasping. Here we directly test whether macaque V6A neurons encode preparatory signals that effectively differentiate between dissimilar actions before movement. We recorded the activity of single V6A neurons during execution of two visuomotor tasks requiring either reach-to-press or reach-to-grasp movements in different background conditions, and described the nature and temporal dynamics of V6A activity preceding movement execution. We found striking consistency in neural discharges measured during pre-movement and movement epochs, suggesting that the former is a preparatory activity exquisitely linked to the subsequent execution of particular motor actions. These findings strongly support a role of V6A beyond the online guidance of movement, with preparatory activity implementing suitable motor programs that subsequently support action execution.

Effector-based attention systems

Visual processing is known to be enhanced at the end point of eye movements. Feedback within the oculomotor system has been shown to drive these alterations in visual processing. However, we do not simply view the world; we also reach out and interact using our hands. Consequently, it is not surprising that visual processing has also been shown to be altered in near-hand space. A growing body of work documents a myriad of alterations in near-hand visual processing, with little consensus on the neural underpinnings of the effect of the hand. Since movement of the eyes and hands is governed by parallel frontoparietal networks and since within the oculomotor system feedback from these motor control regions has been shown to drive enhanced visual processing at saccade end points, it is plausible that a similar feedback mechanism is at play in near-hand improvements in visual processing. Here, we compare and contrast oculomotor-driven and hand-driven changes in visual processing and provide support for the hypothesis that feedback within the reaching and grasping systems enhances visual processing near the hand in a novel way.

Multiple Coordinate Systems and Motor Strategies for Reaching Movements When Eye and Hand Are Dissociated in Depth and Direction

Reaching behavior represents one of the basic aspects of human cognitive abilities important for the interaction with the environment. Reaching movements towards visual objects are controlled by mechanisms based on coordinate systems that transform the spatial information of target location into appropriate motor response. Although recent works have extensively studied the encoding of target position for reaching in three-dimensional space at behavioral level, the combined analysis of reach errors and movement variability has so far been investigated by few studies. Here we did so by testing 12 healthy participants in an experiment where reaching targets were presented at different depths and directions in foveal and peripheral viewing conditions. Each participant executed a memory-guided task in which he/she had to reach the memorized position of the target. A combination of vector and gradient analysis, novel for behavioral data, was applied to analyze patterns of reach errors for different combinations of eye/target positions. The results showed reach error patterns based on both eye- and space-centered coordinate systems: in depth more biased towards a space-centered representation and in direction mixed between space- and eye-centered representation. We calculated movement variability to describe different trajectory strategies adopted by participants while reaching to the different eye/target configurations tested. In direction, the distribution of variability between configurations that shared the same eye/target relative configuration was different, whereas in configurations that shared the same spatial position of targets, it was similar. In depth, the variability showed more similar distributions in both pairs of eye/target configurations tested. These results suggest that reaching movements executed in geometries that require hand and eye dissociations in direction and depth showed multiple coordinate systems and different trajectory strategies according to eye/target configurations and the two dimensions of space.

Mixed Body/Hand Reference Frame for Reaching in 3D Space in Macaque Parietal Area PEc

The neural correlates of coordinate transformations from vision to action are expressed in the activity of posterior parietal cortex (PPC). It has been demonstrated that among the medial-most areas of the PPC, reaching targets are represented mainly in hand-centered coordinates in area PE, and in eye-centered, body-centered, and mixed body/hand-centered coordinates in area V6A. Here, we assessed whether neurons of area PEc, located between V6A and PE in the medial PPC, encode targets in body-centered, hand-centered, or mixed frame of reference during planning and execution of reaching. We studied 104 PEc cells in 3 Macaca fascicularis. The animals performed a reaching task toward foveated targets located at different depths and directions in darkness, starting with the hand from 2 positions located at different depths, one next to the trunk and the other far from it. We show that most PEc neurons encoded targets in a mixed body/hand-centered frame of reference. Although the effect of hand position was often rather strong, it was not as strong as reported previously in area PE. Our results suggest that area PEc represents an intermediate node in the gradual transformation from vision to action that takes place in the reaching network of the dorsomedial PPC.

Decoding Information for Grasping from the Macaque Dorsomedial Visual Stream

Neurodecoders have been developed by researchers mostly to control neuroprosthetic devices, but also to shed new light on neural functions. In this study, we show that signals representing grip configurations can be reliably decoded from neural data acquired from area V6A of the monkey medial posterior parietal cortex. Two Macaca fascicularis monkeys were trained to perform an instructed-delay reach-to-grasp task in the dark and in the light toward objects of different shapes. Population neural activity was extracted at various time intervals on vision of the objects, the delay before movement, and grasp execution. This activity was used to train and validate a Bayes classifier used for decoding objects and grip types. Recognition rates were well over chance level for all the epochs analyzed in this study. Furthermore, we detected slightly different decoding accuracies, depending on the task's visual condition. Generalization analysis was performed by training and testing the system during different time intervals. This analysis demonstrated that a change of code occurred during the course of the task. Our classifier was able to discriminate grasp types fairly well in advance with respect to grasping onset. This feature might be important when the timing is critical to send signals to external devices before the movement start. Our results suggest that the neural signals from the dorsomedial visual pathway can be a good substrate to feed neural prostheses for prehensile actions.SIGNIFICANCE STATEMENT Recordings of neural activity from nonhuman primate frontal and parietal cortex have led to the development of methods of decoding movement information to restore coordinated arm actions in paralyzed human beings. Our results show that the signals measured from the monkey medial posterior parietal cortex are valid for correctly decoding information relevant for grasping. Together with previous studies on decoding reach trajectories from the medial posterior parietal cortex, this highlights the medial parietal cortex as a target site for transforming neural activity into control signals to command prostheses to allow human patients to dexterously perform grasping actions.

Reaching-related Neurons in Superior Parietal Area 5: Influence of the Target Visibility

Reaching movements require the integration of both somatic and visual information. These signals can have different relevance, depending on whether reaches are performed toward visual or memorized targets. We tested the hypothesis that under such conditions, therefore depending on target visibility, posterior parietal neurons integrate differently somatic and visual signals. Monkeys were trained to execute both types of reaches from different hand resting positions and in total darkness. Neural activity was recorded in Area 5 (PE) and analyzed by focusing on the preparatory epoch, that is, before movement initiation. Many neurons were influenced by the initial hand position, and most of them were further modulated by the target visibility. For the same starting position, we found a prevalence of neurons with activity that differed depending on whether hand movement was performed toward memorized or visual targets. This result suggests that posterior parietal cortex integrates available signals in a flexible way based on contextual demands.

Neural activity in the medial parietal area V6A while grasping with or without visual feedback

Recent works have reported that grasping movements are controlled not only by the dorsolateral visual stream, as generally thought, but also by the dorsomedial visual stream, and in particular by the medial posterior parietal area V6A. To date, the grasping activity of V6A neurons has been studied only in darkness. Here we studied the effect of visual feedback on grasp-related discharges of V6A neurons while the monkey was preparing and executing the grasping of a handle. We found that V6A grasping activity could be excited or inhibited by visual information. The neural population was divided into Visual, Motor, and Visuomotor cells. The majority of Visual and Visuomotor neurons did not respond to passive observation of the handle, suggesting that vision of action, rather than object vision, is the most effective factor. The present findings highlight the role of the dorsomedial visual stream in integrating visual and motor signals to monitor and correct grasping.

An Eye in the Palm of Your Hand: Alterations in Visual Processing Near the Hand, a Mini-Review

Feedback within the oculomotor system improves visual processing at eye movement end points, also termed a visual grasp. We do not just view the world around us however, we also reach out and grab things with our hands. A growing body of literature suggests that visual processing in near-hand space is altered. The control systems for moving either the eyes or the hands rely on parallel networks of fronto-parietal regions, which have feedback connections to visual areas. Since the oculomotor system effects on visual processing occur through feedback, both through the motor plan and the motor efference copy, a parallel system where reaching and/or grasping motor-related activity also affects visual processing is likely. Areas in the posterior parietal cortex, for example, receive proprioceptive and visual information used to guide actions, as well as motor efference signals. This trio of information channels is all that would be necessary to produce spatial allocation of reach-related visual attention. We review evidence from behavioral and neurophysiological studies that support the hypothesis that feedback from the reaching and/or grasping motor control networks affects visual processing while noting ways in which it differs from that seen within the oculomotor system. We also suggest that object affordances may represent the neural mechanism through which certain object features are selected for preferential processing when stimuli are near the hand. Finally, we summarize the two effector-based feedback systems and discuss how having separate but parallel effector systems allows for efficient decoupling of eye and hand movements.

Reference frames for reaching when decoupling eye and target position in depth and direction

Spatial representations in cortical areas involved in reaching movements were traditionally studied in a frontoparallel plane where the two-dimensional target location and the movement direction were the only variables to consider in neural computations. No studies so far have characterized the reference frames for reaching considering both depth and directional signals. Here we recorded from single neurons of the medial posterior parietal area V6A during a reaching task where fixation point and reaching targets were decoupled in direction and depth. We found a prevalent mixed encoding of target position, with eye-centered and spatiotopic representations differently balanced in the same neuron. Depth was stronger in defining the reference frame of eye-centered cells, while direction was stronger in defining that of spatiotopic cells. The predominant presence of various typologies of mixed encoding suggests that depth and direction signals are processed on the basis of flexible coordinate systems to ensure optimal motor response.

Depth: the Forgotten Dimension in Multisensory Research

The last quarter of a century has seen a dramatic rise of interest in the spatial constraints on multisensory integration. However, until recently, the majority of this research has investigated integration in the space directly in front of the observer. The space around us, however, extends in three spatial dimensions in the front and to the rear beyond such a limited area. The question to be addressed in this review concerns whether multisensory integration operates according to the same rules throughout the whole of three-dimensional space. The results reviewed here not only show that the space around us seems to be divided into distinct functional regions, but they also suggest that multisensory interactions are modulated by the region of space in which stimuli happen to be presented. We highlight a number of key limitations with previous research in this area, including: (1) The focus on only a very narrow region of two-dimensional space in front of the observer; (2) the use of static stimuli in most research; (3) the study of observers who themselves have been mostly static; and (4) the study of isolated observers. All of these factors may change the way in which the senses interact at any given distance, as can the emotional state/personality of the observer. In summarizing these salient issues, we hope to encourage researchers to consider these factors in their own research in order to gain a better understanding of the spatial constraints on multisensory integration as they affect us in our everyday life.

Spatial Representations in Local Field Potential Activity of Primate Anterior Intraparietal Cortex (AIP)

The execution of reach-to-grasp movements in order to interact with our environment is an important subset of the human movement repertoire. To coordinate such goal-directed movements, information about the relative spatial position of target and effector (in this case the hand) has to be continuously integrated and processed. Recently, we reported the existence of spatial representations in spiking-activity of the cortical fronto-parietal grasp network (Lehmann & Scherberger 2013), and in particular in the anterior intraparietal cortex (AIP). To further investigate the nature of these spatial representations, we explored in two rhesus monkeys (Macaca mulatta) how different frequency bands of the local field potential (LFP) in AIP are modulated by grip type, target position, and gaze position, during the planning and execution of reach-to-grasp movements. We systematically varied grasp type, spatial target, and gaze position and found that both spatial and grasp information were encoded in a variety of frequency bands (1–13Hz, 13–30Hz, 30–60Hz, and 60–100Hz, respectively). Whereas the representation of grasp type strongly increased towards and during movement execution, spatial information was represented throughout the task. Both spatial and grasp type representations could be readily decoded from all frequency bands. The fact that grasp type and spatial (reach) information was found not only in spiking activity, but also in various LFP frequency bands of AIP, might significantly contribute to the development of LFP-based neural interfaces for the control of upper limb prostheses.

Overlapping representations for reach depth and direction in caudal superior parietal lobule of macaques

Reaching movements in the real world have typically a direction and a depth component. Despite numerous behavioral studies, there is no consensus on whether reach coordinates are processed in separate or common visuomotor channels. Furthermore, the neural substrates of reach depth in parietal cortex have been ignored in most neurophysiological studies. In the medial posterior parietal area V6A, we recently demonstrated the strong presence of depth signals and the extensive convergence of depth and direction information on single neurons during all phases of a fixate-to-reach task in 3-dimensional (3D) space. Using the same task, in the present work we examined the processing of direction and depth information in area PEc of the caudal superior parietal lobule (SPL) in three Macaca fascicularis monkeys. Across the task, depth and direction had a similar, high incidence of modulatory effect. The effect of direction was stronger than depth during the initial fixation period. As the task progressed toward arm movement execution, depth tuning became more prominent than directional tuning and the number of cells modulated by both depth and direction increased significantly. Neurons tuned by depth showed a small bias for far peripersonal space. Cells with directional modulations were more frequently tuned toward contralateral spatial locations, but ipsilateral space was also represented. These findings, combined with results from neighboring areas V6A and PE, support a rostral-to-caudal gradient of overlapping representations for reach depth and direction in SPL. These findings also support a progressive change from visuospatial (vergence angle) to somatomotor representations of 3D space in SPL.

Flexible Reference Frames for Grasp Planning in Human Parietofrontal Cortex

Reaching to a location in space is supported by a cortical network that operates in a variety of reference frames. Computational models and recent fMRI evidence suggest that this diversity originates from neuronal populations dynamically shifting between reference frames as a function of task demands and sensory modality. In this human fMRI study, we extend this framework to nonmanipulative grasping movements, an action that depends on multiple properties of a target, not only its spatial location. By presenting targets visually or somaesthetically, and by manipulating gaze direction, we investigate how information about a target is encoded in gaze- and body-centered reference frames in dorsomedial and dorsolateral grasping-related circuits. Data were analyzed using a novel multivariate approach that combines classification and cross-classification measures to explicitly aggregate evidence in favor of and against the presence of gaze- and body-centered reference frames. We used this approach to determine whether reference frames are differentially recruited depending on the availability of sensory information, and where in the cortical networks there is common coding across modalities. Only in the left anterior intraparietal sulcus (aIPS) was coding of the grasping target modality dependent: predominantly gaze-centered for visual targets and body-centered for somaesthetic targets. Left superior parieto-occipital cortex consistently coded targets for grasping in a gaze-centered reference frame. Left anterior precuneus and premotor areas operated in a modality-independent, body-centered frame. These findings reveal how dorsolateral grasping area aIPS could play a role in the transition between modality-independent gaze-centered spatial maps and body-centered motor areas.

Computational cognitive models of spatial memory in navigation space: a review

Spatial memory refers to the part of the memory system that encodes, stores, recognizes and recalls spatial information about the environment and the agent's orientation within it. Such information is required to be able to navigate to goal locations, and is vitally important for any embodied agent, or model thereof, for reaching goals in a spatially extended environment. In this paper, a number of computationally implemented cognitive models of spatial memory are reviewed and compared. Three categories of models are considered: symbolic models, neural network models, and models that are part of a systems-level cognitive architecture. Representative models from each category are described and compared in a number of dimensions along which simulation models can differ (level of modeling, types of representation, structural accuracy, generality and abstraction, environment complexity), including their possible mapping to the underlying neural substrate. Neural mappings are rarely explicated in the context of behaviorally validated models, but they could be useful to cognitive modeling research by providing a new approach for investigating a model's plausibility. Finally, suggested experimental neuroscience methods are described for verifying the biological plausibility of computational cognitive models of spatial memory, and open questions for the field of spatial memory modeling are outlined.

A learning-based approach to artificial sensory feedback leads to optimal integration

Proprioception—the sense of the body’s position in space—plays an important role in natural movement planning and execution and will likewise be necessary for successful motor prostheses and Brain–Machine Interfaces (BMIs). Here, we demonstrated that monkeys could learn to use an initially unfamiliar multi–channel intracortical microstimulation (ICMS) signal, which provided continuous information about hand position relative to an unseen target, to complete accurate reaches. Furthermore, monkeys combined this artificial signal with vision to form an optimal, minimum–variance estimate of relative hand position. These results demonstrate that a learning–based approach can be used to provide a rich artificial sensory feedback signal, suggesting a new strategy for restoring proprioception to patients using BMIs as well as a powerful new tool for studying the adaptive mechanisms of sensory integration.

Multiple representation of reaching space in the medial posterior parietal area V6A

During foveal reaching, the activity of neurons in the macaque medial posterior parietal area V6A is modulated by both gaze and arm direction. In the present work, we dissociated the position of gaze and reaching targets, and studied the neural activity of single V6A cells while the eyes and reaching targets were arranged in different spatial configurations (peripheral and foveal combinations). Target position influenced neural activity in all stages of the task, from visual presentation of target and movement planning, through reach execution and holding time. The majority of neurons preferred reaches directed toward peripheral targets, rather than foveal. Most neurons discharged in both premovement and action epochs. In most cases, reaching activity was tuned coherently across action planning and execution. When reaches were planned and executed in different eye/target configurations, multiple analyses revealed that few neurons coded reaching actions according to the absolute position of target, or to the position of target relative to the eye. The majority of cells responded to a combination of both these factors. These data suggest that V6A contains multiple representations of spatial information for reaching, consistent with a role of this area in forming cross-reference frame representations to be used by premotor cortex.

Multiple aspects of neural activity during reaching preparation in the medial posterior parietal area V6A

The posterior parietal cortex is involved in the visuomotor transformations occurring during arm-reaching movements. The medial posterior parietal area V6A has been shown to be implicated in reaching execution, but its role in reaching preparation has not been sufficiently investigated. Here, we addressed this issue exploring the neural correlates of reaching preparation in V6A. Neural activity of single cells during the instructed delay period of a foveated Reaching task was compared with the activity in the same delay period during a Detection task. In this latter task, animals fixated the target but, instead of performing an arm reaching movement, they responded with a button release to the go signal. Targets were allocated in different positions in 3-D space. We found three types of neurons: cells where delay activity was equally spatially tuned in the two tasks (Gaze cells), cells spatially tuned only during reaching preparation (Set cells), and cells influenced by both gaze and reaching preparation signals (Gaze/Set cells). In cells influenced by reaching preparation, the delay activity in the Reaching task could be higher or lower compared with the Detection task. All the Set cells and a minority of Gaze/Set cells were more active during reaching preparation. Most cells modulated by movement preparation were also modulated with a congruent spatial tuning during movement execution. Present results highlight the convergence of visuospatial information, reach planning and reach execution signals on V6A, and indicate that visuospatial processing and movement execution have a larger influence on V6A activity than the encoding of reach plans.

Coordinate transformation approach to social interactions

A coordinate transformation framework for understanding how neurons compute sensorimotor behaviors has generated significant advances toward our understanding of basic brain function. This influential scaffold focuses on neuronal encoding of spatial information represented in different coordinate systems (e.g., eye-centered, hand-centered) and how multiple brain regions partake in transforming these signals in order to ultimately generate a motor output. A powerful analogy can be drawn from the coordinate transformation framework to better elucidate how the nervous system computes cognitive variables for social behavior. Of particular relevance is how the brain represents information with respect to oneself and other individuals, such as in reward outcome assignment during social exchanges, in order to influence social decisions. In this article, I outline how the coordinate transformation framework can help guide our understanding of neural computations resulting in social interactions. Implications for numerous psychiatric disorders with impaired representations of self and others are also discussed.

The optic chiasm: a turning point in the evolution of eye/hand coordination

The primate visual system has a uniquely high proportion of ipsilateral retinal projections, retinal ganglial cells that do not cross the midline in the optic chiasm. The general assumption is that this developed due to the selective advantage of accurate depth perception through stereopsis. Here, the hypothesis that the need for accurate eye-forelimb coordination substantially influenced the evolution of the primate visual system is presented. Evolutionary processes may change the direction of retinal ganglial cells. Crossing, or non-crossing, in the optic chiasm determines which hemisphere receives visual feedback in reaching tasks. Each hemisphere receives little tactile and proprioceptive information about the ipsilateral hand. The eye-forelimb hypothesis proposes that abundant ipsilateral retinal projections developed in the primate brain to synthesize, in a single hemisphere, visual, tactile, proprioceptive, and motor information about a given hand, and that this improved eye-hand coordination and optimized the size of the brain. If accurate eye-hand coordination was a major factor in the evolution of stereopsis, stereopsis is likely to be highly developed for activity in the area where the hands most often operate.The primate visual system is ideally suited for tasks within arm's length and in the inferior visual field, where most manual activity takes place. Altering of ocular dominance in reaching tasks, reduced cross-modal cuing effects when arms are crossed, response of neurons in the primary motor cortex to viewed actions of a hand, multimodal neuron response to tactile as well as visual events, and extensive use of multimodal sensory information in reaching maneuvers support the premise that benefits of accurate limb control influenced the evolution of the primate visual system. The eye-forelimb hypothesis implies that evolutionary change toward hemidecussation in the optic chiasm provided parsimonious neural pathways in animals developing frontal vision and visually guided forelimbs, and also suggests a new perspective on vision convergence in prey and predatory animals.

Body-centered, mixed, but not hand-centered coding of visual targets in the medial posterior parietal cortex during reaches in 3D space

The frames of reference used by neurons in posterior parietal cortex (PPC) to encode spatial locations during arm reaching movements is a debated topic in modern neurophysiology. Traditionally, target location, encoded in retinocentric reference frame (RF) in caudal PPC, was assumed to be serially transformed to body-centered and then hand-centered coordinates rostrally. However, recent studies suggest that these transformations occur within a single area. The caudal PPC area V6A has been shown to represent reach targets in eye-centered, body-centered, and a combination of both RFs, but the presence of hand-centered coding has not been yet investigated. To examine this issue, 141 single neurons were recorded from V6A in 2 Macaca fascicularis monkeys while they performed a foveated reaching task in darkness. The targets were presented at different distances and lateralities from the body and were reached from initial hand positions located at different depths. Most V6A cells used body-centered, or mixed body- and hand-centered coordinates. Only a few neurons used pure hand-centered coordinates, thus clearly distinguishing V6A from nearby PPC regions. Our findings support the view of a gradual RF transformation in PPC and also highlight the impact of mixed frames of reference.

Posterior cortical atrophy: visuomotor deficits in reaching and grasping

Posterior Cortical Atrophy (PCA) is a rare clinical syndrome characterized by the predominance of higher-order visual disturbances such as optic ataxia, a characteristic of Balint's syndrome. Deficits result from progressive neurodegeneration of occipito-temporal and occipito-parietal cortices. The current study sought to explore the visuomotor functioning of four individuals with PCA by testing their ability to reach out and grasp real objects under various viewing conditions. Experiment 1 had participants reach out and grasp simple, rectangular blocks under visually- and memory-guided conditions. Experiment 2 explored participants' abilities to accurately reach for objects located in their visual periphery. This investigation revealed that PCA patients demonstrate many of the same deficits that have been previously reported in other individuals with optic ataxia, such as “magnetic misreaching”—a pathological reaching bias toward the point of visual fixation when grasping peripheral targets. Unlike many other individuals with optic ataxia, however, the patients in the current study also show symptoms indicative of damage to the more perceptual stream of visual processing, including abolished grip scaling during memory-guided grasping and deficits in face and object identification. These investigations are the first to perform a quantitative analysis of the visuomotor deficits exhibited by patients with PCA. Critically, this study helps characterize common symptoms of PCA, a vital first step for generating effective diagnostic criteria and therapeutic strategies for this understudied neurodegenerative disorder.

Reach and gaze representations in macaque parietal and premotor grasp areas

Voluntary movements are frequently composed of several actions that are combined to achieve a specific behavior. For example, prehension involves reaching and grasping actions to transport the hand to a target to grasp or manipulate it. For controlling these actions, separate parietofrontal networks have been described for generating reaching and grasping actions. However, this separation has been challenged recently for the dorsomedial part of this network (area V6A). Here we report that the anterior intraparietal (AIP) and the rostral ventral premotor area (F5) in the macaque, which are both part of the dorsolateral parietofrontal network and causally linked to hand grasping movements, also represent spatial information during the execution of a reach-to-grasp task. In addition to grip type information, gaze and target positions were represented in AIP and F5 and could be readily decoded from single unit activity in these areas. Whereas the fraction of grip type tuned units increased toward movement execution, the number of cells with spatial representations stayed relatively constant throughout the task, although more prominently in AIP than in F5. Furthermore, the recorded target position signals were substantially encoded in retinotopic coordinates. In conclusion, the simultaneous presence of grasp-related and spatial information in AIP and F5 suggests at least a supportive role of these spatial signals for the planning of grasp actions. Whether these spatial signals in AIP and F5 also play a causal role for the planning of reach actions would need to be the subject of further investigations.

rTMS of medial parieto-occipital cortex interferes with attentional reorienting during attention and reaching tasks

Unexpected changes in the location of a target for an upcoming action require both attentional reorienting and motor planning update. In both macaque and human brain, the medial posterior parietal cortex is involved in both phenomena but its causal role is still unclear. Here we used on-line rTMS over the putative human V6A (pV6A), a reach-related region in the dorsal part of the anterior bank of the parieto-occipital sulcus, during an attention and a reaching task requiring covert shifts of attention and planning of reaching movements toward cued targets in space. We found that rTMS increased RTs to invalidly cued but not to validly cued targets during both the attention and reaching task. Furthermore, we found that rTMS induced a deviation of reaching endpoints toward visual fixation and that this deviation was larger for invalidly cued targets. The results suggest that reorienting signals are used by human pV6A area to rapidly update the current motor plan or the ongoing action when a behaviorally relevant object unexpectedly occurs in an unattended location. The current findings suggest a direct involvement of the action-related dorso-medial visual stream in attentional reorienting and a more specific role of pV6A area in the dynamic, on-line control of reaching actions.

The postsaccadic unreliability of gain fields renders it unlikely that the motor system can use them to calculate target position in space

Gain fields, the eye-position modulation of visual responses, are thought to provide a mechanism by which the motor system can accurately calculate target position in space despite a constantly moving eye. Current gain-field models assume that the modulation of visual responses by eye position is accurate at all times, even around the time of a saccade. Here, we show that for at least 150 ms after a saccade, gain fields in the lateral intraparietal area (LIP) are unreliable. The majority of LIP cells with steady-state gain fields reflect the presaccadic eye position. The remainder of the cells have responses that cannot be predicted by their steady-state gain fields. Nonetheless, a monkey's oculomotor performance is accurate during this time. These results suggest that current models built upon a simple gain-field algorithm cannot be used to calculate the position of a target in space that flashes briefly after a saccade.

Optical imaging of visually guided reaching in macaque posterior parietal cortex

Sensorimotor transformation for reaching movements in primates requires a large network of visual, parietal, and frontal cortical areas. We performed intrinsic optical imaging over posterior parietal cortex including areas 7a and the dorsal perilunate in macaque monkeys during visually guided hand movements. Reaching was performed while foveating one of nine static reach targets; thus eye-position-varied concurrently with reach position. The hemodynamic reflectance signal was analyzed during specific phases of the task including pre-reach, reach, and touch epochs. The eye position maps changed substantially as the task progressed: First, direction of spatial tuning shifted from a weak preference close to the center to the lower eye positions in both cortical areas. Overall tuning strength was greater in area 7a. Second, strength of spatial tuning increased from the early pre-reach to the later touch epoch. These consistent temporal changes suggest that dynamic properties of the reflectance signal were modulated by task parameters. The peak amplitude and peak delay of the reflectance signal showed considerable differences between eye position but were similar between areas. Compared with a detection task using a lever response, the reach task yielded higher amplitudes and longer delays. These findings demonstrate a spatially tuned topographical representation for reaching in both areas and suggest a strong synergistic combination of various feedback signals that result in a spatially tuned amplification of the hemodynamic response in posterior parietal cortex.

The functional role of the medial motion area V6

In macaque, several visual areas are devoted to analyze motion in the visual field, and V6 is one of these areas. In macaque, area V6 occupies the ventral part of the anterior bank of the parieto-occipital sulcus (POs), is retinotopically-organized and contains a point-to-point representation of the retinal surface. V6 is a motion sensitive area that largely represents the peripheral part of the visual field and whose cells are very sensitive to translational motion. Based on the fact that macaque V6 contains many real-motion cells, it has been suggested that V6 is involved in object-motion recognition. Recently, area V6 has been recognized also in the human brain by neuroimaging and electrophysiological methods. Like macaque V6, human V6 is located in the POs, is retinotopically organized, and represents the entire contralateral hemifield up to the far periphery. Human V6, like macaque V6, is a motion area that responds to unidirectional motion. It has a strong preference for coherent motion and a recent combined VEPs/fMRI work has shown that area V6 is even one of the most early stations coding the motion coherence. Human V6 is highly sensitive to flow field and is also able to distinguish between different 3D flow fields being selective to translational egomotion. This suggests that this area processes visual egomotion signals to extract information about the relative distance of objects, likely in order to act on them, or to avoid them. The view that V6 is involved in the estimation of egomotion has been tested also in other recent fMRI studies. Thus, taken together, human and macaque data suggest that V6 is involved in both object and self-motion recognition. Specifically, V6 could be involved in "subtracting out" self-motion signals across the whole visual field and in providing information about moving objects, particularly during self-motion in a complex and dynamically unstable environment.

Behavioral investigation on the frames of reference involved in visuomotor transformations during peripheral arm reaching

BACKGROUND

Several psychophysical experiments found evidence for the involvement of gaze-centered and/or body-centered coordinates in arm-movement planning and execution. Here we aimed at investigating the frames of reference involved in the visuomotor transformations for reaching towards visual targets in space by taking target eccentricity and performing hand into account.

METHODOLOGY/PRINCIPAL FINDINGS

We examined several performance measures while subjects reached, in complete darkness, memorized targets situated at different locations relative to the gaze and/or to the body, thus distinguishing between an eye-centered and a body-centered frame of reference involved in the computation of the movement vector. The errors seem to be mainly affected by the visual hemifield of the target, independently from its location relative to the body, with an overestimation error in the horizontal reaching dimension (retinal exaggeration effect). The use of several target locations within the perifoveal visual field allowed us to reveal a novel finding, that is, a positive linear correlation between horizontal overestimation errors and target retinal eccentricity. In addition, we found an independent influence of the performing hand on the visuomotor transformation process, with each hand misreaching towards the ipsilateral side.

CONCLUSIONS

While supporting the existence of an internal mechanism of target-effector integration in multiple frames of reference, the present data, especially the linear overshoot at small target eccentricities, clearly indicate the primary role of gaze-centered coding of target location in the visuomotor transformation for reaching.

Neural activity in superior parietal cortex during rule-based visual-motor transformations

Cognition allows for the use of different rule-based sensorimotor strategies, but the neural underpinnings of such strategies are poorly understood. The purpose of this study was to compare neural activity in the superior parietal lobule during a standard (direct interaction) reaching task, with two nonstandard (gaze and reach spatially incongruent) reaching tasks requiring the integration of rule-based information. Specifically, these nonstandard tasks involved dissociating the planes of reach and vision or rotating visual feedback by 180°. Single unit activity, gaze, and reach trajectories were recorded from two female Macaca mulattas. In all three conditions, we observed a temporal discharge pattern at the population level reflecting early reach planning and on-line reach monitoring. In the plane-dissociated task, we found a significant overall attenuation in the discharge rate of cells from deep recording sites, relative to standard reaching. We also found that cells modulated by reach direction tended to be significantly tuned either during the standard or the plane-dissociated task but rarely during both. In the standard versus feedback reversal comparison, we observed some cells that shifted their preferred direction by 180° between conditions, reflecting maintenance of directional tuning with respect to the reach goal. Our findings suggest that the superior parietal lobule plays an important role in processing information about the nonstandard nature of a task, which, through reciprocal connections with precentral motor areas, contributes to the accurate transformation of incongruent sensory inputs into an appropriate motor output. Such processing is crucial for the integration of rule-based information into a motor act.

The role of the caudal superior parietal lobule in updating hand location in peripheral vision: further evidence from optic ataxia

Patients with optic ataxia (OA), who are missing the caudal portion of their superior parietal lobule (SPL), have difficulty performing visually-guided reaches towards extra-foveal targets. Such gaze and hand decoupling also occurs in commonly performed non-standard visuomotor transformations such as the use of a computer mouse. In this study, we test two unilateral OA patients in conditions of 1) a change in the physical location of the visual stimulus relative to the plane of the limb movement, 2) a cue that signals a required limb movement 180° opposite to the cued visual target location, or 3) both of these situations combined. In these non-standard visuomotor transformations, the OA deficit is not observed as the well-documented field-dependent misreach. Instead, OA patients make additional eye movements to update hand and goal location during motor execution in order to complete these slow movements. Overall, the OA patients struggled when having to guide centrifugal movements in peripheral vision, even when they were instructed from visual stimuli that could be foveated. We propose that an intact caudal SPL is crucial for any visuomotor control that involves updating ongoing hand location in space without foveating it, i.e. from peripheral vision, proprioceptive or predictive information.

Vision for action in the macaque medial posterior parietal cortex

Area V6A encodes hand configurations for grasping objects (Fattori et al., 2010). The aim of the present study was to investigate whether V6A cells also encode three-dimensional objects, and the relationship between object encoding and grip encoding. Single neurons were recorded in V6A of two monkeys trained to perform two tasks. In the first task, the monkeys were required to passively view an object without performing any action on it. In the second task, the monkeys viewed an object at the beginning of each trial and then they needed to grasp that object in darkness. Five different objects were used. Both tasks revealed that object presentation activates ∼60% of V6A neurons, with about half of them displaying object selectivity. In the Reach-to-Grasp task, the majority of V6A cells discharged during both object presentation and grip execution, displaying selectivity for either the object or the grip, or in some cases for both object and grip. Although the incidence of neurons encoding grips was twofold that of neurons encoding objects, object selectivity in single cells was as strong as grip selectivity, indicating that V6A cells were able to discriminate both the different objects and the different grips required to grasp them. Hierarchical cluster analysis revealed that clustering of the object-selective responses depended on the task requirements (view only or view to grasp) and followed a visual or a visuomotor rule, respectively. Object encoding in V6A reflects representations for action, useful for motor control in reach-to-grasp.