Reference frames for reaching when decoupling eye and target position in depth and direction

Visual sensitivity at the service of action control in posterior parietal cortex

The posterior parietal cortex (PPC) serves as a crucial hub for the integration of sensory with motor cues related to voluntary actions. Visual input is used in different ways along the dorsomedial and the dorsolateral visual pathways. Here we focus on the dorsomedial pathway and recognize a visual representation at the service of action control. Employing different experimental paradigms applied to behaving monkeys while single neural activity is recorded from the medial PPC (area V6A), we show how plastic visual representation can be, matching the different contexts in which the same object is proposed. We also present data on the exchange between vision and arm actions and highlight how this rich interplay can be used to weight different sensory inputs in order to monitor and correct arm actions online. Indeed, neural activity during reaching or reach-to-grasp actions can be excited or inhibited by visual information, suggesting that the visual perception of action, rather than object recognition, is the most effective factor for area V6A. Also, three-dimensional object shape is encoded dynamically by the neural population, according to the behavioral context of the monkey. Along this line, mirror neuron discharges in V6A indicate the plasticity of visual representation of the graspable objects, that changes according to the context and peaks when the object is the target of one's own action. In other words, object encoding in V6A is a visual encoding for action.

Convolutional neural networks reveal properties of reach-to-grasp encoding in posterior parietal cortex

Deep neural networks (DNNs) are widely adopted to decode motor states from both non-invasively and invasively recorded neural signals, e.g., for realizing brain-computer interfaces. However, the neurophysiological interpretation of how DNNs make the decision based on the input neural activity is limitedly addressed, especially when applied to invasively recorded data. This reduces decoder reliability and transparency, and prevents the exploitation of decoders to better comprehend motor neural encoding. Here, we adopted an explainable artificial intelligence approach - based on a convolutional neural network and an explanation technique - to reveal spatial and temporal neural properties of reach-to-grasping from single-neuron recordings of the posterior parietal area V6A. The network was able to accurately decode 5 different grip types, and the explanation technique automatically identified the cells and temporal samples that most influenced the network prediction. Grip encoding in V6A neurons already started at movement preparation, peaking during movement execution. A difference was found within V6A: dorsal V6A neurons progressively encoded more for increasingly advanced grips, while ventral V6A neurons for increasingly rudimentary grips, with both subareas following a linear trend between the amount of grip encoding and the level of grip skills. By revealing the elements of the neural activity most relevant for each grip with no a priori assumptions, our approach supports and advances current knowledge about reach-to-grasp encoding in V6A, and it may represent a general tool able to investigate neural correlates of motor or cognitive tasks (e.g., attention and memory tasks) from single-neuron recordings.

rTMS over the human medial parietal cortex impairs online reaching corrections

Indirect correlational evidence suggests that the posteromedial sector of the human parietal cortex (area hV6A) is involved in reaching corrections. We interfered with hV6A functions using repetitive transcranial magnetic stimulation (rTMS) while healthy participants performed reaching movements and in-flight adjustments of the hand trajectory in presence of unexpected target shifts. rTMS over hV6A specifically altered action reprogramming, causing deviations of the shifted trajectories, particularly along the vertical dimension (i.e., distance). This study provides evidence of the functional relevance of hV6A in action reprogramming while a sudden event requires a change in performance and shows that hV6A also plays a role in state estimation during reaching. These findings are in line with neurological data showing impairments in actions performed along the distance dimension when lesions occur in the dorsal posterior parietal cortex.

Dynamic spatial coding in parietal cortex mediates tactile-motor transformation

Movements towards touch on the body require integrating tactile location and body posture information. Tactile processing and movement planning both rely on posterior parietal cortex (PPC) but their interplay is not understood. Here, human participants received tactile stimuli on their crossed and uncrossed feet, dissociating stimulus location relative to anatomy versus external space. Participants pointed to the touch or the equivalent location on the other foot, which dissociates sensory and motor locations. Multi-voxel pattern analysis of concurrently recorded fMRI signals revealed that tactile location was coded anatomically in anterior PPC but spatially in posterior PPC during sensory processing. After movement instructions were specified, PPC exclusively represented the movement goal in space, in regions associated with visuo-motor planning and with regional overlap for sensory, rule-related, and movement coding. Thus, PPC flexibly updates its spatial codes to accommodate rule-based transformation of sensory input to generate movement to environment and own body alike.

A Short Route for Reach Planning between Human V6A and the Motor Cortex

In the macaque monkey, area V6A, located in the medial posterior parietal cortex, contains cells that encode the spatial position of a reaching target. It has been suggested that during reach planning this information is sent to the frontal cortex along a parieto-frontal pathway that connects V6A-premotor cortex-M1. A similar parieto-frontal network may also exist in the human brain, and we aimed here to study the timing of this functional connection during planning of a reaching movement toward different spatial positions. We probed the functional connectivity between human area V6A (hV6A) and the primary motor cortex (M1) using dual-site, paired-pulse transcranial magnetic stimulation with a short (4 ms) and a longer (10 ms) interstimulus interval while healthy participants (18 men and 18 women) planned a visually-guided or a memory-guided reaching movement toward positions located at different depths and directions. We found that, when the stimulation over hV6A is sent 4 ms before the stimulation over M1, hV6A inhibits motor-evoked potentials during planning of either rightward or leftward reaching movements. No modulations were found when the stimulation over hV6A was sent 10 ms before the stimulation over M1, suggesting that only short medial parieto-frontal routes are active during reach planning. Moreover, the short route of hV6A-premotor cortex-M1 is active during reach planning irrespectively of the nature (visual or memory) of the reaching target. These results agree with previous neuroimaging studies and provide the first demonstration of the flow of inhibitory signals between hV6A and M1.SIGNIFICANCE STATEMENT All our dexterous movements depend on the correct functioning of the network of brain areas. Knowing the functional timing of these networks is useful to gain a deeper understanding of how the brain works to enable accurate arm movements. In this article, we probed the parieto-frontal network and demonstrated that it takes 4 ms for the medial posterior parietal cortex to send inhibitory signals to the frontal cortex during reach planning. This fast flow of information seems not to be dependent on the availability of visual information regarding the reaching target. This study opens the way for future studies to test how this timing could be impaired in different neurological disorders.

Machine learning methods detect arm movement impairments in a patient with parieto-occipital lesion using only early kinematic information

Patients with lesions of the parieto-occipital cortex typically misreach visual targets that they correctly perceive (optic ataxia). Although optic ataxia was described more than 30 years ago, distinguishing this condition from physiological behavior using kinematic data is still far from being an achievement. Here, combining kinematic analysis with machine learning methods, we compared the reaching performance of a patient with bilateral occipitoparietal damage with that of 10 healthy controls. They performed visually guided reaches toward targets located at different depths and directions. Using the horizontal, sagittal, and vertical deviation of the trajectories, we extracted classification accuracy in discriminating the reaching performance of patient from that of controls. Specifically, accurate predictions of the patient's deviations were detected after the 20% of the movement execution in all the spatial positions tested. This classification based on initial trajectory decoding was possible for both directional and depth components of the movement, suggesting the possibility of applying this method to characterize pathological motor behavior in wider frameworks.

Transcranial Magnetic Stimulation Over the Human Medial Posterior Parietal Cortex Disrupts Depth Encoding During Reach Planning

Accumulating evidence supports the view that the medial part of the posterior parietal cortex (mPPC) is involved in the planning of reaching, but while plenty of studies investigated reaching performed toward different directions, only a few studied different depths. Here, we investigated the causal role of mPPC (putatively, human area V6A-hV6A) in encoding depth and direction of reaching. Specifically, we applied single-pulse transcranial magnetic stimulation (TMS) over the left hV6A at different time points while 15 participants were planning immediate, visually guided reaching by using different eye-hand configurations. We found that TMS delivered over hV6A 200 ms after the Go signal affected the encoding of the depth of reaching by decreasing the accuracy of movements toward targets located farther with respect to the gazed position, but only when they were also far from the body. The effectiveness of both retinotopic (farther with respect to the gaze) and spatial position (far from the body) is in agreement with the presence in the monkey V6A of neurons employing either retinotopic, spatial, or mixed reference frames during reach plan. This work provides the first causal evidence of the critical role of hV6A in the planning of visually guided reaching movements in depth.

Mixed Selectivity in Macaque Medial Parietal Cortex during Eye-Hand Reaching

The activity of neurons of the medial posterior parietal area V6A in macaque monkeys is modulated by many aspects of reach task. In the past, research was mostly focused on modulating the effect of single parameters upon the activity of V6A cells. Here, we used Generalized Linear Models (GLMs) to simultaneously test the contribution of several factors upon V6A cells during a fix-to-reach task. This approach resulted in the definition of a representative “functional fingerprint” for each neuron. We first studied how the features are distributed in the population. Our analysis highlighted the virtual absence of units strictly selective for only one factor and revealed that most cells are characterized by “mixed selectivity.” Then, exploiting our GLM framework, we investigated the dynamics of spatial parameters encoded within V6A. We found that the tuning is not static, but changed along the trial, indicating the sequential occurrence of visuospatial transformations helpful to guide arm movement.

•

The parietal cortex integrates a variety of sensorimotor inputs to guide reaching

•

GLM disentangled the effect of various reaching parameters upon cell activity

•

V6A neurons were not functionally clustered, but characterized by mixed selectivity

•

Spatial selectivity was dynamic and reached its peak during the movement phase

Decoding of standard and non-standard visuomotor associations from parietal cortex

OBJECTIVE

Neural signals can be decoded and used to move neural prostheses with the purpose of restoring motor function in patients with mobility impairments. Such patients typically have intact eye movement control and visual function, suggesting that cortical visuospatial signals could be used to guide external devices. Neurons in parietal cortex mediate sensory-motor transformations, encode the spatial coordinates for reaching goals, hand position and movements, and other spatial variables. We studied how spatial information is represented at the population level, and the possibility to decode not only the position of visual targets and the plans to reach them, but also conditional, non-spatial motor responses.

APPROACH

The animals first fixated one of nine targets in 3D space and then, after the target changed color, either reached toward it, or performed a non-spatial motor response (lift hand from a button). Spiking activity of parietal neurons was recorded in monkeys during two tasks. We then decoded different task related parameters.

MAIN RESULTS

We first show that a maximum-likelihood estimation (MLE) algorithm trained separately in each task transformed neural activity into accurate metric predictions of target location. Furthermore, by combining MLE with a Naïve Bayes classifier, we decoded the monkey's motor intention (reach or hand lift) and the different phases of the tasks. These results show that, although V6A encodes the spatial location of a target during a delay period, the signals they carry are updated around the movement execution in an intention/motor specific way.

SIGNIFICANCE

These findings show the presence of multiple levels of information in parietal cortex that could be decoded and used in brain machine interfaces to control both goal-directed movements and more cognitive visuomotor associations.

Neural coding of action in three dimensions: Task- and time-invariant reference frames for visuospatial and motor-related activity in parietal area V6A

Goal-directed movements involve a series of neural computations that compare the sensory representations of goal location and effector position, and transform these into motor commands. Neurons in posterior parietal cortex (PPC) control several effectors (e.g., eye, hand, foot) and encode goal location in a variety of spatial coordinate systems, including those anchored to gaze direction, and to the positions of the head, shoulder, or hand. However, there is little evidence on whether reference frames depend also on the effector and/or type of motor response. We addressed this issue in macaque PPC area V6A, where previous reports using a fixate-to-reach in depth task, from different starting arm positions, indicated that most units use mixed body/hand-centered coordinates. Here, we applied singular value decomposition and gradient analyses to characterize the reference frames in V6A while the animals, instead of arm reaching, performed a nonspatial motor response (hand lift). We found that most neurons used mixed body/hand coordinates, instead of "pure" body-, or hand-centered coordinates. During the task progress the effect of hand position on activity became stronger compared to target location. Activity consistent with body-centered coding was present only in a subset of neurons active early in the task. Applying the same analyses to a population of V6A neurons recorded during the fixate-to-reach task yielded similar results. These findings suggest that V6A neurons use consistent reference frames between spatial and nonspatial motor responses, a functional property that may allow the integration of spatial awareness and movement control.

Enhanced Theta-Band Coherence Between Midfrontal and Posterior Parietal Areas Reflects Post-feedback Adjustments in the State of Outcome Uncertainty

Medial frontal cortex is currently viewed as the main hub of the performance monitoring system; upon detection of an error committed, it establishes functional connections with brain regions involved in task performance, thus leading to neural adjustments in them. Previous research has identified targets of such adjustments in the dorsolateral prefrontal cortex, posterior cortical regions, motor cortical areas, and subthalamic nucleus. Yet most of such studies involved visual tasks with relatively moderate cognitive load and strong dependence on motor inhibition - thus highlighting sensory, executive and motor effects while underestimating sensorimotor transformation and related aspects of decision making. Currently there is ample evidence that posterior parietal cortical areas are involved in task-specific neural processes of decision making (including evidence accumulation, sensorimotor transformation, attention, etc.) - yet, to our knowledge, no EEG studies have demonstrated post-error increase in functional connectivity in the theta-band between midfrontal and posterior parietal areas during performance on non-visual tasks. In the present study, we recorded EEG while subjects were performing an auditory version of the cognitively demanding attentional condensation task; this task involves rather non-straightforward stimulus-to-response mapping rules, thus, creating increased load on sensorimotor transformation. We observed strong pre-response alpha-band suppression in the left parietal area, which presumably reflected involvement of the posterior parietal cortex in task-specific decision-making processes. Negative feedback was followed by increased midfrontal theta-band power and increased functional coupling in the theta band between midfrontal and left parietal regions. This could be interpreted as activation of the performance monitoring system and top-down influence of this system on the posterior parietal regions involved in decision making, respectively. This inter-site coupling related to negative feedback was stronger for subjects who tended to commit errors with slower response times. Generally, current findings support the idea that slower errors are related to the state of outcome uncertainty caused by failures of task-specific processes, associated with posterior parietal regions.

Beta Modulation Depth Is Not Linked to Movement Features

Beta power over the sensorimotor areas starts decreasing just before movement execution (event-related desynchronization, ERD) and increases post-movement (event-related synchronization, ERS). In this study, we determined whether the magnitude of beta ERD, ERS and modulation depth are linked to movement characteristics, such as movement length and velocity. Brain activity was recorded with a 256-channels EEG system in 35 healthy subjects performing fast, uncorrected reaching movements to targets located at three distances. We found that the temporal profiles of velocity were bell-shaped and scaled to the appropriate target distance. However, the magnitude of beta ERD, ERS and modulation depth, as well as their timing, did not significantly change and were not related to movement features.

Mixed Spatial and Movement Representations in the Primate Posterior Parietal Cortex

The posterior parietal cortex (PPC) of humans and non-human primates plays a key role in the sensory and motor transformations required to guide motor actions to objects of interest in the environment. Despite decades of research, the anatomical and functional organization of this region is still a matter of contention. It is generally accepted that specialized parietal subregions and their functional counterparts in the frontal cortex participate in distinct segregated networks related to eye, arm and hand movements. However, experimental evidence obtained primarily from single neuron recording studies in non-human primates has demonstrated a rich mixing of signals processed by parietal neurons, calling into question ideas for a strict functional specialization. Here, we present a brief account of this line of research together with the basic trends in the anatomical connectivity patterns of the parietal subregions. We review, the evidence related to the functional communication between subregions of the PPC and describe progress towards using parietal neuron activity in neuroprosthetic applications. Recent literature suggests a role for the PPC not as a constellation of specialized functional subdomains, but as a dynamic network of sensorimotor loci that combine multiple signals and work in concert to guide motor behavior.

Human posterior parietal and dorsal premotor cortex encode the visual properties of an upcoming action

Behavioral studies show that motor actions are planned by adapting motor programs to produce desired visual consequences. Does this mean that the brain plans these visual consequences independent of the motor actions required to obtain them? Here we addressed this question by investigating planning-related fMRI activity in human posterior parietal (PPC) and dorsal premotor (PMd) cortex. By manipulating visual movement of a virtual end-effector controlled via button presses we could dissociate motor actions from their sensory outcome. A clear representation of the visual consequences was visible in both PPC and PMd activity during early planning stages. Our findings suggest that in both PPC and PMd action plans are initially represented on the basis of the desired sensory outcomes while later activity shifts towards representing motor programs.

Preparatory activity for purposeful arm movements in the dorsomedial parietal area V6A: Beyond the online guidance of movement

Over the years, electrophysiological recordings in macaque monkeys performing visuomotor tasks brought about accumulating evidence for the expression of neuronal properties (e.g., selectivity in the visuospatial and somatosensory domains, encoding of visual affordances and motor cues) in the posterior parietal area V6A that characterize it as an ideal neural substrate for online control of prehension. Interestingly, neuroimaging studies suggested a role of putative human V6A also in action preparation; moreover, pre-movement population activity in monkey V6A has been recently shown to convey grip-related information for upcoming grasping. Here we directly test whether macaque V6A neurons encode preparatory signals that effectively differentiate between dissimilar actions before movement. We recorded the activity of single V6A neurons during execution of two visuomotor tasks requiring either reach-to-press or reach-to-grasp movements in different background conditions, and described the nature and temporal dynamics of V6A activity preceding movement execution. We found striking consistency in neural discharges measured during pre-movement and movement epochs, suggesting that the former is a preparatory activity exquisitely linked to the subsequent execution of particular motor actions. These findings strongly support a role of V6A beyond the online guidance of movement, with preparatory activity implementing suitable motor programs that subsequently support action execution.

Sensory properties of the caudal aspect of the macaque's superior parietal lobule

In the superior parietal lobule (SPL), the anterior part (area PE) is known to process somatosensory information, while the caudalmost part (areas V6Av and V6) processes visual information. Here we studied the visual and somatosensory properties of the areas PEc and V6Ad located in between the somatosensory and visual domains of SPL. About 1500 neurons were extracellularly recorded in 19 hemispheres of 12 monkeys (Macaca fascicularis). Visual and somatosensory properties of single neurons were generally studied separately, while in a subpopulation of neurons, both the sensory properties were tested. Visual neurons were more represented in V6Ad and somatosensory neurons in PEc. The visual neurons of these two areas showed similar properties and represented a large part of the contralateral visual field, mostly the lower part. In contrast, somatosensory neurons showed remarkable differences. The arms were overrepresented in both the areas, but V6Ad represented only the upper limbs, whereas PEc both the upper and lower limbs. Interestingly, we found that in both the areas, bimodal visual-somatosensory cells represented the proximal part of the arms. We suggest that PEc is involved in locomotion and in the control of hand/foot interaction with the objects of the environment, while V6Ad is in the control of the object prehension specifically performed with the upper limbs. Neuroimaging and lesion studies from literature support a strict homology with humans.

Multiple Coordinate Systems and Motor Strategies for Reaching Movements When Eye and Hand Are Dissociated in Depth and Direction

Reaching behavior represents one of the basic aspects of human cognitive abilities important for the interaction with the environment. Reaching movements towards visual objects are controlled by mechanisms based on coordinate systems that transform the spatial information of target location into appropriate motor response. Although recent works have extensively studied the encoding of target position for reaching in three-dimensional space at behavioral level, the combined analysis of reach errors and movement variability has so far been investigated by few studies. Here we did so by testing 12 healthy participants in an experiment where reaching targets were presented at different depths and directions in foveal and peripheral viewing conditions. Each participant executed a memory-guided task in which he/she had to reach the memorized position of the target. A combination of vector and gradient analysis, novel for behavioral data, was applied to analyze patterns of reach errors for different combinations of eye/target positions. The results showed reach error patterns based on both eye- and space-centered coordinate systems: in depth more biased towards a space-centered representation and in direction mixed between space- and eye-centered representation. We calculated movement variability to describe different trajectory strategies adopted by participants while reaching to the different eye/target configurations tested. In direction, the distribution of variability between configurations that shared the same eye/target relative configuration was different, whereas in configurations that shared the same spatial position of targets, it was similar. In depth, the variability showed more similar distributions in both pairs of eye/target configurations tested. These results suggest that reaching movements executed in geometries that require hand and eye dissociations in direction and depth showed multiple coordinate systems and different trajectory strategies according to eye/target configurations and the two dimensions of space.

The Pointing Errors in Optic Ataxia Reveal the Role of "Peripheral Magnification" of the PPC

Interaction with visual objects in the environment requires an accurate correspondence between visual space and its internal representation within the brain. Many clinical conditions involve some impairment in visuo-motor control and the errors created by the lesion of a specific brain region are neither random nor uninformative. Modern approaches to studying the neuropsychology of action require powerful data-driven analyses and error modeling in order to understand the function of the lesioned areas. In the present paper we carried out mixed-effect analyses of the pointing errors of seven optic ataxia patients and seven control subjects. We found that a small parameter set is sufficient to explain the pointing errors produced by unilateral optic ataxia patients. In particular, the extremely stereotypical errors made when pointing toward the contralesional visual field can be fitted by mathematical models similar to those used to model central magnification in cortical or sub-cortical structure(s). Our interpretation is that visual areas that contain this footprint of central magnification guide pointing movements when the posterior parietal cortex (PPC) is damaged and that the functional role of the PPC is to actively compensate for the under-representation of peripheral vision that accompanies central magnification. Optic ataxia misreaching reveals what would be hand movement accuracy and precision if the human motor system did not include elaborated corrective processes for reaching and grasping to non-foveated targets.