Visual sensitivity at the service of action control in posterior parietal cortex

The posterior parietal cortex (PPC) serves as a crucial hub for the integration of sensory with motor cues related to voluntary actions. Visual input is used in different ways along the dorsomedial and the dorsolateral visual pathways. Here we focus on the dorsomedial pathway and recognize a visual representation at the service of action control. Employing different experimental paradigms applied to behaving monkeys while single neural activity is recorded from the medial PPC (area V6A), we show how plastic visual representation can be, matching the different contexts in which the same object is proposed. We also present data on the exchange between vision and arm actions and highlight how this rich interplay can be used to weight different sensory inputs in order to monitor and correct arm actions online. Indeed, neural activity during reaching or reach-to-grasp actions can be excited or inhibited by visual information, suggesting that the visual perception of action, rather than object recognition, is the most effective factor for area V6A. Also, three-dimensional object shape is encoded dynamically by the neural population, according to the behavioral context of the monkey. Along this line, mirror neuron discharges in V6A indicate the plasticity of visual representation of the graspable objects, that changes according to the context and peaks when the object is the target of one's own action. In other words, object encoding in V6A is a visual encoding for action.

Convolutional neural networks reveal properties of reach-to-grasp encoding in posterior parietal cortex

Deep neural networks (DNNs) are widely adopted to decode motor states from both non-invasively and invasively recorded neural signals, e.g., for realizing brain-computer interfaces. However, the neurophysiological interpretation of how DNNs make the decision based on the input neural activity is limitedly addressed, especially when applied to invasively recorded data. This reduces decoder reliability and transparency, and prevents the exploitation of decoders to better comprehend motor neural encoding. Here, we adopted an explainable artificial intelligence approach - based on a convolutional neural network and an explanation technique - to reveal spatial and temporal neural properties of reach-to-grasping from single-neuron recordings of the posterior parietal area V6A. The network was able to accurately decode 5 different grip types, and the explanation technique automatically identified the cells and temporal samples that most influenced the network prediction. Grip encoding in V6A neurons already started at movement preparation, peaking during movement execution. A difference was found within V6A: dorsal V6A neurons progressively encoded more for increasingly advanced grips, while ventral V6A neurons for increasingly rudimentary grips, with both subareas following a linear trend between the amount of grip encoding and the level of grip skills. By revealing the elements of the neural activity most relevant for each grip with no a priori assumptions, our approach supports and advances current knowledge about reach-to-grasp encoding in V6A, and it may represent a general tool able to investigate neural correlates of motor or cognitive tasks (e.g., attention and memory tasks) from single-neuron recordings.

Complementary contribution of the medial and lateral human parietal cortex to grasping: a repetitive TMS study

The dexterous control of our grasping actions relies on the cooperative activation of many brain areas. In the parietal lobe, 2 grasp-related areas collaborate to orchestrate an accurate grasping action: dorsolateral area AIP and dorsomedial area V6A. Single-cell recordings in monkeys and fMRI studies in humans have suggested that both these areas specify grip aperture and wrist orientation, but encode these grasping parameters differently, depending on the context. To elucidate the causal role of phAIP and hV6A, we stimulated these areas, while participants were performing grasping actions (unperturbed grasping). rTMS over phAIP impaired the wrist orientation process, whereas stimulation over hV6A impaired grip aperture encoding. In a small percentage of trials, an unexpected reprogramming of grip aperture or wrist orientation was required (perturbed grasping). In these cases, rTMS over hV6A or over phAIP impaired reprogramming of both grip aperture and wrist orientation. These results represent the first direct demonstration of a different encoding of grasping parameters by 2 grasp-related parietal areas.

The posterior parietal area V6A: an attentionally-modulated visuomotor region involved in the control of reach-toF-grasp action

In the macaque, the posterior parietal area V6A is involved in the control of all phases of reach-to-grasp actions: the transport phase, given that reaching neurons are sensitive to the direction and amplitude of arm movement, and the grasping phase, since reaching neurons are also sensitive to wrist orientation and hand shaping. Reaching and grasping activity are corollary discharges which, together with the somatosensory and visual signals related to the same movement, allow V6A to act as a state estimator that signals discrepancies during the motor act in order to maintain consistency between the ongoing movement and the desired one. Area V6A is also able to encode the target of an action because of gaze-dependent visual neurons and real-position cells. Here, we advance the hypothesis that V6A also uses the spotlight of attention to guide goal-directed movements of the hand, and hosts a priority map that is specific for the guidance of reaching arm movement, combining bottom-up inputs such as visual responses with top-down signals such as reaching plans.

Morphological patterns and spatial probability maps of the superior parietal sulcus in the human brain

The superior parietal sulcus (SPS) is the defining sulcus within the superior parietal lobule (SPL). The morphological variability of the SPS was examined in individual magnetic resonance imaging (MRI) scans of the human brain that were registered to the Montreal Neurological Institute (MNI) standard stereotaxic space. Two primary morphological patterns were consistently identified across hemispheres: (i) the SPS was identified as a single sulcus, separating the anterior from the posterior part of the SPL and (ii) the SPS was found as a complex of multiple sulcal segments. These morphological patterns were subdivided based on whether the SPS or SPS complex remained distinct or merged with surrounding parietal sulci. The morphological variability and spatial extent of the SPS were quantified using volumetric and surface spatial probabilistic mapping. The current investigation established consistent morphological patterns in a common anatomical space, the MNI stereotaxic space, to facilitate structural and functional analyses within the SPL.

The structure of the superior and inferior parietal lobes predicts inter-individual suitability for virtual reality

The global virtual reality (VR) market is significantly expanding and being challenged with an increased demand owing to COVID-19. Unfortunately, VR is not useful for everyone due to large interindividual variability existing in VR suitability. To understand the neurobiological basis of this variability, we obtained neural structural and functional data from the participants using 3T magnetic resonance imaging. The participants completed one of two tasks (sports training or cognitive task) using VR, which differed in the time scale (months/minutes) and domain (motor learning/attention task). Behavioral results showed that some participants improved their motor skills in the real world after 1-month training in the virtual space or obtained high scores in the 3D attention task (high suitability for VR), whereas others did not (low suitability for VR). Brain structure analysis revealed that the structural properties of the superior and inferior parietal lobes contain information that can predict an individual’s suitability for VR.

High-gamma mirror activity patterns in the human brain during reach-to-grasp movement observation, retention, and execution-An MEG study

While the existence of a human mirror neuron system is evident, the involved brain areas and their exact functional roles remain under scientific debate. A number of functionally different mirror neuron types, neurons that selectively respond to specific grasp phases and types for example, have been reported with single cell recordings in monkeys. In humans, spatially limited, intracranially recorded electrophysiological signals in the high-gamma (HG) range have been used to investigate the human mirror system, as they are associated with spiking activity in single neurons. Our goal here is to complement previous intracranial HG studies by using magnetoencephalography to record HG activity simultaneously from the whole head. Participants performed a natural reach-to-grasp movement observation and delayed imitation task with different everyday objects and grasp types. This allowed us to characterize the spatial organization of cortical areas that show HG-activation modulation during movement observation (mirroring), retention (mnemonic mirroring), and execution (motor control). Our results show mirroring related HG modulation patterns over bilateral occipito-parietal as well as sensorimotor areas. In addition, we found mnemonic mirroring related HG modulation over contra-lateral fronto-temporal areas. These results provide a foundation for further human mirror system research as well as possible target areas for brain-computer interface and neurorehabilitation approaches.

Functional Connectivity at Rest between the Human Medial Posterior Parietal Cortex and the Primary Motor Cortex Detected by Paired-Pulse Transcranial Magnetic Stimulation

The medial posterior parietal cortex (PPC) is involved in the complex processes of visuomotor integration. Its connections to the dorsal premotor cortex, which in turn is connected to the primary motor cortex (M1), complete the fronto-parietal network that supports important cognitive functions in the planning and execution of goal-oriented movements. In this study, we wanted to investigate the time-course of the functional connectivity at rest between the medial PPC and the M1 using dual-site transcranial magnetic stimulation in healthy humans. We stimulated the left M1 using a suprathreshold test stimulus to elicit motor-evoked potentials in the hand, and a subthreshold conditioning stimulus was applied over the left medial PPC at different inter-stimulus intervals (ISIs). The conditioning stimulus affected the M1 excitability depending on the ISI, with inhibition at longer ISIs (12 and 15 ms). We suggest that these modulations may reflect the activation of different parieto-frontal pathways, with long latency inhibitions likely recruiting polisynaptic pathways, presumably through anterolateral PPC.

Mixed Selectivity in Macaque Medial Parietal Cortex during Eye-Hand Reaching

The activity of neurons of the medial posterior parietal area V6A in macaque monkeys is modulated by many aspects of reach task. In the past, research was mostly focused on modulating the effect of single parameters upon the activity of V6A cells. Here, we used Generalized Linear Models (GLMs) to simultaneously test the contribution of several factors upon V6A cells during a fix-to-reach task. This approach resulted in the definition of a representative “functional fingerprint” for each neuron. We first studied how the features are distributed in the population. Our analysis highlighted the virtual absence of units strictly selective for only one factor and revealed that most cells are characterized by “mixed selectivity.” Then, exploiting our GLM framework, we investigated the dynamics of spatial parameters encoded within V6A. We found that the tuning is not static, but changed along the trial, indicating the sequential occurrence of visuospatial transformations helpful to guide arm movement.

•

The parietal cortex integrates a variety of sensorimotor inputs to guide reaching

•

GLM disentangled the effect of various reaching parameters upon cell activity

•

V6A neurons were not functionally clustered, but characterized by mixed selectivity

•

Spatial selectivity was dynamic and reached its peak during the movement phase

Hierarchical Action Encoding Within the Human Brain

Humans are able to interact with objects with extreme flexibility. To achieve this ability, the brain does not only control specific muscular patterns, but it also needs to represent the abstract goal of an action, irrespective of its implementation. It is debated, however, how abstract action goals are implemented in the brain. To address this question, we used multivariate pattern analysis of functional magnetic resonance imaging data. Human participants performed grasping actions (precision grip, whole hand grip) with two different wrist orientations (canonical, rotated), using either the left or right hand. This design permitted to investigate a hierarchical organization consisting of three levels of abstraction: 1) “concrete action” encoding; 2) “effector-dependent goal” encoding (invariant to wrist orientation); and 3) “effector-independent goal” encoding (invariant to effector and wrist orientation). We found that motor cortices hosted joint encoding of concrete actions and of effector-dependent goals, while the parietal lobe housed a convergence of all three representations, comprising action goals within and across effectors. The left lateral occipito-temporal cortex showed effector-independent goal encoding, but no convergence across the three levels of representation. Our results support a hierarchical organization of action encoding, shedding light on the neural substrates supporting the extraordinary flexibility of human hand behavior.

Corticocortical Systems Underlying High-Order Motor Control

Cortical networks are characterized by the origin, destination, and reciprocity of their connections, as well as by the diameter, conduction velocity, and synaptic efficacy of their axons. The network formed by parietal and frontal areas lies at the core of cognitive-motor control because the outflow of parietofrontal signaling is conveyed to the subcortical centers and spinal cord through different parallel pathways, whose orchestration determines, not only when and how movements will be generated, but also the nature of forthcoming actions. Despite intensive studies over the last 50 years, the role of corticocortical connections in motor control and the principles whereby selected cortical networks are recruited by different task demands remain elusive. Furthermore, the synaptic integration of different cortical signals, their modulation by transthalamic loops, and the effects of conduction delays remain challenging questions that must be tackled to understand the dynamical aspects of parietofrontal operations. In this article, we evaluate results from nonhuman primate and selected rodent experiments to offer a viewpoint on how corticocortical systems contribute to learning and producing skilled actions. Addressing this subject is not only of scientific interest but also essential for interpreting the devastating consequences for motor control of lesions at different nodes of this integrated circuit. In humans, the study of corticocortical motor networks is currently based on MRI-related methods, such as resting-state connectivity and diffusion tract-tracing, which both need to be contrasted with histological studies in nonhuman primates.

Reduced neural representation of arm/hand actions in the medial posterior parietal cortex

Several investigations at a single-cell level demonstrated that the medial posterior parietal area V6A is involved in encoding reaching and grasping actions in different visual conditions. Here, we looked for a “low-dimensional” representation of these encoding processes by studying macaque V6A neurons tested in three different tasks with a dimensionality reduction technique, the demixed principal component analysis (dPCA), which is very suitable for neuroprosthetics readout. We compared neural activity in reaching and grasping tasks by highlighting the portions of population variance involved in the encoding of visual information, target position, wrist orientation and grip type. The weight of visual information and task parameters in the encoding process was dependent on the task. We found that the distribution of variance captured by visual information in the three tasks did not differ significantly among the tasks, whereas the variance captured by target position and grip type parameters were significantly higher with respect to that captured by wrist orientation regardless of the number of conditions considered in each task. These results suggest a different use of relevant information according to the type of planned and executed action. This study shows a simplified picture of encoding that describes how V6A processes relevant information for action planning and execution.

Preparatory activity for purposeful arm movements in the dorsomedial parietal area V6A: Beyond the online guidance of movement

Over the years, electrophysiological recordings in macaque monkeys performing visuomotor tasks brought about accumulating evidence for the expression of neuronal properties (e.g., selectivity in the visuospatial and somatosensory domains, encoding of visual affordances and motor cues) in the posterior parietal area V6A that characterize it as an ideal neural substrate for online control of prehension. Interestingly, neuroimaging studies suggested a role of putative human V6A also in action preparation; moreover, pre-movement population activity in monkey V6A has been recently shown to convey grip-related information for upcoming grasping. Here we directly test whether macaque V6A neurons encode preparatory signals that effectively differentiate between dissimilar actions before movement. We recorded the activity of single V6A neurons during execution of two visuomotor tasks requiring either reach-to-press or reach-to-grasp movements in different background conditions, and described the nature and temporal dynamics of V6A activity preceding movement execution. We found striking consistency in neural discharges measured during pre-movement and movement epochs, suggesting that the former is a preparatory activity exquisitely linked to the subsequent execution of particular motor actions. These findings strongly support a role of V6A beyond the online guidance of movement, with preparatory activity implementing suitable motor programs that subsequently support action execution.

Sensory properties of the caudal aspect of the macaque's superior parietal lobule

In the superior parietal lobule (SPL), the anterior part (area PE) is known to process somatosensory information, while the caudalmost part (areas V6Av and V6) processes visual information. Here we studied the visual and somatosensory properties of the areas PEc and V6Ad located in between the somatosensory and visual domains of SPL. About 1500 neurons were extracellularly recorded in 19 hemispheres of 12 monkeys (Macaca fascicularis). Visual and somatosensory properties of single neurons were generally studied separately, while in a subpopulation of neurons, both the sensory properties were tested. Visual neurons were more represented in V6Ad and somatosensory neurons in PEc. The visual neurons of these two areas showed similar properties and represented a large part of the contralateral visual field, mostly the lower part. In contrast, somatosensory neurons showed remarkable differences. The arms were overrepresented in both the areas, but V6Ad represented only the upper limbs, whereas PEc both the upper and lower limbs. Interestingly, we found that in both the areas, bimodal visual-somatosensory cells represented the proximal part of the arms. We suggest that PEc is involved in locomotion and in the control of hand/foot interaction with the objects of the environment, while V6Ad is in the control of the object prehension specifically performed with the upper limbs. Neuroimaging and lesion studies from literature support a strict homology with humans.