Anterior Intraparietal Area: A Hub in the Observed Manipulative Action Network

Investigating the Link Between Subjective Depth Perception Deficits and Objective Stereoscopic Vision Deficits in Individuals With Acquired Brain Injury

Individuals with acquired brain injury have reported subjective complaints of depth perception deficits, but few have undergone objective assessments to confirm these deficits. As a result, the literature currently lacks reports detailing the correlation between subjective depth perception deficits and objective stereoscopic vision deficits in individuals with acquired brain injury, particularly those cases that are characterized by a clearly defined lesion. To investigate this relationship, we recruited three individuals with acquired brain injury who experienced depth perception deficits and related difficulties in their daily lives. We had them take neurologic, ophthalmological, and neuropsychological examinations. We also had them take two types of stereoscopic vision tests: a Howard-Dolman-type stereoscopic vision test and the Topcon New Objective Stereo Test. Then, we compared the results with those of two control groups: a group with damage to the right hemisphere of the brain and a group of healthy controls. Performance on the two stereoscopic vision tests was severely impaired in the three patients. One of the patients also presented with cerebral diplopia. We identified the potential neural basis of these deficits in the cuneus and the posterior section of the superior parietal lobule, which play a role in vergence fusion and are located in the caudal region of the dorso-dorsal visual pathway, which is known to be crucial not only for visual spatial perception, but also for reaching, grasping, and making hand postures in the further course of that pathway.

Functional organization of posterior parietal cortex circuitry based on inferred information flow

Many studies infer the role of neurons by asking what information can be decoded from their activity or by observing the consequences of perturbing their activity. An alternative approach is to consider information flow between neurons. We applied this approach to the parietal reach region (PRR) and the lateral intraparietal area (LIP) in posterior parietal cortex. Two complementary methods imply that across a range of reaching tasks, information flows primarily from PRR to LIP. This indicates that during a coordinated reach task, LIP has minimal influence on PRR and rules out the idea that LIP forms a general purpose spatial processing hub for action and cognition. Instead, we conclude that PRR and LIP operate in parallel to plan arm and eye movements, respectively, with asymmetric interactions that likely support eye-hand coordination. Similar methods can be applied to other areas to infer their functional relationships based on inferred information flow.

Differential clustering of visual and choice- and saccade-related activity in macaque V3A and CIP

Neurons in sensory and motor cortices tend to aggregate in clusters with similar functional properties. Within the primate dorsal ("where") pathway, an important interface between three-dimensional (3-D) visual processing and motor-related functions consists of two hierarchically organized areas: V3A and the caudal intraparietal (CIP) area. In these areas, 3-D visual information, choice-related activity, and saccade-related activity converge, often at the single-neuron level. Characterizing the clustering of functional properties in areas with mixed selectivity, such as these, may help reveal organizational principles that support sensorimotor transformations. Here we quantified the clustering of visual feature selectivity, choice-related activity, and saccade-related activity by performing correlational and parametric comparisons of the responses of well-isolated, simultaneously recorded neurons in macaque monkeys. Each functional domain showed statistically significant clustering in both areas. However, there were also domain-specific differences in the strength of clustering across the areas. Visual feature selectivity and saccade-related activity were more strongly clustered in V3A than in CIP. In contrast, choice-related activity was more strongly clustered in CIP than in V3A. These differences in clustering may reflect the areas' roles in sensorimotor processing. Stronger clustering of visual and saccade-related activity in V3A may reflect a greater role in within-domain processing, as opposed to cross-domain synthesis. In contrast, stronger clustering of choice-related activity in CIP may reflect a greater role in synthesizing information across functional domains to bridge perception and action.NEW & NOTEWORTHY The occipital and parietal cortices of macaque monkeys are bridged by hierarchically organized areas V3A and CIP. These areas support 3-D visual transformations, carry choice-related activity during 3-D perceptual tasks, and possess saccade-related activity. This study quantifies the functional clustering of neuronal response properties within V3A and CIP for each of these domains. The findings reveal domain-specific cross-area differences in clustering that may reflect the areas' roles in sensorimotor processing.

The parietal architecture binding cognition to sensorimotor integration: a multimodal causal study

Despite human's praxis abilities are unique among primates, comparative observations suggest that these cognitive motor skills could have emerged from exploitation and adaptation of phylogenetically older building blocks, namely the parieto-frontal networks subserving prehension and manipulation. Within this framework, investigating to which extent praxis and prehension-manipulation overlap and diverge within parieto-frontal circuits could help in understanding how human cognition shapes hand actions. This issue has never been investigated by combining lesion mapping and direct electrophysiological approaches in neurosurgical patients. To this purpose, 79 right-handed left-brain tumour patient candidates for awake neurosurgery were selected based on inclusion criteria. First, a lesion mapping was performed in the early postoperative phase to localize the regions associated with an impairment in praxis (imitation of meaningless and meaningful intransitive gestures) and visuo-guided prehension (reaching-to-grasping) abilities. Then, lesion results were anatomically matched with intraoperatively identified cortical and white matter regions, whose direct electrical stimulation impaired the Hand Manipulation Task. The lesion mapping analysis showed that prehension and praxis impairments occurring in the early postoperative phase were associated with specific parietal sectors. Dorso-mesial parietal resections, including the superior parietal lobe and precuneus, affected prehension performance, while resections involving rostral intraparietal and inferior parietal areas affected praxis abilities (covariate clusters, 5000 permutations, cluster-level family-wise error correction P < 0.05). The dorsal bank of the rostral intraparietal sulcus was associated with both prehension and praxis (overlap of non-covariate clusters). Within praxis results, while resection involving inferior parietal areas affected mainly the imitation of meaningful gestures, resection involving intraparietal areas affected both meaningless and meaningful gesture imitation. In parallel, the intraoperative electrical stimulation of the rostral intraparietal and the adjacent inferior parietal lobe with their surrounding white matter during the hand manipulation task evoked different motor impairments, i.e. the arrest and clumsy patterns, respectively. When integrating lesion mapping and intraoperative stimulation results, it emerges that imitation of praxis gestures first depends on the integrity of parietal areas within the dorso-ventral stream. Among these areas, the rostral intraparietal and the inferior parietal area play distinct roles in praxis and sensorimotor process controlling manipulation. Due to its visuo-motor 'attitude', the rostral intraparietal sulcus, putative human homologue of monkey anterior intraparietal, might enable the visuo-motor conversion of the observed gesture (direct pathway). Moreover, its functional interaction with the adjacent, phylogenetic more recent, inferior parietal areas might contribute to integrate the semantic-conceptual knowledge (indirect pathway) within the sensorimotor workflow, contributing to the cognitive upgrade of hand actions.

A focus on the multiple interfaces between action and perception and their neural correlates

Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.

Silence and its effects on the autonomic nervous system: A systematic review

This systematic review explores the influence of silence on the autonomic nervous system. The Polyvagal Theory has been used as a reference model to describe the autonomic nervous system by explaining its role in emotional regulation, social engagement, and adaptive physiological responses. PubMed, Scopus, PsycInfo, EMBASE, and Google Scholar were systematically searched up until July 2023 for relevant studies. The literature search yielded 511 results, and 37 studies were eventually included in this review. Silence affects the autonomic nervous system differently based on whether it is inner or outer silence. Inner silence enhances activity of the ventral vagus, favoring social engagement, and reducing sympathetic nervous system activity and physiological stress. Outer silence, conversely, can induce a heightened state of alertness, potentially triggering vagal brake removal and sympathetic nervous system activation, though with training, it can foster inner silence, preventing such activation. The autonomic nervous system response to silence can also be influenced by other factors such as context, familiarity with silence, presence and quality of outer noise, and empathy.

Left anterior supramarginal gyrus activity during tool use action observation after extensive tool use training

The advanced use of complex tools is considered a primary characteristic of human evolution and technological advancement. However, questions remain regarding whether humans possess unique underlying brain networks that support advanced tool-using abilities. Specifically, previous studies have demonstrated the presence of a structurally and functionally unique region in the left anterior supramarginal gyrus (aSMG), that is consistently active during tool use action observation. This region has been proposed as a primary hub for integrating semantic and technical information to form action plans with tools. However, it is still largely unknown how tool use motor learning affects left aSMG activation or connectivity with other brain regions. To address this, participants with little experience using chopsticks observed an experimenter using chopsticks to perform a novel task while undergoing two functional magnetic resonance imaging (fMRI) scans. Between the scans, participants underwent four weeks of behavioral training where they learned to use chopsticks and achieve proficiency in the observed task. Results demonstrated a significant change in effective connectivity between the left aSMG and the left anterior intraparietal sulcus (aIPS), a region involved in object affordances and planning grasping actions. These findings suggest that during unfamiliar tool use, the left aSMG integrates semantic and technical information to communicate with regions involved with grasp selection, such as the aIPS. This communication then allows appropriate grasps to be planned based on the physical properties of the objects involved and their potential interactions.

A Selective Hand Posture Apraxia in an Individual With Posterior Cortical Atrophy and Probable Corticobasal Syndrome

A selective impairment for making hand postures that are required to use specific tools has rarely been reported in individuals with acquired brain injury, and such an impairment has not been documented at all in individuals with degenerative disorders. We describe an individual with posterior cortical atrophy and probable corticobasal syndrome who was unable to use tools because of an inability to make the proper hand posture required for each tool. This individual was, however, able to use the tools properly once her hand postures were corrected, and her ability to manipulate the tools (ie, timing, arm posture, and amplitude) was intact. Also, she had no difficulty with a test of her manipulation knowledge. Areas of hypoperfusion observed by single-photon emission computerized tomography included the anterior intraparietal sulcus in the left parietal lobe, which is an area that has been proposed to control hand postures. This selective impairment might be explained by the reasoning-based hypothesis for apraxia, which attributes hand posture errors in the absence of manipulation errors to dysfunction in one of the three independent pathways that subserve tool use, rather than the manipulation-based hypothesis for apraxia, which attributes hand posture errors to impaired manipulation knowledge. This is the first case with a degenerative disorder that revealed a selective impairment for making hand postures for tool use, which might be explained mainly by apraxia of hand postures along with visuospatial dysfunction (simultanagnosia) and/or sensory disturbance.

Ultra-high field fMRI identifies an action-observation network in the common marmoset

The observation of others' actions activates a network of temporal, parietal and premotor/prefrontal areas in macaque monkeys and humans. This action-observation network (AON) has been shown to play important roles in social action monitoring, learning by imitation, and social cognition in both species. It is unclear whether a similar network exists in New-World primates, which separated from Old-Word primates ~35 million years ago. Here we used ultra-high field fMRI at 9.4 T in awake common marmosets (Callithrix jacchus) while they watched videos depicting goal-directed (grasping food) or non-goal-directed actions. The observation of goal-directed actions activates a temporo-parieto-frontal network, including areas 6 and 45 in premotor/prefrontal cortices, areas PGa-IPa, FST and TE in occipito-temporal region and areas V6A, MIP, LIP and PG in the occipito-parietal cortex. These results show overlap with the humans and macaques' AON, demonstrating the existence of an evolutionarily conserved network that likely predates the separation of Old and New-World primates.

Activation of Cerebellum, Basal Ganglia and Thalamus During Observation and Execution of Mouth, hand, and foot Actions

Humans and monkey studies showed that specific sectors of cerebellum and basal ganglia activate not only during execution but also during observation of hand actions. However, it is unknown whether, and how, these structures are engaged during the observation of actions performed by effectors different from the hand. To address this issue, in the present fMRI study, healthy human participants were required to execute or to observe grasping acts performed with different effectors, namely mouth, hand, and foot. As control, participants executed and observed simple movements performed with the same effectors. The results show that: (1) execution of goal-directed actions elicited somatotopically organized activations not only in the cerebral cortex but also in the cerebellum, basal ganglia, and thalamus; (2) action observation evoked cortical, cerebellar and subcortical activations, lacking a clear somatotopic organization; (3) in the territories displaying shared activations between execution and observation, a rough somatotopy could be revealed in both cortical, cerebellar and subcortical structures. The present study confirms previous findings that action observation, beyond the cerebral cortex, also activates specific sectors of cerebellum and subcortical structures and it shows, for the first time, that these latter are engaged not only during hand actions observation but also during the observation of mouth and foot actions. We suggest that each of the activated structures processes specific aspects of the observed action, such as performing internal simulation (cerebellum) or recruiting/inhibiting the overt execution of the observed action (basal ganglia and sensory-motor thalamus).

Action Observation Network Activity Related to Object-Directed and Socially-Directed Actions in Adolescents

The human action observation network (AON) encompasses brain areas consistently engaged when we observe other's actions. Although the core nodes of the AON are present from childhood, it is not known to what extent they are sensitive to different action features during development. Because social cognitive abilities continue to mature during adolescence, the AON response to socially-oriented actions, but not to object-related actions, may differ in adolescents and adults. To test this hypothesis, we scanned with functional magnetic resonance imaging (fMRI) male and female typically-developing teenagers (n = 28; 13 females) and adults (n = 25; 14 females) while they passively watched videos of manual actions varying along two dimensions: sociality (i.e., directed toward another person or not) and transitivity (i.e., involving an object or not). We found that action observation recruited the same fronto-parietal and occipito-temporal regions in adults and adolescents. The modulation of voxel-wise activity according to the social or transitive nature of the action was similar in both groups of participants. Multivariate pattern analysis, however, revealed that decoding accuracies in intraparietal sulcus (IPS)/superior parietal lobe (SPL) for both sociality and transitivity were lower for adolescents compared with adults. In addition, in the lateral occipital temporal cortex (LOTC), generalization of decoding across the orthogonal dimension was lower for sociality only in adolescents. These findings indicate that the representation of the content of others' actions, and in particular their social dimension, in the adolescent AON is still not as robust as in adults.SIGNIFICANCE STATEMENT The activity of the action observation network (AON) in the human brain is modulated according to the purpose of the observed action, in particular the extent to which it involves interaction with an object or with another person. How this conceptual representation of actions is implemented during development is largely unknown. Here, using multivoxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data, we discovered that, while the action observation network is in place in adolescence, the fine-grain organization of its posterior regions is less robust than in adults to decode the abstract social dimensions of an action. This finding highlights the late maturation of social processing in the human brain.

Categorization learning induced changes in action representations in the macaque STS

Neuroimaging and single cell recordings have demonstrated the presence of STS body category-selective regions (body patches) containing neurons responding to presentation of static bodies and body parts. To date, it remains unclear if these body patches and additional STS regions respond during observation of different categories of dynamic actions and to what extent categorization learning influences representations of observed actions in the STS. In the present study, we trained monkeys to discriminate videos depicting three different actions categories (grasping, touching and reaching) with a forced-choice action categorization task. Before and after categorization training, we performed fMRI recordings while monkeys passively observed the same action videos. At the behavioral level, after categorization training, monkeys generalized to untrained action exemplars, in particular for grasping actions. Before training, uni- and/or multivariate fMRI analyses suggest a broad representation of dynamic action categories in particular in posterior and middle STS. Univariate analysis further suggested action category specific training effects in middle and anterior body patches, face patch ML and posterior STS region MT and FST. Overall, our fMRI experiments suggest a widespread representation of observed dynamic bodily actions in the STS that can be modulated by visual learning, supporting its proposed role in action recognition.

Complementary contribution of the medial and lateral human parietal cortex to grasping: a repetitive TMS study

The dexterous control of our grasping actions relies on the cooperative activation of many brain areas. In the parietal lobe, 2 grasp-related areas collaborate to orchestrate an accurate grasping action: dorsolateral area AIP and dorsomedial area V6A. Single-cell recordings in monkeys and fMRI studies in humans have suggested that both these areas specify grip aperture and wrist orientation, but encode these grasping parameters differently, depending on the context. To elucidate the causal role of phAIP and hV6A, we stimulated these areas, while participants were performing grasping actions (unperturbed grasping). rTMS over phAIP impaired the wrist orientation process, whereas stimulation over hV6A impaired grip aperture encoding. In a small percentage of trials, an unexpected reprogramming of grip aperture or wrist orientation was required (perturbed grasping). In these cases, rTMS over hV6A or over phAIP impaired reprogramming of both grip aperture and wrist orientation. These results represent the first direct demonstration of a different encoding of grasping parameters by 2 grasp-related parietal areas.

Parallel processing, hierarchical transformations, and sensorimotor associations along the 'where' pathway

Visually guided behaviors require the brain to transform ambiguous retinal images into object-level spatial representations and implement sensorimotor transformations. These processes are supported by the dorsal ‘where’ pathway. However, the specific functional contributions of areas along this pathway remain elusive due in part to methodological differences across studies. We previously showed that macaque caudal intraparietal (CIP) area neurons possess robust 3D visual representations, carry choice- and saccade-related activity, and exhibit experience-dependent sensorimotor associations (Chang et al., 2020b). Here, we used a common experimental design to reveal parallel processing, hierarchical transformations, and the formation of sensorimotor associations along the ‘where’ pathway by extending the investigation to V3A, a major feedforward input to CIP. Higher-level 3D representations and choice-related activity were more prevalent in CIP than V3A. Both areas contained saccade-related activity that predicted the direction/timing of eye movements. Intriguingly, the time course of saccade-related activity in CIP aligned with the temporally integrated V3A output. Sensorimotor associations between 3D orientation and saccade direction preferences were stronger in CIP than V3A, and moderated by choice signals in both areas. Together, the results explicate parallel representations, hierarchical transformations, and functional associations of visual and saccade-related signals at a key juncture in the ‘where’ pathway.

Mirror neurons 30 years later: implications and applications

Mirror neurons (MNs) were first described in a seminal paper in 1992 as a class of monkey premotor cells discharging during both action execution and observation. Despite their debated origin and function, recent studies in several species, from birds to humans, revealed that beyond MNs properly so called, a variety of cell types distributed among multiple motor, sensory, and emotional brain areas form a 'mirror mechanism' more complex and flexible than originally thought, which has an evolutionarily conserved role in social interaction. Here, we trace the current limits and envisage the future trends of this discovery, showing that it inspired translational research and the development of new neurorehabilitation approaches, and constitutes a point of no return in social and affective neuroscience.

Decoding point-light displays and fully visible hand grasping actions within the action observation network

Action observation typically recruits visual areas and dorsal and ventral sectors of the parietal and premotor cortex. This network has been collectively termed as extended action observation network (eAON). Within this network, the elaboration of kinematic aspects of biological motion is crucial. Previous studies investigated these aspects by presenting subjects with point-light displays (PLDs) videos of whole-body movements, showing the recruitment of some of the eAON areas. However, studies focused on cortical activation during observation of PLDs grasping actions are lacking. In the present functional magnetic resonance imaging (fMRI) study, we assessed the activation of eAON in healthy participants during the observation of both PLDs and fully visible hand grasping actions, excluding confounding effects due to low-level visual features, motion, and context. Results showed that the observation of PLDs grasping stimuli elicited a bilateral activation of the eAON. Region of interest analyses performed on visual and sensorimotor areas showed no significant differences in signal intensity between PLDs and fully visible experimental conditions, indicating that both conditions evoked a similar motor resonance mechanism. Multivoxel pattern analysis (MVPA) revealed significant decoding of PLDs and fully visible grasping observation conditions in occipital, parietal, and premotor areas belonging to eAON. Data show that kinematic features conveyed by PLDs stimuli are sufficient to elicit a complete action representation, suggesting that these features can be disentangled within the eAON from the features usually characterizing fully visible actions. PLDs stimuli could be useful in assessing which areas are recruited, when only kinematic cues are available, for action recognition, imitation, and motor learning.

Exploring Cognition with Brain-Machine Interfaces

Traditional brain-machine interfaces decode cortical motor commands to control external devices. These commands are the product of higher-level cognitive processes, occurring across a network of brain areas, that integrate sensory information, plan upcoming motor actions, and monitor ongoing movements. We review cognitive signals recently discovered in the human posterior parietal cortex during neuroprosthetic clinical trials. These signals are consistent with small regions of cortex having a diverse role in cognitive aspects of movement control and body monitoring, including sensorimotor integration, planning, trajectory representation, somatosensation, action semantics, learning, and decision making. These variables are encoded within the same population of cells using structured representations that bind related sensory and motor variables, an architecture termed partially mixed selectivity. Diverse cognitive signals provide complementary information to traditional motor commands to enable more natural and intuitive control of external devices.

Human mirror neuron system responsivity to unimodal and multimodal presentations of action

This study aims to clarify unresolved questions from two earlier studies by McGarry et al. Exp Brain Res 218(4): 527-538, 2012 and Kaplan and Iacoboni Cogn Process 8: 103-113, 2007 on human mirror neuron system (hMNS) responsivity to multimodal presentations of actions. These questions are: (1) whether the two frontal areas originally identified by Kaplan and Iacoboni (ventral premotor cortex [vPMC] and inferior frontal gyrus [IFG]) are both part of the hMNS (i.e., do they respond to execution as well as observation), (2) whether both areas yield effects of biologicalness (biological, control) and modality (audio, visual, audiovisual), and (3) whether the vPMC is preferentially responsive to multimodal input. To resolve these questions about the hMNS, we replicated and extended McGarry et al.'s electroencephalography (EEG) study, while incorporating advanced source localization methods. Participants were asked to execute movements (ripping paper) as well as observe those movements across the same three modalities (audio, visual, and audiovisual), all while 64-channel EEG data was recorded. Two frontal sources consistent with those identified in prior studies showed mu event-related desynchronization (mu-ERD) under execution and observation conditions. These sources also showed a greater response to biological movement than to control stimuli as well as a distinct visual advantage, with greater responsivity to visual and audiovisual compared to audio conditions. Exploratory analyses of mu-ERD in the vPMC under visual and audiovisual observation conditions suggests that the hMNS tracks the magnitude of visual movement over time.

Structural and functional motor-network disruptions predict selective action-concept deficits: Evidence from frontal lobe epilepsy

Built on neurodegenerative lesions models, the disrupted motor grounding hypothesis (DMGH) posits that motor-system alterations selectively impair action comprehension. However, major doubts remain concerning the dissociability, neural signatures, and etiological generalizability of such deficits. Few studies have compared action-concept outcomes between disorders affecting and sparing motor circuitry, and none has examined their multimodal network predictors via data-driven approaches. Here, we first assessed action- and object-concept processing in patients with frontal lobe epilepsy (FLE), patients with posterior cortex epilepsy (PCE), and healthy controls. Then, we examined structural and functional network signatures via diffusion tensor imaging and resting-state connectivity measures. Finally, we used these measures to predict behavioral performance with an XGBoost machine learning regression algorithm. Relative to controls, FLE (but not PCE) patients exhibited selective action-concept deficits together with structural and functional abnormalities along motor networks. The XGBoost model reached a significantly large effect size only for action-concept outcomes in FLE, mainly predicted by structural (cortico-spinal tract, anterior thalamic radiation, uncinate fasciculus) and functional (M1-parietal/supramarginal connectivity) motor networks. These results extend the DMGH, suggesting that action-concept deficits are dissociable markers of frontal/motor (relative to posterior) disruptions, directly related to the structural and functional integrity of motor networks, and traceable beyond canonical movement disorders.

Parietal maps of visual signals for bodily action planning

The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.

Decoding grip type and action goal during the observation of reaching-grasping actions: A multivariate fMRI study

During execution and observation of reaching-grasping actions, the brain must encode, at the same time, the final action goal and the type of grip necessary to achieve it. Recently, it has been proposed that the Mirror Neuron System (MNS) is involved not only in coding the final goal of the observed action, but also the type of grip used to grasp the object. However, the specific contribution of the different areas of the MNS, at both cortical and subcortical level, in disentangling action goal and grip type is still unclear. Here, twenty human volunteers participated in an fMRI study in which they performed two tasks: (a) observation of four different types of actions, consisting in reaching-to-grasp a box handle with two possible grips (precision, hook) and two possible goals (open, close); (b) action execution, in which participants performed grasping actions similar to those presented during the observation task. A conjunction analysis revealed the presence of shared activated voxels for both action observation and execution within several cortical areas including dorsal and ventral premotor cortex, inferior and superior parietal cortex, intraparietal sulcus, primary somatosensory cortex, and cerebellar lobules VI and VIII. ROI analyses showed a main effect for grip type in several premotor and parietal areas and cerebellar lobule VI, with higher BOLD activation during observation of precision vs hook actions. A grip x goal interaction was also present in the left inferior parietal cortex, with higher BOLD activity during precision-to-close actions. A multivariate pattern analysis (MVPA) revealed a significant accuracy for the grip model in all ROIs, while for the action goal model, significant accuracy was observed only for left inferior parietal cortex ROI. These findings indicate that a large network involving cortical and cerebellar areas is involved in the processing of type of grip, while final action goal appears to be mainly processed within the inferior parietal region, suggesting a differential contribution of the areas activated in this study.

The Complex Hodological Architecture of the Macaque Dorsal Intraparietal Areas as Emerging from Neural Tracers and DW-MRI Tractography

In macaque monkeys, dorsal intraparietal areas are involved in several daily visuomotor actions. However, their border and sources of cortical afferents remain loosely defined. Combining retrograde histologic tracing and MRI diffusion-based tractography, we found a complex hodology of the dorsal bank of the intraparietal sulcus (db-IPS), which can be subdivided into a rostral intraparietal area PEip, projecting to the spinal cord, and a caudal medial intraparietal area MIP lacking such projections. Both include an anterior and a posterior sector, emerging from their ipsilateral, gradient-like connectivity profiles. As tractography estimations, we used the cross-sectional area of the white matter bundles connecting each area with other parietal and frontal regions, after selecting regions of interest (ROIs) corresponding to the injection sites of neural tracers. For most connections, we found a significant correlation between the proportions of cells projecting to all sectors of PEip and MIP along the continuum of the db-IPS and tractography. The latter also revealed “false positive” but plausible connections awaiting histologic validation.

Local and system mechanisms for action execution and observation in parietal and premotor cortices

The action observation network (AON) includes a system of brain areas largely shared with action execution in both human and nonhuman primates. Yet temporal and tuning specificities of distinct areas and of physiologically identified neuronal classes in the encoding of self and others’ action remain unknown. We recorded the activity of 355 single units from three crucial nodes of the AON, the anterior intraparietal area (AIP), and premotor areas F5 and F6, while monkeys performed a Go/No-Go grasping task and observed an experimenter performing it. At the system level, during task execution, F6 displays a prevalence of suppressed neurons and signals whether an action has to be performed, whereas AIP and F5 share a prevalence of facilitated neurons and remarkable target selectivity; during task observation, F5 stands out for its unique prevalence of facilitated neurons and its stronger and earlier modulation than AIP and F6. By applying unsupervised clustering of spike waveforms, we found distinct cell classes unevenly distributed across areas, with different firing properties and carrying specific visuomotor signals. Broadly spiking neurons exhibited a balanced amount of facilitated and suppressed activity during action execution and observation, whereas narrower spiking neurons showed more mutually facilitated responses during the execution of one’s own and others’ action, particularly in areas AIP and F5. Our findings elucidate the time course of activity and firing properties of neurons in the AON during one’s own and others’ action, from the system level of anatomically distinct areas to the local level of physiologically distinct cell classes.

•

F6 neurons show a prevalence of suppressed activity, encoding whether to act

•

Area F5 and AIP share a prevalence of facilitated neurons and target selectivity

•

Across-areas, waveform-based clustering distinguished three neuronal classes

•

Narrow-spiking neurons exhibit mutual modulation during self and others’ action

Colors and Handles: How Action Primes Perception

How deeply does action influence perception? Does action performance affect the perception of object features directly related to action only? Or does it concern also object features such as colors, which are not held to directly afford action? The present study aimed at answering these questions. We asked participants to repeatedly grasp a handled mug hidden from their view before judging whether a visually presented mug was blue rather than cyan. The motor training impacted on their perceptual judgments, by speeding participants' responses, when the handle of the presented mug was spatially aligned with the trained hand. The priming effect did not occur when participants were trained to merely touch the mug with their hand closed in a fist. This indicates that action performance may shape the perceptual judgment on object features, even when these features are colors and do not afford any action. How we act on surrounding objects is therefore not without consequence for how we experience them.

Chronic musculoskeletal impairment is associated with alterations in brain regions responsible for the production and perception of movement

KEY POINTS

Massive irreparable rotator cuff tear was used as a model to study the impact of chronic pain and motor impairment on the motor systems of the human brain using magnetic resonance imaging. Patients show markers of lower grey/white matter integrity and lower functional connectivity compared with control participants in regions responsible for movement and the perception of visual movement and body shape. An independent cohort of patients showed relative deficits in the perception of visual motion and hand laterality compared with an age-matched control group. These data support the hypothesis that the structure and function of the motor control system differs in patients who have experienced chronic motor impairment. This work also raises a new hypothesis, supported by neuroimaging and behaviour, that a loss of motor function could also be associated with off-target effects, namely a reduced ability to perceive motion and body form.

ABSTRACT

Changes in the way we move can induce changes in the brain, yet we know little of such plasticity in relation to musculoskeletal diseases. Here we use massive irreparable rotator cuff tear as a model to study the impact of chronic motor impairment and pain on the human brain. Cuff tear destabilises the shoulder, impairing upper-limb function in overhead and load-bearing tasks. We used neuroimaging and behavioural testing to investigate how brain structure and function differed in cuff tear patients and controls (imaging: 21 patients, age 76.3 ± 7.68; 18 controls, age 74.9 ± 6.59; behaviour: 13 patients, age 75.5 ± 10.2; 11 controls, age 73.4 ± 5.01). We observed lower grey matter density and cortical thickness in cuff tear patients in the postcentral gyrus, inferior parietal lobule, temporal-parietal junction and the pulvinar - areas implicated in somatosensation, reach/grasp and body form perception. In patients we also observed lower functional connectivity between the motor network and the middle temporal visual cortex (MT), a region involved in visual motion perception. Lower white matter integrity was observed in patients in the inferior fronto-occipital/longitudinal fasciculi. We investigated the cognitive domains associated with the brain regions identified. Patients exhibited relative impairment in visual body judgements and the perception of biological/global motion. These data support our initial hypothesis that cuff tear is associated with differences in the brain's motor control regions in comparison with unaffected individuals. Moreover, our combination of neuroimaging and behavioural data raises a new hypothesis that chronic motor impairment is associated with an altered perception of visual motion and body form.

From Observed Action Identity to Social Affordances

Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.

Histological assessment of a chronically implanted cylindrically-shaped, polymer-based neural probe in the monkey

OBJECTIVE

Previous studies demonstrated the possibility to fabricate stereo-electroencephalography (SEEG) probes with high channel count and great design freedom, which incorporate macro- as well as micro-electrodes offering potential benefits for the pre-surgical evaluation of drug resistant epileptic patients. These new polyimide probes allowed to record local field potentials and multi-unit activity in the macaque monkey as early as one hour after implantation, yielding stable single-unit activity for up to 26 days after implantation. The findings opened new perspectives for investigating mechanisms underlying focal epilepsy and its treatment, but before moving to possible human applications, safety data are needed. Thus, in the present study we evaluate the biocompatibility of this new neural interface by assessing post-mortem the reaction of brain tissue along and around the probe implantation site.

APPROACH

Three probes were implanted, independently, in the brain of one monkey (Macaca mulatta) at different times. We used specific immunostaining methods for visualizing neuronal cells and astrocytes, for measuring the extent of damage caused by the probe and for relating it with the implantation time.

MAIN RESULTS

The size of the region where neurons cannot be detected did not exceed the size of the probe, indicating that a complete loss of neuronal cells is only present where the probe was physically positioned in the brain. Furthermore, around the probe shank, we observed a slightly reduced number of neurons within a radius of 50 µm and a modest increase in the number of astrocytes within 100 µm.

SIGNIFICANCE

In the light of previous electrophysiological findings, the present biocompatibility data suggest the potential usefulness and safety of this probe for human applications.

A shared neural substrate for action verbs and observed actions in human posterior parietal cortex

High-level sensory and motor cortical areas are activated when processing the meaning of language, but it is unknown whether, and how, words share a neural substrate with corresponding sensorimotor representations. We recorded from single neurons in human posterior parietal cortex (PPC) while participants viewed action verbs and corresponding action videos from multiple views. We find that PPC neurons exhibit a common neural substrate for action verbs and observed actions. Further, videos were encoded with mixtures of invariant and idiosyncratic responses across views. Action verbs elicited selective responses from a fraction of these invariant and idiosyncratic neurons, without preference, thus associating with a statistical sampling of the diverse sensory representations related to the corresponding action concept. Controls indicated that the results are not the product of visual imagery or arbitrary learned associations. Our results suggest that language may activate the consolidated visual experience of the reader.

Motor resonance in monkey parietal and premotor cortex during action observation: Influence of viewing perspective and effector identity

Observing others performing motor acts like grasping has been shown to elicit neural responses in the observer`s parieto-frontal motor network, which typically becomes active when the observer would perform these actions him/herself. While some human studies suggested strongest motor resonance during observation of first person or egocentric perspectives compared to third person or allocentric perspectives, other research either report the opposite or did not find any viewpoint-related preferences in parieto-premotor cortices. Furthermore, it has been suggested that these motor resonance effects are lateralized in the parietal cortex depending on the viewpoint and identity of the observed effector (left vs right hand). Other studies, however, do not find such straightforward hand identity dependent motor resonance effects. In addition to these conflicting findings in human studies, to date, little is known about the modulatory role of viewing perspective and effector identity (left or right hand) on motor resonance effects in monkey parieto-premotor cortices. Here, we investigated the extent to which different viewpoints of observed conspecific hand actions yield motor resonance in rhesus monkeys using fMRI. Observing first person, lateral and third person viewpoints of conspecific hand actions yielded significant activations throughout the so-called action observation network, including STS, parietal and frontal cortices. Although region-of-interest analysis of parietal and premotor motor/mirror neuron regions AIP, PFG and F5, showed robust responses in these regions during action observation in general, a clear preference for egocentric or allocentric perspectives was not evident. Moreover, except for lateralized effects due to visual field biases, motor resonance in the monkey brain during grasping observation did not reflect hand identity dependent coding.

A parietal region processing numerosity of observed actions: An FMRI study

When observing others' behavior, it is important to perceive not only the identity of the observed actions (OAs), but also the number of times they were performed. Given the mounting evidence implicating posterior parietal cortex in action observation, and in particular that of manipulative actions, the aim of this study was to identify the parietal region, if any, that contributes to the processing of observed manipulative action (OMA) numerosity, using the functional magnetic resonance imaging technique. Twenty‐one right‐handed healthy volunteers performed two discrimination tasks while in the scanner, responding to video stimuli in which an actor performed manipulative actions on colored target balls that appeared four times consecutively. The subjects discriminated between two small numerosities of either OMAs (“Action” condition) or colors of balls (“Ball” condition). A significant difference between the “Action” and “Ball” conditions was observed in occipito‐temporal cortex and the putative human anterior intraparietal sulcus (phAIP) area as well as the third topographic map of numerosity‐selective neurons at the post‐central sulcus (NPC3) of the left parietal cortex. A further region of interest analysis of the group‐average data showed that at the single voxel level the latter area, more than any other parietal or occipito‐temporal numerosity map, favored numerosity of OAs. These results suggest that phAIP processes the identity of OMAs, while neighboring NPC3 likely processes the numerosity of the identified OAs.

Activation of cerebellum and basal ganglia during the observation and execution of manipulative actions

Studies on action observation mostly described the activation of a network of cortical areas, while less investigation focused specifically on the activation and role of subcortical nodes. In the present fMRI study, we investigated the recruitment of cerebellum and basal ganglia during the execution and observation of object manipulation performed with the right hand. The observation conditions consisted in: (a) observation of manipulative actions; (b) observation of sequences of random finger movements. In the execution conditions, participants had to perform the same actions or movements as in (a) and (b), respectively. The results of conjunction analysis showed significant shared activations during both observation and execution of manipulation in several subcortical structures, including: (1) cerebellar lobules V, VI, crus I, VIIIa and VIIIb (bilaterally); (2) globus pallidus, bilaterally, and left subthalamic nucleus; (3) red nucleus (bilaterally) and left thalamus. These findings support the hypothesis that the action observation/execution network also involves subcortical structures, such as cerebellum and basal ganglia, forming an integrated network. This suggests possible mechanisms, involving these subcortical structures, underlying learning of new motor skills, through action observation and imitation.

Movement initiation and grasp representation in premotor and primary motor cortex mirror neurons

Pyramidal tract neurons (PTNs) within macaque rostral ventral premotor cortex (F5) and (M1) provide direct input to spinal circuitry and are critical for skilled movement control. Contrary to initial hypotheses, they can also be active during action observation, in the absence of any movement. A population-level understanding of this phenomenon is currently lacking. We recorded from single neurons, including identified PTNs, in (M1) (n = 187), and F5 (n = 115) as two adult male macaques executed, observed, or withheld (NoGo) reach-to-grasp actions. F5 maintained a similar representation of grasping actions during both execution and observation. In contrast, although many individual M1 neurons were active during observation, M1 population activity was distinct from execution, and more closely aligned to NoGo activity, suggesting this activity contributes to withholding of self-movement. M1 and its outputs may dissociate initiation of movement from representation of grasp in order to flexibly guide behaviour.

Stable readout of observed actions from format-dependent activity of monkey's anterior intraparietal neurons

The anterior intraparietal area (AIP) is a crucial hub in the observed manipulative action (OMA) network of primates. While macaques observe manipulative action videos, their AIP neuronal activity robustly encodes first the viewpoint from which the action is observed, then the actor’s body posture, and finally the observed-action identity. Despite the lack of fully invariant OMA-selective single neurons, OMA exemplars could be decoded accurately from the activity of a set of units that maintain stable OMA selectivity despite rescaling their firing rate across formats. We propose that by integrating signals multiplicatively about others’ action and their visual format, the AIP can provide a stable readout of OMA identity at the population level.

Humans accurately identify observed actions despite large dynamic changes in their retinal images and a variety of visual presentation formats. A large network of brain regions in primates participates in the processing of others’ actions, with the anterior intraparietal area (AIP) playing a major role in routing information about observed manipulative actions (OMAs) to the other nodes of the network. This study investigated whether the AIP also contributes to invariant coding of OMAs across different visual formats. We recorded AIP neuronal activity from two macaques while they observed videos portraying seven manipulative actions (drag, drop, grasp, push, roll, rotate, squeeze) in four visual formats. Each format resulted from the combination of two actor’s body postures (standing, sitting) and two viewpoints (lateral, frontal). Out of 297 recorded units, 38% were OMA-selective in at least one format. Robust population code for viewpoint and actor’s body posture emerged shortly after stimulus presentation, followed by OMA selectivity. Although we found no fully invariant OMA-selective neuron, we discovered a population code that allowed us to classify action exemplars irrespective of the visual format. This code depends on a multiplicative mixing of signals about OMA identity and visual format, particularly evidenced by a set of units maintaining a relatively stable OMA selectivity across formats despite considerable rescaling of their firing rate depending on the visual specificities of each format. These findings suggest that the AIP integrates format-dependent information and the visual features of others’ actions, leading to a stable readout of observed manipulative action identity.

Neural Representation of Observed, Imagined, and Attempted Grasping Force in Motor Cortex of Individuals with Chronic Tetraplegia

Hybrid kinetic and kinematic intracortical brain-computer interfaces (iBCIs) have the potential to restore functional grasping and object interaction capabilities in individuals with tetraplegia. This requires an understanding of how kinetic information is represented in neural activity, and how this representation is affected by non-motor parameters such as volitional state (VoS), namely, whether one observes, imagines, or attempts an action. To this end, this work investigates how motor cortical neural activity changes when three human participants with tetraplegia observe, imagine, and attempt to produce three discrete hand grasping forces with the dominant hand. We show that force representation follows the same VoS-related trends as previously shown for directional arm movements; namely, that attempted force production recruits more neural activity compared to observed or imagined force production. Additionally, VoS-modulated neural activity to a greater extent than grasping force. Neural representation of forces was lower than expected, possibly due to compromised somatosensory pathways in individuals with tetraplegia, which have been shown to influence motor cortical activity. Nevertheless, attempted forces (but not always observed or imagined forces) could be decoded significantly above chance, thereby potentially providing relevant information towards the development of a hybrid kinetic and kinematic iBCI.

Functional links between sensory representations, choice activity, and sensorimotor associations in parietal cortex

Three-dimensional (3D) representations of the environment are often critical for selecting actions that achieve desired goals. The success of these goal-directed actions relies on 3D sensorimotor transformations that are experience-dependent. Here we investigated the relationships between the robustness of 3D visual representations, choice-related activity, and motor-related activity in parietal cortex. Macaque monkeys performed an eight-alternative 3D orientation discrimination task and a visually guided saccade task while we recorded from the caudal intraparietal area using laminar probes. We found that neurons with more robust 3D visual representations preferentially carried choice-related activity. Following the onset of choice-related activity, the robustness of the 3D representations further increased for those neurons. We additionally found that 3D orientation and saccade direction preferences aligned, particularly for neurons with choice-related activity, reflecting an experience-dependent sensorimotor association. These findings reveal previously unrecognized links between the fidelity of ecologically relevant object representations, choice-related activity, and motor-related activity.

Mirror neurons precede non-mirror neurons during action execution

Mirror neurons are thought to represent an individual's ability to understand the actions of others by discharging as one individual performs or observes another individual performing an action. Studies typically have focused on mirror neuron activity during action observation, examining activity during action execution primarily to validate mirror neuron involvement in the motor act. As a result, little is known about the precise role of mirror neurons during action execution. In this study, during execution of reach-grasp-manipulate movements, we found activity of mirror neurons generally preceded that of non-mirror neurons. Not only did the onset of task-related modulation occur earlier in mirror neurons, but state transitions detected by hidden Markov models also occurred earlier in mirror neuron populations. Our findings suggest that mirror neurons may be at the forefront of action execution.NEW & NOTEWORTHY Mirror neurons commonly are thought to provide a neural substrate for understanding the actions of others, but mirror neurons also are active during action execution, when additional, non-mirror neurons are active as well. Examining the timing of activity during execution of a naturalistic reach-grasp-manipulate task, we found that mirror neuron activity precedes that of non-mirror neurons at both the unit and the population level. Thus mirror neurons may be at the leading edge of action execution.

Differential neural dynamics underling pragmatic and semantic affordance processing in macaque ventral premotor cortex

Premotor neurons play a fundamental role in transforming physical properties of observed objects, such as size and shape, into motor plans for grasping them, hence contributing to “pragmatic” affordance processing. Premotor neurons can also contribute to “semantic” affordance processing, as they can discharge differently even to pragmatically identical objects depending on their behavioural relevance for the observer (i.e. edible or inedible objects). Here, we compared the response of monkey ventral premotor area F5 neurons tested during pragmatic (PT) or semantic (ST) visuomotor tasks. Object presentation responses in ST showed shorter latency and lower object selectivity than in PT. Furthermore, we found a difference between a transient representation of semantic affordances and a sustained representation of pragmatic affordances at both the single neuron and population level. Indeed, responses in ST returned to baseline within 0.5 s whereas in PT they showed the typical sustained visual-to-motor activity during Go trials. In contrast, during No-go trials, the time course of pragmatic and semantic information processing was similar. These findings suggest that premotor cortex generates different dynamics depending on pragmatic and semantic information provided by the context in which the to-be-grasped object is presented.

The role of putative human anterior intraparietal sulcus area in observed manipulative action discrimination

INTRODUCTION

Although it has become widely accepted that the action observation network (AON) includes three levels (occipito-temporal, parietal and premotor), little is known concerning the specific role of these levels within perceptual tasks probing action observation. Recent single cell studies suggest that the parietal level carries the information required to discriminate between two-alternative observed actions, but do not exclude possible contributions from the other two levels.

METHODS

Two functional magnetic resonance imaging experiments used a task-based attentional modulation paradigm in which subjects viewed videos of an actor performing a manipulative action on a coloured object, and discriminated between either two observed manipulative actions, two actors or two colours.

RESULTS

Both experiments demonstrated that relative to actor and colour discrimination, discrimination between observed manipulative actions involved the putative human anterior intraparietal sulcus (phAIP) area in parietal cortex. In one experiment, where the observed actions also differed with regard to effectors, premotor cortex was also specifically recruited.

CONCLUSIONS

Our results highlight the primary role of parietal cortex in discriminating between two-alternative observed manipulative actions, consistent with the view that this level plays a major role in representing the identity of an observed action.