Encoding of point of view during action observation in the local field potentials of macaque area F5

Representational momentum of biological motion in full-body, point-light and single-dot displays

Observing the actions of others triggers, in our brain, an internal and automatic simulation of its unfolding in time. Here, we investigated whether the instantaneous internal representation of an observed action is modulated by the point of view under which an action is observed and the stimulus type. To this end, we motion captured the elliptical arm movement of a human actor and used these trajectories to animate a photorealistic avatar, a point-light stimulus or a single dot rendered either from an egocentric or an allocentric point of view. Crucially, the underlying physical characteristics of the movement were the same in all conditions. In a representational momentum paradigm, we then asked subjects to report the perceived last position of an observed movement at the moment in which the stimulus was randomly stopped. In all conditions, subjects tended to misremember the last configuration of the observed stimulus as being further forward than the veridical last showed position. This misrepresentation was however significantly smaller for full-body stimuli compared to point-light and single dot displays and it was not modulated by the point of view. It was also smaller when first-person full body stimuli were compared with a stimulus consisting of a solid shape moving with the same physical motion. We interpret these findings as evidence that full-body stimuli elicit a simulation process that is closer to the instantaneous veridical configuration of the observed movements while impoverished displays (both point-light and single-dot) elicit a prediction that is further forward in time. This simulation process seems to be independent from the point of view under which the actions are observed.

Grasp-specific high-frequency broadband mirror neuron activity during reach-and-grasp movements in humans

Broadly congruent mirror neurons, responding to any grasp movement, and strictly congruent mirror neurons, responding only to specific grasp movements, have been reported in single-cell studies with primates. Delineating grasp properties in humans is essential to understand the human mirror neuron system with implications for behavior and social cognition. We analyzed electrocorticography data from a natural reach-and-grasp movement observation and delayed imitation task with 3 different natural grasp types of everyday objects. We focused on the classification of grasp types from high-frequency broadband mirror activation patterns found in classic mirror system areas, including sensorimotor, supplementary motor, inferior frontal, and parietal cortices. Classification of grasp types was successful during movement observation and execution intervals but not during movement retention. Our grasp type classification from combined and single mirror electrodes provides evidence for grasp-congruent activity in the human mirror neuron system potentially arising from strictly congruent mirror neurons.

My view on your actions: Dynamic changes in viewpoint-dependent auditory ERP attenuation during action observation

It has been suggested that during action observation, a sensory representation of the observed action is mapped onto one's own motor system. However, it is largely unexplored what this may imply for the early processing of the action's sensory consequences, whether the observational viewpoint exerts influence on this and how such a modulatory effect might change over time. We tested whether the event-related potential of auditory effects of actions observed from a first- versus third-person perspective show amplitude reductions compared with externally generated sounds, as revealed for self-generated sounds. Multilevel modeling on trial-level data showed distinct dynamic patterns for the two viewpoints on reductions of the N1, P2, and N2 components. For both viewpoints, an N1 reduction for sounds generated by observed actions versus externally generated sounds was observed. However, only during first-person observation, we found a temporal dynamic within experimental runs (i.e., the N1 reduction only emerged with increasing trial number), indicating time-variant, viewpoint-dependent processes involved in sensorimotor prediction during action observation. For the P2, only a viewpoint-independent reduction was found for sounds elicited by observed actions, which disappeared in the second half of the experiment. The opposite pattern was found in an exploratory analysis concerning the N2, revealing a reduction that increased in the second half of the experiment, and, moreover, a temporal dynamic within experimental runs for the first-person perspective, possibly reflecting an agency-related process. Overall, these results suggested that the processing of auditory outcomes of observed actions is dynamically modulated by the viewpoint over time.

I can see my virtual body in a mirror: The role of visual perspective in changing implicit racial attitudes using virtual reality

INTRODUCTION

Recent studies showed that VR is a valid tool to change implicit attitudes toward outgroup members. Here, we extended this work by investigating conditions under which virtual reality (VR) is effective in changing implicit racial attitudes.

METHODS

To this end, participants were embodied in a Black or White avatar and we manipulated the perspective through which they could see their virtual body. Participants in one condition, could see their virtual body both from a first-person perspective (i.e., by looking down toward themselves) and reflected in a mirror placed in front of them in the VR environment. Participants in another condition could instead see their virtual body only from a first-person perspective (i.e., by looking down toward themselves) as no mirror was placed in the VR environment. Implicit racial attitudes were assessed using the Implicit Association Test (IAT) before and immediately after the VR intervention.

RESULTS

Results showed that when White participants were embodied in a Black avatar compared to a White avatar, they showed a decrease in their implicit pro-White attitudes but only when they could see their virtual body both from a first-person perspective and in a mirror.

DISCUSSION

These results suggest that, in immersive virtual reality interventions, the possibility for participants to see their body also reflected in a mirror, might be a critical factor in changing their implicit racial attitudes.

Cognitive genomics of learning delay and low level of social performance monitoring in macaque

Cognitive skills and the underlying neural architecture are under the influence of genetics. Cognitive genomics research explores the triadic relationship between genes, brain, and cognition, with its major strategy being genotype-driven. Here we show that an inverse strategy is feasible to identify novel candidate genes for particular neuro-cognitive phenotypes in macaques. Two monkeys, originally involved in separate psychological studies, exhibited learning delay and low levels of social performance monitoring. In one monkey, mirror neurons were fewer compared to controls and mu suppression was absent in the frontal cortex. The other monkey showed heightened visual responsiveness in both frontal cortex and dopamine-rich midbrain, with a lack of inter-areal synchronization. Exome analyses revealed that the two monkeys were most likely cousins and shared variants in MAP2, APOC1, and potentially HTR2C. This phenotype-driven strategy in cognitive genomics provides a useful means to clarify the genetic basis of phenotypic variation and develop macaque models of neuropsychiatric disorders.

A novel immersive virtual reality environment for the motor rehabilitation of stroke patients: A feasibility study

We designed and implemented an immersive virtual reality (VR) environment for upper limb rehabilitation, which possesses several notable features. First, by exploiting modern computer graphics its can present a variety of scenarios that make the rehabilitation routines challenging yet enjoyable for patients, thus enhancing their adherence to the therapy. Second, immersion in a virtual 3D space allows the patients to execute tasks that are closely related to everyday gestures, thus enhancing the transfer of the acquired motor skills to real-life routines. Third, in addition to the VR environment, we also developed a client app running on a PC that allows to monitor in real-time and remotely the patients’ routines thus paving the way for telerehabilitation scenarios. Here, we report the results of a feasibility study in a cohort of 16 stroke patients. All our patients showed a high degree of comfort in our immersive VR system and they reported very high scores of ownership and agency in embodiment and satisfaction questionnaires. Furthermore, and notably, we found that behavioral performances in our VR tasks correlated with the patients’ clinical scores (Fugl-Meyer scale) and they could thus be used to assess improvements during the rehabilitation program. While further studies are needed, our results clearly support the feasibility and effectiveness of VR-based motor rehabilitation processes.

The Effects of Action Observation Therapy as a Rehabilitation Tool in Parkinson’s Disease Patients: A Systematic Review

During Action Observation (AO), patients observe human movements that they then try to imitate physically. Until now, few studies have investigated the effectiveness of it in Parkinson’s disease (PD). However, due to the diversity of interventions, it is unclear how the dose and characteristics can affect its efficiency. We investigated the AO protocols used in PD, by discussing the intervention features and the outcome measures in relation to their efficacy. A search was conducted through MEDLINE, Scopus, Cochrane, and WoS until November 2021, for RCTs with AO interventions. Participant’s characteristics, treatment features, outcome measures, and main results were extracted from each study. Results were gathered into a quantitative synthesis (MD and 95% CI) for each time point. Seven studies were included in the review, with 227 participants and a mean PEDro score of 6.7. These studies reported positive effects of AO in PD patients, mainly on walking ability and typical motor signs of PD like freezing of gait. However, disagreements among authors exist, mainly due to the heterogeneity of the intervention features. In overall, AO improves functional abilities and motor control in PD patients, with the intervention dose and the characteristics of the stimulus playing a decisive role in its efficacy.

What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context

Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.

The Role of the Medial Prefrontal Cortex in Moderating Neural Representations of Self and Other in Primates

As a frontal node in the primate social brain, the medial prefrontal cortex (MPFC) plays a critical role in coordinating one's own behavior with respect to that of others. Current literature demonstrates that single neurons in the MPFC encode behavior-related variables such as intentions, actions, and rewards, specifically for self and other, and that the MPFC comes into play when reflecting upon oneself and others. The social moderator account of MPFC function can explain maladaptive social cognition in people with autism spectrum disorder, which tips the balance in favor of self-centered perspectives rather than taking into consideration the perspective of others. Several strands of evidence suggest a hypothesis that the MPFC represents different other mental models, depending on the context at hand, to better predict others' emotions and behaviors. This hypothesis also accounts for aberrant MPFC activity in autistic individuals while they are mentalizing others.

A causal role for frontal cortico-cortical coordination in social action monitoring

Decision-making via monitoring others’ actions is a cornerstone of interpersonal exchanges. Although the ventral premotor cortex (PMv) and the medial prefrontal cortex (MPFC) are cortical nodes in social brain networks, the two areas are rarely concurrently active in neuroimaging, inviting the hypothesis that they are functionally independent. Here we show in macaques that the ability of the MPFC to monitor others’ actions depends on input from the PMv. We found that delta-band coherence between the two areas emerged during action execution and action observation. Information flow especially in the delta band increased from the PMv to the MPFC as the biological nature of observed actions increased. Furthermore, selective blockade of the PMv-to-MPFC pathway using a double viral vector infection technique impaired the processing of observed, but not executed, actions. These findings demonstrate that coordinated activity in the PMv-to-MPFC pathway has a causal role in social action monitoring.

Social interactions require monitoring others’ actions to optimally organise one’s own actions. Here, the authors show that the pathway from the ventral premotor cortex (PMv) to the medial prefrontal cortex (MPFC) is causally involved in monitoring observed, but not executed, actions.

Motor resonance in monkey parietal and premotor cortex during action observation: Influence of viewing perspective and effector identity

Observing others performing motor acts like grasping has been shown to elicit neural responses in the observer`s parieto-frontal motor network, which typically becomes active when the observer would perform these actions him/herself. While some human studies suggested strongest motor resonance during observation of first person or egocentric perspectives compared to third person or allocentric perspectives, other research either report the opposite or did not find any viewpoint-related preferences in parieto-premotor cortices. Furthermore, it has been suggested that these motor resonance effects are lateralized in the parietal cortex depending on the viewpoint and identity of the observed effector (left vs right hand). Other studies, however, do not find such straightforward hand identity dependent motor resonance effects. In addition to these conflicting findings in human studies, to date, little is known about the modulatory role of viewing perspective and effector identity (left or right hand) on motor resonance effects in monkey parieto-premotor cortices. Here, we investigated the extent to which different viewpoints of observed conspecific hand actions yield motor resonance in rhesus monkeys using fMRI. Observing first person, lateral and third person viewpoints of conspecific hand actions yielded significant activations throughout the so-called action observation network, including STS, parietal and frontal cortices. Although region-of-interest analysis of parietal and premotor motor/mirror neuron regions AIP, PFG and F5, showed robust responses in these regions during action observation in general, a clear preference for egocentric or allocentric perspectives was not evident. Moreover, except for lateralized effects due to visual field biases, motor resonance in the monkey brain during grasping observation did not reflect hand identity dependent coding.

Perspective-dependent reactivity of sensorimotor mu rhythm in alpha and beta ranges during action observation: an EEG study

During action observation, several visual features of observed actions can modulate the level of sensorimotor reactivity in the onlooker. Among possibly relevant parameters, one of the less investigated in humans is the visual perspective from which actions are observed. In the present EEG study, we assessed the reactivity of alpha and beta mu rhythm subcomponents to four different visual perspectives, defined by the position of the observer relative to the moving agent (identifying first-person, third-person and lateral viewpoints) and by the anatomical compatibility of observed effectors with self- or other individual’s body (identifying ego- and allo-centric viewpoints, respectively). Overall, the strongest sensorimotor responsiveness emerged for first-person perspective. Furthermore, we found different patterns of perspective-dependent reactivity in rolandic alpha and beta ranges, with the former tuned to visuospatial details of observed actions and the latter tuned to action-related parameters (such as the direction of actions relative to the observer), suggesting a higher recruitment of beta motor rhythm in face-to-face interactions. The impact of these findings on the selection of most effective action stimuli for “Action Observation Treatment” neurorehabilitative protocols is discussed.

Reorganization of the Action Observation Network and Sensory-Motor System in Children with Unilateral Cerebral Palsy: An fMRI Study

Little is known about the action observation network (AON) in children with unilateral cerebral palsy (UCP). Using fMRI, we aimed to explore AON and sensory-motor network (SMN) in UCP children and compare them to typically developed (TD) children and analyse the relationship between AON (re-)organization and several neurophysiological and clinical measures. Twelve UCP children were assessed with clinical scales and transcranial magnetic stimulation (TMS). For the fMRI study, they underwent a paradigm based on observation of complex and simple object-manipulation tasks executed by dominant and nondominant hand. Moreover, UCP and TD children carried out a further fMRI session to explore SMN in both an active motor and passive sensory task. AON in the UCP group showed higher lateralization, negatively related to performances on clinical scales, and had greater activation of unaffected hemisphere as compared to the bilateral representation in the TD group. In addition, a good congruence was found between bilateral or contralateral activation of AON and activation of SMN and TMS data. These findings indicate that our paradigm might be useful in exploring AON and the response to therapy in UCP subjects.

Simultaneous scalp recorded EEG and local field potentials from monkey ventral premotor cortex during action observation and execution reveals the contribution of mirror and motor neurons to the mu-rhythm

The desynchronization of alpha and beta oscillations (mu rhythm) in the central scalp EEG during action observation and action execution is thought to reflect neural mirroring processes. However, the extent to which mirror neurons (MNs) or other populations of neurons contribute to such EEG desynchronization is still unknown. Here, we provide the first evidence that, in the monkey, the neuronal activity recorded from the ventral premotor cortex (PMv) strongly contributes to the EEG changes occurring in the beta band over central scalp electrodes, during executed and observed actions. We simultaneously recorded scalp EEG and extracellular activity, Multi Unit Activity (MUA) and Local Field Potentials (LFP), from area F5 of two macaques executing and observing grasping actions. We found that MUA highly correlates with an increase in high gamma LFP power and, interestingly, such LFP power increase also correlates to EEG beta - and in part also to alpha - desynchronization. In terms of timing of signal changes, the increase in high gamma LFP power precedes the EEG desynchronization, during both action observation and execution, thus suggesting a causal role of PMv neuronal activity in the modulation of the alpha and beta mu-rhythm. Lastly, neuronal signals from deeper layers of PMv exert a greater contribution than superficial layers to the EEG beta rhythm modulation, especially during the motor task. Our findings have clear implications for EEG studies in that they demonstrate that the activity of different populations of neurons in PMv contribute to the generation of the mu-rhythm.

Development of social systems neuroscience using macaques

This paper reviews the literature on social neuroscience studies using macaques in the hope of encouraging as many researchers as possible to participate in this field of research and thereby accelerate the system-level understanding of social cognition and behavior. We describe how different parts of the primate brain are engaged in different aspects of social information processing, with particular emphasis on the use of experimental paradigms involving more than one monkey in laboratory settings. The description begins with how individual neurons are used for evaluating socially relevant information, such as the identity, face, and focus of attention of others in various social contexts. A description of the neural bases of social reward processing and social action monitoring follows. Finally, we provide several perspectives on novel experimental strategies to help clarify the nature of interacting brains under more socially and ecologically plausible conditions.

Spatial and viewpoint selectivity for others' observed actions in monkey ventral premotor mirror neurons

The spatial location and viewpoint of observed actions are closely linked in natural social settings. For example, actions observed from a subjective viewpoint necessarily occur within the observer’s peripersonal space. Neurophysiological studies have shown that mirror neurons (MNs) of the monkey ventral premotor area F5 can code the spatial location of live observed actions. Furthermore, F5 MN discharge can also be modulated by the viewpoint from which filmed actions are seen. Nonetheless, whether and to what extent MNs can integrate viewpoint and spatial location of live observed actions remains unknown. We addressed this issue by comparing the activity of 148 F5 MNs while macaque monkeys observed an experimenter grasping in three different combinations of viewpoint and spatial location, namely, lateral view in the (1) extrapersonal and (2) peripersonal space and (3) subjective view in the peripersonal space. We found that the majority of MNs were space-selective (60.8%): those selective for the peripersonal space exhibited a preference for the subjective viewpoint both at the single-neuron and population level, whereas space-unselective neurons were view invariant. These findings reveal the existence of a previously neglected link between spatial and viewpoint selectivity in MN activity during live-action observation.

MEG Multivariate Analysis Reveals Early Abstract Action Representations in the Lateral Occipitotemporal Cortex

Understanding other people's actions is a fundamental prerequisite for social interactions. Whether action understanding relies on simulating the actions of others in the observers' motor system or on the access to conceptual knowledge stored in nonmotor areas is strongly debated. It has been argued previously that areas that play a crucial role in action understanding should (1) distinguish between different actions, (2) generalize across the ways in which actions are performed (Dinstein et al., 2008; Oosterhof et al., 2013; Caramazza et al., 2014), and (3) have access to action information around the time of action recognition (Hauk et al., 2008). Whereas previous studies focused on the first two criteria, little is known about the dynamics underlying action understanding. We examined which human brain regions are able to distinguish between pointing and grasping, regardless of reach direction (left or right) and effector (left or right hand), using multivariate pattern analysis of magnetoencephalography data. We show that the lateral occipitotemporal cortex (LOTC) has the earliest access to abstract action representations, which coincides with the time point from which there was enough information to allow discriminating between the two actions. By contrast, precentral regions, though recruited early, have access to such abstract representations substantially later. Our results demonstrate that in contrast to the LOTC, the early recruitment of precentral regions does not contain the detailed information that is required to recognize an action. We discuss previous theoretical claims of motor theories and how they are incompatible with our data.

SIGNIFICANCE STATEMENT

It is debated whether our ability to understand other people's actions relies on the simulation of actions in the observers' motor system, or is based on access to conceptual knowledge stored in nonmotor areas. Here, using magnetoencephalography in combination with machine learning, we examined where in the brain and at which point in time it is possible to distinguish between pointing and grasping actions regardless of the way in which they are performed (effector, reach direction). We show that, in contrast to the predictions of motor theories of action understanding, the lateral occipitotemporal cortex has access to abstract action representations substantially earlier than precentral regions.

Processing of Own Hand Visual Feedback during Object Grasping in Ventral Premotor Mirror Neurons

Mirror neurons (MNs) discharge during action execution as well as during observation of others' actions. Our own actions are those that we have the opportunity to observe more frequently, but no study thus far to our knowledge has addressed the issue of whether, and to what extent, MNs can code own hand visual feedback (HVF) during object grasping. Here, we show that MNs of the ventral premotor area F5 of macaque monkeys are particularly sensitive to HVF relative to non-MNs simultaneously recorded in the same penetrations. Importantly, the HVF effect is more evident on MN activity during hand-object interaction than during the hand-shaping phase. Furthermore, the increase of MN activity induced by HVF and others' actions observed from a subjective perspective were positively correlated. These findings indicate that at least part of ventral premotor MNs can process the visual information coming from own hand interacting with objects, likely playing a role in self-action monitoring.

SIGNIFICANCE STATEMENT

We show that mirror neurons (MNs) of area F5 of the macaque, in addition to encoding others' observed actions, are particularly sensitive, relative to simultaneously recorded non-MNs, to the sight of the monkey's own hand during object grasping, likely playing a role in self-action monitoring.

A human homologue of monkey F5c

Area F5c is a monkey premotor area housing mirror neurons which responds more strongly to grasping observation when the actor is visible than when only the actor's hand is visible. Here we used this characteristic fMRI signature of F5c in seven imaging experiments – one in macaque monkeys and six in humans – to identify the human homologue of monkey F5c. By presenting the two grasping actions (actor, hand) and varying the low level visual characteristics, we localized a putative human homologue of area F5c (phF5c) in the inferior part of precentral sulcus, bilaterally. In contrast to monkey F5c, phF5c is asymmetric, with a right-sided bias, and is activated more strongly during the observation of the later stages of grasping when the hand is close to the object. The latter characteristic might be related to the emergence, in humans, of the capacity to precisely copy motor acts performed by others, and thus imitation.

•

We use parallel fMRI to identify the human homologue of macaque F5c.

•

In premotor cortex only F5c reacts more to observing grasping with the actor visible.

•

Two bilateral inferior precentral sulcus sites respond similarly for many stimuli.

•

The human homologues of F5c are asymmetric and require fixation near the target.