Congruent activity during action and action observation in motor cortex

Simple visual stimuli are sufficient to drive responses in action observation and execution neurons in macaque ventral premotor cortex

Neurons responding during action execution and action observation were discovered in the ventral premotor cortex 3 decades ago. However, the visual features that drive the responses of action observation/execution neurons (AOENs) have not been revealed at present. We investigated the neural responses of AOENs in ventral premotor area F5c of 4 macaques during the observation of action videos and crucial control stimuli. The large majority of AOENs showed highly phasic responses during the action videos, with a preference for the moment that the hand made contact with the object. They also responded to an abstract shape moving towards but not interacting with an object, even when the shape moved on a scrambled background, implying that most AOENs in F5c do not require the perception of causality or a meaningful action. Additionally, the majority of AOENs responded to static frames of the videos. Our findings show that very elementary stimuli, even without a grasping context, are sufficient to drive responses in F5c AOENs.

Motor cortex retains and reorients neural dynamics during motor imagery

The most prominent characteristic of motor cortex is its activation during movement execution, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioural and imaging studies, it is unknown how the specific activity patterns and temporal dynamics in motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people who retain some residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population activity into three orthogonal subspaces, where one was similarly active during both action and imagery, and the others were active only during a single task type-action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamic features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by reorienting the components related to motor output and/or feedback into a unique, output-null imagery subspace.

Sequence-specific delayed gains in motor fluency evolve after movement observation training in the absence of early sleep

Following physical practice, delayed, consolidation-phase, gains in the performance of the trained finger-to-thumb opposition sequence (FOS) can be expressed, in young adults, only after a sleep interval is afforded. These delayed gains are order-of-movements specific. However, in several perceptual learning tasks, time post-learning, rather than an interval of sleep, may suffice for the expression of delayed performance gains. Here we tested whether the affordance of a sleep interval is necessary for the expression of delayed performance gains after FOS training by repeated observation. Participants were trained by observing videos displaying a left hand repeatedly performing a 5-element FOS. To assess post-session observation-related learning and delayed gains participants were tested in performing the observed (trained) and an unobserved (new, the 5-elements mirror-reversed) FOS sequences. Repeated observation of a FOS conferred no advantage to its performance, compared to the unobserved FOS, immediately after practice. However, a clear advantage for the observed FOS emerged by 12 h post-training, irrespective of whether this interval included sleep or not; the largest gains appeared by 24 h post-training. These results indicate that time-dependent, offline consolidation processes take place after observation training even in the absence of sleep; akin to perceptual learning rather than physical FOS practice.

Active production and passive observation of hand movements shift visual hand location

Which factors influence the perception of our hand location is a matter of current debate. Here, we test if sensorimotor processing contributes to the perception of hand location. We developed a novel visuomotor adaptation procedure to measure whether actively performing hand movements or passively observing them, influences visual perception of hand location. Participants had to point with a handheld controller to a briefly presented visual target. When they reached the remembered position of the target, the controller presented a tactile buzz. In adaptation trials, the tactile buzz was presented when the hand had not yet reached the target. Over the course of trials, participants adapted to the manipulation and pointed to a location between the visual target and the tactile buzz. We measured the perceived location of the hand by flashing a virtual pair of left and right hands before and after adaptation. Participants had to judge which hand they perceived closer to their body on the fronto-parallel plane. After adaptation, they judged the right hand, that corresponded to the hand used during adaptation, to be located further away from the body. We conclude that sensorimotor prediction of the consequences of hand movements shape sensory processing of hand location.

A motor association area in the depths of the central sulcus

Cells in the precentral gyrus directly send signals to the periphery to generate movement and are principally organized as a topological map of the body. We find that movement-induced electrophysiological responses from depth electrodes extend this map three-dimensionally throughout the gyrus. Unexpectedly, this organization is interrupted by a previously undescribed motor association area in the depths of the midlateral aspect of the central sulcus. This 'Rolandic motor association' (RMA) area is active during movements of different body parts from both sides of the body and may be important for coordinating complex behaviors.

Ultra-high field fMRI identifies an action-observation network in the common marmoset

The observation of others' actions activates a network of temporal, parietal and premotor/prefrontal areas in macaque monkeys and humans. This action-observation network (AON) has been shown to play important roles in social action monitoring, learning by imitation, and social cognition in both species. It is unclear whether a similar network exists in New-World primates, which separated from Old-Word primates ~35 million years ago. Here we used ultra-high field fMRI at 9.4 T in awake common marmosets (Callithrix jacchus) while they watched videos depicting goal-directed (grasping food) or non-goal-directed actions. The observation of goal-directed actions activates a temporo-parieto-frontal network, including areas 6 and 45 in premotor/prefrontal cortices, areas PGa-IPa, FST and TE in occipito-temporal region and areas V6A, MIP, LIP and PG in the occipito-parietal cortex. These results show overlap with the humans and macaques' AON, demonstrating the existence of an evolutionarily conserved network that likely predates the separation of Old and New-World primates.

Activation of Cerebellum, Basal Ganglia and Thalamus During Observation and Execution of Mouth, hand, and foot Actions

Humans and monkey studies showed that specific sectors of cerebellum and basal ganglia activate not only during execution but also during observation of hand actions. However, it is unknown whether, and how, these structures are engaged during the observation of actions performed by effectors different from the hand. To address this issue, in the present fMRI study, healthy human participants were required to execute or to observe grasping acts performed with different effectors, namely mouth, hand, and foot. As control, participants executed and observed simple movements performed with the same effectors. The results show that: (1) execution of goal-directed actions elicited somatotopically organized activations not only in the cerebral cortex but also in the cerebellum, basal ganglia, and thalamus; (2) action observation evoked cortical, cerebellar and subcortical activations, lacking a clear somatotopic organization; (3) in the territories displaying shared activations between execution and observation, a rough somatotopy could be revealed in both cortical, cerebellar and subcortical structures. The present study confirms previous findings that action observation, beyond the cerebral cortex, also activates specific sectors of cerebellum and subcortical structures and it shows, for the first time, that these latter are engaged not only during hand actions observation but also during the observation of mouth and foot actions. We suggest that each of the activated structures processes specific aspects of the observed action, such as performing internal simulation (cerebellum) or recruiting/inhibiting the overt execution of the observed action (basal ganglia and sensory-motor thalamus).

Engaging distributed cortical and cerebellar networks through motor execution, observation, and imagery

When we interact with the environment around us, we are sometimes active participants, making directed physical motor movements and other times only mentally engaging with our environment, taking in sensory information and internally planning our next move without directed physical movement. Traditionally, cortical motor regions and key subcortical structures such as the cerebellum have been tightly linked to motor initiation, coordination, and directed motor behavior. However, recent neuroimaging studies have noted the activation of the cerebellum and wider cortical networks specifically during various forms of motor processing, including the observations of actions and mental rehearsal of movements through motor imagery. This phenomenon of cognitive engagement of traditional motor networks raises the question of how these brain regions are involved in the initiation of movement without physical motor output. Here, we will review evidence for distributed brain network activation during motor execution, observation, and imagery in human neuroimaging studies as well as the potential for cerebellar involvement specifically in motor-related cognition. Converging evidence suggests that a common global brain network is involved in both movement execution and motor observation or imagery, with specific task-dependent shifts in these global activation patterns. We will further discuss underlying cross-species anatomical support for these cognitive motor-related functions as well as the role of cerebrocerebellar communication during action observation and motor imagery.

Motor cortex retains and reorients neural dynamics during motor imagery

The most prominent role of motor cortex is generating patterns of neural activity that lead to movement, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioral and imaging studies, it is unknown how the specific activity patterns and temporal dynamics within motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people with residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population-level activity into orthogonal subspaces such that one set of components was similarly active during both action and imagery, and others were only active during a single task typeâ€"action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamical features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by recreating the missing components related to motor output and/or feedback within a unique imagery-only subspace.

Tickle contagion in the rat somatosensory cortex

The cellular mechanisms of emotional contagion are unknown. We investigated tickle contagion and the underlying neuronal representations in playful rats. We recorded trunk somatosensory cortex activity of observer rats while they received tickling and audiovisual playback of tickling footage and while they witnessed tickling of demonstrator rats. Observers vocalized and showed "Freudensprünge" ("joy jumps") during witnessing live tickling, while they showed little behavioral responses to playbacks. Deep layers in the trunk somatosensory neurons showed a larger correlation between direct and witnessed tickling responses compared to superficial layers. Trunk somatosensory neurons discharged upon emission of own and demonstrator's vocalizations and might drive contagious "laughter". We conclude that trunk somatosensory cortex might represent ticklishness contagion.

Corticomotor Plasticity Underlying Priming Effects of Motor Imagery on Force Performance

The neurophysiological processes underlying the priming effects of motor imagery (MI) on force performance remain poorly understood. Here, we tested whether the priming effects of embedded MI practice involved short-term changes in corticomotor connectivity. In a within-subjects counterbalanced experimental design, participants (n = 20) underwent a series of experimental sessions consisting of successive maximal isometric contractions of elbow flexor muscles. During inter-trial rest periods, we administered MI, action observation (AO), and a control passive recovery condition. We collected electromyograms (EMG) from both agonists and antagonists of the force task, in addition to electroencephalographic (EEG) brain potentials during force trials. Force output was higher during MI compared to AO and control conditions (both p < 0.01), although fatigability was similar across experimental conditions. We also found a weaker relationship between triceps brachii activation and force output during MI and AO compared to the control condition. Imaginary coherence topographies of alpha (8−12 Hz) oscillations revealed increased connectivity between EEG sensors from central scalp regions and EMG signals from agonists during MI, compared to AO and control. Present results suggest that the priming effects of MI on force performance are mediated by a more efficient cortical drive to motor units yielding reduced agonist/antagonist coactivation.

Decoding point-light displays and fully visible hand grasping actions within the action observation network

Action observation typically recruits visual areas and dorsal and ventral sectors of the parietal and premotor cortex. This network has been collectively termed as extended action observation network (eAON). Within this network, the elaboration of kinematic aspects of biological motion is crucial. Previous studies investigated these aspects by presenting subjects with point-light displays (PLDs) videos of whole-body movements, showing the recruitment of some of the eAON areas. However, studies focused on cortical activation during observation of PLDs grasping actions are lacking. In the present functional magnetic resonance imaging (fMRI) study, we assessed the activation of eAON in healthy participants during the observation of both PLDs and fully visible hand grasping actions, excluding confounding effects due to low-level visual features, motion, and context. Results showed that the observation of PLDs grasping stimuli elicited a bilateral activation of the eAON. Region of interest analyses performed on visual and sensorimotor areas showed no significant differences in signal intensity between PLDs and fully visible experimental conditions, indicating that both conditions evoked a similar motor resonance mechanism. Multivoxel pattern analysis (MVPA) revealed significant decoding of PLDs and fully visible grasping observation conditions in occipital, parietal, and premotor areas belonging to eAON. Data show that kinematic features conveyed by PLDs stimuli are sufficient to elicit a complete action representation, suggesting that these features can be disentangled within the eAON from the features usually characterizing fully visible actions. PLDs stimuli could be useful in assessing which areas are recruited, when only kinematic cues are available, for action recognition, imitation, and motor learning.

Action Understanding Promoted by Interoception in Children: A Developmental Model

Action understanding of children develops from simple associative learning to mentalizing. With the rise of embodied cognition, the role of interoception in action observation and action understanding has received more attention. From a developmental perspective, this study proposes a novel developmental model that explores how interoception promotes action understanding of children across ages. In early infancy, most actions observed in infants come from interactions with their caregivers. Babies learn about action effects through automatic interoceptive processing and interoceptive feedback. Interoception in early infancy is not fully developed, such as the not fully developed gastrointestinal tract and intestinal nervous system. Therefore, in early infancy, action understanding is based on low-level and original interoceptive information. At this stage, after observing the actions of others, infants can create mental representations or even imitate actions without external visual feedback, which requires interoception to provide internal reference information. By early childhood, children begin to infer action intentions of other people by integrating various types of information to reach the mentalizing level. Interoception processing requires the integration of multiple internal signals, which promotes the information integration ability of children. Interoception also provides inner information for reasoning about action intention. This review also discussed the neural mechanisms of interoception and possible ways by which it could promote action understanding of children. In early infancy, the central autonomic neural network (CAN) automatically processes and responds to the actions of caregivers on infants, providing interoceptive information for action understanding of infants. In infancy, the growth of the somatomotor system provides important internal reference information for observing and imitating the actions of infants. In early childhood, the development of interoception of children facilitates the integration of internal and external information, which promotes the mentalization of action understanding of children. According to the proposed developmental model of action understanding of children promoted by interoception, there are multilevel and stage-dependent characteristics that impact the role of interoception in action understanding of children.

Sense of agency for intracortical brain-machine interfaces

Intracortical brain-machine interfaces decode motor commands from neural signals and translate them into actions, enabling movement for paralysed individuals. The subjective sense of agency associated with actions generated via intracortical brain-machine interfaces, the neural mechanisms involved and its clinical relevance are currently unknown. By experimentally manipulating the coherence between decoded motor commands and sensory feedback in a tetraplegic individual using a brain-machine interface, we provide evidence that primary motor cortex processes sensory feedback, sensorimotor conflicts and subjective states of actions generated via the brain-machine interface. Neural signals processing the sense of agency affected the proficiency of the brain-machine interface, underlining the clinical potential of the present approach. These findings show that primary motor cortex encodes information related to action and sensing, but also sensorimotor and subjective agency signals, which in turn are relevant for clinical applications of brain-machine interfaces.

What Happened to Mirror Neurons?

Ten years ago, Perspectives in Psychological Science published the Mirror Neuron Forum, in which authors debated the role of mirror neurons in action understanding, speech, imitation, and autism and asked whether mirror neurons are acquired through visual-motor learning. Subsequent research on these themes has made significant advances, which should encourage further, more systematic research. For action understanding, multivoxel pattern analysis, patient studies, and brain stimulation suggest that mirror-neuron brain areas contribute to low-level processing of observed actions (e.g., distinguishing types of grip) but not to high-level action interpretation (e.g., inferring actors' intentions). In the area of speech perception, although it remains unclear whether mirror neurons play a specific, causal role in speech perception, there is compelling evidence for the involvement of the motor system in the discrimination of speech in perceptually noisy conditions. For imitation, there is strong evidence from patient, brain-stimulation, and brain-imaging studies that mirror-neuron brain areas play a causal role in copying of body movement topography. In the area of autism, studies using behavioral and neurological measures have tried and failed to find evidence supporting the "broken-mirror theory" of autism. Furthermore, research on the origin of mirror neurons has confirmed the importance of domain-general visual-motor associative learning rather than canalized visual-motor learning, or motor learning alone.

Shared population-level dynamics in monkey premotor cortex during solo action, joint action and action observation

Studies of neural population dynamics of cell activity from monkey motor areas during reaching show that it mostly represents the generation and timing of motor behavior. We compared neural dynamics in dorsal premotor cortex (PMd) during the performance of a visuomotor task executed individually or cooperatively and during an observation task. In the visuomotor conditions, monkeys applied isometric forces on a joystick to guide a visual cursor in different directions, either alone or jointly with a conspecific. In the observation condition, they observed the cursor's motion guided by the partner. We found that in PMd neural dynamics were widely shared across action execution and observation, with cursor motion directions more accurately discriminated than task types. This suggests that PMd encodes spatial aspects irrespective of specific behavioral demands. Furthermore, our results suggest that largest components of premotor population dynamics, which have previously been suggested to reflect a transformation from planning to movement execution, may rather reflect higher cognitive-motor processes, such as the covert representation of actions and goals shared across tasks that require movement and those that do not.

The role of dorsal premotor cortex in joint action stopping

Human sensorimotor interaction requires mutual behavioral adaptation as well as shared cognitive task representations (Joint Action, JA). Yet, an under-investigated aspect of JA is the neurobehavioral mechanisms employed to stop actions if the context calls for it. Sparse evidence points to the possible contribution of the left dorsal premotor cortex (lPMd) in sculpting movements according to the socio-interactive context. To clarify this issue, we ran two experiments integrating a classical stop signal paradigm with an ecological JA task. The first behavioral study shows longer Stop performance in the JA condition. In the second, we use transcranial magnetic stimulation to inhibit the lPMd or a control site (vertex). Results show that lPMd modulates the JA stopping performance. Action stopping is an important component of JA coordination, and here we provide evidence that lPMd is a key node of a brain network recruited for online mutual co-adaptation in social contexts.

•

Interaction requires mutual adaptation and a shared cognitive task representation

•

Sensorimotor representations must be negotiated between partners to achieve the goal

•

Motor suppression mechanisms might be essential in Joint Action coordination

•

Dorsal premotor cortex (PMd) plays a key role in guiding Joint Action coordination

Neurons of rat motor cortex become active during both grasping execution and grasping observation

In non-human primates, a subset of frontoparietal neurons (mirror neurons) respond both when an individual executes an action and when it observes another individual performing a similar action.^1-8 Mirror neurons constitute an observation and execution matching system likely involved in others' actions processing^3,5,9 and in a large set of complex cognitive functions.^10,11 Here, we show that the forelimb motor cortex of rats contains neurons presenting mirror properties analogous to those observed in macaques. We provide this evidence by event-related potentials acquired by microelectrocorticography and intracortical single-neuron activity, recorded from the same cortical region during grasping execution and observation. Mirror responses are highly specific, because grasping-related neurons do not respond to the observation of either grooming actions or graspable food alone. These results demonstrate that mirror neurons are present already in species phylogenetically distant from primates, suggesting for them a fundamental, albeit basic, role not necessarily related to higher cognitive functions. Moreover, because murine models have long been valued for their superior experimental accessibility and rapid life cycle, the present finding opens an avenue to new empirical studies tackling questions such as the innate or acquired origin of sensorimotor representations and the effects of social and environmental deprivation on sensorimotor development and recovery.

[Mirror neurons, neural substrate of action understanding?]

In 1992, the Laboratory of Human Physiology at the University of Parma (Italy) publish a study describing "mirror" neurons in the macaque that activate both when the monkey performs an action and when it observes an experimenter performing the same action. The research team behind this discovery postulates that the mirror neurons system is the neural basis of our ability to understand the actions of others, through the motor mapping of the observed action on the observer's motor repertory (direct-matching hypothesis). Nevertheless, this conception met serious criticism. These critics attempt to relativize their function by placing them within a network of neurocognitive and sensory interdependencies. In short, the essential characteristic of these neurons is to combine the processing of sensory information, especially visual, with that of motor information. Their elementary function would be to provide a motor simulation of the observed action, based on visual information from it. They can contribute, with other non-mirror areas, to the identification/prediction of the action goal and to the interpretation of the intention of the actor performing it. Studying the connectivity and high frequency synchronizations of the different brain areas involved in action observation would likely provide important information about the dynamic contribution of mirror neurons to "action understanding". The aim of this review is to provide an up-to-date analysis of the scientific evidence related to mirror neurons and their elementary functions, as well as to shed light on the contribution of these neurons to our ability to interpret and understand others' actions.

Decoding grip type and action goal during the observation of reaching-grasping actions: A multivariate fMRI study

During execution and observation of reaching-grasping actions, the brain must encode, at the same time, the final action goal and the type of grip necessary to achieve it. Recently, it has been proposed that the Mirror Neuron System (MNS) is involved not only in coding the final goal of the observed action, but also the type of grip used to grasp the object. However, the specific contribution of the different areas of the MNS, at both cortical and subcortical level, in disentangling action goal and grip type is still unclear. Here, twenty human volunteers participated in an fMRI study in which they performed two tasks: (a) observation of four different types of actions, consisting in reaching-to-grasp a box handle with two possible grips (precision, hook) and two possible goals (open, close); (b) action execution, in which participants performed grasping actions similar to those presented during the observation task. A conjunction analysis revealed the presence of shared activated voxels for both action observation and execution within several cortical areas including dorsal and ventral premotor cortex, inferior and superior parietal cortex, intraparietal sulcus, primary somatosensory cortex, and cerebellar lobules VI and VIII. ROI analyses showed a main effect for grip type in several premotor and parietal areas and cerebellar lobule VI, with higher BOLD activation during observation of precision vs hook actions. A grip x goal interaction was also present in the left inferior parietal cortex, with higher BOLD activity during precision-to-close actions. A multivariate pattern analysis (MVPA) revealed a significant accuracy for the grip model in all ROIs, while for the action goal model, significant accuracy was observed only for left inferior parietal cortex ROI. These findings indicate that a large network involving cortical and cerebellar areas is involved in the processing of type of grip, while final action goal appears to be mainly processed within the inferior parietal region, suggesting a differential contribution of the areas activated in this study.

Dedicated Representation of Others in the Macaque Frontal Cortex: From Action Monitoring and Prediction to Outcome Evaluation

Social neurophysiology has increasingly addressed how several aspects of self and other are distinctly represented in the brain. In social interactions, the self–other distinction is fundamental for discriminating one’s own actions, intentions, and outcomes from those that originate in the external world. In this paper, we review neurophysiological experiments using nonhuman primates that shed light on the importance of the self–other distinction, focusing mainly on the frontal cortex. We start by examining how the findings are impacted by the experimental paradigms that are used, such as the type of social partner or whether a passive or active interaction is required. Next, we describe the 2 sociocognitive systems: mirror and mentalizing. Finally, we discuss how the self–other distinction can occur in different domains to process different aspects of social information: the observation and prediction of others’ actions and the monitoring of others’ rewards.

Largely shared neural codes for biological and nonbiological observed movements but not for executed actions in monkey premotor areas

The neural processing of others' observed actions recruits a large network of brain regions (the action observation network, AON), in which frontal motor areas are thought to play a crucial role. Since the discovery of mirror neurons (MNs) in the ventral premotor cortex, it has been assumed that their activation was conditional upon the presentation of biological rather than nonbiological motion stimuli, supporting a form of direct visuomotor matching. Nonetheless, nonbiological observed movements have rarely been used as control stimuli to evaluate visual specificity, thereby leaving the issue of similarity among neural codes for executed actions and biological or nonbiological observed movements unresolved. Here, we addressed this issue by recording from two nodes of the AON that are attracting increasing interest, namely the ventro-rostral part of the dorsal premotor area F2 and the mesial pre-supplementary motor area F6 of macaques while they 1) executed a reaching-grasping task, 2) observed an experimenter performing the task, and 3) observed a nonbiological effector moving in the same context. Our findings revealed stronger neuronal responses to the observation of biological than nonbiological movement, but biological and nonbiological visual stimuli produced highly similar neural dynamics and relied on largely shared neural codes, which in turn remarkably differed from those associated with executed actions. These results indicate that, in highly familiar contexts, visuo-motor remapping processes in premotor areas hosting MNs are more complex and flexible than predicted by a direct visuomotor matching hypothesis.

Mirror neurons are modulated by grip force and reward expectation in the sensorimotor cortices (S1, M1, PMd, PMv)

Mirror Neurons (MNs) respond similarly when primates make or observe grasping movements. Recent work indicates that reward expectation influences rostral M1 (rM1) during manual, observational, and Brain Machine Interface (BMI) reaching movements. Previous work showed MNs are modulated by subjective value. Here we expand on the above work utilizing two non-human primates (NHPs), one male Macaca Radiata (NHP S) and one female Macaca Mulatta (NHP P), that were trained to perform a cued reward level isometric grip-force task, where the NHPs had to apply visually cued grip-force to move and transport a virtual object. We found a population of (S1 area 1–2, rM1, PMd, PMv) units that significantly represented grip-force during manual and observational trials. We found the neural representation of visually cued force was similar during observational trials and manual trials for the same units; however, the representation was weaker during observational trials. Comparing changes in neural time lags between manual and observational tasks indicated that a subpopulation fit the standard MN definition of observational neural activity lagging the visual information. Neural activity in (S1 areas 1–2, rM1, PMd, PMv) significantly represented force and reward expectation. In summary, we present results indicating that sensorimotor cortices have MNs for visually cued force and value.

Bypassing use-dependent plasticity in the primary motor cortex to preserve adaptive behavior

Behavioral adaptation, a central feature of voluntary movement, is known to rely on top-down cognitive control. For example, the conflict-adaptation effect on tasks such as the Stroop task leads to better performance (e.g. shorter reaction time) for incongruent trials following an already incongruent one. The role of higher-order cortices in such between-trial adjustments is well documented, however, a specific involvement of the primary motor cortex (M1) has seldom been questioned. Here we studied changes in corticospinal excitability associated with the conflict-adaptation process. For this, we used single-pulse transcranial-magnetic stimulation (TMS) applied between two consecutive trials in an interference flanker task, while measuring motor-evoked potentials (MEPs) after agonistic and antagonistic voluntary movements. In agonist movement, MEP amplitude was modulated by recent movement history with an increase favoring movement repetition, but no significant change in MEP size was observed whether a previous trial was incongruent or congruent. Critically, for an antagonist movement, the relative size of MEPs following incongruent trials correlated positively with the strength of behavioral adaptation measured as the degree of RT shortening across subjects. This post-conflict increase in corticospinal excitability related to antagonist muscle recruitment could compensate for a potential deleterious bias due to recent movement history that favors the last executed action. Namely, it prepares the motor system to rapidly adapt to a changing and unpredictable context by equalizing the preparation for all possible motor responses.

Noise-Correlation Is Modulated by Reward Expectation in the Primary Motor Cortex Bilaterally During Manual and Observational Tasks in Primates

Reward modulation is represented in the motor cortex (M1) and could be used to implement more accurate decoding models to improve brain-computer interfaces (BCIs; Zhao et al., 2018). Analyzing trial-to-trial noise-correlations between neural units in the presence of rewarding (R) and non-rewarding (NR) stimuli adds to our understanding of cortical network dynamics. We utilized Pearson's correlation coefficient to measure shared variability between simultaneously recorded units (32-112) and found significantly higher noise-correlation and positive correlation between the populations' signal- and noise-correlation during NR trials as compared to R trials. This pattern is evident in data from two non-human primates (NHPs) during single-target center out reaching tasks, both manual and action observation versions. We conducted a mean matched noise-correlation analysis to decouple known interactions between event-triggered firing rate changes and neural correlations. Isolated reward discriminatory units demonstrated stronger correlational changes than units unresponsive to reward firing rate modulation, however, the qualitative response was similar, indicating correlational changes within the network as a whole can serve as another information channel to be exploited by BCIs that track the underlying cortical state, such as reward expectation, or attentional modulation. Reward expectation and attention in return can be utilized with reinforcement learning (RL) towards autonomous BCI updating.

Activity in Primary Motor Cortex Related to Visual Feedback

Neural modulation in primate motor cortex exhibits complex patterns. We found that modulation during reaching could be separated into discrete temporal epochs. To determine if these epochs are driven by behavioral events, monkeys performed variations of a center-out reaching task. Monkeys viewed a computer cursor matched to hand position and a radial target at 1 of 16 locations. In some trials, they performed a visuomotor rotation (the cursor moved at an angle to the hand). After adaptation, encoding changes for single units are temporally structured: adaptation could affect one temporal component of a unit's response but not another. In half the normal and perturbed trials, we removed visual feedback before movement. Adaptation-sensitive firing components toward the end of movement are often weak or absent during reaches without feedback. These results show that temporal structure in motor cortical activity is driven by behavior, with a discrete component related to visual feedback.

The Motor Cortex Has Independent Representations for Ipsilateral and Contralateral Arm Movements But Correlated Representations for Grasping

Motor commands for the arm and hand generally arise from the contralateral motor cortex, where most of the relevant corticospinal tract originates. However, the ipsilateral motor cortex shows activity related to arm movement despite the lack of direct connections. The extent to which the activity related to ipsilateral movement is independent from that related to contralateral movement is unclear based on conflicting conclusions in prior work. Here we investigate bilateral arm and hand movement tasks completed by two human subjects with intracortical microelectrode arrays implanted in the left hand and arm area of the motor cortex. Neural activity was recorded while they attempted to perform arm and hand movements in a virtual environment. This enabled us to quantify the strength and independence of motor cortical activity related to continuous movements of each arm. We also investigated the subjects' ability to control both arms through a brain-computer interface. Through a number of experiments, we found that ipsilateral arm movement was represented independently of, but more weakly than, contralateral arm movement. However, the representation of grasping was correlated between the two hands. This difference between hand and arm representation was unexpected and poses new questions about the different ways the motor cortex controls the hands and arms.

Activation of cerebellum and basal ganglia during the observation and execution of manipulative actions

Studies on action observation mostly described the activation of a network of cortical areas, while less investigation focused specifically on the activation and role of subcortical nodes. In the present fMRI study, we investigated the recruitment of cerebellum and basal ganglia during the execution and observation of object manipulation performed with the right hand. The observation conditions consisted in: (a) observation of manipulative actions; (b) observation of sequences of random finger movements. In the execution conditions, participants had to perform the same actions or movements as in (a) and (b), respectively. The results of conjunction analysis showed significant shared activations during both observation and execution of manipulation in several subcortical structures, including: (1) cerebellar lobules V, VI, crus I, VIIIa and VIIIb (bilaterally); (2) globus pallidus, bilaterally, and left subthalamic nucleus; (3) red nucleus (bilaterally) and left thalamus. These findings support the hypothesis that the action observation/execution network also involves subcortical structures, such as cerebellum and basal ganglia, forming an integrated network. This suggests possible mechanisms, involving these subcortical structures, underlying learning of new motor skills, through action observation and imitation.

Play, but not observing play, engages rat medial prefrontal cortex

Rats have elaborate cognitive capacities for playing Hide & Seek. Playing Hide & Seek strongly engages medial prefrontal cortex and the activity of prefrontal cortex neurons reflects the structure of the game. We wondered if prefrontal neurons would also show a mirroring of play-related neural activity. Specifically, we asked how does the activity in the rat medial prefrontal cortex differ when the animal plays itself versus when it observes others playing. Consistent with our previous work, when the animal plays itself we observed medial prefrontal cortex activity that was sharply locked to game events. Observing play, however, did not lead to a comparable activation of rat medial prefrontal cortex. Firing rates during observing play were lower than during real play. The modulation of responses in medial prefrontal cortex by game events was strong during playing Hide & Seek, but weak during observing Hide & Seek. We conclude the rat prefrontal cortex does not mirror play events under our experimental conditions.

Movement initiation and grasp representation in premotor and primary motor cortex mirror neurons

Pyramidal tract neurons (PTNs) within macaque rostral ventral premotor cortex (F5) and (M1) provide direct input to spinal circuitry and are critical for skilled movement control. Contrary to initial hypotheses, they can also be active during action observation, in the absence of any movement. A population-level understanding of this phenomenon is currently lacking. We recorded from single neurons, including identified PTNs, in (M1) (n = 187), and F5 (n = 115) as two adult male macaques executed, observed, or withheld (NoGo) reach-to-grasp actions. F5 maintained a similar representation of grasping actions during both execution and observation. In contrast, although many individual M1 neurons were active during observation, M1 population activity was distinct from execution, and more closely aligned to NoGo activity, suggesting this activity contributes to withholding of self-movement. M1 and its outputs may dissociate initiation of movement from representation of grasp in order to flexibly guide behaviour.

Brain correlates of motor complexity during observed and executed actions

Recently, cortical areas with motor properties have attracted attention widely to their involvement in both action generation and perception. Inferior frontal gyrus (IFG), ventral premotor cortex (PMv) and inferior parietal lobule (IPL), presumably consisting of motor-related areas, are of particular interest, given that they respond to motor behaviors both when they are performed and observed. Converging neuroimaging evidence has shown the functional roles of IFG, PMv and IPL in action understanding. Most studies have focused on the effects of modulations in goals and kinematics of observed actions on the brain response, but little research has explored the effects of manipulations in motor complexity. To address this, we used fNIRS to examine the brain activity in the frontal, motor, parietal and occipital regions, aiming to better understand the brain correlates involved in encoding motor complexity. Twenty-one healthy adults executed and observed two hand actions that differed in motor complexity. We found that motor complexity sensitive brain regions were present in the pars opercularis IFG/PMv, primary motor cortex (M1), IPL/supramarginal gyrus and middle occipital gyrus (MOG) during action execution, and in pars opercularis IFG/PMv and M1 during action observation. Our findings suggest that the processing of motor complexity involves not only M1 but also pars opercularis IFG, PMv and IPL, each of which plays a critical role in action perception and execution.

Propagating Motor Cortical Dynamics Facilitate Movement Initiation

Voluntary movement initiation involves the modulations of large groups of neurons in the primary motor cortex (M1). Yet similar modulations occur during movement planning when no movement occurs. Here, we show that a sequential spatiotemporal pattern of excitability propagates across M1 prior to the movement initiation in one of two oppositely oriented directions along the rostro-caudal axis. Using spatiotemporal patterns of intracortical microstimulation, we find that reaction time increases significantly when stimulation is delivered against, but not with, the natural propagation direction. Functional connections among M1 units emerge at movement that are oriented along the same rostro-caudal axis but not during movement planning. Finally, we show that beta amplitude profiles can more accurately decode muscle activity when they conform to the natural propagating patterns. These findings provide the first causal evidence that large-scale, propagating patterns of cortical excitability are behaviorally relevant and may be a necessary component of movement initiation.

Stabilization of a brain-computer interface via the alignment of low-dimensional spaces of neural activity

The instability of neural recordings can render clinical brain-computer interfaces (BCIs) uncontrollable. Here, we show that the alignment of low-dimensional neural manifolds (low-dimensional spaces that describe specific correlation patterns between neurons) can be used to stabilize neural activity, thereby maintaining BCI performance in the presence of recording instabilities. We evaluated the stabilizer with non-human primates during online cursor control via intracortical BCIs in the presence of severe and abrupt recording instabilities. The stabilized BCIs recovered proficient control under different instability conditions and across multiple days. The stabilizer does not require knowledge of user intent and can outperform supervised recalibration. It stabilized BCIs even when neural activity contained little information about the direction of cursor movement. The stabilizer may be applicable to other neural interfaces and may improve the clinical viability of BCIs.

Muscle-specific modulation of indirect inputs to primary motor cortex during action observation

Single-pulse transcranial magnetic stimulation (spTMS) studies report that movement observation facilitates corticospinal excitability in primary motor cortex (M1) in a muscle-specific manner. However, motor evoked potentials (MEPs) elicited by spTMS are known to reflect the summation of several descending volleys in corticospinal neurons which are evoked via mono- and polysynaptic inputs (so-called indirect waves or I-waves). It is unclear which of these components contribute to the muscle-specific modulation of M1 during action observation. The interactions between different I-waves are reflected in the facilitatory peaks elicited with a short-intracortical facilitation (SICF) protocol when two pulses are sent to M1 at precise intervals (i.e., 1.3, 2.5 or 4.1 ms). Here, we explored the modulation of early and late SICF peaks during action observation by measuring highly specific MEP amplitude changes measured in two muscles (index, FDI and little finger, ADM) while participants observed two different actions (precision and whole-hand grip). Our results demonstrate that both early (1.3 ms) and late (2.5 and 4.1 ms) SICF peaks are modulated in the context of movement observation. However, only the second peak (ISI 2.5 ms) was significantly associated with the muscle-specific modulation of corticospinal excitability as measured with spTMS. This late SICF peak is believed to reflect the activity cortico-cortical pathways involved in the facilitation of muscle-specific representations in M1. Thus, our findings suggest that movement observation leads to widespread activation of different neural circuits within M1, including those mediating cortico-cortical communication.

Coding of Self and Other's Future Choices in Dorsal Premotor Cortex during Social Interaction

Representing others' intentions is central to primate social life. We explored the role of dorsal premotor cortex (PMd) in discriminating between self and others' behavior while two male rhesus monkeys performed a non-match-to-goal task in a monkey-human paradigm. During each trial, two of four potential targets were randomly presented on the right and left parts of a screen, and the monkey or the human was required to choose the one that did not match the previously chosen target. Each agent had to monitor the other's action in order to select the correct target in that agent's own turn. We report neurons that selectively encoded the future choice of the monkey, the human agent, or both. Our findings suggest that PMd activity shows a high degree of self-other differentiation during face-to-face interactions, leading to an independent representation of what others will do instead of entailing self-centered mental rehearsal or mirror-like activities.

Decoding of muscle activity from the sensorimotor cortex in freely behaving monkeys

Remarkable advances have recently been made in the development of Brain-Machine Interface (BMI) technologies for restoring or enhancing motor function. However, the application of these technologies may be limited to patients in static conditions, as these developments have been largely based on studies of animals (e.g., non-human primates) in constrained movement conditions. The ultimate goal of BMI technology is to enable individuals to move their bodies naturally or control external devices without physical constraints. Here, we demonstrate accurate decoding of muscle activity from electrocorticogram (ECoG) signals in unrestrained, freely behaving monkeys. We recorded ECoG signals from the sensorimotor cortex as well as electromyogram signals from multiple muscles in the upper arm while monkeys performed two types of movements with no physical restraints, as follows: forced forelimb movement (lever-pull task) and natural whole-body movement (free movement within the cage). As in previous reports using restrained monkeys, we confirmed that muscle activity during forced forelimb movement was accurately predicted from simultaneously recorded ECoG data. More importantly, we demonstrated that accurate prediction of muscle activity from ECoG data was possible in monkeys performing natural whole-body movement. We found that high-gamma activity in the primary motor cortex primarily contributed to the prediction of muscle activity during natural whole-body movement as well as forced forelimb movement. In contrast, the contribution of high-gamma activity in the premotor and primary somatosensory cortices was significantly larger during natural whole-body movement. Thus, activity in a larger area of the sensorimotor cortex was needed to predict muscle activity during natural whole-body movement. Furthermore, decoding models obtained from forced forelimb movement could not be generalized to natural whole-body movement, which suggests that decoders should be built individually and according to different behavior types. These results contribute to the future application of BMI systems in unrestrained individuals.

Learning from Goal and Action Based Observations Differentially Modulates Functional Motor Cortical Plasticity

Action observation can facilitate motor skill learning and lead to a memory trace in motor representations of action. However, it remains unclear whether the action itself or the goal of the action drive changes in motor representations after learning by observation. We performed two experiments. In Experiment 1, using serial reaction time task and transcranial magnetic stimulation, we showed that observation of right-hand actions during skill learning only increased left motor cortical excitability, leading to behavioral gains in the same hand as the observed hand. In contrast, observing a sequence of visual cue positions devoid of hand action increases motor cortical excitability in both hemispheres and facilitates motor skill learning in the right hand (Experiment 1) and left hand for a mirror-symmetric sequence (Experiment 2). We propose that the encoding of observed movements maps onto motor representations of the same action to form a limb-specific motor memory, whereas the learning of spatial goals forms memory traces in the motor representations in both hemispheres to prepare for potential action in either hand.

Action Observation for Neurorehabilitation in Apraxia

Neurorehabilitation and brain stimulation studies of post-stroke patients suggest that action-observation effects can lead to rapid improvements in the recovery of motor functions and long-term motor cortical reorganization. Apraxia is a clinically important disorder characterized by marked impairment in representing and performing skillful movements [gestures], which limits many daily activities and impedes independent functioning. Recent clinical research has revealed errors of visuo-motor integration in patients with apraxia. This paper presents a rehabilitative perspective focusing on the possibility of action observation as a therapeutic treatment for patients with apraxia. This perspective also outlines impacts on neurorehabilitation and brain repair following the reinforcement of the perceptual-motor coupling. To date, interventions based primarily on action observation in apraxia have not been undertaken.

Two Brains in Action: Joint-Action Coding in the Primate Frontal Cortex

Daily life often requires the coordination of our actions with those of another partner. After 50 years (1968-2018) of behavioral neurophysiology of motor control, the neural mechanisms that allow such coordination in primates are unknown. We studied this issue by recording cell activity simultaneously from dorsal premotor cortex (PMd) of two male interacting monkeys trained to coordinate their hand forces to achieve a common goal. We found a population of "joint-action cells" that discharged preferentially when monkeys cooperated in the task. This modulation was predictive in nature, because in most cells neural activity led in time the changes of the "own" and of the "other" behavior. These neurons encoded the joint-performance more accurately than "canonical action-related cells", activated by the action per se, regardless of the individual versus interactive context. A decoding of joint-action was obtained by combining the two brains' activities, using cells with directional properties distinguished from those associated to the "solo" behaviors. Action observation-related activity studied when one monkey observed the consequences of the partner's behavior, i.e., the cursor's motion on the screen, did not sharpen the accuracy of joint-action cells' representation, suggesting that it plays no major role in encoding joint-action. When monkeys performed with a non-interactive partner, such as a computer, joint-action cells' representation of the other (non-cooperative) behavior was significantly degraded. These findings provide evidence of how premotor neurons integrate the time-varying representation of the self-action with that of a co-actor, thus offering a neural substrate for successful visuomotor coordination between individuals.SIGNIFICANCE STATEMENT The neural bases of intersubject motor coordination were studied by recording cell activity simultaneously from the frontal cortex of two interacting monkeys, trained to coordinate their hand forces to achieve a common goal. We found a new class of cells, preferentially active when the monkeys cooperated, rather than when the same action was performed individually. These "joint-action neurons" offered a neural representation of joint-behaviors by far more accurate than that provided by the "canonical action-related cells", modulated by the action per se regardless of the individual/interactive context. A neural representation of joint-performance was obtained by combining the activity recorded from the two brains. Our findings offer the first evidence concerning neural mechanisms subtending interactive visuomotor coordination between co-acting agents.

Action perception and motor imagery: Mental practice of action

Motor cognition is related to the planning and generation of actions as well as to the recognition and imagination of motor acts. Recently, there is evidence that the motor system participates not only in overt actions but also in mental processes supporting covert actions. Within this framework, we have investigated the cortical areas engaged in execution, observation, and imagination of the same action, by the use of the high resolution quantitative ¹⁴C-deoxyglucose method in monkeys and by fMRI in humans, throughout the entire primate brain. Our data demonstrated that observing or imagining an action excites virtually the same sensory-motor cortical network which supports execution of that same action. In general agreement with the results of five relevant meta-analyses that we discuss extensively, our results imply mental practice, i.e. internal rehearsal of the action including movements and their sensory effects. We suggest that we actively perceive and imagine actions by selecting and running off-line restored sensory-motor memories, by mentally simulating the actions. We provide empirical evidence that mental simulation of actions underlies motor cognition, and conceptual representations are grounded in sensory-motor codes. Motor cognition may, therefore, be embodied and modal. Finally, we consider questions regarding agency attribution and the possible causal or epiphenomenal role the involved sensory-motor network could play in motor cognition.

Neurons in the Macaque Dorsal Premotor Cortex Respond to Execution and Observation of Actions

We identified neurons in dorsal premotor cortex (PMd) of the macaque brain that respond during execution and observation of reaching-to-grasp actions, thus fulfilling the mirror neuron (MirN) criterion. During observation, the percentage of grip-selective MirNs in PMd and area F5 were comparable, and the selectivity indices in the two areas were similar. During execution, F5-MirNs were more selective than PMd–MirNs for grip, which was reflected in the higher selectivity indices in F5 than in PMd. PMd displayed grip-related information earlier than F5 during both conditions. In both areas, the number of neurons exhibiting congruent visual and motor selectivity did not differ from that expected by chance. However, both the PMd and F5 neuronal ensembles provided observation–execution matching, suggesting that the congruency may be achieved in a distributed fashion across the selective elements of the population. Furthermore, representational similarity analysis revealed that grip encoding in PMd and F5 is alike during both observation and execution. Our study provides direct evidence of mirror activity in PMd during observation of forelimb movements, and suggests that PMd is a node of the MirN circuit.

Neural Basis of Action Observation and Understanding From First- and Third-Person Perspectives: An fMRI Study

Understanding the intentions of others while observing their actions is a fundamental aspect of social behavior. However, the differences in neural and functional mechanisms between observing actions from the first-person perspective (1PP) and third-person perspective (3PP) are poorly understood. The present study had two aims: (1) to delineate the neural basis of action observation and understanding from the 1PP and 3PP; and (2) to identify whether there are different activation patterns during action observation and understanding from 1PP and 3PP. We used a blocked functional magnetic resonance imaging (fMRI) experimental design. Twenty-six right-handed participants observed interactions between the right hand and a cup from 1PP and 3PP. The results indicated that both 1PP and 3PP were associated with similar patterns of activation in key areas of the mirror neuron system underlying action observation and understanding. Importantly, besides of the core network of mirror neuron system, we also found that parts of the basal ganglia and limbic system were involved in action observation in both the 1PP and 3PP tasks, including the putamen, insula and hippocampus, providing a more complete understanding of the neural basis for action observation and understanding. Moreover, compared with the 3PP, the 1PP task caused more extensive and stronger activation. In contrast, the opposite comparison revealed that no regions exhibited significantly more activation in the 3PP compared with the 1PP condition. The current results have important implications for understanding the role of the core network underlying the mirror neuron system, as well as parts of the basal ganglia and limbic system, during action observation and understanding.

Single Neuron Firing Rate Statistics in Motor Cortex During Execution and Observation of Movement

Mirror neurons, which fire during both the execution and observation of movement, are believed to play an important role in motor processing and learning. However, much work still remains to understand the similarities and differences in how these neurons compute in the motor cortex during movement execution and observation. Here, we performed experiments where a monkey both executes and observes a center-out-and-back task within the same experimental session. By recording from putatively the same neural population, we were able to analyze and compare single neuron statistics between movement execution and observation. We found that a majority of neurons in the primary motor cortex (M1) and dorsal premotor cortex (PMd) have statistically different firing rate statistics between movement execution and observation. As a result of this difference, we then wondered if neurons during movement observation exhibited a similar characteristic to those during movement execution: changing of preferred directions as a function of movement speed. Interestingly, we found that while observed movement speed is encoded in the neural population, it only alters a small proportion of the neuron's firing rate statistics. These results suggest that neural populations in Ml and PMd process information related to movement differently between execution and observation.