Action observation and execution: What is shared?

Effector-specific improvements in action prediction in left-handed individuals after short-term physical practice

Research has established the influence of short-term physical practice for enhancing action prediction in right-handed (RH) individuals. In addition to benefits of physical practice for these later assessed perceptual-cognitive skills, effector-specific interference has been shown through action-incongruent secondary tasks (motor interference tasks). Here we investigated this experience-driven facilitation of action predictions and effector-specific interference in left-handed (LH) novices, before and after practicing a dart throwing task. Participants watched either RH (n = 19) or LH (n = 24) videos of temporally occluded dart throws, across a control condition and three secondary-task conditions: tone-monitoring, RH or LH force monitoring. These conditions were completed before and after physical practice throwing with the LH. Significantly greater improvement in prediction accuracy was shown post-practice for the LH- versus RH-video group. Consistent with previous work, effector-specific interference was shown, exclusive to the LH-video group. Only when doing the LH force monitoring task did the LH-video group show secondary task interference in prediction accuracy. These data support the idea that short-term physical practice resulted in the development of an effector-specific motor representation. The results are also consistent with other work in RH individuals (showing RH motor interference) and hence rule out the interpretation that these effector specific effects are due to the disruption of more generalized motor processes, thought to be lateralized to the left-hemisphere of the brain.

Harnessing Mirror Neurons: A New Frontier in Parkinson's Disease Rehabilitation-A Scoping Review of the Literature

Background: Parkinson's disease (PD) is a neurodegenerative disorder characterized by motor symptoms such as tremors, rigidity, and bradykinesia. Rehabilitation utilizing mirror neurons leverages the brain's capacity for action observation (AO) and motor imagery (MI) to enhance motor function. This approach involves patients imitating movements observed in therapists or videos, aiming to improve gait, coordination, and overall quality of life. Mirror neuron activation facilitates motor learning and may decelerate disease progression, thus enhancing patient mobility and independence. Methods: This scoping review aimed to map current evidence on PD therapies employing mirror neuron-based rehabilitation. Databases searched included PubMed, PEDro, and Cochrane. The review included randomized controlled trials (RCTs) and systematic reviews that examined the effects of AO and MI in PD rehabilitation. Results: Five studies met the inclusion criteria, encompassing various rehabilitation techniques focusing on AO and MI. These studies consistently demonstrated positive outcomes, such as reduced disease severity and improved quality of life, gait, and balance in PD patients. The activation of mirror neurons through AO and MI was shown to facilitate motor learning and contribute to improved functional mobility. Conclusions: Although the included studies support the beneficial impact of AO and MI techniques in PD rehabilitation, numerous questions remain unresolved. Further research is necessary to evaluate the potential integration of these techniques into standard physiotherapy routines for PD patients. This review highlights the promise of AO and MI in enhancing motor rehabilitation for PD, suggesting the need for more comprehensive studies to validate and refine these therapeutic approaches.

Simultaneous multimodal fNIRS-EEG recordings reveal new insights in neural activity during motor execution, observation, and imagery

Motor execution, observation, and imagery are important skills used in motor learning and rehabilitation. The neural mechanisms underlying these cognitive-motor processes are still poorly understood. We used a simultaneous recording of functional near-infrared spectroscopy (fNIRS) and electroencephalogram (EEG) to elucidate the differences in neural activity across three conditions requiring these processes. Additionally, we used a new method called structured sparse multiset Canonical Correlation Analysis (ssmCCA) to fuse the fNIRS and EEG data and determine the brain regions of neural activity consistently detected by both modalities. Unimodal analyses revealed differentiated activation between conditions; however, the activated regions did not fully overlap across the two modalities (fNIRS: left angular gyrus, right supramarginal gyrus, as well as right superior and inferior parietal lobes; EEG: bilateral central, right frontal, and parietal). These discrepancies might be because fNIRS and EEG detect different signals. Using fused fNIRS-EEG data, we consistently found activation over the left inferior parietal lobe, superior marginal gyrus, and post-central gyrus during all three conditions, suggesting that our multimodal approach identifies a shared neural region associated with the Action Observation Network (AON). This study highlights the strengths of using the multimodal fNIRS-EEG fusion technique for studying AON. Neural researchers should consider using the multimodal approach to validate their findings.

Is motor activity the key to the observation-inflation effect? The role of action simulation

Observing others performing an action can lead to false memories of self-performance - the observation-inflation effect. The action simulation hypothesis proposes that an action simulation caused by people's observation of an action is the key reason for this effect. Previous studies have inconsistent views of this hypothesis. In the present study, we re-examined the role of action simulation and discussed the key aspects of the mental processes associated with it. We examined the hypotheses that (a) the magnitude of the observation-inflation effect would decrease as the action simulation was impeded and (b) the magnitude of the observation-inflation effect would not be significantly different in conditions in which participants watched either a part of a video or a full video. The results are consistent with the hypotheses. This study provides strong evidence that action simulation influences the generation of observation-inflation effects and that the process is continuous and can refer to further action information.

Emergence of perceptuomotor relationships during paleolithic stone toolmaking learning: intersections of observation and practice

Stone toolmaking is a human motor skill which provides the earliest archeological evidence motor skill and social learning. Intentionally shaping a stone into a functional tool relies on the interaction of action observation and practice to support motor skill acquisition. The emergence of adaptive and efficient visuomotor processes during motor learning of such a novel motor skill requiring complex semantic understanding, like stone toolmaking, is not understood. Through the examination of eye movements and motor skill, the current study sought to evaluate the changes and relationship in perceptuomotor processes during motor learning and performance over 90 h of training. Participants' gaze and motor performance were assessed before, during and following training. Gaze patterns reveal a transition from initially high gaze variability during initial observation to lower gaze variability after training. Perceptual changes were strongly associated with motor performance improvements suggesting a coupling of perceptual and motor processes during motor learning.

No evidence for somatosensory attenuation during action observation of self-touch

The discovery of mirror neurons in the macaque brain in the 1990s triggered investigations on putative human mirror neurons and their potential functionality. The leading proposed function has been action understanding: Accordingly, we understand the actions of others by 'simulating' them in our own motor system through a direct matching of the visual information to our own motor programmes. Furthermore, it has been proposed that this simulation involves the prediction of the sensory consequences of the observed action, similar to the prediction of the sensory consequences of our executed actions. Here, we tested this proposal by quantifying somatosensory attenuation behaviourally during action observation. Somatosensory attenuation manifests during voluntary action and refers to the perception of self-generated touches as less intense than identical externally generated touches because the self-generated touches are predicted from the motor command. Therefore, we reasoned that if an observer simulates the observed action and, thus, he/she predicts its somatosensory consequences, then he/she should attenuate tactile stimuli simultaneously delivered to his/her corresponding body part. In three separate experiments, we found a systematic attenuation of touches during executed self-touch actions, but we found no evidence for attenuation when such actions were observed. Failure to observe somatosensory attenuation during observation of self-touch is not compatible with the hypothesis that the putative human mirror neuron system automatically predicts the sensory consequences of the observed action. In contrast, our findings emphasize a sharp distinction between the motor representations of self and others.

Knowledge guides attention to goal-relevant information in older adults

How does viewers’ knowledge guide their attention while they watch everyday events, how does it affect their memory, and does it change with age? Older adults have diminished episodic memory for everyday events, but intact semantic knowledge. Indeed, research suggests that older adults may rely on their semantic memory to offset impairments in episodic memory, and when relevant knowledge is lacking, older adults’ memory can suffer. Yet, the mechanism by which prior knowledge guides attentional selection when watching dynamic activity is unclear. To address this, we studied the influence of knowledge on attention and memory for everyday events in young and older adults by tracking their eyes while they watched videos. The videos depicted activities that older adults perform more frequently than young adults (balancing a checkbook, planting flowers) or activities that young adults perform more frequently than older adults (installing a printer, setting up a video game). Participants completed free recall, recognition, and order memory tests after each video. We found age-related memory deficits when older adults had little knowledge of the activities, but memory did not differ between age groups when older adults had relevant knowledge and experience with the activities. Critically, results showed that knowledge influenced where viewers fixated when watching the videos. Older adults fixated less goal-relevant information compared to young adults when watching young adult activities, but they fixated goal-relevant information similarly to young adults, when watching more older adult activities. Finally, results showed that fixating goal-relevant information predicted free recall of the everyday activities for both age groups. Thus, older adults may use relevant knowledge to more effectively infer the goals of actors, which guides their attention to goal-relevant actions, thus improving their episodic memory for everyday activities.

Neural substrates for sharing intention in action during face-to-face imitation

Face-to-face imitation is a unique social interaction wherein a shared action is executed based on the feedback of the partner. Imitation by the partner is the feedback to the imitatee's action, resulting in sharing actions. The neural mechanisms of the shared representation of action during face-to-face imitation, the core of inter-subjectivity, are not well-known. Here, based on the predictive coding account, we hypothesized that the pair-specific forward internal model is the shared representation of action which is represented by the inter-individual synchronization of some portion of the mirror neuron system. Hyperscanning functional magnetic resonance imaging was conducted during face-to-face interaction in 16 pairs of participants who completed an immediate imitation task of facial expressions. Paired participants were alternately assigned to either an imitator or an imitatee who was prompted to express a happy, sad, or non-emotional face. While neural activation elicited by imitating and being imitated were distinct with little overlap, on-line imitative interaction enhanced inter-brain synchronization in the right inferior parietal lobule that correlated with the similarity in facial movement kinematic profile. This finding indicates a critical role of the right inferior parietal lobule in sharing representation of action as a pair-specific forward internal model through imitative interaction.

Role of the right anterior insular cortex in joint attention-related identification with a partner

Understanding others as intentional agents is critical in social interactions. We perceive others' intentions through identification, a categorical judgment that others should work like oneself. The most primitive form of understanding others' intentions is joint attention (JA). During JA, an initiator selects a shared object through gaze (initiative joint attention, IJA), and the responder follows the direction of the initiator's gaze (reactive joint attention, RJA). Therefore, both participants share the intention of object selection. However, the neural underpinning of shared intention through JA remains unknown. In this study, we hypothesized that JA is represented by inter-individual neural synchronization of the intention-related activity. Additionally, JA requires eye contact that activates the limbic mirror system; therefore, we hypothesized that this system is involved in shared attention through JA. To test these hypotheses, participants underwent hyperscanning fMRI while performing JA tasks. We found that IJA-related activation of the right anterior insular cortex of participants was positively correlated with RJA-related activation of homologous regions in their partners. This area was activated by volitional selection of the target during IJA. Therefore, identification with others by JA is likely accomplished by the shared intentionality of target selection represented by inter-individual synchronization of the right anterior insular cortex.

The topographical organization of motor processing: An ALE meta-analysis on six action domains and the relevance of Broca's region

Action is a cover term used to refer to a large set of motor processes differing in domain specificities (e.g. execution or observation). Here we review neuroimaging evidence on action processing (N = 416; Subjects = 5912) using quantitative Activation Likelihood Estimation (ALE) and Meta-Analytic Connectivity Modeling (MACM) approaches to delineate the functional specificities of six domains: (1) Action Execution, (2) Action Imitation, (3) Motor Imagery, (4) Action Observation, (5) Motor Learning, (6) Motor Preparation. Our results show distinct functional patterns for the different domains with convergence in posterior BA44 (pBA44) for execution, imitation and imagery processing. The functional connectivity network seeding in the motor-based localized cluster of pBA44 differs from the connectivity network seeding in the (language-related) anterior BA44. The two networks implement distinct cognitive functions. We propose that the motor-related network encompassing pBA44 is recruited when processing movements requiring a mental representation of the action itself.

Anticipatory effect of execution on observation: an approach using ExoPinch finger robot

Background/aim

This study aims to explore the mirror neuron system (MNS) involvement using mu (8–12 Hz)/beta (15–25 Hz) band suppression in an action observation-execution paradigm.

Materials and methods

Electrophysiological (EEG) data from 16 electrodes were recorded while 8 participants observed video clips of a hand squeezing a spring. Specifically, the effect of anticipated execution on observation was studied. For this purpose, a fully actuated finger exoskeleton robot was utilized to synchronize observation and execution and to control the execution condition for the partici-pants. Anticipatory effect was created with a randomized robot accompany session.

Results

The results showed that the observational condition (with or without anticipation) interacted with hemisphere at central chan-nels near somatosensory cortex. Additionally, we explored the response of MNS on the kinetics features of visual stimuli (hard or soft spring).

Conclusion

he results showed an interaction effect of kinetics features and hemisphere at frontal channels corresponding nearly to the ventral premotor cortex area of the brain. The activation of mirror neurons in this area plays a crucial role in observational learning. Based on our results, we propose that specific type of visual stimuli can be combined with the functional abilities of the MNS in the ac-tion observation based treatment of hand motor dysfunction of stroke patients to have a positive additional impact.

You or me? Disentangling perspectival, perceptual, and integrative mechanisms in heterotopagnosia

Heterotopagnosia-without-Autotopagnosia (HwA) is characterized by the incapacity to point to body parts on others, but not on one's own body. This has been classically interpreted as related to a self-other distinction, with impaired visual representations of other bodies seen in third person perspective (3PP), besides spared own body somatosensory representations in 1PP. However, HwA could be impacted by a deficit in the integration of visual and somatosensory information in space, that are spatially congruent in the case of one's own body, but not for others' body. Here, we test this hypothesis in a rare neurological patient with HwA, H+, as well as in a control patient with a comparable neuropsychological profile, but without HwA, and in age-matched healthy controls, in two experiments. First, we assessed body part recognition in a new task where somatosensory information from the participant's body and visual information from the target body shown in virtual reality was never aligned in space. Results show that, differently from the flawless performance in controls, H+ committed errors for not only the body of others in 3PP, but for all conditions where the information related to the real and the target body was not spatially congruent. Then, we tested whether the integration between these multisensory bodily cues in space, as during visuo-tactile stimulation in the full-body illusion, improves the patient's performance. Data show that after the stimulation prompting visuo-tactile integration, but not in control conditions, the patient's abilities to process body parts improved up to normal level, thus confirming and extending the first findings. Altogether, these results support a new interpretation of HwA as linked to the matching between somatosensory inputs from one's body and visual information from a body seen at a distance, and encourage the application of multisensory stimulation and virtual reality for the treatment of body-related disorders.

Action perception and motor imagery: Mental practice of action

Motor cognition is related to the planning and generation of actions as well as to the recognition and imagination of motor acts. Recently, there is evidence that the motor system participates not only in overt actions but also in mental processes supporting covert actions. Within this framework, we have investigated the cortical areas engaged in execution, observation, and imagination of the same action, by the use of the high resolution quantitative ¹⁴C-deoxyglucose method in monkeys and by fMRI in humans, throughout the entire primate brain. Our data demonstrated that observing or imagining an action excites virtually the same sensory-motor cortical network which supports execution of that same action. In general agreement with the results of five relevant meta-analyses that we discuss extensively, our results imply mental practice, i.e. internal rehearsal of the action including movements and their sensory effects. We suggest that we actively perceive and imagine actions by selecting and running off-line restored sensory-motor memories, by mentally simulating the actions. We provide empirical evidence that mental simulation of actions underlies motor cognition, and conceptual representations are grounded in sensory-motor codes. Motor cognition may, therefore, be embodied and modal. Finally, we consider questions regarding agency attribution and the possible causal or epiphenomenal role the involved sensory-motor network could play in motor cognition.

Observing Action Sequences Elicits Sequence-Specific Neural Representations in Frontoparietal Brain Regions

Learning new skills by watching others is important for social and motor development throughout the lifespan. Prior research has suggested that observational learning shares common substrates with physical practice at both cognitive and brain levels. In addition, neuroimaging studies have used multivariate analysis techniques to understand neural representations in a variety of domains, including vision, audition, memory, and action, but few studies have investigated neural plasticity in representational space. Therefore, although movement sequences can be learned by observing other people's actions, a largely unanswered question in neuroscience is how experience shapes the representational space of neural systems. Here, across a sample of male and female participants, we combined pretraining and posttraining fMRI sessions with 6 d of observational practice to determine whether the observation of action sequences elicits sequence-specific representations in human frontoparietal brain regions and the extent to which these representations become more distinct with observational practice. Our results showed that observed action sequences are modeled by distinct patterns of activity in frontoparietal cortex and that such representations largely generalize to very similar, but untrained, sequences. These findings advance our understanding of what is modeled during observational learning (sequence-specific information), as well as how it is modeled (reorganization of frontoparietal cortex is similar to that previously shown following physical practice). Therefore, on a more fine-grained neural level than demonstrated previously, our findings reveal how the representational structure of frontoparietal cortex maps visual information onto motor circuits in order to enhance motor performance.

SIGNIFICANCE STATEMENT Learning by watching others is a cornerstone in the development of expertise and skilled behavior. However, it remains unclear how visual signals are mapped onto motor circuits for such learning to occur. Here, we show that observed action sequences are modeled by distinct patterns of activity in frontoparietal cortex and that such representations largely generalize to very similar, but untrained, sequences. These findings advance our understanding of what is modeled during observational learning (sequence-specific information), as well as how it is modeled (reorganization of frontoparietal cortex is similar to that previously shown following physical practice). More generally, these findings demonstrate how motor circuit involvement in the perception of action sequences shows high fidelity to prior work, which focused on physical performance of action sequences.

Linguistic and motor representations of everyday complex actions: an fNIRS investigation

The present work aimed at exploring functional correlates of motor and linguistic representations of everyday actions, with a specific interest in potential sensorimotor activation effects induced by the use of related action sentences. While it is indeed known that observing simple motor acts (e.g., precision grasping) and listening to the sound of specific actions (e.g., walking) activate sensorimotor structures, less is known when we move to more complex behaviors and more abstract linguistic representations (e.g., verbal descriptions). Again, the potential of linguistic representations to facilitate the activation of specific sensorimotor structures during action execution or observation is yet unexplored. We then aimed at investigating hemodynamic activation patterns (via functional near-infrared spectroscopy, fNIRS) within the sensorimotor network during different tasks based on everyday activities. Twenty volunteers were asked to execute (EXE), observe (OBS), or listen (LIS) to brief verbal descriptions of transitive actions, to observe them while listening to their description (OBS-LIS), or to execute them while listening to their description (EXE-LIS). Analyses highlighted that, in the left hemisphere, hemodynamic responses were the lowest during observation of complex actions and observation coupled with listening, greater during simple listening to verbal description of actions, and maximal when participants actually executed complex actions or executed them while listening to their verbal descriptions. The present results suggest that processing verbal descriptions of actions might keep the sensorimotor network more active than simply observing them. Such first pieces of evidence hint at potential implications for novel procedures for rehabilitation of movement and action deficits.

Brain-machine interfaces for rehabilitation of poststroke hemiplegia

Noninvasive brain-machine interfaces (BMIs) are typically associated with neuroprosthetic applications or communication aids developed to assist in daily life after loss of motor function, eg, in severe paralysis. However, BMI technology has recently been found to be a powerful tool to promote neural plasticity facilitating motor recovery after brain damage, eg, due to stroke or trauma. In such BMI paradigms, motor cortical output and input are simultaneously activated, for instance by translating motor cortical activity associated with the attempt to move the paralyzed fingers into actual exoskeleton-driven finger movements, resulting in contingent visual and somatosensory feedback. Here, we describe the rationale and basic principles underlying such BMI motor rehabilitation paradigms and review recent studies that provide new insights into BMI-related neural plasticity and reorganization. Current challenges in clinical implementation and the broader use of BMI technology in stroke neurorehabilitation are discussed.

Influence of Perspective of Action Observation Training on Residual Limb Control in Naïve Prosthesis Usage

Prior work in amputees and partial limb immobilization have shown improved neural and behavioral outcomes in using their residual limb with prosthesis when undergoing observation-based training with a prosthesis-using actor compared to an intact limb. It was posited that these improvements are due to an alignment of user with the actor. It may be affected by visual angles that allow emphasis of critical joint actions which may promote behavioral changes. The purpose of this study was to examine how viewing perspective of observation-based training effects prosthesis adaptation in naïve device users. Twenty nonamputated prosthesis users learned how to use an upper extremity prosthetic device while viewing a training video from either a sagittal or coronal perspective. These views were chosen as they place visual emphasis on different aspects of task performance to the device. The authors found that perspective of actions has a significant role in adaptation of the residual limb while using upper limb prostheses. Perspectives that demonstrate elbow adaptations to prosthesis usage may enhance the functional motor outcomes of action observation therapy. This work has potential implications on how prosthetic device operation is conveyed to persons adapting to prostheses through action observation based therapy.

Obstruction increases activation in the right inferior frontal gyrus

The right inferior frontal gyrus (IFG) is involved in intention understanding during interpersonal interactions. To examine how prior experience of cooperation and competition affects one's right IFG activation in the subsequent interaction, using near-infrared spectroscopy (NIRS) we simultaneously measured paired participants' bilateral IFG activations during a turn-taking game. Participant pairs were assigned to either one of two roles: a Builder taking the initial move to copy a target disk-pattern on monitor and the Partner taking the second move to aid in (cooperation) or to obstruct (competition) the Builder. The experiment consisted of two sessions. One participant (B-P) played as a Builder (B-) in session 1 and changed the role to the Partner (-P) in session 2, and vice versa for the paired participant (P-B). NIRS data in competition demonstrated that the Builder (B-) being obstructed in session 1 showed higher right IFG activation when (s)he took a role of obstructor (-P) in session 2 (the obstructed effect), whereas "the cooperated effect" was not revealed in cooperation. These results suggest that prior experience of being obstructed may facilitate understanding of the Builder and/or the obstructor's tactical move, thereby increasing his/her right IFG activation when one is meant to obstruct in subsequent competitions.

Perceiving what you intend to do from what you do: evidence for embodiment in social interactions

Although action and perception are central components of our interactions with the external world, the most recent experimental investigations also support their implications in the emotional, decision-making, and goal ascription processes in social context. In this article, we review the existing literature supporting this view and highlighting a link between reach-to-grasp motor actions and social communicative processes. First, we discuss the most recent experimental findings showing how the social context subtly influences the execution of object-oriented motor actions. Then, we show that the kinematic characteristics of object-oriented motor actions are modulated by the actor's social intention. Finally, we demonstrate that naïve observers can implicitly take advantage of these kinematic effects for their own motor productions. Considered together, these data are compatible with the embodied cognition framework stating that cognition, and in our case social cognition, is grounded in knowledge associated with past sensory and motor experiences.

Agency in the sensorimotor system and its relation to explicit action awareness

People generally have a strong and immediate intuition whether they are the author of an action or not. Nevertheless, recent psychological studies focused on situations of ambiguous agency. These studies concluded that agency is an inference rather than a direct perception, and is, at least sometimes, illusory. Moreover, shared representations of executed and merely observed actions within the sensorimotor system pose a challenge to the idea that a sense of agency can be grounded within that system. Here, we sought to investigate whether the human motor system is indeed sensitive to whether observed actions are linked to agency or not. In addition, we investigated whether the mere observation of an action has comparable effects on low-level, sensorimotor measures of agency, and on high-level, explicit representations of agency. To this end, we instructed participants to make simple manual movements, and manipulated the temporal correspondence between the movement that they made and the movement that they observed. Motor-evoked potentials to single-pulse TMS were taken as a low-level, sensorimotor measure of agency. To assess explicit representations of agency, participants verbally judged whether or not the observed movement temporally corresponded to the movement they executed. The results showed that corticospinal excitability varied with the degree of temporal correspondence of the executed and observed movements. Moreover, explicit agency judgments could be predicted from corticospinal excitability. This suggests that explicit judgments of agency could be directly based on information within the sensorimotor system.

Perspective taking in language: integrating the spatial and action domains

Language is an inherently social behavior. In this paper, we bring together two research areas that typically occupy distinct sections of the literature: perspective taking in spatial language (whether people represent a scene from their own or a different spatial perspective), and perspective taking in action language (the extent to which they simulate an action as though they were performing that action). First, we note that vocabulary is used inconsistently across the spatial and action domains, and propose a more transparent vocabulary that will allow researchers to integrate action- and spatial-perspective taking. Second, we note that embodied theories of language comprehension often make the narrow assumption that understanding action descriptions involves adopting the perspective of an agent carrying out that action. We argue that comprehenders can adopt embodied action-perspectives other than that of the agent, including those of the patient or an observer. Third, we review evidence showing that perspective taking in spatial language is a flexible process. We argue that the flexibility of spatial-perspective taking provides a means for conversation partners engaged in dialogue to maximize similarity between their situation models. These situation models can then be used as the basis for action language simulations, in which language users adopt a particular action-perspective.

Neural mirroring systems: exploring the EEG μ rhythm in human infancy

How do human children come to understand the actions of other people? What neural systems are associated with the processing of others' actions and how do these systems develop, starting in infancy? These questions span cognitive psychology and developmental cognitive neuroscience, and addressing them has important implications for the study of social cognition. A large amount of research has used behavioral measures to investigate infants' imitation of the actions of other people; a related but smaller literature has begun to use neurobiological measures to study of infants' action representation. Here we focus on experiments employing electroencephalographic (EEG) techniques for assessing mu rhythm desynchronization in infancy, and analyze how this work illuminates the links between action perception and production prior to the onset of language.

The role of prediction in social neuroscience

Research has shown that the brain is constantly making predictions about future events. Theories of prediction in perception, action and learning suggest that the brain serves to reduce the discrepancies between expectation and actual experience, i.e., by reducing the prediction error. Forward models of action and perception propose the generation of a predictive internal representation of the expected sensory outcome, which is matched to the actual sensory feedback. Shared neural representations have been found when experiencing one's own and observing other's actions, rewards, errors, and emotions such as fear and pain. These general principles of the “predictive brain” are well established and have already begun to be applied to social aspects of cognition. The application and relevance of these predictive principles to social cognition are discussed in this article. Evidence is presented to argue that simple non-social cognitive processes can be extended to explain complex cognitive processes required for social interaction, with common neural activity seen for both social and non-social cognitions. A number of studies are included which demonstrate that bottom-up sensory input and top-down expectancies can be modulated by social information. The concept of competing social forward models and a partially distinct category of social prediction errors are introduced. The evolutionary implications of a “social predictive brain” are also mentioned, along with the implications on psychopathology. The review presents a number of testable hypotheses and novel comparisons that aim to stimulate further discussion and integration between currently disparate fields of research, with regard to computational models, behavioral and neurophysiological data. This promotes a relatively new platform for inquiry in social neuroscience with implications in social learning, theory of mind, empathy, the evolution of the social brain, and potential strategies for treating social cognitive deficits.

Dissociable roles of human inferior frontal gyrus during action execution and observation

There has been recent controversy about whether activation in the human inferior frontal gyrus (IFG) and Brodmann Area (BA) 6 when observing actions indicates operation of mirror neurons. Recent functional magnetic resonance imaging (fMRI) data have demonstrated repetition suppression (RS) effects in posterior IFG which are consistent with the presence of mirror neurons in humans. Here we investigated whether there were similar RS effects elsewhere in the IFG and BA6, or whether, instead, activation in other locations may signal operation of alternative mechanisms. Replicating previous findings, we found RS effects in posterior IFG consistent with the operation of mirror neurons. However, these effects were not found in other locations in IFG and BA6. Additionally, activation patterns in anterior regions of IFG suggested dissociable operations when observing and executing actions. Therefore, caution should be exercised when claiming that activations in many locations during action observation indicate the operation of mirror neurons. Activation may instead reflect alternative mechanisms, such as encoding of the semantic features of actions.

Hierarchies in action and motor control

In analyses of the motor system, two hierarchies are often posited: The first-the action hierarchy-is a decomposition of an action into subactions and sub-subactions. The second-the control hierarchy-is a postulated hierarchy in the neural control processes that are supposed to bring about the action. A general assumption in cognitive neuroscience is that these two hierarchies are internally consistent and provide complementary descriptions of neuronal control processes. In this article, we suggest that neither offers a complete explanation and that they cannot be reconciled in a logical or conceptually coherent way. Furthermore, neither pays proper attention to the dynamics and temporal aspects of neural control processes. We will explore an alternative hierarchical organization in which causality is inherent in the dynamics over time. Specifically, high levels of the hierarchy encode more stable (goal-related) representations, whereas lower levels represent more transient (actions and motor acts) kinematics. If employed properly, a hierarchy based on this latter principle of temporal extension is not subject to the problems that plague the traditional accounts.

Understanding motor resonance

The discovery of mirror neurons in monkeys, and the finding of motor activity during action observation in humans are generally regarded to support motor theories of action understanding. These theories take motor resonance to be essential in the understanding of observed actions and the inference of action goals. However, the notions of "resonance," "action understanding," and "action goal" appear to be used ambiguously in the literature. A survey of the literature on mirror neurons and motor resonance yields two different interpretations of the term "resonance," three different interpretations of action understanding, and again three different interpretations of what the goal of an action is. This entails that, unless it is specified what interpretation is used, the meaning of any statement about the relation between these concepts can differ to a great extent. By discussing an experiment we will show that more precise definitions and use of the concepts will allow for better assessments of motor theories of action understanding and hence a more fruitful scientific debate. Lastly, we will provide an example of how the discussed experimental setup could be adapted to test other interpretations of the concepts.

Distinguishing self and other in joint action. Evidence from a musical paradigm

The capacity to distinguish between one's own and others' behavior is a cognitive prerequisite for successful joint action. We employed a musical joint action task to investigate how the brain achieves this distinction. Pianists performed the right-hand part of piano pieces, previously learned bimanually, while the complementary left-hand part either was not executed or was (believed to be) played by a co-performer. This experimental setting served to induce a co-representation of the left-hand part reflecting either the self or the co-performer. Single-pulse transcranial magnetic stimulation was applied to the right primary motor cortex and motor-evoked potentials (MEPs) were recorded from the resting left forearm. Results show that corticospinal excitability was modulated by whether the representation of the left hand was associated with the self or the other, with the MEP amplitude being low and high, respectively. This result remained unchanged in a separate session where participants could neither see nor hear the other but still infer his presence by means of contextual information. Furthermore, the amplitude of MEPs associated with co-performer presence increased with pianists' self-reported empathy. Thus, the sociality of the context modulates action attribution at the level of the motor control system.

Representing others' actions: the role of expertise in the aging mind

A large body of evidence suggests that action execution and action observation share a common representational domain. To date, little is known about age-related changes in these action representations that are assumed to support various abilities such as the prediction of observed actions. The purpose of the present study was to investigate (a) how age affects the ability to predict the time course of observed actions; and (b) whether and to what extent sensorimotor expertise attenuates age-related declines in prediction performance. In a first experiment, older adults predicted the time course of familiar everyday actions less precisely than younger adults. In a second experiment, younger and older figure skating experts as well as age-matched novices were asked to predict the time course of figure skating elements and simple movement exercises. Both young age and sensorimotor expertise had a positive influence on prediction performance of figure skating elements. The expertise-related benefit did not show a transfer to movement exercises. Together, the results suggest a specific decline of action representations in the aging mind. However, extensive sensorimotor experience seems to enable experts to represent actions from their domain of expertise more precisely even in older age.

Interplay Between Action and Movement Intentions During Social Interaction

Observing the movements of another person influences the observer’s intention to execute similar movements. However, little is known about how action intentions formed prior to movement planning influence this effect. In the experiment reported here, we manipulated the congruency of movement intentions and action intentions in a pair of jointly acting individuals (i.e., a participant paired with a confederate coactor) and investigated how congruency influenced performance. Overall, participants initiated actions faster when they had the same action intention as the coactor (i.e., when participants and the coactor were pursuing the same conceptual goal). Participants’ responses were also faster when their and the coactor’s movement intentions were directed to the same spatial location, but only when participants had the same action intention as the coactor. These findings suggest that observers use the same representation to implement their own action intentions that they use to infer other people’s action intentions and also that a dynamic, multitiered intentional mechanism is involved in the processing of other people’s actions.

The self in action effects: selective attenuation of self-generated sounds

The immediate experience of self-agency, that is, the experience of generating and controlling our actions, is thought to be a key aspect of selfhood. It has been suggested that this experience is intimately linked to internal motor signals associated with the ongoing actions. These signals should lead to an attenuation of the sensory consequences of one's own actions and thereby allow classifying them as self-generated. The discovery of shared representations of actions between self and other, however, challenges this idea and suggests similar attenuation of one's own and other's sensory action effects. Here, we tested these assumptions by comparing sensory attenuation of self-generated and observed sensory effects. More specifically, we compared the loudness perception of sounds that were either self-generated, generated by another person or a computer. In two experiments, we found a reduced perception of loudness intensity specifically related to self-generation. Furthermore, the perception of sounds generated by another person and a computer did not differ from each other. These findings indicate that one's own agentive influence upon the outside world has a special perceptual quality which distinguishes it from any sort of external influence, including human and non-human sources. This suggests that a real sense of self-agency is not a socially shared but rather a unique and private experience.

More than one pathway to action understanding

Many believe that the ability to understand the actions of others is made possible by mirror neurons and a network of brain areas known as the action-observation network (AON). Despite nearly two decades of research into mirror neurons and the AON, however, there is little evidence that they enable the inference of the intention of observed actions. Instead, theories of action selection during action execution indicate that a ventral pathway, linking middle temporal gyrus with the anterior inferior frontal gyrus, might encode these abstract features during action observation. Here I propose that action understanding requires more than merely the AON, and might be achieved through interactions between a ventral pathway and the dorsal AON.

Experience with novel actions modulates frontal α EEG desynchronization

There is growing interest in the effects of experience on the neural processes linking action execution and action perception. We tested whether experience with unfamiliar actions can alter desynchronization of alpha-range power in the EEG upon re-observation of those actions. In a training session, participants (N=21) watched videos of novel drawing movements. Half of the movements were imitated after each viewing, and half of the movements were seen but not imitated, thus forming two training conditions: visual plus motor experience (V+M), and visual experience only (VO). In a testing session the next day, participants were shown the same videos of both sets of movements, and were also shown a third, completely novel, set of movements. Imitative performance was better for both training conditions than for novel actions. Event-related EEG desynchronization in the upper alpha band during action observation differed between conditions at frontal electrode sites, with novel actions being associated with less frontal desynchronization compared to V+M and VO actions. Differences between conditions were not noted over other regions. This suggests that moderate amounts of initial experience with novel actions can alter the neural processing of these actions when viewed again, particularly over frontal regions.

Spatiotemporal tuning of the facilitation of biological motion perception by concurrent motor execution

The execution of motor behavior influences concurrent visual action observation and especially the perception of biological motion. The neural mechanisms underlying this interaction between perception and motor execution are not exactly known. In addition, the available experimental evidence is partially inconsistent because previous studies have reported facilitation as well as impairments of action perception by concurrent execution. Exploiting a novel virtual reality paradigm, we investigated the spatiotemporal tuning of the influence of motor execution on the perception of biological motion within a signal-detection task. Human observers were presented with point-light stimuli that were controlled by their own movements. Participants had to detect a point-light arm in a scrambled mask, either while executing waving movements or without concurrent motor execution (baseline). The temporal and spatial coherence between the observed and executed movements was parametrically varied. We found a systematic tuning of the facilitatory versus inhibitory influences of motor execution on biological motion detection with respect to the temporal and the spatial congruency between observed and executed movements. Specifically, we found a gradual transition between facilitatory and inhibitory interactions for decreasing temporal synchrony and spatial congruency. This result provides evidence for a spatiotemporally highly selective coupling between dynamic motor representations and neural structures involved in the visual processing of biological motion. In addition, our study offers a unifying explanation that reconciles contradicting results about modulatory effects of motor execution on biological motion perception in previous studies.

Up and Down, Front and Back

The present study shows how directional movement is related to meaning. We measured the influence of congruent versus incongruent movement – meaning pairings on reaction times in a Stroop-type categorization task. Movement-related words corresponding to the vertical up-down axis (e.g., happiness – grief; successful; to sink) and to the sagittal front-back axis (e.g., tomorrow – yesterday; decisive; to retreat) were coupled with actual movement in the vertical and sagittal axes. The color of the word appearing on a computer screen indicated the movement direction, creating congruent and incongruent movement – meaning trials. Participants reacted faster on congruent trials (e.g., happy – upward movement; decisive – forward movement) than on incongruent trials (e.g., happy – downward movement; decisive – backward movement). Results supported the hypothesized movement – meaning relation for both the vertical and the sagittal dimensions.

"Stay tuned": inter-individual neural synchronization during mutual gaze and joint attention

Eye contact provides a communicative link between humans, prompting joint attention. As spontaneous brain activity might have an important role in the coordination of neuronal processing within the brain, their inter-subject synchronization might occur during eye contact. To test this, we conducted simultaneous functional MRI in pairs of adults. Eye contact was maintained at baseline while the subjects engaged in real-time gaze exchange in a joint attention task. Averted gaze activated the bilateral occipital pole extending to the right posterior superior temporal sulcus, the dorso-medial prefrontal cortex, and the bilateral inferior frontal gyrus. Following a partner's gaze toward an object activated the left intraparietal sulcus. After all the task-related effects were modeled out, inter-individual correlation analysis of residual time-courses was performed. Paired subjects showed more prominent correlations than non-paired subjects in the right inferior frontal gyrus, suggesting that this region is involved in sharing intention during eye contact that provides the context for joint attention.