fMRI adaptation reveals mirror neurons in human inferior parietal cortex

Investigating common coding of observed and executed actions in the monkey brain using cross-modal multi-variate fMRI classification

Mirror neurons are generally described as a neural substrate hosting shared representations of actions, by simulating or 'mirroring' the actions of others onto the observer's own motor system. Since single neuron recordings are rarely feasible in humans, it has been argued that cross-modal multi-variate pattern analysis (MVPA) of non-invasive fMRI data is a suitable technique to investigate common coding of observed and executed actions, allowing researchers to infer the presence of mirror neurons in the human brain. In an effort to close the gap between monkey electrophysiology and human fMRI data with respect to the mirror neuron system, here we tested this proposal for the first time in the monkey. Rhesus monkeys either performed reach-and-grasp or reach-and-touch motor acts with their right hand in the dark or observed videos of human actors performing similar motor acts. Unimodal decoding showed that both executed or observed motor acts could be decoded from numerous brain regions. Specific portions of rostral parietal, premotor and motor cortices, previously shown to house mirror neurons, in addition to somatosensory regions, yielded significant asymmetric action-specific cross-modal decoding. These results validate the use of cross-modal multi-variate fMRI analyses to probe the representations of own and others' actions in the primate brain and support the proposed mapping of others' actions onto the observer's own motor cortices.

MEG adaptation reveals action representations in posterior occipitotemporal regions

When we observe other people's actions, a number of parietal and precentral regions known to be involved in the planning and execution of actions are recruited for example seen as power decreases in alpha and beta frequencies indicative of increased activation. It has been argued that this recruitment reflects the process of simulating the observed action, thereby providing access to the meaning of the action. Alternatively, it has been suggested that rather than providing access to the meaning of an action, parietal and precentral regions might be recruited as a consequence of action understanding. A way to distinguish between these alternatives is to examine where in the brain and at which time point it is possible to discriminate between different types of actions (e.g., pointing or grasping) irrespective of the way these are performed. To this aim, we presented participants with videos of simple hand actions performed with the left or right hand towards a target on the left or the right side while recording magnetoencephalography (MEG) data. In each trial, participants were presented with two subsequent videos (S1, S2) depicting either the same (repeat trials) or different (non-repeat trials) actions. We predicted that areas that are sensitive to the type of action should show stronger adaptation (i.e., a smaller decrease in alpha and beta power) in repeat in comparison to non-repeat trials. Indeed, we observed less alpha and beta power decreases during the presentation of S2 when the action was repeated compared to when two different actions were presented indicating adaptation of neuronal populations that are selective for the type of action. Sources were obtained exclusively in posterior occipitotemporal regions, supporting the notion that an early differentiation of actions occurs outside the motor system.

Corticospinal excitability is modulated by distinct movement patterns during action observation

It is well established that excitability of the primary motor cortex increases during action observation. However, the modulation of motor cortex excitability during observation of different actions, with distinct movement patterns, is not fully understood. The aim of the current study was to examine time-dependent changes in corticospinal excitability during observation of two actions with different levels of complexity. We developed videos of two distinct actions (a point and a reach-and-grasp), that were matched in video length, action onset, and onset of kinematics. Single-pulse transcranial magnetic stimulation was used to investigate time-dependent changes in primary motor cortex excitability during observation of the two actions. Motor evoked potentials (MEP) were recorded from two intrinsic hand muscles, namely first dorsal interosseous (FDI) and abductor digiti minimi. Results showed no difference in MEP amplitude during observation of a static hand compared to observation of the actions. When comparing the point to the grasp action, there were two key findings showing time-dependent changes in motor cortex excitability: first, greater MEP amplitude in FDI during observation of the point than the grasp action at an early time-point (index finger extension) and second, greater MEP amplitude in FDI during observation of the grasp than the point action at a later time-point (hand opening to form a grasp). These results show that excitability of the primary motor cortex is differentially modulated during observation of a point and grasp action, suggesting that the action observation network is engaged in a time-dependent manner during action observation.

Effects of High-Frequency Repetitive Transcranial Magnetic Stimulation Combined with Task-Oriented Mirror Therapy Training on Hand Rehabilitation of Acute Stroke Patients

Background

Impairments of hand function make it difficult to perform daily life activities and to return to work. The aim of this study was to investigate the effect of high-frequency repetitive transcranial magnetic stimulation (HF-rTMS) combined with task-oriented mirror therapy (TOMT) on hand rehabilitation in acute stroke patients.

Material/Methods

Twenty subacute stroke patients in the initial stages (<3 months) participated in the study. Subjects were allocated to 2 groups: the experimental group received HF-rTMS + TOMT and the control group received HF-rTMS. TOMT training was conducted in 10 sessions over 2 weeks for 30 min. rTMS was applied at a 20 Hz frequency over the hand motor area in the cortex of the affected hemisphere for 15 min. Outcomes, including motor-evoked potential (MEP), pinch grip, hand grip, and box and block test, were measured before and after training.

Results

Significant improvements in the MEP and hand function variables were observed in both groups (p<0.05). In particular, hand functions (pinch grip and box and block test) were significantly different between the 2 groups (p<0.05).

Conclusions

HF-rTMS combined with TOMT had a positive effect on hand function and can be used for the rehabilitation of precise hand movements in acute stroke patients.

Modulating Mimetic Preference with Theta Burst Stimulation of the Inferior Parietal Cortex

We like an object more when we see someone else reaching for it. To what extent is action observation causally linked to object valuation? In this study, we set out to answer to this question by applying continuous theta burst stimulation (cTBS) over the left inferior parietal lobule (IPL). Previous studies pointed to this region as critical in the representation of others' actions and in tool manipulation. However, it is unclear to what extent IPL's involvement simply reflects action observation, rather than a casual role in objects' valuation. To clarify this issue, we measured cTBS-dependent modulations of participants' “mimetic preference ratings”, i.e., the difference between the ratings of pairs of familiar objects that were (vs. were not) reached out for by other individuals. Our result shows that cTBS increased mimetic preference ratings for tools, when compared to a control condition without stimulation. This effect was selective for items that were reached for or manipulated by another individual, whilst it was not detected in non-tool objects. Although preliminary, this finding suggests that the automatic and covert simulation of an observed action, even when there is no intention to act on an object, influences explicit affective judgments for objects. This work supports embodied cognition theories by substantiating that our subjective preference is grounded in action.

Repetition suppression: a means to index neural representations using BOLD?

Understanding how the human brain gives rise to complex cognitive processes remains one of the biggest challenges of contemporary neuroscience. While invasive recording in animal models can provide insight into neural processes that are conserved across species, our understanding of cognition more broadly relies upon investigation of the human brain itself. There is therefore an imperative to establish non-invasive tools that allow human brain activity to be measured at high spatial and temporal resolution. In recent years, various attempts have been made to refine the coarse signal available in functional magnetic resonance imaging (fMRI), providing a means to investigate neural activity at the meso-scale, i.e. at the level of neural populations. The most widely used techniques include repetition suppression and multivariate pattern analysis. Human neuroscience can now use these techniques to investigate how representations are encoded across neural populations and transformed by relevant computations. Here, we review the physiological basis, applications and limitations of fMRI repetition suppression with a brief comparison to multivariate techniques. By doing so, we show how fMRI repetition suppression holds promise as a tool to reveal complex neural mechanisms that underlie human cognitive function.

This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’.

The Mirror Neurons Network in Aging, Mild Cognitive Impairment, and Alzheimer Disease: A functional MRI Study

The aim of the current study is to investigate the integrity of the Mirror Neurons (MN) network in normal aging, Mild Cognitive Impairment (MCI), and Alzheimer disease (AD). Although AD and MCI are considered “cognitive” diseases, there has been increasing recognition of a link between motor function and AD. More recently the embodied cognition hypothesis has also been developed: it postulates that a part of cognition results from the coupling between action and perception representations. MN represent a neuronal population which links perception, action, and cognition, therefore we decided to characterize MN functioning in neurodegenerative cognitive decline. Three matched groups of 16 subjects (normal elderly-NE, amnesic MCI with hippocampal atrophy and AD) were evaluated with a focused neuropsychological battery and an fMRI task specifically created to test MN: that comprised of an observation run, where subjects were shown movies of a right hand grasping different objects, and of a motor run, where subjects observed visual pictures of objects oriented to be grasped with the right hand. In NE subjects, the conjunction analysis (comparing fMRI activation during observation and execution), showed the activation of a bilateral fronto-parietal network in “classical” MN areas, and of the superior temporal gyrus (STG). The MCI group showed the activation of areas belonging to the same network, however, parietal areas were activated to a lesser extent and the STG was not activated, while the opposite was true for the right Broca's area. We did not observe any activation of the fronto-parietal network in AD participants. They did not perform as well as the NE subjects in all the neuropsychological tests (including tests of functions attributed to MN) whereas the MCI subjects were significantly different from the NE subjects only in episodic memory and semantic fluency. Here we show that the MN network is largely preserved in aging, while it appears involved following an anterior-posterior gradient in neurodegenerative decline. In AD, task performance decays and the MN network appears clearly deficient. The preservation of the anterior part of the MN network in MCI could possibly supplement the initial decay of the posterior part, preserving cognitive performance.

Object words modulate the activity of the mirror neuron system during action imitation

BACKGROUND

Although research has demonstrated that the mirror neuron system (MNS) plays a crucial role in both action imitation and action-related semantic processing, whether action-related words can inversely modulate the MNS activity remains unclear.

METHODS

Here, three types of task-irrelevant words (body parts, verbs, and manufactured objects) were presented to examine the modulation effect of these words on the MNS activity during action observation and imitation. Twenty-two participants were recruited for the fMRI scanning and remaining data from 19 subjects were reported here.

RESULTS

Brain activity results showed that word types elicited different modulation effects over nodes of the MNS (i.e., the right inferior frontal gyrus, premotor cortex, inferior parietal lobule, and STS), especially during the imitation stage. Compared with other word conditions, action imitation following manufactured objects words induced stronger activation in these brain regions during the imitation stage. These results were consistent in both task-dependent and -independent ROI analysis.

CONCLUSION

Our findings thus provide evidence for the unique effect of object words on the MNS during imitation of action, which may also confirm the key role of goal inference in action imitation.

Neural correlates of empathic accuracy in adolescence

Empathy, the ability to understand others' emotions, can occur through perspective taking and experience sharing. Neural systems active when adults empathize include regions underlying perspective taking (e.g. medial prefrontal cortex; MPFC) and experience sharing (e.g. inferior parietal lobule; IPL). It is unknown whether adolescents utilize networks implicated in both experience sharing and perspective taking when accurately empathizing. This question is critical given the importance of accurately understanding others' emotions for developing and maintaining adaptive peer relationships during adolescence. We extend the literature on empathy in adolescence by determining the neural basis of empathic accuracy, a behavioral assay of empathy that does not bias participants toward the exclusive use of perspective taking or experience sharing. Participants (N = 155, aged 11.1-15.5 years) watched videos of 'targets' describing emotional events and continuously rated the targets' emotions during functional magnetic resonance imaging scanning. Empathic accuracy related to activation in regions underlying perspective taking (MPFC, temporoparietal junction and superior temporal sulcus), while activation in regions underlying experience sharing (IPL, anterior cingulate cortex and anterior insula) related to lower empathic accuracy. These results provide novel insight into the neural basis of empathic accuracy in adolescence and suggest that perspective taking processes may be effective for increasing empathy.

Robots As Intentional Agents: Using Neuroscientific Methods to Make Robots Appear More Social

Robots are increasingly envisaged as our future cohabitants. However, while considerable progress has been made in recent years in terms of their technological realization, the ability of robots to interact with humans in an intuitive and social way is still quite limited. An important challenge for social robotics is to determine how to design robots that can perceive the user's needs, feelings, and intentions, and adapt to users over a broad range of cognitive abilities. It is conceivable that if robots were able to adequately demonstrate these skills, humans would eventually accept them as social companions. We argue that the best way to achieve this is using a systematic experimental approach based on behavioral and physiological neuroscience methods such as motion/eye-tracking, electroencephalography, or functional near-infrared spectroscopy embedded in interactive human-robot paradigms. This approach requires understanding how humans interact with each other, how they perform tasks together and how they develop feelings of social connection over time, and using these insights to formulate design principles that make social robots attuned to the workings of the human brain. In this review, we put forward the argument that the likelihood of artificial agents being perceived as social companions can be increased by designing them in a way that they are perceived as intentional agents that activate areas in the human brain involved in social-cognitive processing. We first review literature related to social-cognitive processes and mechanisms involved in human-human interactions, and highlight the importance of perceiving others as intentional agents to activate these social brain areas. We then discuss how attribution of intentionality can positively affect human-robot interaction by (a) fostering feelings of social connection, empathy and prosociality, and by (b) enhancing performance on joint human-robot tasks. Lastly, we describe circumstances under which attribution of intentionality to robot agents might be disadvantageous, and discuss challenges associated with designing social robots that are inspired by neuroscientific principles.

Testing the Motor Simulation Account of Source Errors for Actions in Recall

Observing someone else perform an action can lead to false memories of self-performance - the observation inflation effect. One explanation is that action simulation via mirror neuron activation during action observation is responsible for observation inflation by enriching memories of observed actions with motor representations. In three experiments we investigated this account of source memory failures, using a novel paradigm that minimized influences of verbalization and prior object knowledge. Participants worked in pairs to take turns acting out geometric shapes and letters. The next day, participants recalled either actions they had performed or those they had observed. Experiment 1 showed that participants falsely retrieved observed actions as self-performed, but also retrieved self-performed actions as observed. Experiment 2 showed that preventing participants from encoding observed actions motorically by taxing their motor system with a concurrent motor task did not lead to the predicted decrease in false claims of self-performance. Indeed, Experiment 3 showed that this was the case even if participants were asked to carefully monitor their recall. Because our data provide no evidence for a motor activation account, we also discussed our results in light of a source monitoring account.

Time-Frequency Analysis of Mu Rhythm Activity during Picture and Video Action Naming Tasks

This study used whole-head 64 channel electroencephalography to measure changes in sensorimotor activity—as indexed by the mu rhythm—in neurologically-healthy adults, during subvocal confrontation naming tasks. Independent component analyses revealed sensorimotor mu component clusters in the right and left hemispheres. Event related spectral perturbation analyses indicated significantly stronger patterns of mu rhythm activity (pFDR < 0.05) during the video condition as compared to the picture condition, specifically in the left hemisphere. Mu activity is hypothesized to reflect typical patterns of sensorimotor activation during action verb naming tasks. These results support further investigation into sensorimotor cortical activity during action verb naming in clinical populations.

Gravity Cues Embedded in the Kinematics of Human Motion Are Detected in Form-from-Motion Areas of the Visual System and in Motor-Related Areas

The present study investigated the cortical areas engaged in the perception of graviceptive information embedded in biological motion (BM). To this end, functional magnetic resonance imaging was used to assess the cortical areas active during the observation of human movements performed under normogravity and microgravity (parabolic flight). Movements were defined by motion cues alone using point-light displays. We found that gravity modulated the activation of a restricted set of regions of the network subtending BM perception, including form-from-motion areas of the visual system (kinetic occipital region, lingual gyrus, cuneus) and motor-related areas (primary motor and somatosensory cortices). These findings suggest that compliance of observed movements with normal gravity was carried out by mapping them onto the observer's motor system and by extracting their overall form from local motion of the moving light points. We propose that judgment on graviceptive information embedded in BM can be established based on motor resonance and visual familiarity mechanisms and not necessarily by accessing the internal model of gravitational motion stored in the vestibular cortex.

Mental steps: Differential activation of internal pacemakers in motor imagery and in mental imitation of gait

Gait imagery and gait observation can boost the recovery of locomotion dysfunctions; yet, a neurologically justified rationale for their clinical application is lacking as much as a direct comparison of their neural correlates. Using functional magnetic resonance imaging, we measured the neural correlates of explicit motor imagery of gait during observation of in-motion videos shot in a park with a steady cam (Virtual Walking task). In a 2 × 2 factorial design, we assessed the modulatory effect of gait observation and of foot movement execution on the neural correlates of the Virtual Walking task: in half of the trials, the participants were asked to mentally imitate a human model shown while walking along the same route (mental imitation condition); moreover, for half of all the trials, the participants also performed rhythmic ankle dorsiflexion as a proxy for stepping movements. We found that, beyond the areas associated with the execution of lower limb movements (the paracentral lobule, the supplementary motor area, and the cerebellum), gait imagery also recruited dorsal premotor and posterior parietal areas known to contribute to the adaptation of walking patterns to environmental cues. When compared with mental imitation, motor imagery recruited a more extensive network, including a brainstem area compatible with the human mesencephalic locomotor region (MLR). Reduced activation of the MLR in mental imitation indicates that this more visually guided task poses less demand on subcortical structures crucial for internally generated gait patterns. This finding may explain why patients with subcortical degeneration benefit from rehabilitation protocols based on gait observation. Hum Brain Mapp 38:5195-5216, 2017. © 2017 Wiley Periodicals, Inc.

[Cognitive-perceptive approaches in the treatment of chronic pain]

In the treatment of difficult chronic pain conditions, cognitive-perceptive approaches offer an alternative to conventional therapies. Especially phantom limb pain and complex regional pain syndrome (CRPS) are frequently treated with these promising modalities. This article provides an overview of the most important cognitive-perceptive therapies and the research results concerning their clinical efficacy. In addition, we discuss their neurobiological foundation and clinical perspectives.

The role of attention in human motor resonance

Observation of others' actions evokes in primary motor cortex and spinal circuits of observers a subliminal motor resonance response, which reflects the motor program encoding observed actions. We investigated the role of attention in human motor resonance with four experimental conditions, explored in different subject groups: in the first explicit condition, subjects were asked to observe a rhythmic hand flexion-extension movement performed live in front of them. In two other conditions subjects had to monitor the activity of a LED light mounted on the oscillating hand. The hand was clearly visible but it was not the focus of subjects' attention: in the semi-implicit condition hand movement was relevant to task completion, while in the implicit condition it was irrelevant. In a fourth, baseline, condition subjects observed the rhythmic oscillation of a metal platform. Motor resonance was measured with the H-reflex technique as the excitability modulation of cortico-spinal motorneurons driving a hand flexor muscle. As expected, a normal resonant response developed in the explicit condition, and no resonant response in the baseline condition. Resonant responses also developed in both semi-implicit and implicit conditions and, surprisingly, were not different from each other, indicating that viewing an action is, per se, a powerful stimulus for the action observation network, even when it is not the primary focus of subjects' attention and even when irrelevant to the task. However, the amplitude of these responses was much reduced compared to the explicit condition, and the phase-lock between the time courses of observed movement and resonant motor program was lost. In conclusion, different parameters of the response were differently affected by subtraction of attentional resources with respect to the explicit condition: time course and muscle selection were preserved while the activation of motor circuits resulted in much reduced amplitude and lost its kinematic specificity.

Human-Object Interactions Are More than the Sum of Their Parts

Understanding human-object interactions is critical for extracting meaning from everyday visual scenes and requires integrating complex relationships between human pose and object identity into a new percept. To understand how the brain builds these representations, we conducted 2 fMRI experiments in which subjects viewed humans interacting with objects, noninteracting human-object pairs, and isolated humans and objects. A number of visual regions process features of human-object interactions, including object identity information in the lateral occipital complex (LOC) and parahippocampal place area (PPA), and human pose information in the extrastriate body area (EBA) and posterior superior temporal sulcus (pSTS). Representations of human-object interactions in some regions, such as the posterior PPA (retinotopic maps PHC1 and PHC2) are well predicted by a simple linear combination of the response to object and pose information. Other regions, however, especially pSTS, exhibit representations for human-object interaction categories that are not predicted by their individual components, indicating that they encode human-object interactions as more than the sum of their parts. These results reveal the distributed networks underlying the emergent representation of human-object interactions necessary for social perception.

Social Interaction Affects Neural Outcomes of Sign Language Learning As a Foreign Language in Adults

Children naturally acquire a language in social contexts where they interact with their caregivers. Indeed, research shows that social interaction facilitates lexical and phonological development at the early stages of child language acquisition. It is not clear, however, whether the relationship between social interaction and learning applies to adult second language acquisition of syntactic rules. Does learning second language syntactic rules through social interactions with a native speaker or without such interactions impact behavior and the brain? The current study aims to answer this question. Adult Japanese participants learned a new foreign language, Japanese sign language (JSL), either through a native deaf signer or via DVDs. Neural correlates of acquiring new linguistic knowledge were investigated using functional magnetic resonance imaging (fMRI). The participants in each group were indistinguishable in terms of their behavioral data after the instruction. The fMRI data, however, revealed significant differences in the neural activities between two groups. Significant activations in the left inferior frontal gyrus (IFG) were found for the participants who learned JSL through interactions with the native signer. In contrast, no cortical activation change in the left IFG was found for the group who experienced the same visual input for the same duration via the DVD presentation. Given that the left IFG is involved in the syntactic processing of language, spoken or signed, learning through social interactions resulted in an fMRI signature typical of native speakers: activation of the left IFG. Thus, broadly speaking, availability of communicative interaction is necessary for second language acquisition and this results in observed changes in the brain.

Neural Representations of Observed Actions Generalize across Static and Dynamic Visual Input

People interact with entities in the environment in distinct and categorizable ways (e.g., kicking is making contact with foot). We can recognize these action categories across variations in actors, objects, and settings; moreover, we can recognize them from both dynamic and static visual input. However, the neural systems that support action recognition across these perceptual differences are unclear. Here, we used multivoxel pattern analysis of fMRI data to identify brain regions that support visual action categorization in a format-independent way. Human participants were scanned while viewing eight categories of interactions (e.g., pulling) depicted in two visual formats: (1) visually controlled videos of two interacting actors and (2) visually varied photographs selected from the internet involving different actors, objects, and settings. Action category was decodable across visual formats in bilateral inferior parietal, bilateral occipitotemporal, left premotor, and left middle frontal cortex. In most of these regions, the representational similarity of action categories was consistent across subjects and visual formats, a property that can contribute to a common understanding of actions among individuals. These results suggest that the identified brain regions support action category codes that are important for action recognition and action understanding.SIGNIFICANCE STATEMENT Humans tend to interpret the observed actions of others in terms of categories that are invariant to incidental features: whether a girl pushes a boy or a button and whether we see it in real-time or in a single snapshot, it is still pushing Here, we investigated the brain systems that facilitate the visual recognition of these action categories across such differences. Using fMRI, we identified several areas of parietal, occipitotemporal, and frontal cortex that exhibit action category codes that are similar across viewing of dynamic videos and still photographs. Our results provide strong evidence for the involvement of these brain regions in recognizing the way that people interact physically with objects and other people.

Oxytocin and Interpersonal Relationships

The neuropeptide oxytocin (OT) has emerged as a potent modulator of diverse aspects of interpersonal relationships. OT appears to work in close interaction with several other neurotransmitter networks, including the dopaminergic reward circuit, and to be dependent on sex-specific hormonal influences. In this chapter, we focus on four main domains of OT and interpersonal relationships, including (1) the protective effect of OT on an individual's ability to withstand stress (i.e., stress buffering), (2) the effect of OT on emotion recognition and empathy, (3) OT's ability to enhance social synchrony and cooperation among individuals, and (4) the effect of OT on an individual's perception of social touch. We then illustrate the connection between OT and loneliness while grieving the loss of a loved one. We finish by discussing the clinical potential of OT, focusing on its potential role as an adjunct to psychotherapy, its enhancement through sex-specific hormonal influences, and the difficulties that present themselves when considering OT as a therapy. Overall, we argue that OT continues to hold strong therapeutic promise, but that it is strongly dependent on internal and external influences, for instance the patient's personal past experiences and interaction with the therapist, in order to provide the best possible therapy.

From movement kinematics to social cognition: the case of autism

The way in which we move influences our ability to perceive, interpret and predict the actions of others. Thus movements play an important role in social cognition. This review article will appraise the literature concerning movement kinematics and motor control in individuals with autism, and will argue that movement differences between typical and autistic individuals may contribute to bilateral difficulties in reciprocal social cognition.

Network interactions underlying mirror feedback in stroke: A dynamic causal modeling study

Mirror visual feedback (MVF) is potentially a powerful tool to facilitate recovery of disordered movement and stimulate activation of under-active brain areas due to stroke. The neural mechanisms underlying MVF have therefore been a focus of recent inquiry. Although it is known that sensorimotor areas can be activated via mirror feedback, the network interactions driving this effect remain unknown. The aim of the current study was to fill this gap by using dynamic causal modeling to test the interactions between regions in the frontal and parietal lobes that may be important for modulating the activation of the ipsilesional motor cortex during mirror visual feedback of unaffected hand movement in stroke patients. Our intent was to distinguish between two theoretical neural mechanisms that might mediate ipsilateral activation in response to mirror-feedback: transfer of information between bilateral motor cortices versus recruitment of regions comprising an action observation network which in turn modulate the motor cortex. In an event-related fMRI design, fourteen chronic stroke subjects performed goal-directed finger flexion movements with their unaffected hand while observing real-time visual feedback of the corresponding (veridical) or opposite (mirror) hand in virtual reality. Among 30 plausible network models that were tested, the winning model revealed significant mirror feedback-based modulation of the ipsilesional motor cortex arising from the contralesional parietal cortex, in a region along the rostral extent of the intraparietal sulcus. No winning model was identified for the veridical feedback condition. We discuss our findings in the context of supporting the latter hypothesis, that mirror feedback-based activation of motor cortex may be attributed to engagement of a contralateral (contralesional) action observation network. These findings may have important implications for identifying putative cortical areas, which may be targeted with non-invasive brain stimulation as a means of potentiating the effects of mirror training.

Power modulation of electroencephalogram mu and beta frequency depends on perceived level of observed actions

INTRODUCTION

The ability to understand actions and intentions of others is of great importance to social relationships and is associated with the mirror neuron system of the human brain. Whether conscious perception of specific actions is necessary to trigger activity in this system, or alternatively whether this response is independent of conscious perception is not known.

METHODS

We addressed this issue by rendering videos of right hand movements invisible to conscious perception, and measuring electroencephalogram (EEG) power suppression in the mu (8-13 Hz) and beta (15-25 Hz) range as index corresponding to the magnitude of mirror neuron activity.

RESULTS

In the beta range over bilateral sensorimotor sites, we find that suppression indices follow the reported perceptual level of subjects with stronger suppression for consciously perceived trials. Furthermore, in the nonperceived trials, oscillation power is significantly suppressed relative to baseline. In the low mu range (8-10 Hz), oscillation power over the left sensorimotor site is significantly more suppressed in the consciously perceived versus nonperceived trials.

CONCLUSIONS

Our data suggest that the intensity of mirror system responses during action observation decreases with the observers' perception level yet remains significant during observation of invisible actions. Such subliminal activity could help explain phenomena such as covert imitation.

Changing motor perception by sensorimotor conflicts and body ownership

Experimentally induced sensorimotor conflicts can result in a loss of the feeling of control over a movement (sense of agency). These findings are typically interpreted in terms of a forward model in which the predicted sensory consequences of the movement are compared with the observed sensory consequences. In the present study we investigated whether a mismatch between movements and their observed sensory consequences does not only result in a reduced feeling of agency, but may affect motor perception as well. Visual feedback of participants’ finger movements was manipulated using virtual reality to be anatomically congruent or incongruent to the performed movement. Participants made a motor perception judgment (i.e. which finger did you move?) or a visual perceptual judgment (i.e. which finger did you see moving?). Subjective measures of agency and body ownership were also collected. Seeing movements that were visually incongruent to the performed movement resulted in a lower accuracy for motor perception judgments, but not visual perceptual judgments. This effect was modified by rotating the virtual hand (Exp.2), but not by passively induced movements (Exp.3). Hence, sensorimotor conflicts can modulate the perception of one’s motor actions, causing viewed “alien actions” to be felt as one’s own.

Interactional leader-follower sensorimotor communication strategies during repetitive joint actions

Non-verbal communication is the basis of animal interactions. In dyadic leader-follower interactions, leaders master the ability to carve their motor behaviour in order to 'signal' their future actions and internal plans while these signals influence the behaviour of follower partners, who automatically tend to imitate the leader even in complementary interactions. Despite their usefulness, signalling and imitation have a biomechanical cost, and it is unclear how this cost-benefits trade-off is managed during repetitive dyadic interactions that present learnable regularities. We studied signalling and imitation dynamics (indexed by movement kinematics) in pairs of leaders and followers during a repetitive, rule-based, joint action. Trial-by-trial Bayesian model comparison was used to evaluate the relation between signalling, imitation and pair performance. The different models incorporate different hypotheses concerning the factors (past interactions versus online movements) influencing the leader's signalling (or follower's imitation) kinematics. This approach showed that (i) leaders' signalling strategy improves future couple performance, (ii) leaders used the history of past interactions to shape their signalling, (iii) followers' imitative behaviour is more strongly affected by the online movement of the leader. This study elucidates the ways online sensorimotor communication help individuals align their task representations and ultimately improves joint action performance.

Simultaneous EEG-fMRI for working memory of the human brain

Memory plays an important role in human life. Memory can be divided into two categories, i.e., long term memory and short term memory (STM). STM or working memory (WM) stores information for a short span of time and it is used for information manipulations and fast response activities. WM is generally involved in the higher cognitive functions of the brain. Different studies have been carried out by researchers to understand the WM process. Most of these studies were based on neuroimaging modalities like fMRI, EEG, MEG etc., which use standalone processes. Each neuroimaging modality has some pros and cons. For example, EEG gives high temporal resolution but poor spatial resolution. On the other hand, the fMRI results have a high spatial resolution but poor temporal resolution. For a more in depth understanding and insight of what is happening inside the human brain during the WM process or during cognitive tasks, high spatial as well as high temporal resolution is desirable. Over the past decade, researchers have been working to combine different modalities to achieve a high spatial and temporal resolution at the same time. Developments of MRI compatible EEG equipment in recent times have enabled researchers to combine EEG-fMRI successfully. The research publications in simultaneous EEG-fMRI have been increasing tremendously. This review is focused on the WM research involving simultaneous EEG-fMRI data acquisition and analysis. We have covered the simultaneous EEG-fMRI application in WM and data processing. Also, it adds to potential fusion methods which can be used for simultaneous EEG-fMRI for WM and cognitive tasks.

fMRI Adaptation between Action Observation and Action Execution Reveals Cortical Areas with Mirror Neuron Properties in Human BA 44/45

Mirror neurons (MNs) are considered to be the supporting neural mechanism for action understanding. MNs have been identified in monkey’s area F5. The identification of MNs in the human homolog of monkeys’ area F5 Broadmann Area 44/45 (BA 44/45) has been proven methodologically difficult. Cross-modal functional MRI (fMRI) adaptation studies supporting the existence of MNs restricted their analysis to a priori candidate regions, whereas studies that failed to find evidence used non-object-directed (NDA) actions. We tackled these limitations by using object-directed actions (ODAs) differing only in terms of their object directedness in combination with a cross-modal adaptation paradigm and a whole-brain analysis. Additionally, we tested voxels’ blood oxygenation level-dependent (BOLD) response patterns for several properties previously reported as typical MN response properties. Our results revealed 52 voxels in left inferior frontal gyrus (IFG; particularly BA 44/45), which respond to both motor and visual stimulation and exhibit cross-modal adaptation between the execution and observation of the same action. These results demonstrate that part of human IFG, specifically BA 44/45, has BOLD response characteristics very similar to monkey’s area F5.

Developmental changes in the embodied self of spatial perspective taking

Spatial perspective taking consists of mental self-rotation and other cognitive information processing. Mental self-rotation is a process of rotating an embodied representational self through mental simulation of the sensorimotor mechanisms underlying actual self-movement. It was predicted that physical development would affect the operation of the representational self. One hundred and twenty-five individuals aged 5-80 years (57 children, 35 students, and 33 elderly people) executed a video game task of spatial perspective taking in three conditions of sensorimotor activation: A restrained, stable, and unstable condition. In the linear function formulas considering the degree of rotation and response times, the gradient represented the theoretical speed of mental self-rotation and the intercept represented other cognitive processing. A significant interaction was found between age group and condition on the gradients, indicating that the response times in the unstable condition were faster than in the other conditions for the children, the restrained condition was slower than the other conditions for the students, while no difference was found for the elderly adults. The results suggest that the influence of sensorimotor activation on the embodied representational self depends on developmental changes in physical control.

What Do Eye Gaze Metrics Tell Us about Motor Imagery?

Many of the brain structures involved in performing real movements also have increased activity during imagined movements or during motor observation, and this could be the neural substrate underlying the effects of motor imagery in motor learning or motor rehabilitation. In the absence of any objective physiological method of measurement, it is currently impossible to be sure that the patient is indeed performing the task as instructed. Eye gaze recording during a motor imagery task could be a possible way to "spy" on the activity an individual is really engaged in. The aim of the present study was to compare the pattern of eye movement metrics during motor observation, visual and kinesthetic motor imagery (VI, KI), target fixation, and mental calculation. Twenty-two healthy subjects (16 females and 6 males), were required to perform tests in five conditions using imagery in the Box and Block Test tasks following the procedure described by Liepert et al. Eye movements were analysed by a non-invasive oculometric measure (SMI RED250 system). Two parameters describing gaze pattern were calculated: the index of ocular mobility (saccade duration over saccade + fixation duration) and the number of midline crossings (i.e. the number of times the subjects gaze crossed the midline of the screen when performing the different tasks). Both parameters were significantly different between visual imagery and kinesthesic imagery, visual imagery and mental calculation, and visual imagery and target fixation. For the first time we were able to show that eye movement patterns are different during VI and KI tasks. Our results suggest gaze metric parameters could be used as an objective unobtrusive approach to assess engagement in a motor imagery task. Further studies should define how oculomotor parameters could be used as an indicator of the rehabilitation task a patient is engaged in.

Reduced motor imagery efficiency is associated with online control difficulties in children with probable developmental coordination disorder

Recent evidence indicates that the ability to correct reaching movements in response to unexpected target changes (i.e., online control) is reduced in children with developmental coordination disorder (DCD). Recent computational modeling of human reaching suggests that these inefficiencies may result from difficulties generating and/or monitoring internal representations of movement. This study was the first to test this putative relationship empirically. We did so by investigating the degree to which the capacity to correct reaching mid-flight could be predicted by motor imagery (MI) proficiency in a sample of children with probable DCD (pDCD). Thirty-four children aged 8 to 12 years (17 children with pDCD and 17 age-matched controls) completed the hand rotation task, a well-validated measure of MI, and a double-step reaching task (DSRT), a protocol commonly adopted to infer one's capacity for correcting reaching online. As per previous research, children with pDCD demonstrated inefficiencies in their ability to generate internal action representations and correct their reaching online, demonstrated by inefficient hand rotation performance and slower correction to the reach trajectory following unexpected target perturbation during the DSRT compared to age-matched controls. Critically, hierarchical moderating regression demonstrated that even after general reaching ability was controlled for, MI efficiency was a significant predictor of reaching correction efficiency, a relationship that was constant across groups. Ours is the first study to provide direct pilot evidence in support of the view that a decreased capacity for online control of reaching typical of DCD may be associated with inefficiencies generating and/or using internal representations of action.

Mirror neuron deficit in schizophrenia: Evidence from repetition suppression

BACKGROUND

Schizophrenia is associated with impaired cognition, especially cognition in social contexts. The mirror neuron system (MNS) serves as an important neuronal basis for social cognitive skills; however, previous investigations on the integrity of MNS function in schizophrenia remain approximate.

METHODS

We employed a repetition suppression paradigm that allows for measuring neuronal responses to gesture observation and gesture execution. Cross-modal repetition suppression, i.e., adaptation between observe/execute and execute/observe conditions, was defined as the decisive experimental condition characterizing the unique sensori-motor properties of mirror neurons. Event-related potentials (ERPs) were assessed in 15 schizophrenia patients and 15 matched controls.

RESULTS

We isolated an ERP signature of specific adaptation effects to identical hand gestures. Of critical importance, this ERP signature indicated intact intra-modal adaptive pattern, i.e., observe/observe and execute/execute, of comparable magnitude between groups, but deficient cross-modal adaptation, i.e., observe/execute and execute/observe, in schizophrenia patients.

CONCLUSION

Our data provide robust evidence that pure perception and execution of hand gestures are relatively intact in schizophrenia. In contrast, visuo-motor transformation processes mediated by the MNS seem to be specifically disturbed in schizophrenia. These results unambiguously demonstrate MNS deficits in schizophrenia and extend our understanding of the neuronal bases of social dysfunction in this disorder.

Adaptive coding of orofacial and speech actions in motor and somatosensory spaces with and without overt motor behavior

Studies of speech motor control suggest that articulatory and phonemic goals are defined in multidimensional motor, somatosensory, and auditory spaces. To test whether motor simulation might rely on sensory-motor coding common with those for motor execution, we used a repetition suppression (RS) paradigm while measuring neural activity with sparse sampling fMRI during repeated overt and covert orofacial and speech actions. RS refers to the phenomenon that repeated stimuli or motor acts lead to decreased activity in specific neural populations and are associated with enhanced adaptive learning related to the repeated stimulus attributes. Common suppressed neural responses were observed in motor and posterior parietal regions in the achievement of both repeated overt and covert orofacial and speech actions, including the left premotor cortex and inferior frontal gyrus, the superior parietal cortex and adjacent intraprietal sulcus, and the left IC and the SMA. Interestingly, reduced activity of the auditory cortex was observed during overt but not covert speech production, a finding likely reflecting a motor rather an auditory imagery strategy by the participants. By providing evidence for adaptive changes in premotor and associative somatosensory brain areas, the observed RS suggests online state coding of both orofacial and speech actions in somatosensory and motor spaces with and without motor behavior and sensory feedback.

Causative role of left aIPS in coding shared goals during human-avatar complementary joint actions

Successful motor interactions require agents to anticipate what a partner is doing in order to predictively adjust their own movements. Although the neural underpinnings of the ability to predict others' action goals have been well explored during passive action observation, no study has yet clarified any critical neural substrate supporting interpersonal coordination during active, non-imitative (complementary) interactions. Here, we combine non-invasive inhibitory brain stimulation (continuous Theta Burst Stimulation) with a novel human–avatar interaction task to investigate a causal role for higher-order motor cortical regions in supporting the ability to predict and adapt to others' actions. We demonstrate that inhibition of left anterior intraparietal sulcus (aIPS), but not ventral premotor cortex, selectively impaired individuals' performance during complementary interactions. Thus, in addition to coding observed and executed action goals, aIPS is crucial in coding ‘shared goals', that is, integrating predictions about one's and others' complementary actions.

The neural mechanisms supporting imitative motor interactions have been well studied. However, considerably less is known about the mechanisms supporting complementary interactions. Here the authors demonstrate a causal role for left anterior intraparietal sulcus in coding complementary motor goals.

Locomotor adaptation is modulated by observing the actions of others

Observing the motor actions of another person could facilitate compensatory motor behavior in the passive observer. Here we explored whether action observation alone can induce automatic locomotor adaptation in humans. To explore this possibility, we used the "broken escalator" paradigm. Conventionally this involves stepping upon a stationary sled after having previously experienced it actually moving (Moving trials). This history of motion produces a locomotor aftereffect when subsequently stepping onto a stationary sled. We found that viewing an actor perform the Moving trials was sufficient to generate a locomotor aftereffect in the observer, the size of which was significantly correlated with the size of the movement (postural sway) observed. Crucially, the effect is specific to watching the task being performed, as no motor adaptation occurs after simply viewing the sled move in isolation. These findings demonstrate that locomotor adaptation in humans can be driven purely by action observation, with the brain adapting motor plans in response to the size of the observed individual's motion. This mechanism may be mediated by a mirror neuron system that automatically adapts behavior to minimize movement errors and improve motor skills through social cues, although further neurophysiological studies are required to support this theory. These data suggest that merely observing the gait of another person in a challenging environment is sufficient to generate appropriate postural countermeasures, implying the existence of an automatic mechanism for adapting locomotor behavior.

A neural network model of causative actions

A common idea in models of action representation is that actions are represented in terms of their perceptual effects (see e.g., Prinz, 1997; Hommel et al., 2001; Sahin et al., 2007; Umiltà et al., 2008; Hommel, 2013). In this paper we extend existing models of effect-based action representations to account for a novel distinction. Some actions bring about effects that are independent events in their own right: for instance, if John smashes a cup, he brings about the event of the cup smashing. Other actions do not bring about such effects. For instance, if John grabs a cup, this action does not cause the cup to "do" anything: a grab action has well-defined perceptual effects, but these are not registered by the perceptual system that detects independent events involving external objects in the world. In our model, effect-based actions are implemented in several distinct neural circuits, which are organized into a hierarchy based on the complexity of their associated perceptual effects. The circuit at the top of this hierarchy is responsible for actions that bring about independently perceivable events. This circuit receives input from the perceptual module that recognizes arbitrary events taking place in the world, and learns movements that reliably cause such events. We assess our model against existing experimental observations about effect-based motor representations, and make some novel experimental predictions. We also consider the possibility that the "causative actions" circuit in our model can be identified with a motor pathway reported in other work, specializing in "functional" actions on manipulable tools (Bub et al., 2008; Binkofski and Buxbaum, 2013).

Tool-use-associated sound in the evolution of language

Proponents of the motor theory of language evolution have primarily focused on the visual domain and communication through observation of movements. In the present paper, it is hypothesized that the production and perception of sound, particularly of incidental sound of locomotion (ISOL) and tool-use sound (TUS), also contributed. Human bipedalism resulted in rhythmic and more predictable ISOL. It has been proposed that this stimulated the evolution of musical abilities, auditory working memory, and abilities to produce complex vocalizations and to mimic natural sounds. Since the human brain proficiently extracts information about objects and events from the sounds they produce, TUS, and mimicry of TUS, might have achieved an iconic function. The prevalence of sound symbolism in many extant languages supports this idea. Self-produced TUS activates multimodal brain processing (motor neurons, hearing, proprioception, touch, vision), and TUS stimulates primate audiovisual mirror neurons, which is likely to stimulate the development of association chains. Tool use and auditory gestures involve motor processing of the forelimbs, which is associated with the evolution of vertebrate vocal communication. The production, perception, and mimicry of TUS may have resulted in a limited number of vocalizations or protowords that were associated with tool use. A new way to communicate about tools, especially when out of sight, would have had selective advantage. A gradual change in acoustic properties and/or meaning could have resulted in arbitrariness and an expanded repertoire of words. Humans have been increasingly exposed to TUS over millions of years, coinciding with the period during which spoken language evolved. ISOL and tool-use-related sound are worth further exploration.

Common coding and dynamic interactions between observed, imagined, and experienced motor and somatosensory activity

Motor imagery and perception - considered generally as forms of motor simulation - share overlapping neural representations with motor production. While much research has focused on the extent of this "common coding," less attention has been paid to how these overlapping representations interact. How do imagined, observed, or produced actions influence one another, and how do we maintain control over our perception and behavior? In the first part of this review we describe interactions between motor production and motor simulation, and explore apparent regulatory mechanisms that balance these processes. Next, we consider the somatosensory system. Numerous studies now support a "sensory mirror system" comprised of neural representations activated by either afferent sensation or vicarious sensation. In the second part of this review we summarize evidence for shared representations of sensation and sensory simulation (including imagery and observed sensation), and suggest that similar interactions and regulation of simulation occur in the somatosensory domain as in the motor domain. We suggest that both motor and somatosensory simulations are flexibly regulated to support simulations congruent with our sensorimotor experience and goals and suppress or separate the influence of those that are not. These regulatory mechanisms are frequently revealed by cases of brain injury but can also be employed to facilitate sensorimotor rehabilitation.

Interoceptive dysfunction: toward an integrated framework for understanding somatic and affective disturbance in depression

Depression is characterized by disturbed sleep and eating, a variety of other nonspecific somatic symptoms, and significant somatic comorbidities. Why there is such close association between cognitive and somatic dysfunction in depression is nonetheless poorly understood. An explosion of research in the area of interoception-the perception and interpretation of bodily signals-over the last decade nonetheless holds promise for illuminating what have until now been obscure links between the social, cognitive-affective, and somatic features of depression. This article reviews rapidly accumulating evidence that both somatic signaling and interoception are frequently altered in depression. This includes comparative studies showing vagus-mediated effects on depression-like behaviors in rodent models as well as studies in humans indicating both dysfunction in the neural substrates for interoception (e.g., vagus, insula, anterior cingulate cortex) and reduced sensitivity to bodily stimuli in depression. An integrative framework for organizing and interpreting this evidence is put forward which incorporates (a) multiple potential pathways to interoceptive dysfunction; (b) interaction with individual, gender, and cultural differences in interoception; and (c) a developmental psychobiological systems perspective, emphasizing likely differential susceptibility to somatic and interoceptive dysfunction across the lifespan. Combined with current theory and evidence, it is suggested that core symptoms of depression (e.g., anhedonia, social deficits) may be products of disturbed interoceptive-exteroceptive integration. More research is nonetheless needed to fully elucidate the relationship between mind, body, and social context in depression.

Object visibility alters the relative contribution of ventral visual stream and mirror neuron system to goal anticipation during action observation

We used fMRI to study the effect of hiding the target of a grasping action on the cerebral activity of an observer whose task was to anticipate the size of the object being grasped. Activity in the putative mirror neuron system (pMNS) was higher when the target was concealed from the view of the observer and anticipating the size of the object being grasped requested paying attention to the hand kinematics. In contrast, activity in ventral visual areas outside the pMNS increased when the target was fully visible, and the performance improved in this condition. A repetition suppression analysis demonstrated that in full view, the size of the object being grasped by the actor was encoded in the ventral visual stream. Dynamic causal modeling showed that monitoring a grasping action increased the coupling between the parietal and ventral premotor nodes of the pMNS. The modulation of the functional connectivity between these nodes was correlated with the subject's capability to detect the size of hidden objects. In full view, synaptic activity increased within the ventral visual stream, and the connectivity with the pMNS was diminished. The re-enactment of observed actions in the pMNS is crucial when interpreting others' actions requires paying attention to the body kinematics. However, when the context permits, visual-spatial information processing may complement pMNS computations for improved action anticipation accuracy.

Visual and Sensorimotor Contributions to the Esthetic Appraisal of Body Form, Motion, and Emotion

Recent neuroscience studies indicate that the visual processing of human bodies relies on a cortical network comprising different sensorimotor regions (extrastriate body area [EBA], superior temporal sulcus [STS], parietal cortex [PC], and premotor cortex [PM]). These regions seem to be specifically involved in the processing of morphological (form) and dynamic (movement) cues of the body. Importantly, the integrated activity within the network dedicated to body processing seems to underpin the unified perception of the body and its movements via simulation-like mechanisms (“cold embodiment”). Studies also suggest that regions within the body-related network are involved in the esthetic appreciation of human bodies together with a variety of cortical and subcortical regions associated to the emotional reward coding of stimuli (e.g., the amygdala for fear/disgust and the nucleus accumbens, the insula, and the cingulate cortex for pleasure reward), which may drive a form of “hot embodiment.” Thus, the esthetic evaluation of human bodies may rely upon a large cortico-subcortical network. Here we review evidence concerning the role of specific sensorimotor cortical and subcortical regions in the perception of beauty and attractiveness of the body. We conclude that exploring the way in which visual, sensorimotor, affective, and multisensory information in art and ecological life in general perturb our body representations is crucial for understanding the neural foundations of esthetic body appreciation.

Early integration of bilateral touch in the primary somatosensory cortex

Animal, as well as behavioural and neuroimaging studies in humans have documented integration of bilateral tactile information at the level of primary somatosensory cortex (SI). However, it is still debated whether integration in SI occurs early or late during tactile processing, and whether it is somatotopically organized. To address both the spatial and temporal aspects of bilateral tactile processing we used magnetoencephalography in a tactile repetition-suppression paradigm. We examined somatosensory evoked-responses produced by probe stimuli preceded by an adaptor, as a function of the relative position of adaptor and probe (probe always at the left index finger; adaptor at the index or middle finger of the left or right hand) and as a function of the delay between adaptor and probe (0, 25, or 125 ms). Percentage of response-amplitude suppression was computed by comparing paired (adaptor + probe) with single stimulations of adaptor and probe. Results show that response suppression varies differentially in SI and SII as a function of both spatial and temporal features of the stimuli. Remarkably, repetition suppression of SI activity emerged early in time, regardless of whether the adaptor stimulus was presented on the same and the opposite body side with respect to the probe. These novel findings support the notion of an early and somatotopically organized inter-hemispheric integration of tactile information in SI.