Neural Circuits Underlying Imitation Learning of Hand Actions

Predicting point-light actions in real-time

There is convincing evidence for a mirror system in humans which simulates actions of conspecifics. One possible purpose of such a simulation system is to support action prediction in real-time. Our goal was to study whether the prediction of actions involves a real-time simulation process. We motion-captured a number of human actions and rendered them as point-light action sequences. Observers perceived brief videos of these actions, followed by an occluder and a static test posture. We independently varied the occluder time and the movement gap (i.e., the time between the endpoint of the action and the test posture). Observers were required to judge whether the test stimulus depicted a continuation of the action in the same depth orientation. Prediction performance was best when occluder time and movement gap corresponded, i.e., when the test posture was a continuation of the sequence that matched the occluder duration (Experiments 1, 2 and 4). This pattern of results was destroyed when the sequences and test images were flipped around the horizontal axis (Experiment 3). Overall, our findings suggest that action prediction involves a simulation process that operates in real-time. This process can break down when the actions are presented under viewing conditions for which observers have little experience.

Neural correlates of human action observation in hearing and deaf subjects

Accumulating evidence has suggested the existence of a human action recognition system involving inferior frontal, parietal, and superior temporal regions that may participate in both the perception and execution of actions. However, little is known about the specificity of this system in response to different forms of human action. Here we present data from PET neuroimaging studies from passive viewing of three distinct action types, intransitive self-oriented actions (e.g., stretching, rubbing one's eyes, etc.), transitive object-oriented actions (e.g., opening a door, lifting a cup to the lips to drink), and the abstract, symbolic actions-signs used in American Sign Language. Our results show that these different classes of human actions engage a frontal/parietal/STS human action recognition system in a highly similar fashion. However, the results indicate that this neural consistency across motion classes is true primarily for hearing subjects. Data from deaf signers shows a non-uniform response to different classes of human actions. As expected, deaf signers engaged left-hemisphere perisylvian language areas during the perception of signed language signs. Surprisingly, these subjects did not engage the expected frontal/parietal/STS circuitry during passive viewing of non-linguistic actions, but rather reliably activated middle-occipital temporal-ventral regions which are known to participate in the detection of human bodies, faces, and movements. Comparisons with data from hearing subjects establish statistically significant contributions of middle-occipital temporal-ventral during the processing of non-linguistic actions in deaf signers. These results suggest that during human motion processing, deaf individuals may engage specialized neural systems that allow for rapid, online differentiation of meaningful linguistic actions from non-linguistic human movements.

From visuo-motor interactions to imitation learning: Behavioural and brain imaging studies

We review three areas of research and theory relating to the involvement of motor processing in action observation: behavioural studies on imitation learning, behavioural work on short-term visuomotor interactions, and related neurophysiological and neuroimaging work. A large number of behavioural studies now indicate bi-directional links between perception and action: visual processing can automatically induce related motor processes, and motor actions can direct future visual processing. The related concept of direct matching (Rizzolatti et al., 2001) does not, however, imply that observed actions are transduced into a corresponding motor representation that would guarantee an instant and accurate imitation. Rather, studies on the mirror neuron system indicate that action observation engages the observer's own motor prototype of the observed action. This allows for enhanced action recognition, imitation recognition, and, predominantly in humans, imitation and observational learning. Despite the clear impact of action observation on motor representations, recent neuroimaging work also indicates the overlap of imitation learning with processes of non-imitative skill acquisition.

A rapid sound-action association effect in human insular cortex

Background

Learning to play a musical piece is a prime example of complex sensorimotor learning in humans. Recent studies using electroencephalography (EEG) and transcranial magnetic stimulation (TMS) indicate that passive listening to melodies previously rehearsed by subjects on a musical instrument evokes differential brain activation as compared with unrehearsed melodies. These changes were already evident after 20–30 minutes of training. The exact brain regions involved in these differential brain responses have not yet been delineated.

Methodology/Principal Finding

Using functional MRI (fMRI), we investigated subjects who passively listened to simple piano melodies from two conditions: In the ‘actively learned melodies’ condition subjects learned to play a piece on the piano during a short training session of a maximum of 30 minutes before the fMRI experiment, and in the ‘passively learned melodies’ condition subjects listened passively to and were thus familiarized with the piece. We found increased fMRI responses to actively compared with passively learned melodies in the left anterior insula, extending to the left fronto-opercular cortex. The area of significant activation overlapped the insular sensorimotor hand area as determined by our meta-analysis of previous functional imaging studies.

Conclusions/Significance

Our results provide evidence for differential brain responses to action-related sounds after short periods of learning in the human insular cortex. As the hand sensorimotor area of the insular cortex appears to be involved in these responses, re-activation of movement representations stored in the insular sensorimotor cortex may have contributed to the observed effect. The insular cortex may therefore play a role in the initial learning phase of action-perception associations.

Action representation of sound: audiomotor recognition network while listening to newly acquired actions

The discovery of audiovisual mirror neurons in monkeys gave rise to the hypothesis that premotor areas are inherently involved not only when observing actions but also when listening to action-related sound. However, the whole-brain functional formation underlying such "action-listening" is not fully understood. In addition, previous studies in humans have focused mostly on relatively simple and overexperienced everyday actions, such as hand clapping or door knocking. Here we used functional magnetic resonance imaging to ask whether the human action-recognition system responds to sounds found in a more complex sequence of newly acquired actions. To address this, we chose a piece of music as a model set of acoustically presentable actions and trained non-musicians to play it by ear. We then monitored brain activity in subjects while they listened to the newly acquired piece. Although subjects listened to the music without performing any movements, activation was found bilaterally in the frontoparietal motor-related network (including Broca's area, the premotor region, the intraparietal sulcus, and the inferior parietal region), consistent with neural circuits that have been associated with action observations, and may constitute the human mirror neuron system. Presentation of the practiced notes in a different order activated the network to a much lesser degree, whereas listening to an equally familiar but motorically unknown music did not activate this network. These findings support the hypothesis of a "hearing-doing" system that is highly dependent on the individual's motor repertoire, gets established rapidly, and consists of Broca's area as its hub.

Processing the spatial configuration of complex actions involves right posterior parietal cortex: An fMRI study with clinical implications

The left hemispheric dominance for complex motor behavior is undisputed. Clinical observations of complex motor deficits in patients with right hemispheric lesions, however, suggest an additional contribution of the right hemisphere to higher motor control. We assessed, using functional MRI (fMRI), which brain regions are implicated in processing the spatial aspects of complex, object-related actions. Using a blocked, factorial design, 17 healthy volunteers were asked to detect either spatial or sequential errors (factor ERROR) in complex activities of daily living, presented as video sequences with the appropriate object(s) or as pantomimes (factor STIMULUS). Observing complex actions (irrespective of stimulus type) activated a bilateral frontoparietal network. Observing actions with objects (relative to pantomimes) differentially increased neural activity in the fusiform gyrus and inferior occipital cortex bilaterally. Observing pantomimes, i.e., the same actions but without any object, differentially activated right prefrontal cortex, anterior cingulate cortex, the precuneus, and left cerebellum. The left cingulate cortex was differentially activated when subjects assessed the sequencing of actions. By contrast, assessing the spatial configuration of complex actions differentially increased neural activity in right posterior parietal cortex. A significant interaction of ERROR and STIMULUS was revealed for the right inferior parietal cortex only. These findings suggest a specific role of the right hemisphere, especially of right posterior parietal cortex, in processing spatial aspects of complex actions and thus provide a physiological basis for the observed apraxic motor deficits in patients with right hemispheric damage.

Imitation and action understanding in autistic spectrum disorders: how valid is the hypothesis of a deficit in the mirror neuron system?

The motor mirror neuron system supports imitation and goal understanding in typical adults. Recently, it has been proposed that a deficit in this mirror neuron system might contribute to poor imitation performance in children with autistic spectrum disorders (ASD) and might be a cause of poor social abilities in these children. We aimed to test this hypothesis by examining the performance of 25 children with ASD and 31 typical children of the same verbal mental age on four action representation tasks and a theory of mind battery. Both typical and autistic children had the same tendency to imitate an adult's goals, to imitate in a mirror fashion and to imitate grasps in a motor planning task. Children with ASD showed superior performance on a gesture recognition task. These imitation and gesture recognition tasks all rely on the mirror neuron system in typical adults, but performance was not impaired in children with ASD. In contrast, the ASD group were impaired on the theory of mind tasks. These results provide clear evidence against a general imitation impairment and a global mirror neuron system deficit in children with autism. We suggest this data can best be understood in terms of multiple brain systems for different types of imitation and action understanding, and that the ability to understand and imitate the goals of hand actions is intact in children with ASD.

Action representation of sound: audiomotor recognition network while listening to newly acquired actions

The discovery of audiovisual mirror neurons in monkeys gave rise to the hypothesis that premotor areas are inherently involved not only when observing actions but also when listening to action-related sound. However, the whole-brain functional formation underlying such "action-listening" is not fully understood. In addition, previous studies in humans have focused mostly on relatively simple and overexperienced everyday actions, such as hand clapping or door knocking. Here we used functional magnetic resonance imaging to ask whether the human action-recognition system responds to sounds found in a more complex sequence of newly acquired actions. To address this, we chose a piece of music as a model set of acoustically presentable actions and trained non-musicians to play it by ear. We then monitored brain activity in subjects while they listened to the newly acquired piece. Although subjects listened to the music without performing any movements, activation was found bilaterally in the frontoparietal motor-related network (including Broca's area, the premotor region, the intraparietal sulcus, and the inferior parietal region), consistent with neural circuits that have been associated with action observations, and may constitute the human mirror neuron system. Presentation of the practiced notes in a different order activated the network to a much lesser degree, whereas listening to an equally familiar but motorically unknown music did not activate this network. These findings support the hypothesis of a "hearing-doing" system that is highly dependent on the individual's motor repertoire, gets established rapidly, and consists of Broca's area as its hub.

Modulation of neural activity during observational learning of actions and their sequential orders

How does the brain transform perceptual representations of others' actions into motor representations that can be used to guide behavior? Here we used functional magnetic resonance imaging to record human brain activity while subjects watched others construct multipart objects under varied task demands. We find that relative to resting baseline, passive action observation increases activity within inferior frontal and parietal cortices implicated in action encoding (mirror system) and throughout a distributed network of areas involved in motor representation, including dorsal premotor cortex, pre-supplementary motor area, cerebellum, and basal ganglia (experiments 1 and 2). Relative to passive observation, these same areas show increased activity when subjects observe with the intention to subsequently reproduce component actions using the demonstrated sequential procedures (experiment 1). Observing the same actions with the intention of reproducing component actions, but without the requirement to use the demonstrated sequential procedure, increases activity in the same regions, although to a lesser degree (experiment 2). These findings demonstrate that when attempting to learn behaviors through observation, the observers' intentions modulate responses in a widely distributed network of cortical and subcortical regions implicated previously in action encoding and/or motor representation. Among these regions, only activity within the right intraparietal sulcus predicts the accuracy with which observed procedures are subsequently performed. Successful formation of motor representations of sequential procedures through observational learning is dependent on computations implemented within this parietal region.

Action observation has a positive impact on rehabilitation of motor deficits after stroke

Evidence exists that the observation of actions activates the same cortical motor areas that are involved in the performance of the observed actions. The neural substrate for this is the mirror neuron system. We harness this neuronal system and its ability to re-enact stored motor representations as a means for rehabilitating motor control. We combined observation of daily actions with concomitant physical training of the observed actions in a new neurorehabilitative program (action observation therapy). Eight stroke patients with moderate, chronic motor deficit of the upper limb as a consequence of medial artery infarction participated. A significant improvement of motor functions in the course of a 4-week treatment, as compared to the stable pre-treatment baseline, and compared with a control group have been found. The improvement lasted for at least 8 weeks after the end of the intervention. Additionally, the effects of action observation therapy on the reorganization of the motor system were investigated by functional magnetic resonance imaging (fMRI), using an independent sensorimotor task consisting of object manipulation. The direct comparison of neural activations between experimental and control groups after training with those elicited by the same task before training yielded a significant rise in activity in the bilateral ventral premotor cortex, bilateral superior temporal gyrus, the supplementary motor area (SMA) and the contralateral supramarginal gyrus. Our results provide pieces of evidence that action observation has a positive additional impact on recovery of motor functions after stroke by reactivation of motor areas, which contain the action observation/action execution matching system.

Neural representations of pantomimed and actual tool use: Evidence from an event-related fMRI study

Pantomime of tool use is a highly sensitive test to detect apraxia. The relationship to real-life performance is however unclear since apraxic patients frequently improve substantially when allowed to actually use tools. In the present study, the neural correlates of pantomimed and actual tool use were directly compared in healthy subjects using an event-related functional magnetic resonance imaging (fMRI) paradigm. Subjects were requested to demonstrate the use of various tools either as pantomimes or with the tool in hand. Movement and pre-movement events were evaluated. The comparison of all conditions versus rest revealed a widespread activation including parietal, posterior temporal, frontal, and subcortical areas with some characteristic activation for the different events. The direct comparison between pantomime and actual use conditions revealed no or only minor differential activations for pre-movement events. During the movement event, actual tool use induced the expected additional activation in sensory and motor areas, but also representations presumably related to tool-use knowledge at parietal, posterior temporal, and frontal sites. The opposite contrast of pantomimed versus actual tool use revealed differential activation only in the left intraparietal sulcus in a corresponding region-of-interest analysis. We conclude that planning and preparing of either pantomimed or actual tool use share large parts of a common network. Characteristic differences in the kinematics and dynamics of both movement conditions may be defined just before or during the initiation of the movement when sensory cues about the tool and environment are available in the actual use condition. Sensory and cognitive cues may provide apraxic patients the capacity to evoke a correct action program despite impaired pantomime.

Intentional attunement: mirror neurons and the neural underpinnings of interpersonal relations

The neural circuits activated in a person carrying out actions, expressing emotions, and experiencing sensations are activated also, automatically via a mirror neuron system, in the observer of those actions, emotions, and sensations. It is proposed that this finding of shared activation suggests a functional mechanism of "embodied simulation" that consists of the automatic, unconscious, and noninferential simulation in the observer of actions, emotions, and sensations carried out and experienced by the observed. It is proposed also that the shared neural activation pattern and the accompanying embodied simulation constitute a fundamental biological basis for understanding another's mind. The implications of this perspective for psychoanalysis are discussed, particularly regarding unconscious communication, projective identification, attunement, empathy, autism, therapeutic action, and transference-countertransference interactions.

When Language Meets Action: The Neural Integration of Gesture and Speech

Although generally studied in isolation, language and action often co-occur in everyday life. Here we investigated one particular form of simultaneous language and action, namely speech and gestures that speakers use in everyday communication. In a functional magnetic resonance imaging study, we identified the neural networks involved in the integration of semantic information from speech and gestures. Verbal and/or gestural content could be integrated easily or less easily with the content of the preceding part of speech. Premotor areas involved in action observation (Brodmann area [BA] 6) were found to be specifically modulated by action information "mismatching" to a language context. Importantly, an increase in integration load of both verbal and gestural information into prior speech context activated Broca's area and adjacent cortex (BA 45/47). A classical language area, Broca's area, is not only recruited for language-internal processing but also when action observation is integrated with speech. These findings provide direct evidence that action and language processing share a high-level neural integration system.

Actions anchored by concepts: defective action comprehension in semantic dementia

OBJECTIVE

To study the ability of patients with semantic dementia to understand actions, in order to examine the contribution of semantic memory to action comprehension.

METHODS

The ability to comprehend symbolic and instrumental actions was assessed in 6 patients with semantic dementia and 10 healthy controls. The patients were also given the imitation test of meaningful and meaningless actions.

RESULTS

In all patients with semantic dementia, comprehension of both symbolic and instrumental actions was defective. The comprehension of symbolic actions was more impaired than that of instrumental actions. Their ability to imitate other's actions was well preserved.

CONCLUSION

This study showed that comprehension of action was impaired in semantic dementia, suggesting that semantic memory has an important role in comprehension of human action.

Weaving the fabric of social interaction: articulating developmental psychology and cognitive neuroscience in the domain of motor cognition

In this article, we bring together recent findings from developmental science and cognitive neuroscience to argue that perception-action coupling constitutes the fundamental mechanism of motor cognition. A variety of empirical evidence suggests that observed and executed actions are coded in a common cognitive and neural framework, enabling individuals to construct shared representations of self and other actions. We review work to suggest that such shared representations support action anticipation, organization, and imitation. These processes, along with additional computational mechanisms for determining a sense of agency and behavioral regulation, form the fabric of socialinteraction. In addition, humans possess the capacity to move beyond these basic aspects of action analysis to interpret behavior at a deeper level, an ability that may be outside the scope of the mirror system. Understanding the nature of shared representations from the vantage point of developmental and cognitive science and neuroscience has the potential to inform a range of motor and social processes. This perspective also elucidates intriguing new directions and research questions and generates specific hypotheses regarding the impact of early disorders (e.g., developmental movement disorders) on subsequent action processing.

Motor brain regions are involved in the encoding of delayed intentions: a fMRI study

In studies of prospective memory, recall of the content of delayed intentions is normally excellent, probably because they contain actions that have to be enacted at a later time. Action words encoded for later enactment are more accessible from memory than those encoded for later verbal report [Freeman, J.E., and Ellis, J.A. 2003a. The representation of delayed intentions: A prospective subject-performed task? Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 976-992.]. As this higher assessibility is lost when the intended actions have to be enacted during encoding, or when a motor interference task is introduced concurrent to intention encoding, Freeman and Ellis suggested that the advantage of to-be-enacted actions is due to additional preparatory motor operations during encoding. Accordingly, in a fMRI study with 10 healthy young participants, we investigated whether motor brain regions are differentially activated during verbal encoding of actions for later enactment with the right hand in contrast to verbal encoding of actions for later verbal report. We included an additional condition of verbal encoding of abstract verbs for later verbal report to investigate whether the semantic motor information inherent in action verbs in contrast to abstract verbs activates motor brain regions different from those involved in the verbal encoding of actions for later enactment. Differential activation for the verbal encoding of to-be-enacted actions in contrast to to-be-reported actions was found in brain regions known to be involved in covert motor preparation for hand movements, i.e. the postcentral gyrus, the precuneus, the dorsal and ventral premotor cortex, the posterior middle temporal gyrus and the inferior parietal lobule. There was no overlap between these brain regions and those differentially activated during the verbal encoding of actions in contrast to abstract verbs for later verbal report. Consequently, the results of this fMRI study suggest the presence of preparatory motor operations during the encoding of delayed intentions requiring a future motor response, which cannot be attributed to semantic information inherent to action verbs.

The mirror neuron system and the consequences of its dysfunction

The discovery of premotor and parietal cells known as mirror neurons in the macaque brain that fire not only when the animal is in action, but also when it observes others carrying out the same actions provides a plausible neurophysiological mechanism for a variety of important social behaviours, from imitation to empathy. Recent data also show that dysfunction of the mirror neuron system in humans might be a core deficit in autism, a socially isolating condition. Here, we review the neurophysiology of the mirror neuron system and its role in social cognition and discuss the clinical implications of mirror neuron dysfunction.

Observing complex action sequences: The role of the fronto-parietal mirror neuron system

A fronto-parietal mirror neuron network in the human brain supports the ability to represent and understand observed actions allowing us to successfully interact with others and our environment. Using functional magnetic resonance imaging (fMRI), we wanted to investigate the response of this network in adults during observation of hierarchically organized action sequences of varying complexity that emerge at different developmental stages. We hypothesized that fronto-parietal systems may play a role in coding the hierarchical structure of object-directed actions. The observation of all action sequences recruited a common bilateral network including the fronto-parietal mirror neuron system and occipito-temporal visual motion areas. Activity in mirror neuron areas varied according to the motoric complexity of the observed actions, but not according to the developmental sequence of action structures, possibly due to the fact that our subjects were all adults. These results suggest that the mirror neuron system provides a fairly accurate simulation process of observed actions, mimicking internally the level of motoric complexity. We also discuss the results in terms of the links between mirror neurons, language development and evolution.

A Neurolinguistic Model of Grammatical Construction Processing

One of the functions of everyday human language is to communicate meaning. Thus, when one hears or reads the sentence, “John gave a book to Mary,” some aspect of an event concerning the transfer of possession of a book from John to Mary is (hopefully) transmitted. One theoretical approach to language referred to as construction grammar emphasizes this link between sentence structure and meaning in the form of grammatical constructions. The objective of the current research is to (1) outline a functional description of grammatical construction processing based on principles of psycholinguistics, (2) develop a model of how these functions can be implemented in human neurophysiology, and then (3) demonstrate the feasibility of the resulting model in processing languages of typologically diverse natures, that is, English, French, and Japanese. In this context, particular interest will be directed toward the processing of novel compositional structure of relative phrases. The simulation results are discussed in the context of recent neurophysiological studies of language processing.

Functional activation in parieto-premotor and visual areas dependent on congruency between hand movement and visual stimuli during motor-visual priming

Electrophysiological studies in monkeys and neuroimaging studies of humans have shown that action execution and action observation share neural processing sites traditionally thought to be responsible for motor execution alone. This experiment investigates a behavioral phenomenon in which a visual discrimination task is influenced by concurrent motor performance. Functional magnetic resonance imaging (fMRI) was used to determine whether this discrimination task uses components of the motor system. Participants viewed and responded to an animated hand while performing either congruent or incongruent right hand actions; the visual presentation was either a sequence showing a hand opening and closing, or randomly ordered frames from this series. The participant responded to onscreen target hand postures on a left footpedal. Previous behavioral results have shown a reaction time advantage on this discrimination task when performing congruent compared to incongruent hand actions, but only for sequential visual presentation. Left superior parietal lobule (SPL) and dorsal premotor cortex were more strongly activated when visual series and hand action did not match, as were dorsal premotor cortex and primary visual cortex. These results suggest that mismatches between performed action and visual feedback produce an inaccurate neural representation of limb state, which we suggest causes the contralateral SPL activation. This representation could not be used in the visual discrimination task, requiring increased reliance on direct visual inputs in order to perform the discrimination task accurately.

A mirror representation of others' actions in the human anterior parietal cortex

The anterior part of the human intraparietal sulcus is known to be involved in visually guided grasping. This region is also active during the observation of object manipulation by others. Here, we explore the nature of action representation using functional magnetic resonance imaging (fMRI). Fourteen subjects observed video clips showing object manipulation by the right or left hand. The clips were presented in either the right or left peripheral visual field. The fMRI activation in the occipital cortex and in the caudal sections of the parietal cortex was specific to the visual-field location of the clips. In contrast, the principal factor determining the response in anterior intraparietal cortex was the identity of the observed hand. Furthermore, these "hand-specific" parietal areas also showed contralateral hand specificity during self action (i.e., object manipulation) without visual feedback. A similar selectivity for the identity of the observed hand was seen when using a region of interest analysis, focusing on individually defined visuomotor voxels within the parietal cortex. This dual visuomotor grasping representation lends further evidence for the existence of a mirror system in humans and suggests that the anterior intraparietal cortex is involved in the specific motor simulation of hand actions.

Seeing or Doing? Influence of Visual and Motor Familiarity in Action Observation

The human brain contains specialized circuits for observing and understanding actions. Previous studies have not distinguished whether this "mirror system" uses specialized motor representations or general processes of visual inference and knowledge to understand observed actions. We report the first neuroimaging study to distinguish between these alternatives. Purely motoric influences on perception have been shown behaviorally, but their neural bases are unknown. We used fMRI to reveal the neural bases of motor influences on action observation. We controlled for visual and knowledge effects by studying expert dancers. Some ballet moves are performed by only one gender. However, male and female dancers train together and have equal visual familiarity with all moves. Male and female dancers viewed videos of gender-specific male and female ballet moves. We found greater premotor, parietal, and cerebellar activity when dancers viewed moves from their own motor repertoire, compared to opposite-gender moves that they frequently saw but did not perform. Our results show that mirror circuits have a purely motor response over and above visual representations of action. We understand actions not only by visual recognition, but also motorically. In addition, we confirm that the cerebellum is part of the action observation network.

Empathy and the Somatotopic Auditory Mirror System in Humans

How do we understand the actions of other individuals if we can only hear them? Auditory mirror neurons respond both while monkeys perform hand or mouth actions and while they listen to sounds of similar actions . This system might be critical for auditory action understanding and language evolution . Preliminary evidence suggests that a similar system may exist in humans . Using fMRI, we searched for brain areas that respond both during motor execution and when individuals listened to the sound of an action made by the same effector. We show that a left hemispheric temporo-parieto-premotor circuit is activated in both cases, providing evidence for a human auditory mirror system. In the left premotor cortex, a somatotopic pattern of activation was also observed: A dorsal cluster was more involved during listening and execution of hand actions, and a ventral cluster was more involved during listening and execution of mouth actions. Most of this system appears to be multimodal because it also responds to the sight of similar actions. Finally, individuals who scored higher on an empathy scale activated this system more strongly, adding evidence for a possible link between the motor mirror system and empathy.

Observation of a finger or an object movement primes imitative responses differentially

Behavioural advantages for imitation of human movements over movements instructed by other visual stimuli are attributed to an 'action observation-execution matching' (AOEM) mechanism. Here, we demonstrate that priming/exogenous cueing with a videotaped finger movement stimulus (S1) produces specific congruency effects in reaction times (RTs) of imitative responses to a target movement (S2) at defined stimulus onset asynchronies (SOAs). When contrasted with a moving object at an SOA of 533 ms, only a human movement is capable of inducing an effect reminiscent of 'inhibition of return' (IOR), i.e. a significant advantage for imitation of a subsequent incongruent as compared to a congruent movement. When responses are primed by a finger movement at SOAs of 533 and 1,200 ms, inhibition of congruent or facilitation of incongruent responses, respectively, is stronger as compared to priming by a moving object. This pattern does not depend on whether S2 presents a finger movement or a moving object, thus effects cannot be attributed to visual similarity between S1 and S2. We propose that, whereas both priming by a finger movement and a moving object induces processes of spatial orienting, solely observation of a human movement activates AOEM. Thus, S1 immediately elicits an imitative response tendency. As an overt imitation of S1 is inadequate in the present setting, the response is inhibited which, in turn, modulates congruency effects.

An event-related potential component sensitive to images of the human body

One of the critical functions of vision is to provide information about other individuals. Neuroimaging experiments examining the cortical regions that analyze the appearance of other people have found partially overlapping networks that respond selectively to human faces and bodies. In event-related potential (ERP) studies, faces systematically elicit a negative component peaking 170 ms after presentation - the N170. To characterize the electrophysiological response to human bodies, we compared the ERPs elicited by faces, bodies and various control stimuli. In Experiment 1, a comparison of ERPs elicited by faces, bodies, objects and places showed that pictures of the human body (without the head) elicit a negative component peaking at 190 ms (an N190). While broadly similar to the N170, the N190 differs in both spatial distribution and amplitude from the N1 components elicited by faces, objects and scenes and peaks significantly later than the N170. The difference between N190 and N170 was further supported using topographic analyses of ERPs and source localization techniques. A unique, stable map topography was found to characterize human bodies between 130 and 230 ms. In Experiment 2, we tested the four conditions from Experiment 1, as well as intact and scrambled silhouettes and stick figures of the human body. We found that intact silhouettes and stick figures elicited significantly greater N190 amplitudes than their scrambled counterparts. Thus, the N190 generalizes to some degree to schematic depictions of the human form. Overall, our findings are consistent with intertwined, but functionally distinct, neural representations of the human face and body.

A dynamic model for action understanding and goal-directed imitation

The understanding of other individuals' actions is a fundamental cognitive skill for all species living in social groups. Recent neurophysiological evidence suggests that an observer may achieve the understanding by mapping visual information onto his own motor repertoire to reproduce the action effect. However, due to differences in embodiment, environmental constraints or motor skills, this mapping very often cannot be direct. In this paper, we present a dynamic network model which represents in its layers the functionality of neurons in different interconnected brain areas known to be involved in action observation/execution tasks. The model aims at substantiating the idea that action understanding is a continuous process which combines sensory evidence, prior task knowledge and a goal-directed matching of action observation and action execution. The model is tested in variations of an imitation task in which an observer with dissimilar embodiment tries to reproduce the perceived or inferred end-state of a grasping-placing sequence. We also propose and test a biologically plausible learning scheme which allows establishing during practice a goal-directed organization of the distributed network. The modeling results are discussed with respect to recent experimental findings in action observation/execution studies.

Functions of the mirror neuron system: implications for neurorehabilitation

Mirror neurons discharge during the execution of hand object-directed actions and during the observation of the same actions performed by other individuals. These neurons were first identified in the ventral premotor cortex (area F5) and later on in the inferior parietal lobule of monkey brain, thus constituting the mirror neuron system. More recently, mirror neurons for mouth object-directed actions have also been found in the monkey. Several pieces of experimental data demonstrate that a mirror neuron system devoted to hand, mouth, and foot actions is also present in humans. In the present paper we review the experimental evidence on the role of the mirror neuron system in action understanding, imitation learning of novel complex actions, and internal rehearsal (motor imagery) of actions. On the basis of features of the mirror neuron system and its role in action understanding and imitation, we discuss the possible use of action observation and imitation as an approach for systematic training in the rehabilitation of patients with motor impairment of the upper limb after stroke.

Brain regions concerned with perceptual skills in tennis: an fMRI study

Sporting performance makes special demands on perceptual skills, but the neural mechanisms underlying such performance are little understood. We address this issue, making use of fMRI to identify the brain areas activated in viewing and responding to video sequences of tennis players, filmed from the opponent's perspective. In a block-design, fMRI study, 9 novice tennis players watched video clips of tennis play. The main stimulus conditions were (1) serve sequences, (2) non-serve behaviour (ball bouncing) and (3) static control sequences. A button response was required indicating the direction of serve (left or right for serve sequences, middle button for non-serve and static sequences). By comparing responses to the three stimulus conditions, it was possible to identify two groups of brain regions responsive to different components of the task. Areas MT/MST and STS in the posterior part of the temporal lobe responded either to serve and to non-serve stimuli, relative to static controls. Serve sequences produced additional regions of activation in the parietal lobe (bilateral IPL, right SPL) and in the right frontal cortex (IFGd, IFGv), and these areas were not activated by non-serve sequences. These regions of the parietal and frontal cortex have been implicated in a "mirror neuron" network in the human brain. It is concluded that the task of judgement of serve direction produces two different patterns of response: activations in the MT/MST and STS concerned with primarily with the analysis of motion and body actions, and activations in the parietal and frontal cortex associated specifically with the task of identification of direction of serve.

Neural circuits involved in imitation and perspective-taking

Is it important to adopt the perspective of the model when learning a new skill? Is the "mirror system" equally involved when the teacher is facing or side-by-side with students? In this functional MRI study, we measured the cerebral hemodynamic changes in participants who watched video-clips depicting simple hand or foot actions. The participants either watched passively or imitated these actions. Half the video-clips depicted actions filmed from the perspective of the participant (1st-person perspective) and half from a frontal view as if watching someone else (3rd-person perspective). Behavioral results showed that latency to imitate was significantly shorter for the 1st-person perspective than the 3rd-person perspective. Functional imaging results demonstrate that the observation of intransitive actions engaged primary visual and extrastriate visual areas, but not the premotor cortex. Imitation vs. observation of actions yielded enhanced signal in the contralateral somatosensory and motor cortices, cerebellum, left inferior parietal lobule and superior parietal cortex, and left ventral premotor cortex. Activity in the lateral occipital cortex around the extrastriate body area was significantly enhanced during imitation, as compared to observation of actions confirming that this region involvement reaches beyond the perception of body parts. Moreover, comparisons of the two visual perspectives showed more activity in the left sensory-motor cortex for 1st-person, even during observation alone, and in the lingual gyrus for 3rd-person perspective. These findings suggest that the 1st-person perspective is more tightly coupled to the sensory-motor system than the 3rd-person perspective, which requires additional visuospatial transformation.

Variability of EEG synchronization prior to and during observation and execution of a sequential finger movement

The aim of this study was to test the validity of mirror neuron activity in humans through analysis of electroencephalographic (EEG) functional connectivity during an action not directed towards an object. We investigated changes in EEG interchannel synchronization prior to and during action execution and also prior to and during observation of the same action. Twelve participants observed a simple finger movement sequence. In a second testing session they physically executed the movement. EEGs were recorded from 19 active sites across the cortex. Activity was considered in four frequency bands (7-10 Hz, 10-13 Hz, 13-20 Hz, and 20-30 Hz) using a new measure: synchronization likelihood. This technique considers rapid changes in signal synchronization and spatiotemporal patterns of coherence. The results revealed no statistically significant difference in synchronization likelihood between the observation and execution data. We found an increase in synchronization over a broad frequency range during task processing and suggest that this may reflect interregional cortical coupling of intricately and hierarchically interconnected networks that are active in a similar way during both observation and execution of a movement. While EEG may be insensitive to differences present during the observation and execution of a movement, the results of the present study shed some light on the general mechanisms of cognitive integration.

Perception of socially relevant stimuli in schizophrenia

To examine whether patients with schizophrenia have deficits in the appraisal of socially relevant stimuli, we tested 20 patients and 14 healthy volunteers equated for parental socioeconomic status on recognition of gender stimuli, emotional people stimuli, and emotional scenes. Patients with schizophrenia showed deficits in discrimination of subtle gender differences and in the identification of emotion from human shapes and body motion. Patients showed no impairment on measures of hedonic appraisal of emotional scenes and recognition of emotional expression in human face stimuli. Across tasks, subjects with schizophrenia showed poorer identification of happiness, anger, and fear. The findings point towards circumscribed domains of impaired social cognition in schizophrenia and suggest specific further hypotheses about the neural dysfunction that may underlie them.

The neuroscience of observing consciousness & mirror neurons in therapeutic hypnosis

Neuroscience documents the activity of "mirror neurons" in the human brain as a mechanism whereby we experience empathy and recognize the intentions of others by observing their behavior and automatically matching their brain activity. This neural basis of empathy finds support in research on dysfunctions in the mirror systems of humans with autism and fMRI research on normal subjects designed to assess intentionality, emotions, and complex cognition. Such empathy research now appears to be consistent with the historical and research literature on hypnotic induction, rapport, and many of the classical phenomena of suggestion. A preliminary outline of how mirror neurons may function as a rapport zone mediating between observing consciousness, the gene expression/protein synthesis cycle, and brain plasticity in therapeutic hypnosis and psychosomatic medicine is proposed. Brain plasticity is generalized in the theory, research, and practice of utilizing mirror neurons as an explanatory framework in developing and training new skill sets for facilitating an activity-dependent approach to creative problem solving, mind-body healing, and rehabilitation with therapeutic hypnosis.

Goal representation in human anterior intraparietal sulcus

When a child reaches toward a cookie, the watching parent knows immediately what the child wants. The neural basis of this ability to interpret other people's actions in terms of their goals has been the subject of much speculation. Research with infants has shown that 6 month olds respond when they see an adult reach to a novel goal but habituate when an adult reaches to the same goal repeatedly. We used a similar approach in an event-related functional magnetic resonance imaging experiment. Adult participants observed a series of movies depicting goal-directed actions, with the sequence controlled so that some goals were novel and others repeated relative to the previous movie. Repeated presentation of the same goal caused a suppression of the blood oxygen level-dependent response in two regions of the left intraparietal sulcus. These regions were not sensitive to the trajectory taken by the actor's hand. This result demonstrates that the anterior intraparietal sulcus represents the goal of an observed action.

Human parietal cortex in action

Experiments using functional neuroimaging and transcranial magnetic stimulation in humans have revealed regions of the parietal lobes that are specialized for particular visuomotor actions, such as reaching, grasping and eye movements. In addition, the human parietal cortex is recruited by processing and perception of action-related information, even when no overt action occurs. Such information can include object shape and orientation, knowledge about how tools are employed and the understanding of actions made by other individuals. We review the known subregions of the human posterior parietal cortex and the principles behind their organization.

Action understanding requires the left inferior frontal cortex

Numerous studies have established that inferior frontal cortex is active when hand actions are planned, imagined, remembered, imitated, and even observed. Furthermore, it has been proposed that these activations reflect a process of simulating the observed action to allow it to be understood and thus fully perceived. However, direct evidence for a perceptual role for left inferior frontal cortex is rare, and linguistic or motor contributions to the reported activations have not been ruled out. We used repetitive transcranial magnetic stimulation (rTMS) over inferior frontal gyrus during a perceptual weight-judgement task to test the hypothesis that this region contributes to action understanding. rTMS at this site impaired judgments of the weight of a box lifted by a person, but not judgements of the weight of a bouncing ball or of stimulus duration, and rTMS at control sites had no impact. This demonstrates that the integrity of left inferior frontal gyrus is necessary to make accurate perceptual judgments about other people's actions.

Cortical signatures of noun and verb production

Categories like "noun" and "verb" represent the basic units of grammar in all human languages, and the retrieval of categorical information associated with words is an essential step in the production of grammatical speech. Studies of brain-damaged patients suggest that knowledge of nouns and verbs can be spared or impaired selectively; however, the neuroanatomical correlates of this dissociation are not well understood. We used event-related functional MRI to identify cortical regions that were active when English-speaking subjects produced nouns or verbs in the context of short phrases. Two regions, in the left prefrontal cortex and left superior parietal lobule, were selectively activated for verb trials compared with noun trials; one region in the left inferior temporal lobe was more active during noun production than verb production. We propose that these regions are involved in representing core conceptual properties of nouns and verbs.

Comparable Mechanisms for Action and Language: Neural Systems Behind Intentions, Goals, and Means

In this position paper we explore correspondence between neural systems for language and action starting from recent electrophysiological findings on the roles of posterior and frontal areas in goal-directed grasping actions. The paper compares the perceptual and motor organization for action and language, and discusses similarities between the impairments of apraxic and aphasic patients. Furthermore, based on the anatomical connectivity of Brodmann areas (BA) 44 and 45 separate functional roles are proposed for the two constituent parts of Broca's area. The final part of the paper includes a discussion on the role of BA 44 and neighboring areas in sequential processing for action and language.

Encoding a motor memory in the older adult by action observation

The ability of motor training to encode a motor memory is reduced in older adults. Here, we tested the hypothesis that training-dependent memory encoding, an issue of relevance in neurorehabilitation, is enhanced in elder individuals by action observation which alone can contribute to learning processes. A group of 11 healthy older adults participated in this study, which consisted of three randomized counterbalanced sessions on different days testing the effects of motor training (MT) alone, action observation (AO) alone, and a combination of both (MT + AO) on motor memory encoding. The combination of MT + AO formed a motor memory in the primary motor cortex and differentially modulated motor cortical excitability in muscles that were agonist and antagonist with respect to the training task, but MT or AO alone did not. These results suggest that action observation can enhance the effects of motor training on memory encoding protocols in the older adult, possibly through Hebbian modulation of intracortical excitatory mechanisms.

Towards a unifying neural theory of social cognition

Humans can effortlessly understand a lot of what is going on in other peoples' minds. Understanding the neural basis of this capacity has proven quite difficult. Since the discovery of mirror neurons, a number of successful experiments have approached the question of how we understand the actions of others from the perspective of sharing their actions. Recently we have demonstrated that a similar logic may apply to understanding the emotions and sensations of others. Here, we therefore review evidence that a single mechanism (shared circuits) applies to actions, sensations and emotions: witnessing the actions, sensations and emotions of other individuals activates brain areas normally involved in performing the same actions and feeling the same sensations and emotions. We propose that these circuits, shared between the first (I do, I feel) and third person perspective (seeing her do, seeing her feel) translate the vision and sound of what other people do and feel into the language of the observers own actions and feelings. This translation could help understand the actions and feelings of others by providing intuitive insights into their inner life. We propose a mechanism for the development of shared circuits on the basis of Hebbian learning, and underline that shared circuits could integrate with more cognitive functions during social cognitions.

Differential cerebral activation during observation of expressive gestures and motor acts

We compared brain activation involved in the observation of isolated right hand movements (e.g. twisting a lid), body-referred movements (e.g. brushing teeth) and expressive gestures (e.g. threatening) in 20 healthy subjects by using functional magnetic resonance imaging (fMRI). Perception-related areas in the occipital and inferior temporal lobe but also the mirror neuron system in the lateral frontal (ventral premotor cortex and BA 44) and superior parietal lobe were active during all three conditions. Observation of body-referred compared to common hand actions induced increased activity in the bilateral posterior superior temporal sulcus (STS), the left temporo-parietal lobe and left BA 45. Expressive gestures involved additional areas related to social perception (bilateral STS, temporal poles, medial prefrontal lobe), emotional processing (bilateral amygdala, bilateral ventrolateral prefrontal cortex (VLPFC), speech and language processing (Broca's and Wernicke's areas) and the pre-supplementary motor area (pre-SMA). In comparison to body-referred actions, expressive gestures evoked additional activity only in the left VLPFC (BA 47). The valence-ratings for expressive gestures correlated significantly with activation intensity in the VLPFC during expressive gesture observation. Valence-ratings for negative expressive gestures correlated with right STS-activity. Our data suggest that both, the VLPFC and the STS are coding for differential emotional valence during the observation of expressive gestures.

FMRI analysis of neural mechanisms underlying rehabilitation in virtual reality: activating secondary motor areas

A pilot functional MRI study on a control subject investigated the possibility of inducing increased neural activations in primary, as well as secondary motor areas through virtual reality-based exercises of the hand. These areas are known to be important in effective motor output in stroke patients with impaired corticospinal systems. We found increased activations in these brain areas during hand exercises in VR when compared to vision of non-anthropomorphic shapes. Further studies are needed to investigate the potential of virtual reality-based rehabilitation for tapping into the properties of the mirror neuron system to stimulate plasticity in sensorimotor areas.

Sign Language Processing and the Mirror Neuron System

In this paper we review evidence for frontal and parietal lobe involvement in sign language comprehension and production, and evaluate the extent to which these data can be interpreted within the context of a mirror neuron system for human action observation and execution. We present data from three literatures--aphasia, cortical stimulation, and functional neuroimaging. Generally, we find support for the idea that sign language comprehension and production can be viewed in the context of a broadly-construed frontal-parietal human action observation/execution system. However, sign language data cannot be fully accounted for under a strict interpretation of the mirror neuron system. Additionally, we raise a number of issues concerning the lack of specificity in current accounts of the human action observation/execution system.

Cyclic time course of motor excitability modulation during the observation of a cyclic hand movement

The observation of a sinusoidal flexion-extension of the wrist was utilized to determine the continuous time course and phase relation between observed movement and its effects on the observer's motor pathways. While observing movements performed by others, the observers' cortical motor areas and spinal circuits were activated, reflecting the specific temporal and muscular pattern of the actual movement (motor resonance). H-reflexes and motor-evoked potentials (MEPs) were elicited, respectively, by electrical stimulation of the median nerve and magnetic stimulation of the appropriate cortical area, in the right forearm muscle Flexor Carpi Radialis (FCR) of subjects who were observing a 1-Hz cyclic oscillation of the right prone hand executed by a different person. Observation elicited a parallel cyclic excitability modulation of the observer's H-reflex and MEP responses with identical period as the observed movement. Modulation was phase advanced, as is muscle activation with respect to the real movement. The same results were obtained when the observed hand oscillation was executed with different frequency (1.6 Hz) and when the hands of mover and observer were supine. No motor resonance was elicited by observing the oscillation of a metal platform. The excitability modulation of MEPs simultaneously monitored in both antagonists of the observer's forearm (FCR and Extensor Carpi Radialis, ECR) was in almost perfect phase opposition, reflecting their natural reciprocal activation during the execution of a hand oscillation. These findings suggest that during observation, motor pathways are modulated subliminally reproducing with high temporal fidelity the motor commands needed to execute the observed movement.

Neural mechanisms of imitation

Recent advances in our knowledge of the neural mechanisms of imitation suggest that there is a core circuitry of imitation comprising the superior temporal sulcus and the 'mirror neuron system', which consists of the posterior inferior frontal gyrus and adjacent ventral premotor cortex, as well as the rostral inferior parietal lobule. This core circuitry communicates with other neural systems according to the type of imitation performed. Imitative learning is supported by interaction of the core circuitry of imitation with the dorsolateral prefrontal cortex and perhaps motor preparation areas--namely, the mesial frontal, dorsal premotor and superior parietal areas. By contrast, imitation as a form of social mirroring is supported by interaction of the core circuitry of imitation with the limbic system.

Action selectivity in parietal and temporal cortex

The sensory-action theory proposes that the neural substrates underlying action representations are related to a visuomotor action system encompassing the left ventral premotor cortex, the anterior intraparietal (AIP) and left posterior middle temporal gyrus (LPMT). Using fMRI, we demonstrate that semantic decisions on action, relative to non-action words, increased activation in the left AIP and LPMT irrespective of whether the words were presented in a written or spoken form. Left AIP and LPMT might thus play the role of amodal semantic regions that can be activated via auditory as well as visual input. Left AIP and LPMT did not distinguish between different types of actions such as hand actions and whole body movements, although a right STS region responded selectively to whole body movements.