Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study

Die Fähigkeiten von Athleten verändern deren Wahrnehmung von Handlungen

Zusammenfassung. Wie nimmt das menschliche visuelle System Handlungen wahr? – Traditionelle Modelle der visuellen Wahrnehmung nehmen an, dass bei allen Beobachtern die gleichen visuellen Prozesse der Analyse von visuellen Stimuli unterschiedlicher Art zu Grunde liegen. Dieser theoretische Ansatz sagt vorher, dass unterschiedliche Personen Gegenstände und Handlungen in gleicher Art und Weise wahrnehmen, unabhängig davon, ob sich ihr Bewegungssystem beispielsweise durch krankheitsbedingte Veränderungen oder Trainingsanpassungen unterscheidet. Demgegenüber nehmen Theorien der embodied perception an, dass individuelle Fähigkeiten des Beobachters die visuelle Wahrnehmung beeinflussen. Ausgehend von diesem Ansatz ist das, was man sieht, dadurch bestimmt, was man physisch tun (kann). Menschliche Bewegung wird dabei als eine spezielle Kategorie von visuellen Bewegungsreizen angesehen, da es die einzige Bewegungsart ist, welche der Mensch ausführen und wahrnehmen kann. Der vorliegende Artikel gibt einen Überblick über aktuelle neuro- und verhaltenswissenschaftliche Befunde zur visuellen Wahrnehmung menschlicher Bewegung unter besonderer Berücksichtigung der Rolle des motorischen Systems. Dabei wird auf die Wahrnehmung von Athleten eingegangen, da diese Personengruppe über spezifische motorische und visuelle Fähigkeiten verfügt, welche den Erklärungswert traditioneller Theorien der visuellen Wahrnehmung kritisch hinterfragen.

Familiarity modulates mirror neuron and mentalizing regions during intention understanding

Recent research suggests that the inference of others' intentions from their observed actions is supported by two neural systems that perform complementary roles. The human putative mirror neuron system (pMNS) is thought to support automatic motor simulations of observed actions, with increased activity for previously experienced actions, whereas the mentalizing system provides reflective, non-intuitive reasoning of others' perspectives, particularly in the absence of prior experience. In the current fMRI study, we show how motor familiarity with an action and perceptual familiarity with the race of an actor uniquely modulate these two systems. Chinese participants were asked to infer the intentions of actors performing symbolic gestures, an important form of non-verbal communication that has been shown to activate both mentalizing and mirror neuron regions. Stimuli were manipulated along two dimensions: (1) actor's race (Caucasian vs. Chinese actors) and (2) participants' level of experience with the gestures (familiar or unfamiliar). We found that observing all gestures compared to observing still images was associated with increased activity in key regions of both the pMNS and mentalizing systems. In addition, observations of one's same race generated greater activity in the posterior pMNS-related regions and the insula than observations of a different race. Surprisingly, however, familiar gestures more strongly activated regions associated with mentalizing, while unfamiliar gestures more strongly activated the posterior region of the pMNS, a finding that is contrary to prior literature and demonstrates the powerful modulatory effects of both motor and perceptual familiarity on pMNS and mentalizing regions when asked to infer the intentions of intransitive gestures.

Embodiment in early development

'Embodiment' has come to represent the many ways in which the body influences the functioning of the brain and cognitive processing. This article on embodiment and early development reviews several examples of studies demonstrating embodiment in cognitive tasks. Our overall message is that what the body does during cognitive processing influences cognition in important ways. This might be especially true during early development, before actions are automatized. WIREs Cogn Sci 2011 2 117-123 DOI: 10.1002/wcs.109 For further resources related to this article, please visit the WIREs website.

Cortical networks representing object categories and high-level attributes of familiar real-world action sounds

In contrast to visual object processing, relatively little is known about how the human brain processes everyday real-world sounds, transforming highly complex acoustic signals into representations of meaningful events or auditory objects. We recently reported a fourfold cortical dissociation for representing action (nonvocalization) sounds correctly categorized as having been produced by human, animal, mechanical, or environmental sources. However, it was unclear how consistent those network representations were across individuals, given potential differences between each participant's degree of familiarity with the studied sounds. Moreover, it was unclear what, if any, auditory perceptual attributes might further distinguish the four conceptual sound-source categories, potentially revealing what might drive the cortical network organization for representing acoustic knowledge. Here, we used functional magnetic resonance imaging to test participants before and after extensive listening experience with action sounds, and tested for cortices that might be sensitive to each of three different high-level perceptual attributes relating to how a listener associates or interacts with the sound source. These included the sound's perceived concreteness, effectuality (ability to be affected by the listener), and spatial scale. Despite some variation of networks for environmental sounds, our results verified the stability of a fourfold dissociation of category-specific networks for real-world action sounds both before and after familiarity training. Additionally, we identified cortical regions parametrically modulated by each of the three high-level perceptual sound attributes. We propose that these attributes contribute to the network-level encoding of category-specific acoustic knowledge representations.

Emotions in action through the looking glass

The paper aims at highlighting how our primary understanding of others' actions is rooted in the mirror mechanism. To this end, the anatomical architecture of the mirror neuron system for action will be outlined as well as its role in grasping goals and intentions in others' motor behaviour. One further step through the looking glass of social cognition will be referring to the ubiquitous emotional colouring of actions and considering its links with the motor domain. This will allow a clearer perspective on the mechanism underlying our abilities for emotional understanding and on cases in which these abilities are amiss, as in autistic spectrum disorders.

Lesions to the motor system affect action perception

Several studies have shown that the motor system is involved in action perception, suggesting that action concepts are represented through sensory-motor processes. Such conclusions imply that motor system impairments should diminish action perception. To test this hypothesis, a group of 10 brain-damaged patients with hemiplegia (specifically, a lesion at the motor system that affected the contralesional arm) viewed point-light displays of arm gestures and attempted to name each gesture. To create the dynamic stimuli, patients individually performed simple gestures with their unaffected arm while being videotaped. The videotapes were converted into point-light animations. Each action was presented as it had been performed, that is, as having been produced by the observer's unaffected arm, and in its mirror reversed orientation, that is, as having been produced by the observer's hemiplegic arm. Action recognition accuracy by patients with hemiplegia was compared with that by 8 brain-damaged patients without any motor deficit and by 10 healthy controls. Overall, performance was better in control observers than in patients. Most importantly, performance by hemiplegic patients, but not by nonhemiplegic patients and controls, varied systematically as a function of the observed limb. Action recognition was best when hemiplegic patients viewed actions that appeared to have been performed by their unaffected arm. Action recognition performance dropped significantly when hemiplegic patients viewed actions that appeared to have been produced with their hemiplegic arm or the corresponding arm of another person. The results of a control study involving the recognition of point-light defined animals in motion indicate that a generic deficit to visual and cognitive functions cannot account for this laterality-specific deficit in action recognition. Taken together, these results suggest that motor cortex impairment decreases visual sensitivity to human action. Specifically, when a cortical lesion renders an observer incapable of performing an observed action, action perception is compromised, possibly by a failure to map the observed action onto the observer's contralesional hemisoma.

Motor imagery beyond the joint limits: a transcranial magnetic stimulation study

The processes and neural bases used for motor imagery are also used for the actual execution of correspondent movements. Humans, however, can imagine movements they cannot perform. Here we explored whether plausibility of movements is mapped on the corticospinal motor system and whether the process is influenced by visuomotor vs. kinesthetic-motor first person imagery strategy. Healthy subjects imagined performing possible or biomechanically impossible right index finger movements during single pulse TMS of the left motor cortex. We found an increase of corticospinal excitability during motor imagery which was higher for impossible than possible movements and specific for the muscle involved in the actual execution of the imagined movement. We expand our previous action observation studies, suggesting that the plausibility of a movement is computed in regions upstream the primary motor cortex, and that motor imagery is a higher-order process not fully constrained by the rules that govern motor execution.

Hemispheric asymmetries of motor versus nonmotor processes during (visuo)motor control

Language and certain aspects of motor control are typically served by the left hemisphere, whereas visuospatial and attentional control are lateralized to the right. Here a (visuo)motor tracing task was used to identify hemispheric lateralization beyond the general, contralateral organization of the motor system. Functional magnetic resonance imaging (fMRI) was applied in 40 male right-handers (19-30 yrs) during line tracing with dominant and nondominant hand, with and without visual guidance. Results revealed a network of areas activating more in the right than left hemisphere, irrespective of the effector. Inferior portions of frontal gyrus and parietal lobe overlapped largely with a previously described ventral attention network responding to unexpected or behaviourally relevant stimuli. This demonstrates a hitherto unreported functionality of this circuit that also seems to activate when spatial information is continuously exploited to adapt motor behaviour. Second, activation of left dorsal premotor and postcentral regions during tracing with the nondominant left hand was more pronounced than that in their right hemisphere homologues during tracing with the dominant right hand. These activation asymmetries of motor areas ipsilateral to the moving hand could not be explained by asymmetries in skill performance, the degree of handedness, or interhemispheric interactions. The latter was measured by a double-pulse transcranial magnetic stimulation paradigm, whereby a conditioning stimulus was applied over one hemisphere and a test stimulus over the other. We propose that the left premotor areas contain action representations strongly related to movement implementation which are also accessed during movements performed with the left body side.

Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures

Background

The humanoid robot WE4-RII was designed to express human emotions in order to improve human-robot interaction. We can read the emotions depicted in its gestures, yet might utilize different neural processes than those used for reading the emotions in human agents.

Methodology

Here, fMRI was used to assess how brain areas activated by the perception of human basic emotions (facial expression of Anger, Joy, Disgust) and silent speech respond to a humanoid robot impersonating the same emotions, while participants were instructed to attend either to the emotion or to the motion depicted.

Principal Findings

Increased responses to robot compared to human stimuli in the occipital and posterior temporal cortices suggest additional visual processing when perceiving a mechanical anthropomorphic agent. In contrast, activity in cortical areas endowed with mirror properties, like left Broca's area for the perception of speech, and in the processing of emotions like the left anterior insula for the perception of disgust and the orbitofrontal cortex for the perception of anger, is reduced for robot stimuli, suggesting lesser resonance with the mechanical agent. Finally, instructions to explicitly attend to the emotion significantly increased response to robot, but not human facial expressions in the anterior part of the left inferior frontal gyrus, a neural marker of motor resonance.

Conclusions

Motor resonance towards a humanoid robot, but not a human, display of facial emotion is increased when attention is directed towards judging emotions.

Significance

Artificial agents can be used to assess how factors like anthropomorphism affect neural response to the perception of human actions.

Gesture imitation in musicians and non-musicians

Imitation plays a crucial role in the learning of many complex motor skills. Recent behavioral and neuroimaging evidence suggests that the ability to imitate is influenced by past experience, such as musical training. To investigate the impact of musical training on motor imitation, musicians and non-musicians were tested on their ability to imitate videoclips of simple and complex two-handed gestures taken from American Sign Language. Participants viewed a set of 30 gestures, one at a time, and imitated them immediately after presentation. Participants' imitations were videotaped and scored off-line by raters blind to participant group. Imitation performance was assessed by a rating of performance accuracy, where the arm, hand, and finger components of the gestures were rated separately on a 5-point scale (1 = unrecognizable; 5 = exact imitation). A global accuracy score (PAglobal) was calculated by summing the three components. Response duration compared to the model (%MTdiff), and reaction time (RT) were also assessed. Results indicated that musicians were able to imitate more accurately than non-musicians, reflected by significantly higher PAglobal and lower %MTdiff scores. Furthermore, the greatest difference in performance was for the fine-motor (finger) gesture component. These findings support the view that the ability to imitate is influenced by experience. This is consistent with generalist theories of motor imitation, which explain imitation in terms of links between perceptual and motor action representations that become strengthened through experience. It is also likely that musical training contributed to the ability to imitate manual gestures by influencing the personal action repertoire of musicians.

Mirror systems

Mirror neurons are a class of visuomotor neurons, discovered in the monkey premotor cortex and in an anatomically connected area of the inferior parietal lobule, that activate both during action execution and action observation. They constitute a circuit dedicated to match actions made by others with the internal motor representations of the observer. It has been proposed that this matching system enables individuals to understand others' behavior and motor intentions. Here we will describe the main features of mirror neurons in monkeys. Then we will present evidence of the presence of a mirror system in humans and of its involvement in several social-cognitive functions, such as imitation, intention, and emotion understanding. This system may have several implications at a cognitive level and could be linked to specific social deficits in humans such as autism. Recent investigations addressed the issue of the plasticity of the mirror neuron system in both monkeys and humans, suggesting also their possible use in rehabilitation. WIREs Cogn Sci 2011 2 22-38 DOI: 10.1002/wcs.89 For further resources related to this article, please visit the WIREs website.

From music making to speaking: engaging the mirror neuron system in autism

Individuals with autism show impairments in emotional tuning, social interactions and communication. These are functions that have been attributed to the putative human mirror neuron system (MNS), which contains neurons that respond to the actions of self and others. It has been proposed that a dysfunction of that system underlies some of the characteristics of autism. Here, we review behavioral and imaging studies that implicate the MNS (or a brain network with similar functions) in sensory-motor integration and speech representation, and review data supporting the hypothesis that MNS activity could be abnormal in autism. In addition, we propose that an intervention designed to engage brain regions that overlap with the MNS may have significant clinical potential. We argue that this engagement could be achieved through forms of music making. Music making with others (e.g., playing instruments or singing) is a multi-modal activity that has been shown to engage brain regions that largely overlap with the human MNS. Furthermore, many children with autism thoroughly enjoy participating in musical activities. Such activities may enhance their ability to focus and interact with others, thereby fostering the development of communication and social skills. Thus, interventions incorporating methods of music making may offer a promising approach for facilitating expressive language in otherwise nonverbal children with autism.

Action Observation Improves Freezing of Gait in Patients With Parkinson’s Disease

Background. Freezing of gait (FOG) is a disabling impairment for people with Parkinson’s disease (PD) and may not respond to medications. The effectiveness of physical therapy for FOG is debatable. Action observation strategies to overcome FOG may enhance physical training. Objective. To assess whether action observation, combined with practicing the observed actions, may reduce FOG episodes. Methods. Twenty patients with PD entered a single-blind trial and were randomly assigned to the experimental (Action) or control (Landscape) groups. Those in the Action group watched video clips showing specific movements and strategies to circumvent FOG episodes, whereas those in the Landscape group watched video clips of static pictures showing different landscapes. All patients underwent identical physical therapy training, 3 sessions a week for 4 weeks. Results. The FOG Questionnaire score and the number of FOG episodes were significantly reduced in both groups after the training period. At follow-up examination (4 weeks after the end of the intervention), a significant reduction in the number of FOG episodes was observed only in the Action group. Motor performance (walking and balance) and quality-of-life assessments were significantly improved in both groups at the end of training and at follow-up. Conclusions. Our results suggest that action observation has a positive additional effect on recovery of walking ability in PD patients with FOG. Further studies on the combination of observation and imitation to supplement a physical training program may result in an innovative rehabilitative approach for FOG.

Disembodying cognition

The idea that concepts are embodied by our motor and sensory systems is popular in current theorizing about cognition. Embodied cognition accounts come in different versions and are often contrasted with a purely symbolic amodal view of cognition. Simulation, or the hypothesis that concepts simulate the sensory and motor experience of real world encounters with instances of those concepts, has been prominent in psychology and cognitive neuroscience. Here, with a focus on spatial thought and language, I review some of the evidence cited in support of simulation versions of embodied cognition accounts. While these data are extremely interesting and many of the experiments are elegant, knowing how to best interpret the results is often far from clear. I point out that a quick acceptance of embodied accounts runs the danger of ignoring alternate hypotheses and not scrutinizing neuroscience data critically. I also review recent work from my lab that raises questions about the nature of sensory motor grounding in spatial thought and language. In my view, the question of whether or not cognition is grounded is more fruitfully replaced by questions about gradations in this grounding. A focus on disembodying cognition, or on graded grounding, opens the way to think about how humans abstract. Within neuroscience, I propose that three functional anatomic axes help frame questions about the graded nature of grounded cognition. First, are questions of laterality differences. Do association cortices in both hemispheres instantiate the same kind of sensory or motor information? Second, are questions about ventral dorsal axes. Do neuronal ensembles along this axis shift from conceptual representations of objects to the relationships between objects? Third, are questions about gradients centripetally from sensory and motor cortices towards and within perisylvian cortices. How does sensory and perceptual information become more language-like and then get transformed into language proper?

Corticospinal excitability during observation and imagery of simple and complex hand tasks: implications for motor rehabilitation

Movement observation and imagery are increasingly propagandized for motor rehabilitation. Both observation and imagery are thought to improve motor function through repeated activation of mental motor representations. However, it is unknown what stimulation parameters or imagery conditions are optimal for rehabilitation purposes. A better understanding of the mechanisms underlying movement observation and imagery is essential for the optimization of functional outcome using these training conditions. This study systematically assessed the corticospinal excitability during rest, observation, imagery and execution of a simple and a complex finger-tapping sequence in healthy controls using transcranial magnetic stimulation (TMS). Observation was conducted passively (without prior instructions) as well as actively (in order to imitate). Imagery was performed visually and kinesthetically. A larger increase in corticospinal excitability was found during active observation in comparison with passive observation and visual or kinesthetic imagery. No significant difference between kinesthetic and visual imagery was found. Overall, the complex task led to a higher corticospinal excitability in comparison with the simple task. In conclusion, the corticospinal excitability was modulated during both movement observation and imagery. Specifically, active observation of a complex motor task resulted in increased corticospinal excitability. Active observation may be more effective than imagery for motor rehabilitation purposes. In addition, the activation of mental motor representations may be optimized by varying task-complexity.

Smelling odors, understanding actions

Previous evidence indicates that we understand others' actions not only by perceiving their visual features but also by their sound. This raises the possibility that brain regions responsible for action understanding respond to cues coming from different sensory modalities. Yet no studies, to date, have examined if this extends to olfaction. Here we addressed this issue by using functional magnetic resonance imaging. We searched for brain activity related to the observation of an action executed towards an object that was smelled rather than seen. The results show that temporal, parietal, and frontal areas were activated when individuals observed a hand grasping a smelled object. This activity differed from that evoked during the observation of a mimed grasp. Furthermore, superadditive activity was revealed when the action target-object was both seen and smelled. Together these findings indicate the influence of olfaction on action understanding and its contribution to multimodal action representations.

IMITATE: An intensive computer-based treatment for aphasia based on action observation and imitation

BACKGROUND: Neurophysiological evidence from primates has demonstrated the presence of mirror neurons, with visual and motor properties, that discharge both when an action is performed and during observation of the same action. A similar system for observation-execution matching may also exist in humans. We postulate that behavioral stimulation of this parietal-frontal system may play an important role in motor learning for speech and thereby aid language recovery after stroke. AIMS: The purpose of this article is to describe the development of IMITATE, a computer-assisted system for aphasia therapy based on action observation and imitation. We also describe briefly the randomized controlled clinical trial that is currently underway to evaluate its efficacy and mechanism of action. METHODS AND PROCEDURES: IMITATE therapy consists of silent observation of audio-visually presented words and phrases spoken aloud by six different speakers, followed by a period during which the participant orally repeats the stimuli. We describe the rationale for the therapeutic features, stimulus selection, and delineation of treatment levels. The clinical trial is a randomized single blind controlled trial in which participants receive two pre-treatment baseline assessments, six weeks apart, followed by either IMITATE or a control therapy. Both treatments are provided intensively (90 minutes per day). Treatment is followed by a post-treatment assessment, and a six-week follow-up assessment. OUTCOMES #ENTITYSTARTX00026; RESULTS: Thus far, five participants have completed IMITATE. We expect the results of the randomized controlled trial to be available by late 2010. CONCLUSIONS: IMITATE is a novel computer-assisted treatment for aphasia that is supported by theoretical rationales and previous human and primate data from neurobiology. The treatment is feasible, and preliminary behavioral data are emerging. However, the results will not be known until the clinical trial data are available to evaluate fully the efficacy of IMITATE and to inform theoretically about the mechanism of action and the role of a human mirror system in aphasia treatment.

Experts see it all: configural effects in action observation

Biological motion perception is influenced by observers' familiarity with the observed action. Here, we used classical dance as a means to investigate how visual and motor experience modulates perceptual mechanism for configural processing of actions. Although some ballet moves are performed by only one gender, male and female dancers train together and acquire visual knowledge of all ballet moves. Twenty-four expert ballet dancers (12 female) and matched non-expert participants viewed pairs of upright and inverted point light female and common dance movements. Visual discrimination between different exemplars of the same movement presented upright was significantly better in experts than controls, whilst no differences were found when the same stimuli were presented upside down. These results suggest expertise influences configural action processing. Within the expert group, effects were stronger for female participants than for males, whilst no differences were found between movement types. This observer gender effect could suggest an additional role for motor familiarity in action perception, over and above the visual experience. Our results are consistent with a specific motor contribution to configural processing of action.

Playing charades in the fMRI: are mirror and/or mentalizing areas involved in gestural communication?

Communication is an important aspect of human life, allowing us to powerfully coordinate our behaviour with that of others. Boiled down to its mere essentials, communication entails transferring a mental content from one brain to another. Spoken language obviously plays an important role in communication between human individuals. Manual gestures however often aid the semantic interpretation of the spoken message, and gestures may have played a central role in the earlier evolution of communication. Here we used the social game of charades to investigate the neural basis of gestural communication by having participants produce and interpret meaningful gestures while their brain activity was measured using functional magnetic resonance imaging. While participants decoded observed gestures, the putative mirror neuron system (pMNS: premotor, parietal and posterior mid-temporal cortex), associated with motor simulation, and the temporo-parietal junction (TPJ), associated with mentalizing and agency attribution, were significantly recruited. Of these areas only the pMNS was recruited during the production of gestures. This suggests that gestural communication relies on a combination of simulation and, during decoding, mentalizing/agency attribution brain areas. Comparing the decoding of gestures with a condition in which participants viewed the same gestures with an instruction not to interpret the gestures showed that although parts of the pMNS responded more strongly during active decoding, most of the pMNS and the TPJ did not show such significant task effects. This suggests that the mere observation of gestures recruits most of the system involved in voluntary interpretation.

Language as gesture

Language can be understood as an embodied system, expressible as gestures. Perception of these gestures depends on the "mirror system," first discovered in monkeys, in which the same neural elements respond both when the animal makes a movement and when it perceives the same movement made by others. This system allows gestures to be understood in terms of how they are produced, as in the so-called motor theory of speech perception. I argue that human speech evolved from manual gestures, with vocal gestures being gradually incorporated into the mirror system in the course of hominin evolution. Speech may have become the dominant mode only with the emergence of Homo sapiens some 170,100 years ago, although language as a relatively complex syntactic system probably emerged over the past 2 million years, initially as a predominantly manual system. Despite the present-day dominance of speech, manual gestures accompany speech, and visuomanual forms of language persist in signed languages of the deaf, in handwriting, and even in such forms as texting.

The observation of manual grasp actions affects the control of speech: a combined behavioral and Transcranial Magnetic Stimulation study

Does the mirror system affect the control of speech? This issue was addressed in behavioral and Transcranial Magnetic Stimulation (TMS) experiments. In behavioral experiment 1, participants pronounced the syllable /da/ while observing (1) a hand grasping large and small objects with power and precision grasps, respectively, (2) a foot interacting with large and small objects and (3) differently sized objects presented alone. Voice formant 1 was higher when observing power as compared to precision grasp, whereas it remained unaffected by observation of the different types of foot interaction and objects alone. In TMS experiment 2, we stimulated hand motor cortex, while participants observed the two types of grasp. Motor Evoked Potentials (MEPs) of hand muscles active during the two types of grasp were greater when observing power than precision grasp. In experiments 3-5, TMS was applied to tongue motor cortex of participants silently pronouncing the syllable /da/ and simultaneously observing power and precision grasps, pantomimes of the two types of grasps, and differently sized objects presented alone. Tongue MEPs were greater when observing power than precision grasp either executed or pantomimed. Finally, in TMS experiment 6, the observation of foot interaction with large and small objects did not modulate tongue MEPs. We hypothesized that grasp observation activated motor commands to the mouth as well as to the hand that were congruent with the hand kinematics implemented in the observed type of grasp. The commands to the mouth selectively affected postures of phonation organs and consequently basic features of phonological units.

Eight problems for the mirror neuron theory of action understanding in monkeys and humans

The discovery of mirror neurons in macaque frontal cortex has sparked a resurgence of interest in motor/embodied theories of cognition. This critical review examines the evidence in support of one of these theories, namely, that mirror neurons provide the basis of action understanding. It is argued that there is no evidence from monkey data that directly tests this theory, and evidence from humans makes a strong case against the position.

How symbolic gestures and words interact with each other

Previous repetitive Transcranial Magnetic Stimulation and neuroimaging studies showed that Broca's area is involved in the interaction between gestures and words. However, in these studies the nature of this interaction was not fully investigated; consequently, we addressed this issue in three behavioral experiments. When compared to the expression of one signal at a time, arm kinematics slowed down and voice parameters were amplified when congruent words plus gestures were simultaneously produced (experiment 1). When word and gesture were incongruent, arm kinematics did not change regardless of word category, whereas the gesture induced variation in vocal parameters of communicative and action words only (experiments 2 and 3). Data are discussed according to the hypothesis that integration between gesture and word occurs by transferring the social intention to interact directly with the interlocutor from the gesture to the word.

Modulation of frontal lobe speech areas associated with the production and perception of speech movements

PURPOSE

It is unclear whether the production and perception of speech movements are subserved by the same brain networks. The purpose of this study was to investigate neural recruitment in cortical areas commonly associated with speech production during the production and visual perception of speech.

METHOD

This study utilized functional magnetic resonance imaging (fMRI) to assess brain function while participants either imitated or observed speech movements.

RESULTS

A common neural network was recruited by both tasks. The greatest frontal lobe activity in Broca's area was triggered not only when producing speech but also when watching speech movements. Relatively less activity was observed in the left anterior insula during both tasks.

CONCLUSION

These results support the emerging view that cortical areas involved in the execution of speech movements are also recruited in the perception of the same movements in other speakers.

Brain basis of human social interaction: from concepts to brain imaging

Modern neuroimaging provides a common platform for neuroscience and related disciplines to explore the human brain, mind, and behavior. We base our review on the social shaping of the human mind and discuss various aspects of brain function related to social interaction. Despite private mental contents, people can share their understanding of the world using, beyond verbal communication, nonverbal cues such as gestures, facial expressions, and postures. The understanding of nonverbal messages is supported by the brain's mirroring systems that are shaped by individual experience. Within the organism-environment system, tight links exist between action and perception, both within an individual and between several individuals. Therefore, any comprehensive brain imaging study of the neuronal basis of social cognition requires appreciation of the situated and embodied nature of human cognition, motivating simultaneous monitoring of brain and bodily functions within a socially relevant environment. Because single-person studies alone cannot unravel the dynamic aspects of interpersonal interactions, it seems both necessary and beneficial to move towards "two-person neuroscience"; technological shortcomings and a limited conceptual framework have so far hampered such a leap. We conclude by discussing some major disorders of social interaction.

The evolution of language

Language, whether spoken or signed, can be viewed as a gestural system, evolving from the so-called mirror system in the primate brain. In nonhuman primates the gestural system is well developed for the productions and perception of manual action, especially transitive acts involving the grasping of objects. The emergence of bipedalism in the hominins freed the hands for the adaptation of the mirror system for intransitive acts for communication, initially through the miming of events. With the emergence of the genus Homo from some 2 million years ago, pressures for more complex communication and increased vocabulary size led to the conventionalization of gestures, the loss of iconic representation, and a gradual shift to vocal gestures replacing manual ones-although signed languages are still composed of manual and facial gestures. In parallel with the conventionalization of symbols, languages gained grammatical complexity, perhaps driven by the evolution of episodic memory and mental time travel, which involve combinations of familiar elements--Who did what to whom, when, where, and why? Language is thus adapted to allow us to share episodic structures, whether past, planned, or fictional, and so increase survival fitness.

Motor abstraction: a neuroscientific account of how action goals and intentions are mapped and understood

Recent findings in cognitive neuroscience shed light on the existence of a common neural mechanism that could account for action and intention to understand abilities in humans and non-human primates. Empirical evidence on the neural underpinnings of action goals and on their ontogeny and phylogeny is introduced and discussed. It is proposed that the properties of the mirror neuron system and the functional mechanism describing them, embodied simulation, enabled pre-linguistic forms of action and intention understanding. Basic aspects of social cognition appear to be primarily based on the motor cognition that underpins one's own capacity to act, here defined as motor abstraction. On the basis of this new account of the motor system, it is proposed that intersubjectivity is the best conceived of as intercorporeity.

Mirror neurons and the social nature of language: the neural exploitation hypothesis

This paper discusses the relevance of the discovery of mirror neurons in monkeys and of the mirror neuron system in humans to a neuroscientific account of primates' social cognition and its evolution. It is proposed that mirror neurons and the functional mechanism they underpin, embodied simulation, can ground within a unitary neurophysiological explanatory framework important aspects of human social cognition. In particular, the main focus is on language, here conceived according to a neurophenomenological perspective, grounding meaning on the social experience of action. A neurophysiological hypothesis--the "neural exploitation hypothesis"--is introduced to explain how key aspects of human social cognition are underpinned by brain mechanisms originally evolved for sensorimotor integration. It is proposed that these mechanisms were later on adapted as new neurofunctional architecture for thought and language, while retaining their original functions as well. By neural exploitation, social cognition and language can be linked to the experiential domain of action.

The mirror neuron system: new frontiers

Since the discovery of mirror neurons, much effort has been invested into studying their location and properties in the human brain. Here we review these original findings and introduce the main topics of this special issue of Social Neuroscience. What does the mirror system code? How is the mirror system embedded into the mosaic of circuits that compose our brain? How does the mirror system contribute to communication, language and social interaction? Can the principle of mirror neurons be extended to emotions, sensations and thoughts? Papers using a wide range of methods, including single cell recordings, fMRI, TMS, EEG and psychophysics, collected in this special issue, start to give us some impressive answers.