Areas Recruited during Action Understanding Are Not Modulated by Auditory or Sign Language Experience

The Language Network Is Recruited but Not Required for Nonverbal Event Semantics

The ability to combine individual concepts of objects, properties, and actions into complex representations of the world is often associated with language. Yet combinatorial event-level representations can also be constructed from nonverbal input, such as visual scenes. Here, we test whether the language network in the human brain is involved in and necessary for semantic processing of events presented nonverbally. In Experiment 1, we scanned participants with fMRI while they performed a semantic plausibility judgment task versus a difficult perceptual control task on sentences and line drawings that describe/depict simple agent-patient interactions. We found that the language network responded robustly during the semantic task performed on both sentences and pictures (although its response to sentences was stronger). Thus, language regions in healthy adults are engaged during a semantic task performed on pictorial depictions of events. But is this engagement necessary? In Experiment 2, we tested two individuals with global aphasia, who have sustained massive damage to perisylvian language areas and display severe language difficulties, against a group of age-matched control participants. Individuals with aphasia were severely impaired on the task of matching sentences to pictures. However, they performed close to controls in assessing the plausibility of pictorial depictions of agent-patient interactions. Overall, our results indicate that the left frontotemporal language network is recruited but not necessary for semantic processing of nonverbally presented events.

Enhancement of visual biological motion recognition in early-deaf adults: Functional and behavioral correlates

Deafness leads to brain modifications that are generally associated with a cross-modal activity of the auditory cortex, particularly for visual stimulations. In the present study, we explore the cortical processing of biological motion that conveyed either non-communicative (pantomimes) or communicative (emblems) information, in early-deaf and hearing individuals, using fMRI analyses. Behaviorally, deaf individuals showed an advantage in detecting communicative gestures relative to hearing individuals. Deaf individuals also showed significantly greater activation in the superior temporal cortex (including the planum temporale and primary auditory cortex) than hearing individuals. The activation levels in this region were correlated with deaf individuals’ response times. This study provides neural and behavioral evidence that cross-modal plasticity leads to functional advantages in the processing of biological motion following lifelong auditory deprivation.

Role of sensorimotor areas in early detection of motor errors: An EEG and TMS study

Action execution is prone to errors and, while engaged in interaction, our brain is tuned to detect deviations from what one expects from other's action. Prior research has shown that Event-Related-Potentials (ERPs) are specifically modulated by the observation of action mistakes interfering with goal achievement. However, in complex and modular actions, embedded motor errors do not necessarily produce an immediate effect on the global goal. Here we dissociate embedded motor goals from global action goals by asking subjects to observe familiar but untrained knotting actions. During knotting an embedded motor error (i.e. the rope is inserted top-down instead of bottom-up during the formation of a loop) while not producing any immediate mistake, may strongly affect the final result. We found that embedded errors elicit in the observer specific early fronto-central negativity (120-180 ms). In a second experiment, we online administered exicitatory transcranial magnetic stimulation (TMS) over central (C3) or occipital (Oz) scalp locations, at the timing of the ERP components observed in the first experiment. C3 stimulation produced a significant improvement in embedded error discrimination performance. These results show that sensorimotor areas are instrumental in the early detection of embedded motor errors. We conclude that others' embedded errors provide fundamental cues which, inserted within a complex hierarchical action plan, might be used by the observer to anticipate whether an action will eventually fail.