Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study

Does what you hear predict what you will do and say?

I evaluate the bottlenecks involved in the simulation mechanism underpinning superior predictive abilities for upcoming actions. This perceptual-motor state is characterized by a complex interrelationship designed to make predictions using a highly fine-tuned and constrained motor operation. The extension of such mechanisms to language may occur only in sensorimotor circuits devoted to the action domain.

Fine-grained semantic categorization across the abstract and concrete domains

A consolidated approach to the study of the mental representation of word meanings has consisted in contrasting different domains of knowledge, broadly reflecting the abstract-concrete dichotomy. More fine-grained semantic distinctions have emerged in neuropsychological and cognitive neuroscience work, reflecting semantic category specificity, but almost exclusively within the concrete domain. Theoretical advances, particularly within the area of embodied cognition, have more recently put forward the idea that distributed neural representations tied to the kinds of experience maintained with the concepts' referents might distinguish conceptual meanings with a high degree of specificity, including those within the abstract domain. Here we report the results of two psycholinguistic rating studies incorporating such theoretical advances with two main objectives: first, to provide empirical evidence of fine-grained distinctions within both the abstract and the concrete semantic domains with respect to relevant psycholinguistic dimensions; second, to develop a carefully controlled linguistic stimulus set that may be used for auditory as well as visual neuroimaging studies focusing on the parametrization of the semantic space beyond the abstract-concrete dichotomy. Ninety-six participants rated a set of 210 sentences across pre-selected concrete (mouth, hand, or leg action-related) and abstract (mental state-, emotion-, mathematics-related) categories, with respect either to different semantic domain-related scales (rating study 1), or to concreteness, familiarity, and context availability (rating study 2). Inferential statistics and correspondence analyses highlighted distinguishing semantic and psycholinguistic traits for each of the pre-selected categories, indicating that a simple abstract-concrete dichotomy is not sufficient to account for the entire semantic variability within either domains.

Seeking a bridge between language and motor cortices: a PPI study

The relation between the sensorimotor cortex and the language network has been widely discussed but still remains controversial. Two independent theories compete to explain how this area is involved during action-related verbs processing. The embodied view assumes that action word representations activate sensorimotor representations which are accessed when an action word is processed or when an action is observed. The abstract hypothesis states that the mental representations of words are abstract and independent of the objects' sensorimotor properties they refer to. We combined neuropsychological and fMRI-PPI connectivity data, to address action-related verbs processing in neurosurgical patients with lesions involving (N = 5) or sparing (N = 5) the primary motor cortex and healthy controls (N = 12). A lack of significant changes in the functional coupling between the left M1 cortex and functional nodes of the linguistic network during the verb generation task was found for all the groups. In addition, we found that the ability to perform an action verb naming task was not related to a damaged M1. These data showed that there was not a task-specific functional interaction active between M1 and the inferior frontal gyrus. We will discuss how these findings indicate that action words do not automatically activate the M1 cortex; we suggest rather that its enrolment could be related to other not strictly linguistic processing.

Comprehension of action negation involves inhibitory simulation

Previous research suggests that action language is comprehended by activating the motor system. We report a study, investigating a critical question in this research field: do negative sentences activate the motor system? Participants were exposed to sentences in the affirmation and negation forms while the zygomatic muscle activity on the left side of the face was continuously measured (Electromyography technique: EMG). Sentences were descriptions of emotional expressions that mapped either directly upon the zygomatic muscle (e.g., "I am smiling") or did not (e.g., "I am frowning"). Reading sentences involving the negation of the activity of a specific muscle (zygomatic major-"I am not smiling") is shown to lead to the inhibition of this muscle. Reading sentences involving the affirmative form instead ("I am smiling") leads to the activation of zygomatic mucle. In contrast, sentences describing an activity that is irrelevant to the zygomatic muscle (e.g., "I am frowning" or "I am not frowning") produce no muscle activity. These results extend the range of simulation models to negation and by implication to an abstract domain. We discuss how this research contributes to the grounding of abstract and concrete concepts.

Motor activation in literal and non-literal sentences: does time matter?

Despite the impressive amount of evidence showing involvement of the sensorimotor systems in language processing, important questions remain unsolved among which the relationship between non-literal uses of language and sensorimotor activation. The literature did not yet provide a univocal answer on whether the comprehension of non-literal, abstract motion sentences engages the same neural networks recruited for literal sentences. A previous TMS study using the same experimental materials of the present study showed activation for literal, fictive and metaphoric motion sentences but not for idiomatic ones. To evaluate whether this may depend on insufficient time for elaborating the idiomatic meaning, we conducted a behavioral experiment that used a sensibility judgment task performed by pressing a button either with a hand finger or with a foot. Motor activation is known to be sensitive to the action-congruency of the effector used for responding. Therefore, all other things being equal, significant differences between response emitted with an action-congruent or incongruent effector (foot vs. hand) may be attributed to motor activation. Foot-related action verbs were embedded in sentences conveying literal motion, fictive motion, metaphoric motion or idiomatic motion. Mental sentences were employed as a control condition. foot responses were significantly faster than finger responses but only in literal motion sentences. We hypothesize that motor activation may arise in early phases of comprehension processes (i.e., upon reading the verb) for then decaying as a function of the strength of the semantic motion component of the verb.

The "subjective" pupil old/new effect: is the truth plain to see?

Human memory is an imperfect process, prone to distortion and errors that range from minor disturbances to major errors that can have serious consequences on everyday life. In this study, we investigated false remembering of manipulatory verbs using an explicit recognition task and pupillometry. Our results replicated the "classical" pupil old/new effect as well as data in false remembering literature that show how items must be recognize as old in order for the pupil size to increase (e.g., "subjective" pupil old/new effect), even though these items do not necessarily have to be truly old. These findings support the strength-of-memory trace account that affirms that pupil dilation is related to experience rather than to the accuracy of recognition. Moreover, behavioral results showed higher rates of true and false recognitions for manipulatory verbs and a consequent larger pupil diameter, supporting the embodied view of language.

Preserved tool knowledge in the context of impaired action knowledge: implications for models of semantic memory

A number of studies have observed that the motor system is activated when processing the semantics of manipulable objects. Such phenomena have been taken as evidence that simulation over motor representations is a necessary and intermediary step in the process of conceptual understanding. Cognitive neuropsychological evaluations of patients with impairments for action knowledge permit a direct test of the necessity of motor simulation in conceptual processing. Here, we report the performance of a 47-year-old male individual (Case AA) and six age-matched control participants on a number of tests probing action and object knowledge. Case AA had a large left-hemisphere frontal-parietal lesion and hemiplegia affecting his right arm and leg. Case AA presented with impairments for object-associated action production, and his conceptual knowledge of actions was severely impaired. In contrast, his knowledge of objects such as tools and other manipulable objects was largely preserved. The dissociation between action and object knowledge is difficult to reconcile with strong forms of the embodied cognition hypothesis. We suggest that these, and other similar findings, point to the need to develop tractable hypotheses about the dynamics of information exchange among sensory, motor and conceptual processes.

Where is the action? Action sentence processing in Parkinson's disease

According to an influential view of conceptual representation, action concepts are understood through motoric simulations, involving motor networks of the brain. A stronger version of this embodied account suggests that even figurative uses of action words (e.g., grasping the concept) are understood through motoric simulations. We investigated these claims by assessing whether Parkinson's disease (PD), a disorder affecting the motor system, is associated with selective deficits in comprehending action-related sentences. Twenty PD patients and 21 age-matched controls performed a sentence comprehension task, where sentences belonged to one of four conditions: literal action, non-idiomatic metaphoric action, idiomatic action, and abstract. The same verbs (referring to hand/arm actions) were used in the three action-related conditions. Patients, but not controls, were slower to respond to literal and idiomatic action than to abstract sentences. These results indicate that sensory-motor systems play a functional role in semantic processing, including processing of figurative action language.

Disrupting the brain to validate hypotheses on the neurobiology of language

Comprehension of words is an important part of the language faculty, involving the joint activity of frontal and temporo-parietal brain regions. Transcranial Magnetic Stimulation (TMS) enables the controlled perturbation of brain activity, and thus offers a unique tool to test specific predictions about the causal relationship between brain regions and language understanding. This potential has been exploited to better define the role of regions that are classically accepted as part of the language-semantic network. For instance, TMS has contributed to establish the semantic relevance of the left anterior temporal lobe, or to solve the ambiguity between the semantic vs. phonological function assigned to the left inferior frontal gyrus (LIFG). We consider, more closely, the results from studies where the same technique, similar paradigms (lexical-semantic tasks) and materials (words) have been used to assess the relevance of regions outside the classically-defined language-semantic network—i.e., precentral motor regions—for the semantic analysis of words. This research shows that different aspects of the left precentral gyrus (primary motor and premotor sites) are sensitive to the action-non action distinction of words' meanings. However, the behavioral changes due to TMS over these sites are incongruent with what is expected after perturbation of a task-relevant brain region. Thus, the relationship between motor activity and language-semantic behavior remains far from clear. A better understanding of this issue could be guaranteed by investigating functional interactions between motor sites and semantically-relevant regions.

Converging modalities ground abstract categories: the case of politics

Three studies are reported examining the grounding of abstract concepts across two modalities (visual and auditory) and their symbolic representation. A comparison of the outcomes across these studies reveals that the symbolic representation of political concepts and their visual and auditory modalities is convergent. In other words, the spatial relationships between specific instances of the political categories are highly overlapping across the symbolic, visual and auditory modalities. These findings suggest that abstract categories display redundancy across modal and amodal representations, and are multimodal.

Fine tuned modulation of the motor system by adjectives expressing positive and negative properties

Using transcranial magnetic stimulation (TMS), motor evoked potentials (MEPs) were recorded from two antagonistic muscles, the first dorsal interosseus (FDI) of the hand and the extensor communis digitorum (EC) of the forearm. FDI is involved in grasping actions and EC in releasing. TMS pulses were delivered while participants were reading adjectives expressing either negative or positive pragmatic properties, at 150 ms after presentation of language material. Overall findings showed an interaction of adjective type (positive, negative) and muscle (FDI, EC), the effect being driven by a significant difference for negative adjectives. Further analysis aimed at investigating the effectiveness of positive adjectives showed a similar, but opposite, pattern of effects for the positive words in the initial two blocks. The present results indicate that, as for verbs and nouns, adjectives recruit the sensorimotor system, and their processing is best explained by an embodiment rather than an amodal approach to language.

Spatial frequency tuning reveals interactions between the dorsal and ventral visual systems

It is widely argued that the ability to recognize and identify manipulable objects depends on the retrieval and simulation of action-based information associated with using those objects. Evidence for that view comes from fMRI studies that have reported differential BOLD contrast in dorsal visual stream regions when participants view manipulable objects compared with a range of baseline categories. An alternative interpretation is that processes internal to the ventral visual pathway are sufficient to support the visual identification of manipulable objects and that the retrieval of object-associated use information is contingent on analysis of the visual input by the ventral stream. Here, we sought to distinguish these two perspectives by exploiting the fact that the dorsal stream is largely driven by magnocellular input, which is biased toward low spatial frequency visual information. Thus, any tool-selective responses in parietal cortex that are driven by high spatial frequencies would be indicative of inputs from the ventral visual pathway. Participants viewed images of tools and animals containing only low, or only high, spatial frequencies during fMRI. We find an internal parcellation of left parietal "tool-preferring" voxels: Inferior aspects of left parietal cortex are driven by high spatial frequency information and have privileged connectivity with ventral stream regions that show similar category preferences, whereas superior regions are driven by low spatial frequency information. Our findings suggest that the automatic activation of complex object-associated manipulation knowledge is contingent on analysis of the visual input by the ventral visual pathway.

The Body of Evidence: What Can Neuroscience Tell Us about Embodied Semantics?

Semantic knowledge is based on the way we perceive and interact with the world. However, the jury is still out on the question: to what degree are neuronal systems that subserve acquisition of semantic knowledge, such as sensory-motor networks, involved in its representation and processing? We will begin with a critical evaluation of the main behavioral and neuroimaging methods with respect to their capability to define the functional roles of specific brain areas. Any behavioral or neuroscientific measure is a conflation of representations and processes. Hence, a combination of behavioral and neurophysiological interactions as well as time-course information is required to define the functional roles of brain areas. This will guide our review of the empirical literature. Most research in this area has been done on semantics of concrete words, where clear theoretical frameworks for an involvement of sensory-motor systems in semantics exist. Most of this evidence still stems from correlational studies that are ambiguous with respect to the behavioral relevance of effects. Evidence for causal effects of sensory-motor systems on semantic processes is still scarce but evolving. Relatively few neuroscientific studies so far have investigated the embodiment of abstract semantics for words, numbers, and arithmetic facts. Here, some correlational evidence exists, but data on causality are mostly absent. We conclude that neuroimaging data, just as behavioral data, have so far not disentangled the fundamental link between process and representation. Future studies should therefore put more emphasis on the effects of task and context on semantic processing. Strong conclusions can only be drawn from a combination of methods that provide time-course information, determine the connectivity among poly- or amodal and sensory-motor areas, link behavioral with neuroimaging measures, and allow causal inferences. We will conclude with suggestions on how this could be accomplished in future research.

At the mercy of strategies: the role of motor representations in language understanding

Classical cognitive theories hold that word representations in the brain are abstract and amodal, and are independent of the objects’ sensorimotor properties they refer to. An alternative hypothesis emphasizes the importance of bodily processes in cognition: the representation of a concept appears to be crucially dependent upon perceptual-motor processes that relate to it. Thus, understanding action-related words would rely upon the same motor structures that also support the execution of the same actions. In this context, motor simulation represents a key component. Our approach is to draw parallels between the literature on mental rotation and the literature on action verb/sentence processing. Here we will discuss recent studies on mental imagery, mental rotation, and language that clearly demonstrate how motor simulation is neither automatic nor necessary to language understanding. These studies have shown that motor representations can or cannot be activated depending on the type of strategy the participants adopt to perform tasks involving motor phrases. On the one hand, participants may imagine the movement with the body parts used to carry out the actions described by the verbs (i.e., motor strategy); on the other, individuals may solve the task without simulating the corresponding movements (i.e., visual strategy). While it is not surprising that the motor strategy is at work when participants process action-related verbs, it is however striking that sensorimotor activation has been reported also for imageable concrete words with no motor content, for “non-words” with regular phonology, for pseudo-verb stimuli, and also for negations. Based on the extant literature, we will argue that implicit motor imagery is not uniquely used when a body-related stimulus is encountered, and that it is not the type of stimulus that automatically triggers the motor simulation but the type of strategy. Finally, we will also comment on the view that sensorimotor activations are subjected to a top-down modulation.

No specific role for the manual motor system in processing the meanings of words related to the hand

The present study explored whether semantic and motor systems are functionally interwoven via the use of a dual-task paradigm. According to embodied language accounts that propose an automatic and necessary involvement of the motor system in conceptual processing, concurrent processing of hand-related information should interfere more with hand movements than processing of unrelated body-part (i.e., foot, mouth) information. Across three experiments, 100 right-handed participants performed left- or right-hand tapping movements while repeatedly reading action words related to different body-parts, or different body-part names, in both aloud and silent conditions. Concurrent reading of single words related to specific body-parts, or the same words embedded in sentences differing in syntactic and phonological complexity (to manipulate context-relevant processing), and reading while viewing videos of the actions and body-parts described by the target words (to elicit visuomotor associations) all interfered with right-hand but not left-hand tapping rate. However, this motor interference was not affected differentially by hand-related stimuli. Thus, the results provide no support for proposals that body-part specific resources in cortical motor systems are shared between overt manual movements and meaning-related processing of words related to the hand.

The disembodiment effect of negation: negating action-related sentences attenuates their interference on congruent upper limb movements

Human languages can express opposite propositions by means of the negative operator "not," which turns affirmative sentences into negative ones. Psycholinguistic research has indicated that negative meanings are formed by transiently reducing the access to mental representations of negated conceptual information. Neuroimaging studies have corroborated these findings, showing reduced activation of concept-specific embodied neural systems by negative versus affirmative sentences. This "disembodiment effect" of sentential negation should have two distinct consequences: first, the embodied systems should be computationally more free to support concurrent tasks when processing negative than affirmative sentences; second, the computational interference should only be reduced when there is a strict semantic congruency between the negated concept and the referent targeted by concurrent tasks. We tested these two predictions in two complementary experiments involving the comprehension of action-related sentences and kinematic measurements of its effects on concurrent, congruent actions. Sentences referred to actions involving either proximal or distal arm musculature. In experiment 1, requiring a proximal arm movement, we found interference reduction for negative proximal sentences. In experiment 2, requiring a distal arm movement, we found interference reduction for negative distal sentences. This dissociation provides the first conclusive evidence in support of a disembodiment theory of negation. We conclude that the computational cost resulting from the insertion of an additional lexical item ("not") in negative sentences is compensated by solely storing a concept in affirmative form in semantic memory, since its negative counterpart can be produced by transiently reducing the access to such stored semantic information.

Embodied cognition: taking the next step

Recent years have seen a large amount of empirical studies related to "embodied cognition." While interesting and valuable, there is something dissatisfying with the current state of affairs in this research domain. Hypotheses tend to be underspecified, testing in general terms for embodied versus disembodied processing. The lack of specificity of current hypotheses can easily lead to an erosion of the embodiment concept, and result in a situation in which essentially any effect is taken as positive evidence. Such erosion is not helpful to the field and does not do justice to the importance of embodiment. Here we want to take stock, and formulate directions for how it can be studied in a more fruitful fashion. As an example we will describe few example studies that have investigated the role of sensori-motor systems in the coding of meaning ("embodied semantics"). Instead of focusing on the dichotomy between embodied and disembodied theories, we suggest that the field move forward and ask how and when sensori-motor systems and behavior are involved in cognition.

Training of manual actions improves language understanding of semantically related action sentences

Conceptual knowledge accessed by language may involve the reactivation of the associated primary sensory-motor processes. Whether these embodied representations are indeed constitutive to conceptual knowledge is hotly debated, particularly since direct evidence that sensory-motor expertise can improve conceptual processing is scarce. In this study, we sought for this crucial piece of evidence, by training naive healthy subjects to perform complex manual actions and by measuring, before and after training, their performance in a semantic language task. Nineteen participants engaged in 3 weeks of motor training. Each participant was trained in three complex manual actions (e.g., origami). Before and after the training period, each subject underwent a series of manual dexterity tests and a semantic language task. The latter consisted of a sentence-picture semantic congruency judgment task, with 6 target congruent sentence-picture pairs (semantically related to the trained manual actions), 6 non-target congruent pairs (semantically unrelated), and 12 filler incongruent pairs. Manual action training induced a significant improvement in all manual dexterity tests, demonstrating the successful acquisition of sensory-motor expertise. In the semantic language task, the reaction times (RTs) to both target and non-target congruent sentence-picture pairs decreased after action training, indicating a more efficient conceptual-semantic processing. Noteworthy, the RTs for target pairs decreased more than those for non-target pairs, as indicated by the 2 × 2 interaction. These results were confirmed when controlling for the potential bias of increased frequency of use of target lexical items during manual training. The results of the present study suggest that sensory-motor expertise gained by training of specific manual actions can lead to an improvement of cognitive-linguistic skills related to the specific conceptual-semantic domain associated to the trained actions.

The effects of rTMS over the primary motor cortex: the link between action and language

Is the primary motor cortex (M1) necessary for language comprehension? The present study investigates the role of the primary motor cortex during verbs comprehension, within the framework of the embodied theories of language. We applied rTMS over the right and left hand portion of M1 and tested the effects of the stimulation toward the processing of hand-related action verbs versus abstract verbs. Results underlined a specific inhibition effect following left stimulation, only with hand-related action verbs. These findings seem to corroborate the hypothesis of a functional role of M1 in action verbs comprehension.

Reading salt activates gustatory brain regions: fMRI evidence for semantic grounding in a novel sensory modality

Because many words are typically used in the context of their referent objects and actions, distributed cortical circuits for these words may bind information about their form with perceptual and motor aspects of their meaning. Previous work has demonstrated such semantic grounding for sensorimotor, visual, auditory, and olfactory knowledge linked to words, which is manifest in activation of the corresponding areas of the cortex. Here, we explore the brain basis of gustatory semantic links of words whose meaning is primarily related to taste. In a blocked functional magnetic resonance imaging design, Spanish taste words and control words matched for a range of factors (including valence, arousal, image-ability, frequency of use, number of letters and syllables) were presented to 59 right-handed participants in a passive reading task. Whereas all the words activated the left inferior frontal (BA44/45) and the posterior middle and superior temporal gyri (BA21/22), taste-related words produced a significantly stronger activation in these same areas and also in the anterior insula, frontal operculum, lateral orbitofrontal gyrus, and thalamus among others. As these areas comprise primary and secondary gustatory cortices, we conclude that the meaning of taste words is grounded in distributed cortical circuits reaching into areas that process taste sensations.

Neurological evidence linguistic processes precede perceptual simulation in conceptual processing

There is increasing evidence from response time experiments that language statistics and perceptual simulations both play a role in conceptual processing. In an EEG experiment we compared neural activity in cortical regions commonly associated with linguistic processing and visual perceptual processing to determine to what extent symbolic and embodied accounts of cognition applied. Participants were asked to determine the semantic relationship of word pairs (e.g., sky – ground) or to determine their iconic relationship (i.e., if the presentation of the pair matched their expected physical relationship). A linguistic bias was found toward the semantic judgment task and a perceptual bias was found toward the iconicity judgment task. More importantly, conceptual processing involved activation in brain regions associated with both linguistic and perceptual processes. When comparing the relative activation of linguistic cortical regions with perceptual cortical regions, the effect sizes for linguistic cortical regions were larger than those for the perceptual cortical regions early in a trial with the reverse being true later in a trial. These results map upon findings from other experimental literature and provide further evidence that processing of concept words relies both on language statistics and on perceptual simulations, whereby linguistic processes precede perceptual simulation processes.

Quantitative analysis of language production in Parkinson's disease using a cued sentence generation task

The present study examined language production skills in Parkinson's disease (PD) patients. A unique cued sentence generation task was created in order to reduce demands on memory and attention. Differences in sentence production abilities according to disease severity and cognitive impairments were assessed. Language samples were obtained from 20 PD patients and 20 healthy control participants matched for age, sex and educational level. In addition, a cognitive test for verbal memory and resistance to cognitive interference was administered. Statistical comparisons revealed significant language changes in an advanced stage of the disease. Advanced PD patients showed a reduction in lexical diversity in notional verbs, which was absent in nouns. Cognitive dysfunctions such as impaired verbal memory are suggested to contribute to the typical noun/verb dissociation in PD patients. In addition, advanced PD patients produced more semantic perseverations, which may be related to set-switching problems. In conclusion, whether language disturbances in PD are the result of non-linguistic cognitive dysfunctions or reflect pure language deficits exacerbated by cognitive impairments, remains a matter of debate. However, the negative impact of cognitive dysfunctions may be important.

Action-related semantic content and negation polarity modulate motor areas during sentence reading: an event-related desynchronization study

Our study evaluated motor cortex involvement during silent reading of sentences referring to hand actions. We aimed at defining whether sentential polarity (affirmative vs. negative) would modulate motor cortex activation using the event-related desynchronization (ERD) analysis of the mu rhythm. Eleven healthy volunteers performed a reading task involving 160 sentences (80 affirmative: 40 hand-related, 40 abstract; 80 negative: 40 hand-related, 40 abstract). After reading each sentence, subjects had to decide whether the verb was high or low frequency in Italian. Electroencephalographic (EEG) activity was recorded with 32 surface electrodes and mu ERD analyses were performed for each subject. Hand-action related sentences induced a greater mu ERD over the left premotor and motor hand areas compared to abstract sentences. Mu ERD was greater and temporally delayed when the hand-related verbs were presented in the negative versus affirmative form. As predicted by the "embodied semantic" theory of language understanding, motor areas were activated during sentences referring to hand actions. In addition, motor cortex activation was larger for negative than affirmative motor sentences, a finding compatible with the hypothesis that comprehension is more demanding in the specific case of motor content negation.

Behavioral patterns and lesion sites associated with impaired processing of lexical and conceptual knowledge of actions

To further investigate the neural substrates of lexical and conceptual knowledge of actions, we administered a battery of six tasks to 226 brain-damaged patients with widely distributed lesions in the left and right cerebral hemispheres. The tasks probed lexical and conceptual knowledge of actions in a variety of verbal and non-verbal ways, including naming, word-picture matching, attribute judgments involving both words and pictures, and associative comparisons involving both words and pictures. Of the 226 patients who were studied, 61 failed one or more of the six tasks, with four patients being impaired on the entire battery, and varied numbers of patients being impaired on varied combinations of tasks. Overall, the 61 patients manifested a complex array of associations and dissociations across the six tasks. The lesion sites of 147 of the 226 patients were also investigated, using formal methods for lesion-deficit statistical mapping and power analysis of lesion overlap maps. Significant effects for all six tasks were found in the following left-hemisphere regions: the inferior frontal gyrus; the ventral precentral gyrus, extending superiorly into what are likely to be hand-related primary motor and premotor areas; and the anterior insula. In addition, significant effects for 4-5 tasks were found in not only the regions just mentioned, but also in several other left-hemisphere areas: the ventral postcentral gyrus; the supramarginal gyrus; and the posterior middle temporal gyrus. These results converge with previous research on the neural underpinnings of action words and concepts. However, the current study goes considerably beyond most previous investigations by providing extensive behavioral and lesion data for an unusually large and diverse sample of brain-damaged patients, and by incorporating multiple measures of verb comprehension. Regarding theoretical implications, the study provides new support for the Embodied Cognition Framework, which maintains that conceptual knowledge is grounded in sensorimotor systems.

Increases of corticospinal excitability in self-related processing

Involvement of fronto-parietal structures within the right hemisphere in bodily self recognition has gained convergent support from behavioural, neuropsychological and neuroimaging studies. Increases in corticospinal excitability via transcranial magnetic stimulation (TMS) also testify to right hemisphere self-related processing. However, evidence for self-dependent modulations of motor excitability is limited to the processing of face-related information that, by definition, conveys someone's identity. Here we tested the hypothesis that vision of one's own hand, as compared with vision of somebody else's hand, would also engage specific self-hand processing in the right hemisphere. Healthy participants were submitted to a classic TMS paradigm to assess changes in corticospinal excitability of the right (Experiment 1) and left (Experiment 2) motor cortex, while viewing pictures of a (contralateral) still hand, which could either be their own (Self) or not (Other). As a control for body selectivity, subjects were also presented with pictures of a hand-related, but non-corporeal object, i.e. a mobile phone, which could similarly be their own or not. Results showed a selective right hemisphere increase in corticospinal excitability with self-hand and self-phone stimuli with respect to Other stimuli. Such a Self vs. Other modulation of primary motor cortex appeared at 600 ms and was maintained at 900 ms, but was not present at earlier timings (100 and 300 ms) and was completely absent following stimulation of the left hemisphere. A similar pattern observed for self-hand and self-phone stimuli suggests that owned hands and objects may undergo similar self-processing, possibly via a different cortical network from that responsible for self-face processing.

Taking action: a cross-modal investigation of discourse-level representations

Segmenting stimuli into events and understanding the relations between those events is crucial for understanding the world. For example, on the linguistic level, successful language use requires the ability to recognize semantic coherence relations between events (e.g., causality, similarity). However, relatively little is known about the mental representation of discourse structure. We report two experiments that used a cross-modal priming paradigm to investigate how humans represent the relations between events. Participants repeated a motor action modeled by the experimenter (e.g., rolled a ball toward mini bowling pins to knock them over), and then completed an unrelated sentence-continuation task (e.g., provided a continuation for "Peter scratched John.…"). In two experiments, we tested whether and how the coherence relations represented by the motor actions (e.g., causal events vs. non-causal events) influence participants' performance in the linguistic task. (A production study was also conducted to explore potential syntactic priming effects.) Our analyses focused on the coherence relations between the prompt sentences and participants' continuations, as well as the referential shifts in the continuations. As a whole, the results suggest that the mental representations activated by motor actions overlap with the mental representations used during linguistic discourse-level processing, but nevertheless contain fine-grained information about sub-types of causality (reaction vs. consequence). In addition, the findings point to parallels between shifting one's attention from one-event to another and shifting one's attention from one referent to another, and indicate that the event structure of causal sequences is conceptualized more like single events than like two distinct events. As a whole, the results point toward common representations activated by motor sequences and discourse-semantic relations, and further our understanding of the mental representation of discourse structure, an area that is still not yet well-understood.

Early semantic and phonological effects on temporal- and muscle-specific motor resonance

Previous studies using functional magnetic resonance imaging and transcranial magnetic stimulation (TMS) explored the relationships between linguistic processing and motor resonance, i.e. the activation of the motor system while perceiving others performing an action. These studies have mainly investigated a specific linguistic domain, i.e. semantics, whereas phonology has been largely neglected. Here we used single-pulse TMS to compare the effects of semantic and phonological processing with motor resonance effects. We applied TMS to the primary motor hand area while subjects observed object-oriented actions and performed semantic and phonological tasks related to the observed action. Motor evoked potentials were recorded in two hand muscles, one of them more involved in the execution of the observed actions than the other one, at three different timepoints (0, 200 and 400 ms after stimulus onset). The results demonstrated increased corticospinal excitability that was muscle-specific (i.e. restricted to the hand muscle involved in the observed action), hemisphere-specific (left), and time-specific (400 ms after stimulus onset). The results suggest an additive effect of independent semantic and phonological processing on motor resonance. The novel phonological effect reported here expands the links between language and the motor system and is consistent with a theory of shared control for hand and mouth. Furthermore, the timing of the semantic effect suggests that motor activation during semantic processing is not an 'epiphenomenon' but rather is essential to the construction of meaning.

Music and epilepsy: a critical review

The effect of music on patients with epileptic seizures is complex and at present poorly understood. Clinical studies suggest that the processing of music within the human brain involves numerous cortical areas, extending beyond Heschl's gyrus and working within connected networks. These networks could be recruited during a seizure manifesting as musical phenomena. Similarly, if certain areas within the network are hyperexcitable, then there is a potential that particular sounds or certain music could act as epileptogenic triggers. This occurs in the case of musicogenic epilepsy, whereby seizures are triggered by music. Although it appears that this condition is rare, the exact prevalence is unknown, as often patients do not implicate music as an epileptogenic trigger and routine electroencephalography does not use sound in seizure provocation. Music therapy for refractory epilepsy remains controversial, and further research is needed to explore the potential anticonvulsant role of music. Dopaminergic system modulation and the ambivalent action of cognitive and sensory input in ictogenesis may provide possible theories for the dichotomous proconvulsant and anticonvulsant role of music in epilepsy. The effect of antiepileptic drugs and surgery on musicality should not be underestimated. Altered pitch perception in relation to carbamazepine is rare, but health care professionals should discuss this risk or consider alternative medication particularly if the patient is a professional musician or native-born Japanese. Studies observing the effect of epilepsy surgery on musicality suggest a risk with right temporal lobectomy, although the extent of this risk and correlation to size and area of resection need further delineation. This potential risk may bring into question whether tests on musical perception and memory should form part of the preoperative neuropsychological workup for patients embarking on surgery, particularly that of the right temporal lobe.

tDCS of the primary motor cortex improves the detection of semantic dissonance

Increasing evidences show that the linguistic representation of motor activities induces simulative processes that involve motor neural systems normally engaged in actual execution of movements. However, other researches suggest that the motor cortex is not an integral part of the network for action-word representation but is recruited only to execute tasks that critically require the retrieval of sensorimotor attributes associated with words. In order to enlighten this controversial literature, three groups of healthy participants were submitted to transcranial direct current stimulation (tDCS) (cathodal, anodal and sham stimulations) of the left primary motor cortex during the execution of a picture recognition task. Results show that cathodal stimulation improves the participants' ability to detect either mismatching motor vs. no motor sentence-drawing associations, while no significant difference has not been reported for compatible associations. The current result is in line with the suggestion that motor regions play a critical role in detecting dissonant outcomes.

Processing of hand-related verbs specifically affects the planning and execution of arm reaching movements

Even though a growing body of research has shown that the processing of action language affects the planning and execution of motor acts, several aspects of this interaction are still hotly debated. The directionality (i.e. does understanding action-related language induce a facilitation or an interference with the corresponding action?), the time course, and the nature of the interaction (i.e. under what conditions does the phenomenon occur?) are largely unclear. To further explore this topic we exploited a go/no-go paradigm in which healthy participants were required to perform arm reaching movements toward a target when verbs expressing either hand or foot actions were shown, and to refrain from moving when abstract verbs were presented. We found that reaction times (RT) and percentages of errors increased when the verb involved the same effector used to give the response. This interference occurred very early, when the interval between verb presentation and the delivery of the go signal was 50 ms, and could be elicited until this delay was about 600 ms. In addition, RTs were faster when subjects used the right arm than when they used the left arm, suggesting that action–verb understanding is left-lateralized. Furthermore, when the color of the printed verb and not its meaning was the cue for movement execution the differences between RTs and error percentages between verb categories disappeared, unequivocally indicating that the phenomenon occurs only when the semantic content of a verb has to be retrieved. These results are compatible with the theory of embodied language, which hypothesizes that comprehending verbal descriptions of actions relies on an internal simulation of the sensory–motor experience of the action, and provide a new and detailed view of the interplay between action language and motor acts.

Motor-language coupling: direct evidence from early Parkinson's disease and intracranial cortical recordings

Language and action systems are functionally coupled in the brain as demonstrated by converging evidence using Functional magnetic resonance imaging (fMRI), electroencephalography (EEG), transcranial magnetic stimulation (TMS), and lesion studies. In particular, this coupling has been demonstrated using the action-sentence compatibility effect (ACE) in which motor activity and language interact. The ACE task requires participants to listen to sentences that described actions typically performed with an open hand (e.g., clapping), a closed hand (e.g., hammering), or without any hand action (neutral); and to press a large button with either an open hand position or closed hand position immediately upon comprehending each sentence. The ACE is defined as a longer reaction time (RT) in the action-sentence incompatible conditions than in the compatible conditions. Here we investigated direct motor-language coupling in two novel and uniquely informative ways. First, we measured the behavioural ACE in patients with motor impairment (early Parkinson's disease - EPD), and second, in epileptic patients with direct electrocorticography (ECoG) recordings. In experiment 1, EPD participants with preserved general cognitive repertoire, showed a much diminished ACE relative to non-EPD volunteers. Moreover, a correlation between ACE performance and action-verb processing (kissing and dancing test - KDT) was observed. Direct cortical recordings (ECoG) in motor and language areas (experiment 2) demonstrated simultaneous bidirectional effects: motor preparation affected language processing (N400 at left inferior frontal gyrus and middle/superior temporal gyrus), and language processing affected activity in movement-related areas (motor potential at premotor and M1). Our findings show that the ACE paradigm requires ongoing integration of preserved motor and language coupling (abolished in EPD) and engages motor-temporal cortices in a bidirectional way. In addition, both experiments suggest the presence of a motor-language network which is not restricted to somatotopically defined brain areas. These results open new pathways in the fields of motor diseases, theoretical approaches to language understanding, and models of action-perception coupling.

Incidental and context-responsive activation of structure- and function-based action features during object identification

Previous studies suggest that action representations are activated during object processing, even when task-irrelevant. In addition, there is evidence that lexical-semantic context may affect such activation during object processing. Finally, prior work from our laboratory and others indicates that function-based ("use") and structure-based ("move") action subtypes may differ in their activation characteristics. Most studies assessing such effects, however, have required manual object-relevant motor responses, thereby plausibly influencing the activation of action representations. The present work uses eyetracking and a Visual World Paradigm task without object-relevant actions to assess the time course of activation of action representations, as well as their responsiveness to lexical-semantic context. In two experiments, participants heard a target word and selected its referent from an array of four objects. Gaze fixations on nontarget objects signal activation of features shared between targets and nontargets. The experiments assessed activation of structure-based (Experiment 1) or function-based (Experiment 2) distractors, using neutral sentences ("S/he saw the....") or sentences with a relevant action verb (Experiment 1: "S/he picked up the...."; Experiment 2: "S/he used the...."). We observed task-irrelevant activations of action information in both experiments. In neutral contexts, structure-based activation was relatively faster-rising but more transient than function-based activation. Additionally, action verb contexts reliably modified patterns of activation in both Experiments. These data provide fine-grained information about the dynamics of activation of function-based and structure-based actions in neutral and action-relevant contexts, in support of the "Two Action System" model of object and action processing (e.g., Buxbaum & Kalénine, 2010).

Writing's shadow: corticospinal activation during letter observation

We can recognize handwritten letters despite the variability among writers. One possible strategy is exploiting the motor memory of orthography. By using TMS, we clarified the excitatory and inhibitory neural circuits of the motor corticospinal pathway that might be activated during the observation of handwritten letters. During experiments, participants looked at the handwritten or printed single letter that appeared in a random order. The excitability of the left and right primary motor cortex (M1) was evaluated by motor-evoked potentials elicited by single-pulse TMS. Short interval intracortical inhibition (SICI) of the left M1 was evaluated using paired-pulse TMS. F waves were measured for the right ulnar nerve. We found significant reduction of corticospinal excitability only for the right hand at 300-400 msec after each letter presentation without significant changes in SICI. This suppression is likely to be of supraspinal origin, because of no significant alteration in F-wave amplitudes. These findings suggest that the recognition of handwritten letters may include the implicit knowledge of "writing" in M1. The M1 activation associated with that process, which has been shown in previous neuroimaging studies, is likely to reflect the active suppression of the corticospinal excitability.

When Sounds Become Actions: Higher-order Representation of Newly Learned Action Sounds in the Human Motor System

In the absence of visual information, our brain is able to recognize the actions of others by representing their sounds as a motor event. Previous studies have provided evidence for a somatotopic activation of the listener's motor cortex during perception of the sound of highly familiar motor acts. The present experiments studied (a) how the motor system is activated by action-related sounds that are newly acquired and (b) whether these sounds are represented with reference to extrinsic features related to action goals rather than with respect to lower-level intrinsic parameters related to the specific movements. TMS was used to measure the correspondence between auditory and motor codes in the listener's motor system. We compared the corticomotor excitability in response to the presentation of auditory stimuli void of previous motor meaning before and after a short training period in which these stimuli were associated with voluntary actions. Novel cross-modal representations became manifest very rapidly. By disentangling the representation of the muscle from that of the action's goal, we further showed that passive listening to newly learnt action-related sounds activated a precise motor representation that depended on the variable contexts to which the individual was exposed during testing. Our results suggest that the human brain embodies a higher-order audio-visuo-motor representation of perceived actions, which is muscle-independent and corresponds to the goals of the action.

Grasp it loudly! Supporting actions with semantically congruent spoken action words

Evidence for cross-talk between motor and language brain structures has accumulated over the past several years. However, while a significant amount of research has focused on the interaction between language perception and action, little attention has been paid to the potential impact of language production on overt motor behaviour.

The aim of the present study was to test whether verbalizing during a grasp-to-displace action would affect motor behaviour and, if so, whether this effect would depend on the semantic content of the pronounced word (Experiment I). Furthermore, we sought to test the stability of such effects in a different group of participants and investigate at which stage of the motor act language intervenes (Experiment II). For this, participants were asked to reach, grasp and displace an object while overtly pronouncing verbal descriptions of the action (“grasp” and “put down”) or unrelated words (e.g. “butterfly” and “pigeon”).

Fine-grained analyses of several kinematic parameters such as velocity peaks revealed that when participants produced action-related words their movements became faster compared to conditions in which they did not verbalize or in which they produced words that were not related to the action. These effects likely result from the functional interaction between semantic retrieval of the words and the planning and programming of the action.

Therefore, links between (action) language and motor structures are significant to the point that language can refine overt motor behaviour.

Language-induced modulation during the prediction of others' actions

Processing of action words has been shown to influence the perception of the actions the words refer to. Specifically, the accuracy with which people predict the future course of actions observed in another individual seems to be affected by verbal primes. Two processes may be involved in action prediction; dynamic simulation (updating) and static matching. The present study examined this issue by testing the impact of action verb processing on action prediction performance using a masked priming paradigm. Evidence of dynamic updating was revealed after prime verbs expressing dynamic actions (e.g., 'to catch') but not those expressing static actions (e.g., 'to lean'). In contrast to previous work, the primes were masked and did not require any response at all. Hence, our results indicate that implicit action-related linguistic processing may trigger action simulation that in turn might affect action prediction (see also Liepelt, Dolk, & Prinz, Psychological Research, 2012, in this issue).

Mountain High, Valley Low: Direction-Specific Effects of Articulation on Reaching

Representations underpinning action and language overlap and interact very closely. There are bidirectional interactions between word and action comprehension, semantic processing of language, and response selection. This study extends our understanding of the influence of speech on concurrent motor execution. Participants reached-to-grasp the top or bottom of a vertically oriented bar in response to the location of a word on a computer screen (top/bottom). Words were synonyms for “up” or “down”, and participants were required to articulate the word during movement. We were particularly interested in the influence of articulated word semantics on the transport component of the reach. Using motion capture to analyse action kinematics, we show that irrespective of reach direction, saying “up” synonyms led to greater height of the hand, while saying “down” synonyms was associated with reduced height. This direction-specific influence of articulation on the spatial parameters of the hand supports the idea that linguistic systems are tightly integrated and influence each other.