Movement priming of EEG/MEG brain responses for action-words characterizes the link between language and action

The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization

The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.

Brain Signatures of Embodied Semantics and Language: A Consensus Paper

According to embodied theories (including embodied, embedded, extended, enacted, situated, and grounded approaches to cognition), language representation is intrinsically linked to our interactions with the world around us, which is reflected in specific brain signatures during language processing and learning. Moving on from the original rivalry of embodied vs. amodal theories, this consensus paper addresses a series of carefully selected questions that aim at determining when and how rather than whether motor and perceptual processes are involved in language processes. We cover a wide range of research areas, from the neurophysiological signatures of embodied semantics, e.g., event-related potentials and fields as well as neural oscillations, to semantic processing and semantic priming effects on concrete and abstract words, to first and second language learning and, finally, the use of virtual reality for examining embodied semantics. Our common aim is to better understand the role of motor and perceptual processes in language representation as indexed by language comprehension and learning. We come to the consensus that, based on seminal research conducted in the field, future directions now call for enhancing the external validity of findings by acknowledging the multimodality, multidimensionality, flexibility and idiosyncrasy of embodied and situated language and semantic processes.

Hand Motions Reveal Attentional Status and Subliminal Semantic Processing: A Mouse-Tracking Technique

Theories of embodied cognition suggest that hand motions and cognition are closely interconnected. An emerging technique of tracking how participants move a computer mouse (i.e., the mouse-tracking technique) has shown advantages over the traditional response time measurement to detect implicit cognitive conflicts. Previous research suggests that attention is essential for subliminal processing to take place at a semantic level. However, this assumption is challenged by evidence showing the presence of subliminal semantic processing in the near-absence of attention. The inconsistency of evidence could stem from the insufficient sensitivity in the response time measurement. Therefore, we examined the role of attention in subliminal semantic processing by analyzing participants' hand motions using the mouse-tracking technique. The results suggest that subliminal semantic processing is not only enhanced by attention but also occurs when attention is disrupted, challenging the necessity of facilitated top-down attention for subliminal semantic processing, as claimed by a number of studies. In addition, by manipulating the color of attentional cues, our experiment shows that the cue color per se could influence participants' response patterns. Overall, the current study suggests that attentional status and subliminal semantic processing can be reliably revealed by temporal-spatial features extracted from cursor motion trajectories.

Spatiotemporal Dynamics of Activation in Motor and Language Areas Suggest a Compensatory Role of the Motor Cortex in Second Language Processing

The involvement of the motor cortex in language understanding has been intensively discussed in the framework of embodied cognition. Although some studies have provided evidence for the involvement of the motor cortex in different receptive language tasks, the role that it plays in language perception and understanding is still unclear. In the present study, we explored the degree of involvement of language and motor areas in a visually presented sentence comprehension task, modulated by language proficiency (L1: native language, L2: second language) and linguistic abstractness (literal, metaphorical, and abstract). Magnetoencephalography data were recorded from 26 late Chinese learners of English. A cluster-based permutation F test was performed on the amplitude of the source waveform for each motor and language region of interest (ROI). Results showed a significant effect of language proficiency in both language and motor ROIs, manifested as overall greater involvement of language ROIs (short insular gyri and planum polare of the superior temporal gyrus) in the L1 than the L2 during 300-500 ms, and overall greater involvement of motor ROI (central sulcus) in the L2 than the L1 during 600-800 ms. We interpreted the over-recruitment of the motor area in the L2 as a higher demand for cognitive resources to compensate for the inadequate engagement of the language network. In general, our results indicate a compensatory role of the motor cortex in L2 understanding.

Embodying Language through Gestures: Residuals of Motor Memories Modulate Motor Cortex Excitability during Abstract Words Comprehension

There is a debate about whether abstract semantics could be represented in a motor domain as concrete language. A contextual association with a motor schema (action or gesture) seems crucial to highlighting the motor system involvement. The present study with transcranial magnetic stimulation aimed to assess motor cortex excitability changes during abstract word comprehension after conditioning word reading to a gesture execution with congruent or incongruent meaning. Twelve healthy volunteers were engaged in a lexical-decision task responding to abstract words or meaningless verbal stimuli. Motor cortex (M1) excitability was measured at different after-stimulus intervals (100, 250, or 500 ms) before and after an associative-learning training where the execution of the gesture followed word processing. Results showed a significant post-training decrease in hand motor evoked potentials at an early processing stage (100 ms) in correspondence to words congruent with the gestures presented during the training. We hypothesized that traces of individual semantic memory, combined with training effects, induced M1 inhibition due to the redundancy of evoked motor representation. No modulation of cortical excitability was found for meaningless or incongruent words. We discuss data considering the possible implications in research to understand the neural basis of language development and language rehabilitation protocols.

Editing reality in the brain

Recent information technologies such as virtual reality (VR) and augmented reality (AR) allow the creation of simulated sensory worlds with which we can interact. Using programming language, digital details can be overlaid onto displays of our environment, confounding what is real and what has been artificially engineered. Natural language, particularly the use of direct verbal suggestion (DVS) in everyday and hypnotic contexts, can also manipulate the meaning and significance of objects and events in ourselves and others. In this review, we focus on how socially rewarding language can construct and influence reality. Language is symbolic, automatic and flexible and can be used to augment bodily sensations e.g. feelings of heaviness in a limb or suggest a colour that is not there. We introduce the term 'suggested reality' (SR) to refer to the important role that language, specifically DVS, plays in constructing, maintaining and manipulating our shared reality. We also propose the term edited reality to encompass the wider influence of information technology and linguistic techniques that results in altered subjective experience and review its use in clinical settings, while acknowledging its limitations. We develop a cognitive model indicating how the brain's central executive structures use our personal and linguistic-based narrative in subjective awareness, arguing for a central role for language in DVS. A better understanding of the characteristics of VR, AR and SR and their applications in everyday life, research and clinical settings can help us to better understand our own reality and how it can be edited.

The Inhibition Effect of Affordances in Action Picture Naming: An ERP Study

How quickly are different kinds of conceptual knowledge activated in action picture naming? Using a masked priming paradigm, we manipulated the prime category type (artificial vs. natural), prime action type (precision, power, vs. neutral grip), and target action type (precision vs. power grip) in action picture naming, while electrophysiological signals were measured concurrently. Naming latencies showed an inhibition effect in the congruent action type condition compared with the neutral condition. ERP results showed that artificial and natural category primes induced smaller waveforms in precision or power action primes than neutral primes in the time window of 100-200 msec. Time-frequency results consistently presented a power desynchronization of the mu rhythm in the time window of 0-210 msec with precision action type artificial objects compared with neutral primes, which localized at the supplementary motor, precentral and postcentral areas in the left hemisphere. These findings suggest an inhibitory effect of affordances arising at conceptual preparation in action picture naming and provide evidence for embodied cognition.

Same Action, Different Meaning: Neural Substrates of Action Semantic Meaning

Voluntary actions are shaped by desired goals and internal intentions. Multiple factors, including the planning of subsequent actions and the expectation of sensory outcome, were shown to modulate kinetics and neural activity patterns associated with similar goal-directed actions. Notably, in many real-world tasks, actions can also vary across the semantic meaning they convey, although little is known about how semantic meaning modulates associated neurobehavioral measures. Here, we examined how behavioral and functional magnetic resonance imaging measures are modulated when subjects execute similar actions (button presses) for two different semantic meanings-to answer "yes" or "no" to a binary question. Our findings reveal that, when subjects answer using their right hand, the two semantic meanings are differentiated based on voxel patterns in the frontoparietal cortex and lateral-occipital complex bilaterally. When using their left hand, similar regions were found, albeit only with a more liberal threshold. Although subjects were faster to answer "yes" versus "no" when using their right hand, the neural differences cannot be explained by these kinetic differences. To the best of our knowledge, this is the first evidence showing that semantic meaning is embedded in the neural representation of actions, independent of alternative modulating factors such as kinetic and sensory features.

Hand-related action words impair action anticipation in expert table tennis players: Behavioral and neural evidence

Athletes extract kinematic information to anticipate action outcomes. Here, we examined the influence of linguistic information (experiment 1, 2) and its underlying neural correlates (experiment 2) on anticipatory judgment. Table tennis experts and novices remembered a hand- or leg-related verb or a spatial location while predicting the trajectory of a ball in a video occluded at the moment of the serve. Experiment 1 showed that predictions by experts were more accurate than novices, but experts' accuracy significantly decreased when hand-related words versus spatial locations were memorized. For nonoccluded videos with ball trajectories congruent or incongruent with server actions in experiment 2, remembering hand-related verbs shared cognitive resources with action anticipation only in experts, with heightened processing load (increased P3 amplitude) and more efficient conflict monitoring (decreased N2 amplitude) versus leg-related verbs. Thus, action anticipation required updating of motor representations facilitated by motor expertize but was also affected by effector-specific semantic representations of actions, suggesting a link from language to motor systems.

The Neural Blending of Words and Movement: Event-Related Potential Signatures of Semantic and Action Processes during Motor-Language Coupling

Behavioral embodied research shows that words evoking limb-specific meanings can affect responses performed with the corresponding body part. However, no study has explored this phenomenon's neural dynamics under implicit processing conditions, let alone by disentangling its conceptual and motoric stages. Here, we examined whether the blending of hand actions and manual action verbs, relative to nonmanual action verbs and nonaction verbs, modulates electrophysiological markers of semantic integration (N400) and motor-related cortical potentials during a lexical decision task. Relative to both other categories, manual action verbs involved reduced posterior N400 amplitude and greater modulations of frontal motor-related cortical potentials. Such effects overlapped in a window of ∼380-440 msec after word presentation and ∼180 msec before response execution, revealing the possible time span in which both semantic and action-related stages reach maximal convergence. These results allow refining current models of motor-language coupling while affording new insights on embodied dynamics at large.

Embodiment of sleep-related words: Evidence from event-related potentials

Our thoughts can influence sleep, but the underlying mechanisms are unknown. According to the theory of "embodied cognition," the semantic content of cognitive processes is represented by multimodal networks in the brain, which include body-related functions. Such multimodal representations could offer a mechanism, which explains mutual influences between cognition and sleep. Here we tested whether sleep-related words are represented in multimodal networks by examining the effect of congruent versus incongruent body positions on word processing during wakefulness. We experimentally manipulated the body position of 66 subjects (19-40 years old) between standing upright and lying down. Sleep- and activity-related words were presented around the individual speech recognition threshold. Our results show that word processing was facilitated in congruent body positions (sleep words: lying down and activity words: standing upright) compared with incongruent body positions, as indicated by a reduced N400 in the congruent condition with the lowest volume. In addition, early sensory components of the ERP (N180 and P280) were enhanced, suggesting that words were also acoustically better understood in a congruent body position. However, the difference in ERPs did not translate to differences on a behavioral level. Our results support the prediction of embodied processing of sleep- and activity-related words. Body position potentially induces a pre-activation of multimodal networks, thereby enhancing access to the semantic concepts of words related to current body position. The link between semantic meaning and body-related function could be a key element in explaining the influences of cognitive processing on sleep.

Motor processing modulates word comprehension

We evaluated whether movement modulates the semantic processing of words. To this end, we used homograph words with two meanings, one associated with hand movements (e.g., 'abanico', 'fan' in Spanish) or foot movements ('bota', 'boot' in Spanish), and the other not associated with movement ('abanico', 'range' in Spanish; 'bota', 'wineskin' in Spanish). After the homograph, three words were presented, and participants were asked to choose the word related to one of the two homograph meanings. The words could be either related to the motor meaning of the homograph ('fan-heat'), to the non-motor meaning of the homograph ('range-possibility') or unrelated ('fan-phone'). The task was performed without movement (simple condition) or by performing hand (Experiment 1) and foot (Experiment 2) movements. Compared with the simple condition, the performance of movement oriented the preference towards the motor meaning of the homograph. This pattern of results confirms that movement modulates word comprehension.

Prioritized verbal working memory content biases ongoing action

Working memory (WM) holds information temporarily in mind, imparting the ability to guide behavior based on internal goals rather than external stimuli. However, humans often maintain WM content for a future task while performing more immediate actions. Consequently, transient WM representations may inadvertently influence ongoing (but unrelated) motor behavior. Here, we tested the impact of WM on adult human action execution and examined how the attentional or "activation" state of WM content modulates that impact. In 3 dual-task experiments, verbal WM for directional words influenced the trajectory and speed of hand movements performed during WM maintenance. This movement bias was also modulated by the attentional state of the WM content. Prioritized WM content strongly influenced actions during WM maintenance, while de-prioritized WM content was less influential. In summary, WM can unintentionally shape ongoing motor behavior, but the behavioral relevance of WM content determines the degree of influence on motor output. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The Embodied Penman: Effector-Specific Motor-Language Integration During Handwriting

Several studies have illuminated how processing manual action verbs (MaVs) affects the programming or execution of concurrent hand movements. Here, to circumvent key confounds in extant designs, we conducted the first assessment of motor-language integration during handwriting-a task in which linguistic and motoric processes are co-substantiated. Participants copied MaVs, non-manual action verbs, and non-action verbs as we collected measures of motor programming and motor execution. Programming latencies were similar across conditions, but execution was faster for MaVs than for the other categories, regardless of whether word meanings were accessed implicitly or explicitly. In line with the Hand-Action-Network Dynamic Language Embodiment (HANDLE) model, such findings suggest that effector-congruent verbs can prime manual movements even during highly automatized tasks in which motoric and verbal processes are naturally intertwined. Our paradigm opens new avenues for fine-grained explorations of embodied language processes.

Time to Face Language: Embodied Mechanisms Underpin the Inception of Face-Related Meanings in the Human Brain

In construing meaning, the brain recruits multimodal (conceptual) systems and embodied (modality-specific) mechanisms. Yet, no consensus exists on how crucial the latter are for the inception of semantic distinctions. To address this issue, we combined electroencephalographic (EEG) and intracranial EEG (iEEG) to examine when nouns denoting facial body parts (FBPs) and nonFBPs are discriminated in face-processing and multimodal networks. First, FBP words increased N170 amplitude (a hallmark of early facial processing). Second, they triggered fast (~100 ms) activity boosts within the face-processing network, alongside later (~275 ms) effects in multimodal circuits. Third, iEEG recordings from face-processing hubs allowed decoding ~80% of items before 200 ms, while classification based on multimodal-network activity only surpassed ~70% after 250 ms. Finally, EEG and iEEG connectivity between both networks proved greater in early (0-200 ms) than later (200-400 ms) windows. Collectively, our findings indicate that, at least for some lexico-semantic categories, meaning is construed through fast reenactments of modality-specific experience.

Soundbeam imitation intervention: Training children with autism to imitate meaningless body gestures through music

Purpose

This paper aims to present the application and critical reflection on the effects of a intervention for children with autism spectrum disorder (ASD): the Soundbeam Imitation Intervention (SII). The intervention is based on the imitation of meaningless body gestures supported by a musical feedback. The rationale underlying SII is that mirror neurons deficit may represent the cause for the incomplete development of social and motor functioning in children with ASD. Following this assumption, it is possible to hypothesise that a systematic activation of this a system through the simultaneous observation-execution of meaningless body gestures may affect functional changes of mirror-related functions.

Design/methodology/approach

A sample of 14 children, who were between 5 and 9 years of age, with a diagnosis of ASD were involved in a six weeks’ SII programme. The programme is designed as a three-step progression, where each step includes exercises that focus on an activity: synchronous/one arm imitation, synchronous/two arms imitation and delayed imitation. Exercises are based on repeated movements-melodies associations of increasing difficulty. Motor imitation and social attention were assessed using a synchronous video-modelling task pre and post intervention.

Findings

Data highlight significant improvements in imitation accuracy and duration of social sustained attention were achieved.

Originality/value

Data reported in this paper provide preliminary and promising evidence that imitation and social attention skills acquired through SII can be generalised to a video-modelling imitation setting. The SII ordinal execution has included meaningless gestures, usually excluded from previous interventions, and this adds further validity to the training.

Positive effects of grasping virtual objects on memory for novel words in a second language

Theories of embodied cognition describe language processing and representation as inherently connected to the sensorimotor experiences collected during acquisition. While children grasp their world, collect bodily experiences and name them, in second language (L2), students learn bilingual word lists. Experimental evidence shows that embodiment by mean of gestures enhances memory for words in L2. However, no study has been conducted on the effects of grasping in L2. In a virtual scenario, we trained 46 participants on 18 two- and three-syllabic words of Vimmi, an artificial corpus created for experimental purposes. The words were assigned concrete meanings of graspable objects. Six words were learned audio-visually, by reading the words projected on the wall and by hearing them. Another 6 words were trained by observation of virtual objects. Another 6 words were learned by observation and additional grasping the virtual objects. Thereafter participants were subministered free, cued recall, and reaction time tests in order to assess the word retention and the word recognition. After 30 days, the recall tests were repeated remotely to assess the memory in the long term. The results show that grasping of virtual objects can lead to superior memory performance and to lower reaction times during recognition.

Feeling better: Tactile verbs speed up tactile detection

Embodiment of action-related language into the motor system has been extensively documented. Yet the case of sensory words, especially referring to touch, remains overlooked. We investigated the influence of verbs denoting tactile sensations on tactile perception. In Experiment 1, participants detected tactile stimulations on their forearm, preceded by tactile or non-tactile verbs by one of three delays (170, 350, 500 ms) reflecting different word processing stages. Results revealed shorter reaction times to tactile stimulations following tactile than non-tactile verbs, irrespective of delay. To ensure that priming pertained to tactile, and not motor, verb properties, Experiment 2 compared the impact of tactile verbs to both action and non-tactile verbs, while stimulations were delivered on the index finger. No priming emerged following action verbs, therefore not supporting the motor-grounded interpretation. Facilitation by tactile verbs was however not observed, possibly owing to methodological changes. Experiment 3, identical to Experiment 2 except that stimulation was delivered to participants' forearm, replicated the priming effect. Importantly, tactile stimulations were detected faster after tactile than after both non-tactile and action verbs, indicating that verbs' tactile properties engaged resources shared with sensory perception. Our findings suggest that language conveying tactile information can activate somatosensory representations and subsequently promote tactile detection.

Motor-system dynamics during naturalistic reading of action narratives in first and second language

Do embodied semantic systems play different roles depending on when and how well a given language was learned? Emergent evidence suggests that this is the case for isolated, decontextualized stimuli, but no study has addressed the issue considering naturalistic narratives. Seeking to bridge this gap, we assessed motor-system dynamics in 26 Spanish-English bilinguals as they engaged in free, unconstrained reading of naturalistic action texts (ATs, highlighting the characters’ movements) and neutral texts (NTs, featuring low motility) in their first and second language (L1, L2). To explore functional connectivity spread over each reading session, we recorded ongoing high-density electroencephalographic signals and subjected them to functional connectivity analysis via a spatial clustering approach. Results showed that, in L1, AT (relative to NT) reading involved increased connectivity between left and right central electrodes consistently implicated in action-related processes, as well as distinct source-level modulations in motor regions. In L2, despite null group-level effects, enhanced motor-related connectivity during AT reading correlated positively with L2 proficiency and negatively with age of L2 learning. Taken together, these findings suggest that action simulations during unconstrained narrative reading involve neural couplings between motor-sensitive mechanisms, in proportion to how consolidated a language is. More generally, such evidence addresses recent calls to test the ecological validity of motor-resonance effects while offering new insights on their relation with experiential variables.

The role of motor system in action-related language comprehension in L1 and L2: An fMRI study

The framework of embodied cognition has challenged the modular view of a language-cognition divide by suggesting that meaning-retrieval critically involves the sensory-motor system. Despite extensive research into the neural mechanisms underlying language-motor coupling, it remains unclear how the motor system might be differentially engaged by different levels of linguistic abstraction and language proficiency. To address this issue, we used fMRI to quantify neural activations in brain regions underlying motor and language processing in Chinese-English speakers' processing of literal, metaphorical, and abstract language in their L1 and L2. Results overall revealed a response in motor ROIs gradually attenuating in intensity from literal to abstract via metaphorical language in both L1 and L2. Furthermore, contrast analyses between L1 and L2 showed overall greater activations of motor ROIs in the L2. We conclude that motor involvement in language processing is graded rather than all-or-none and that the motor system has a dual-functional role.

Left Amygdala Regulates the Cerebral Reading Network During Fast Emotion Word Processing

Emotion words constitute a special class of verbal stimuli which can quickly activate the limbic system outside the left-hemisphere language network. Such fast response to emotion words may arise independently of the left occipitotemporal area involved in visual word-form analysis and rely on a distinct amygdala-dependent emotion circuit involved in fearful face processing. Using a hemifield priming paradigm with fMRI, we explored how the left and right amygdala systems interact with the reading network during emotion word processing. On each trial, participants viewed a centrally presented target which was preceded by a masked prime flashed either to the left or right visual field. Primes and targets, each denoting negative or positive nouns, could be either affectively congruent or incongruent with each other. We observed that affective congruency produced parallel changes in neural priming between the left frontal and parietotemporal regions and the bilateral amygdala. However, we also found that the left, but not right, amygdala exhibited significant change in functional connectivity with the neural components of reading as a function of affective congruency. Collectively, these results suggest that emotion words activate the bilateral amygdala during early stages of emotion word processing, whereas only the left amygdala exerts a long-distance regulatory influence over the reading network via its strong within-hemisphere connectivity.

Action verb processing specifically modulates motor behaviour and sensorimotor neuronal oscillations

Understanding action-related language recruits the brain’s motor system and can interact with motor behaviour. The current study shows MEG oscillatory patterns during verb-motor priming. Hand and foot verbs were followed by hand or foot responses, with faster reaction times for congruent conditions. In ROIs placed in the hand/arm and foot/leg portions of the sensorimotor cortex, this behavioural priming effect was accompanied by modulations in MEG oscillatory patterns preceding the responses. Power suppression in the alpha/beta frequency bands was reduced in congruent conditions in the body-part-specific ROIs. These results imply that the verb-motor priming effect may be a direct consequence of motor cortex contributions to action word processing.

Language, Gesture, and Emotional Communication: An Embodied View of Social Interaction

Spoken language is an innate ability of the human being and represents the most widespread mode of social communication. The ability to share concepts, intentions and feelings, and also to respond to what others are feeling/saying is crucial during social interactions. A growing body of evidence suggests that language evolved from manual gestures, gradually incorporating motor acts with vocal elements. In this evolutionary context, the human mirror mechanism (MM) would permit the passage from “doing something” to “communicating it to someone else.” In this perspective, the MM would mediate semantic processes being involved in both the execution and in the understanding of messages expressed by words or gestures. Thus, the recognition of action related words would activate somatosensory regions, reflecting the semantic grounding of these symbols in action information. Here, the role of the sensorimotor cortex and in general of the human MM on both language perception and understanding is addressed, focusing on recent studies on the integration between symbolic gestures and speech. We conclude documenting some evidence about MM in coding also the emotional aspects conveyed by manual, facial and body signals during communication, and how they act in concert with language to modulate other’s message comprehension and behavior, in line with an “embodied” and integrated view of social interaction.

How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.

Does watching Han Solo or C-3PO similarly influence our language processing?

Several studies have demonstrated that perceiving an action influences the subsequent processing of action verbs. However, which characteristics of the perceived action are truly determinant to enable this influence is still unknown. The current study investigated the role of the agent executing an action in this action-language relationship. Participants performed a semantic decision task after seeing a video of a human or a robot performing an action. The results of the first study showed that perceiving a human being executing an action as well as perceiving a robot facilitate subsequent language processing, suggesting that the humanness (The term "humanness" is used as meaning "belonging to human race" and not to refer to a personal quality) of the agent is not crucial in the link between action and language. However, this experiment was conducted with Japanese people who are very familiar with robots; thus, an alternative explanation could be that it is the unfamiliarity with the agent that could perturb the action-language relationship. To assess this hypothesis, we carried out two additional experiments with French participants. The results of the second study showed that, unlike the observation of a human agent, the observation of a robot did not influence language processing. Finally, the results of the third study showed that, after a familiarization phase, French participants too were influenced by the observation of a robot. Overall, the outcomes of these studies indicate that, more than the humanness of the agent, it is the familiarity which we have with this agent that is crucial in the action-language relationship.

Time-Course of Motor Involvement in Literal and Metaphoric Action Sentence Processing: A TMS Study

There is evidence that the motor cortex is involved in reading sentences containing an action verb ("The spike was hammered into the ground") as well as metaphoric sentences ("The army was hammered in the battle"). Verbs such as 'hammered' may be homonyms, with separate meanings belonging to the literal action and metaphoric action, or they may be polysemous, with the metaphoric sense grounded in the literal sense. We investigated the time course of the effects of single-pulse transcranial magnetic stimulation to primary motor cortex on literal and metaphoric sentence comprehension. Stimulation 300 ms post-verb presentation impaired comprehension of both literal and metaphoric sentences, supporting a causal role of sensory-motor areas in comprehension. Results suggest that the literal meaning of an action verb remains activated during metaphor comprehension, even after the temporal window of homonym disambiguation. This suggests that such verbs are polysemous, and both senses are related and grounded in motor cortex.

Language as a Predictor of Motor Recovery: The Case for a More Global Approach to Stroke Rehabilitation

Stroke is the third leading cause of death in the developed world and the primary cause of adult disability. The most common site of stroke is the middle cerebral artery (MCA), an artery that supplies a range of areas involved in both language and motor function. As a consequence, many stroke patients experience a combination of language and motor deficits. Indeed, those suffering from Broca's aphasia have an 80% chance of also suffering hemiplegia. Despite the prevalence of multifaceted disability in patients, the current trend in both clinical trials and clinical practice is toward compartmentalization of dysfunction. In this article, we review evidence that aphasia and hemiplegia do not just coexist, but that they interact. We review a number of clinical reports describing how therapies for one type of deficit can improve recovery in the other and vice versa. We go on to describe how language deficits should be seen as a warning to clinicians that the patient is likely to experience motor impairment and slower motor recovery, aiding clinicians to optimize their choice of therapy. We explore these findings and offer a tentative link between language and arm function through their shared need for sequential action, which we term fluency. We propose that area BA44 (part of Broca's area) acts as a hub for fluency in both movement and language, both in terms of production and comprehension.

Role of Sensorimotor Cortex in Gestural-Verbal Integration

Action comprehension that is related to language or gestural integration has been shown to engage the motor system in the brain, thus providing preliminary evidence for the gestural-verbal embodiment concept. Based on the involvement of the sensorimotor cortex (M1) in language processing, we aimed to further explore its role in the cognitive embodiment necessary for gestural-verbal integration. As such, we applied anodal (excitatory) and sham transcranial direct current stimulation (tDCS) over the left M1 (with reference electrode over the contralateral supraorbital region) during a gestural-verbal integration task where subjects had to make a decision about the semantic congruency of the gesture (prime) and the word (target). We used a cross-over within-subject design in young subjects. Attentional load and simple reaction time (RT) tasks served as control conditions, applied during stimulation (order of three tasks was counterbalanced). Our results showed that anodal (atDCS) compared to sham tDCS (stDCS) reduced RTs in the gestural-verbal integration task, specifically for incongruent pairs of gestures and verbal expressions, with no effect on control task performance. Our findings provide evidence for the involvement of the sensorimotor system in gestural-verbal integration performance. Further, our results suggest that functional modulation induced by sensorimotor tDCS may be specific to gestural-verbal integration. Future studies should now evaluate the modulatory effect of tDCS on semantic congruency by using tDCS over additional brain regions and include assessments of neural connectivity.

Body Topography Parcellates Human Sensory and Motor Cortex

The cytoarchitectonic map as proposed by Brodmann currently dominates models of human sensorimotor cortical structure, function, and plasticity. According to this model, primary motor cortex, area 4, and primary somatosensory cortex, area 3b, are homogenous areas, with the major division lying between the two. Accumulating empirical and theoretical evidence, however, has begun to question the validity of the Brodmann map for various cortical areas. Here, we combined in vivo cortical myelin mapping with functional connectivity analyses and topographic mapping techniques to reassess the validity of the Brodmann map in human primary sensorimotor cortex. We provide empirical evidence that area 4 and area 3b are not homogenous, but are subdivided into distinct cortical fields, each representing a major body part (the hand and the face). Myelin reductions at the hand-face borders are cortical layer-specific, and coincide with intrinsic functional connectivity borders as defined using large-scale resting state analyses. Our data extend the Brodmann model in human sensorimotor cortex and suggest that body parts are an important organizing principle, similar to the distinction between sensory and motor processing.

Linguistic and motor representations of everyday complex actions: an fNIRS investigation

The present work aimed at exploring functional correlates of motor and linguistic representations of everyday actions, with a specific interest in potential sensorimotor activation effects induced by the use of related action sentences. While it is indeed known that observing simple motor acts (e.g., precision grasping) and listening to the sound of specific actions (e.g., walking) activate sensorimotor structures, less is known when we move to more complex behaviors and more abstract linguistic representations (e.g., verbal descriptions). Again, the potential of linguistic representations to facilitate the activation of specific sensorimotor structures during action execution or observation is yet unexplored. We then aimed at investigating hemodynamic activation patterns (via functional near-infrared spectroscopy, fNIRS) within the sensorimotor network during different tasks based on everyday activities. Twenty volunteers were asked to execute (EXE), observe (OBS), or listen (LIS) to brief verbal descriptions of transitive actions, to observe them while listening to their description (OBS-LIS), or to execute them while listening to their description (EXE-LIS). Analyses highlighted that, in the left hemisphere, hemodynamic responses were the lowest during observation of complex actions and observation coupled with listening, greater during simple listening to verbal description of actions, and maximal when participants actually executed complex actions or executed them while listening to their verbal descriptions. The present results suggest that processing verbal descriptions of actions might keep the sensorimotor network more active than simply observing them. Such first pieces of evidence hint at potential implications for novel procedures for rehabilitation of movement and action deficits.

Semantic discrimination impacts tDCS modulation of verb processing

Motor cortex activation observed during body-related verb processing hints at simulation accompanying linguistic understanding. By exploiting the up- and down-regulation that anodal and cathodal transcranial direct current stimulation (tDCS) exert on motor cortical excitability, we aimed at further characterizing the functional contribution of the motor system to linguistic processing. In a double-blind sham-controlled within-subjects design, online stimulation was applied to the left hemispheric hand-related motor cortex of 20 healthy subjects. A dual, double-dissociation task required participants to semantically discriminate concrete (hand/foot) from abstract verb primes as well as to respond with the hand or with the foot to verb-unrelated geometric targets. Analyses were conducted with linear mixed models. Semantic priming was confirmed by faster and more accurate reactions when the response effector was congruent with the verb's body part. Cathodal stimulation induced faster responses for hand verb primes thus indicating a somatotopical distribution of cortical activation as induced by body-related verbs. Importantly, this effect depended on performance in semantic discrimination. The current results point to verb processing being selectively modifiable by neuromodulation and at the same time to a dependence of tDCS effects on enhanced simulation. We discuss putative mechanisms operating in this reciprocal dependence of neuromodulation and motor resonance.

Neural reuse of action perception circuits for language, concepts and communication

Neurocognitive and neurolinguistics theories make explicit statements relating specialized cognitive and linguistic processes to specific brain loci. These linking hypotheses are in need of neurobiological justification and explanation. Recent mathematical models of human language mechanisms constrained by fundamental neuroscience principles and established knowledge about comparative neuroanatomy offer explanations for where, when and how language is processed in the human brain. In these models, network structure and connectivity along with action- and perception-induced correlation of neuronal activity co-determine neurocognitive mechanisms. Language learning leads to the formation of action perception circuits (APCs) with specific distributions across cortical areas. Cognitive and linguistic processes such as speech production, comprehension, verbal working memory and prediction are modelled by activity dynamics in these APCs, and combinatorial and communicative-interactive knowledge is organized in the dynamics within, and connections between APCs. The network models and, in particular, the concept of distributionally-specific circuits, can account for some previously not well understood facts about the cortical 'hubs' for semantic processing and the motor system's role in language understanding and speech sound recognition. A review of experimental data evaluates predictions of the APC model and alternative theories, also providing detailed discussion of some seemingly contradictory findings. Throughout, recent disputes about the role of mirror neurons and grounded cognition in language and communication are assessed critically.

Sensorimotor experience and verb-category mapping in human sensory, motor and parietal neurons

Semantic grounding is the process of relating meaning to symbols (e.g., words). It is the foundation for creating a representational symbolic system such as language. Semantic grounding for verb meaning is hypothesized to be achieved through two mechanisms: sensorimotor mapping, i.e., directly encoding the sensorimotor experiences the verb describes, and verb-category mapping, i.e., encoding the abstract category a verb belongs to. These two mechanisms were investigated by examining neuronal-level spike (i.e. neuronal action potential) activities from the motor, somatosensory and parietal areas in two human participants. Motor and a portion of somatosensory neurons were found to be involved in primarily sensorimotor mapping, while parietal and some somatosensory neurons were found to be involved in both sensorimotor and verb-category mapping. The time course of the spike activities and the selective tuning pattern of these neurons indicate that they belong to a large neural network used for semantic processing. This study is the first step towards understanding how words are processed by neurons.

Oscillatory Dynamics Supporting Semantic Cognition: MEG Evidence for the Contribution of the Anterior Temporal Lobe Hub and Modality-Specific Spokes

The "hub and spoke model" of semantic representation suggests that the multimodal features of objects are drawn together by an anterior temporal lobe (ATL) "hub", while modality-specific "spokes" capture perceptual/action features. However, relatively little is known about how these components are recruited through time to support object identification. We used magnetoencephalography to measure neural oscillations within left ATL, lateral fusiform cortex (FC) and central sulcus (CS) during word-picture matching at different levels of specificity (employing superordinate vs. specific labels) for different categories (manmade vs. animal). This allowed us to determine (i) when each site was sensitive to semantic category and (ii) whether this was modulated by task demands. In ATL, there were two phases of response: from around 100 ms post-stimulus there were phasic bursts of low gamma activity resulting in reductions in oscillatory power, relative to a baseline period, that were modulated by both category and specificity; this was followed by more sustained power decreases across frequency bands from 250 ms onwards. In the spokes, initial power increases were not stronger for specific identification, while later power decreases were stronger for specific-level identification in FC for animals and in CS for manmade objects (from around 150 ms and 200 ms, respectively). These data are inconsistent with a temporal sequence in which early sensory-motor activity is followed by later retrieval in ATL. Instead, knowledge emerges from the rapid recruitment of both hub and spokes, with early specificity and category effects in the ATL hub. The balance between these components depends on semantic category and task, with visual cortex playing a greater role in the fine-grained identification of animals and motor cortex contributing to the identification of tools.