Brain dynamics in the comprehension of action-related language. A time-frequency analysis of mu rhythms

Causal role of frontocentral beta oscillation in comprehending linguistic communicative functions

Linguistic communication is often considered as an action serving the function of conveying the speaker's goal to the addressee. Although neuroimaging studies have suggested a role of the motor system in comprehending communicative functions, the underlying mechanism is yet to be specified. Here, by two EEG experiments and a tACS experiment, we demonstrate that the frontocentral beta oscillation, which represents action states, plays a crucial part in linguistic communication understanding. Participants read scripts involving two interlocutors and rated the interlocutors' attitudes. Each script included a critical sentence said by the speaker expressing a context-dependent function of either promise, request, or reply to the addressee's query. These functions were behaviorally discriminated, with higher addressee's will rating for the promise than for the reply and higher speaker's will rating for the request than for the reply. EEG multivariate analyses showed that different communicative functions were represented by different patterns of the frontocentral beta activity but not by patterns of alpha activity. Further tACS results showed that, relative to alpha tACS and sham stimulation, beta tACS improved the predictability of communicative functions of request or reply, as measured by the speaker's will rating. These results convergently suggest a causal role of the frontocentral beta activities in comprehending linguistic communications.

Learning to Listen: Changes in Children's Brain Activity Following a Listening Comprehension Intervention

"Are you LISTENING?" may be one of the most frequent questions preschoolers hear from their parents and teachers, but can children be taught to listen carefully-and thus better comprehend language-and if so, what changes occur in their brains? Twenty-seven four- and five-year-old children were taught a language simulation strategy to use while listening to stories: first, they practiced moving graphics on an iPad to correspond to the story actions, and then they practiced imagining the movements. Compared to a control condition, children in the intervention answered comprehension questions more accurately when imagining moving the graphics and on a measure of transfer using a new story without any instruction and with only immovable graphics. Importantly, for children in the intervention, the change in comprehension from the first to the sixth day was strongly correlated with changes in EEG mu and alpha desynchronization, suggesting changes in motor and visual processing following the intervention. Thus, the data are consistent with our hypothesis that a language simulation listening comprehension intervention can improve children's listening comprehension by teaching children to align visual and motor processing with language comprehension.

The Neural Correlates of Embodied L2 Learning: Does Embodied L2 Verb Learning Affect Representation and Retention?

We investigated how naturalistic actions in a highly immersive, multimodal, interactive 3D virtual reality (VR) environment may enhance word encoding by recording EEG in a pre/post-test learning paradigm. While behavior data have shown that coupling word encoding with gestures congruent with word meaning enhances learning, the neural underpinnings of this effect have yet to be elucidated. We coupled EEG recording with VR to examine whether embodied learning improves learning and creates linguistic representations that produce greater motor resonance. Participants learned action verbs in an L2 in two different conditions: specific action (observing and performing congruent actions on virtual objects) and pointing (observing actions and pointing to virtual objects). Pre- and post-training participants performed a match-mismatch task as we measured EEG (variation in the N400 response as a function of match between observed actions and auditory verbs) and a passive listening task while we measured motor activation (mu [8-13 Hz] and beta band [13-30 Hz] desynchronization during auditory verb processing) during verb processing. Contrary to our expectations, post-training results revealed neither semantic nor motor effects in either group when considered independently of learning success. Behavioral results showed a great deal of variability in learning success. When considering performance, low performance learners showed no semantic effect and high performance learners exhibited an N400 effect for mismatch versus match trials post-training, independent of the type of learning. Taken as a whole, our results suggest that embodied processes can play an important role in L2 learning.

Electrophysiological alterations during action semantic processing in Parkinson's disease

Assessments of action semantics consistently reveal markers of Parkinson's disease (PD). However, neurophysiological signatures of the domain remain under-examined in this population, especially under conditions that allow patients to process stimuli without stringent time constraints. Here we assessed event-related potentials and time-frequency modulations in healthy individuals (HPs) and PD patients during a delayed-response semantic judgment task involving related and unrelated action-picture pairs. Both groups had shorter response times for related than for unrelated trials, but they exhibited discrepant electrophysiological patterns. HPs presented significantly greater N400 amplitudes as well as theta enhancement and mu desynchronization for unrelated relative to related trials. Conversely, N400 and theta modulations were abolished in the patients, who further exhibited a contralateralized cluster in the mu range. None of these patterns were associated with the participants' cognitive status. Our results suggest that PD involves multidimensional neurophysiological disruptions during action-concept processing, even under task conditions that elicit canonical behavioral effects. New constraints thus emerge for translational neurocognitive models of the disease.

The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization

The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.

Characteristics of different Mandarin pronunciation element perception: evidence based on a multifeature paradigm for recording MMN and P3a components of phonemic changes in speech sounds

Background

As a tonal language, Mandarin Chinese has the following pronunciation elements for each syllable: the vowel, consonant, tone, duration, and intensity. Revealing the characteristics of auditory-related cortical processing of these different pronunciation elements is interesting.

Methods

A Mandarin pronunciation multifeature paradigm was designed, during which a standard stimulus and five different phonemic deviant stimuli were presented. The electroencephalogram (EEG) data were recorded with 256-electrode high-density EEG equipment. Time-domain and source localization analyses were conducted to demonstrate waveform characteristics and locate the sources of the cortical processing of mismatch negativity (MMN) and P3a components following different stimuli.

Results

Vowel and consonant differences elicited distinct MMN and P3a components, but tone and duration differences did not. Intensity differences elicited distinct MMN components but not P3a components. For MMN and P3a components, the activated cortical areas were mainly in the frontal-temporal lobe. However, the regions and intensities of the cortical activation were significantly different among the components for the various deviant stimuli. The activated cortical areas of the MMN and P3a components elicited by vowels and consonants seemed to be larger and show more intense activation.

Conclusion

The auditory processing centers use different auditory-related cognitive resources when processing different Mandarin pronunciation elements. Vowels and consonants carry more information for speech comprehension; moreover, more neurons in the cortex may be involved in the recognition and cognitive processing of these elements.

Meaning in hand: Investigating shared mechanisms of motor imagery and sensorimotor simulation in language processing

There is substantial evidence to support grounded theories of semantic representation, however the mechanisms of simulation in most theories are underspecified. In the present study, we used an individual differences approach to test whether motor imagery may share some mechanisms with sensorimotor simulations engaged during semantic processing. We quantified individual differences in motor imagery ability via implicit imagery tasks and explicit imagery questionnaires and tested their relationship to sensorimotor effects in syntactic classification tasks. In Experiment 1 (N = 185) we tested relationships between motor imagery and semantic processing of body-object interaction meaning (BOI; the degree to which you can interact with a word's referent) and foot/leg action meaning. We observed two interactions between imagery ability measured on the Florida Praxis Imagery Questionnaire (FPIQ) and BOI effects in semantic processing (response time and accuracy). In both interactions poorer imagery ability was associated with null BOI effects, whereas better imagery was associated with BOI effects. We also observed faster and more accurate responses to verbs associated with more foot/leg action meaning than verbs with less foot/leg action meaning, but this foot/leg action effect did not significantly interact with individual differences in motor imagery. In Experiment 2 (N = 195) we tested whether the interactions observed in Experiment 1 were dependent on the object-directed nature of the actions, or whether similar effects would be observed for hand actions not associated with objects. We also expanded our investigation beyond hand and foot imagery to consider whole body imagery. We observed an interaction between performance on a hand laterality judgement task (HLJT; assessing hand motor imagery) and sensorimotor effects in semantic processing of verbs associated with hand/arm action meaning. Participants with the fastest responses on the most difficult trials of the HLJT showed no significant difference in their response times to words with high and low hand/arm action meaning. We also observed faster and more accurate responses to high relative to low embodiment verbs, but this sensorimotor effect did not interact with individual differences in motor imagery. The results suggest specific (and not general) associations, in that some, but not all forms of hand and object-directed motor imagery are related to sensorimotor effects in language processing of hand/arm action verbs and nouns describing objects that are easy to interact with. As such, hand and object-directed motor imagery may share mechanisms with sensorimotor simulation during semantic processing.

Ecological Meanings: A Consensus Paper on Individual Differences and Contextual Influences in Embodied Language

Embodied theories of cognition consider many aspects of language and other cognitive domains as the result of sensory and motor processes. In this view, the appraisal and the use of concepts are based on mechanisms of simulation grounded on prior sensorimotor experiences. Even though these theories continue receiving attention and support, increasing evidence indicates the need to consider the flexible nature of the simulation process, and to accordingly refine embodied accounts. In this consensus paper, we discuss two potential sources of variability in experimental studies on embodiment of language: individual differences and context. Specifically, we show how factors contributing to individual differences may explain inconsistent findings in embodied language phenomena. These factors include sensorimotor or cultural experiences, imagery, context-related factors, and cognitive strategies. We also analyze the different contextual modulations, from single words to sentences and narratives, as well as the top-down and bottom-up influences. Similarly, we review recent efforts to include cultural and language diversity, aging, neurodegenerative diseases, and brain disorders, as well as bilingual evidence into the embodiment framework. We address the importance of considering individual differences and context in clinical studies to drive translational research more efficiently, and we indicate recommendations on how to correctly address these issues in future research. Systematically investigating individual differences and context may contribute to understanding the dynamic nature of simulation in language processes, refining embodied theories of cognition, and ultimately filling the gap between cognition in artificial experimental settings and cognition in the wild (i.e., in everyday life).

Brain Signatures of Embodied Semantics and Language: A Consensus Paper

According to embodied theories (including embodied, embedded, extended, enacted, situated, and grounded approaches to cognition), language representation is intrinsically linked to our interactions with the world around us, which is reflected in specific brain signatures during language processing and learning. Moving on from the original rivalry of embodied vs. amodal theories, this consensus paper addresses a series of carefully selected questions that aim at determining when and how rather than whether motor and perceptual processes are involved in language processes. We cover a wide range of research areas, from the neurophysiological signatures of embodied semantics, e.g., event-related potentials and fields as well as neural oscillations, to semantic processing and semantic priming effects on concrete and abstract words, to first and second language learning and, finally, the use of virtual reality for examining embodied semantics. Our common aim is to better understand the role of motor and perceptual processes in language representation as indexed by language comprehension and learning. We come to the consensus that, based on seminal research conducted in the field, future directions now call for enhancing the external validity of findings by acknowledging the multimodality, multidimensionality, flexibility and idiosyncrasy of embodied and situated language and semantic processes.

Disturbing the activity of the primary motor cortex by means of transcranial magnetic stimulation affects long term memory of sentences referred to manipulable objects

Introduction

Previous studies on embodied meaning suggest that simulations in the motor cortex play a crucial role in the processing of action sentences. However, there is little evidence that embodied meaning have functional impact beyond working memory. This study examines how the neuromodulation of the motor cortex (M1) could affect the processing of action-related language, measuring participants' performance in a long-term memory task.

Method

Participants were submitted to two sessions in separate days, one with low-frequency repetitive transcranial magnetic stimulation (rTMS) and the other with sham rTMS. The pulses were delivered for 15 minutes over M1 or over V1, used as a control area. After each stimulation or sham period, the participants were asked to memorize a list of simple sentences, with a manual action verb or an attentional verb, followed in both cases by a noun referred to a manipulable object (e.g., to hang a cane vs. to observe a cane). Finally, they received the verbs as cues with instructions to recall the nouns.

Results

The results showed that low frequency rTMS on M1, compared to sham stimulation, significantly improved the performance in the memory task, for both types of sentences. No change in performance was found after the rTMS stimulation of V1.

Discussion

These results confirm that the perturbation on the motor system, affect the memory of manipulable object names in the context of sentences, providing further evidence of the role played by the sensorimotor system in the encoding and recall of concrete sentences of action.

Mapping relational links between motor imagery, action observation, action-related language, and action execution

Actions can be physically executed, observed, imagined, or simply thought about. Unifying mental processes, such as simulation, emulation, or predictive processing, are thought to underlie different action types, whether they are mental states, as in the case of motor imagery and action observation, or involve physical execution. While overlapping brain activity is typically observed across different actions which indicates commonalities, research interest is also concerned with investigating the distinct functional components of these action types. Unfortunately, untangling subtleties associated with the neurocognitive bases of different action types is a complex endeavour due to the high dimensional nature of their neural substrate (e.g., any action process is likely to activate multiple brain regions thereby having multiple dimensions to consider when comparing across them). This has impeded progress in action-related theorising and application. The present study addresses this challenge by using the novel approach of multidimensional modeling to reduce the high-dimensional neural substrate of four action-related behaviours (motor imagery, action observation, action-related language, and action execution), find the least number of dimensions that distinguish or relate these action types, and characterise their neurocognitive relational links. Data for the model comprised brain activations for action types from whole-brain analyses reported in 53 published articles. Eighty-two dimensions (i.e., 82 brain regions) for the action types were reduced to a three-dimensional model, that mapped action types in ordination space where the greater the distance between the action types, the more dissimilar they are. A series of one-way ANOVAs and post-hoc comparisons performed on the mean coordinates for each action type in the model showed that across all action types, action execution and concurrent action observation (AO)-motor imagery (MI) were most neurocognitively similar, while action execution and AO were most dissimilar. Most action types were similar on at least one neurocognitive dimension, the exception to this being action-related language. The import of the findings are discussed in terms of future research and implications for application.

Motor features of abstract verbs determine their representations in the motor system

Embodied cognition theory posits that concept representations inherently rely on sensorimotor experiences that accompany their acquisitions. This is well established through concrete concepts. However, it is debatable whether representations of abstract concepts are based on sensorimotor representations. This study investigated the causal role of associated motor experiences that accompany concept acquisition in the involvement of the motor system in the abstract verb processing. Through two experiments, we examined the action–sentence compatibility effect, in the test phase after an increase in motor features during the learning phase for abstract verbs with low motor features (Experiment 1) or novel words with no conceptual features at all (Experiment 2). After associated motor experiences were added in the word learning phase, action–sentence compatibility effect was found in the semantic processing tasks during the test phase for abstract verbs (Experiment 1a) and novel words (Experiment 2). This was lacking in the word font color judgment task requiring no semantic processing (Experiment 1b). Coupled with our previous study, these findings suggest that motor features formed during word learning could causally affect embodiment in the motor system for abstract verbs, and reactivation of motor experiences in abstract verb processing depends on a given task’s demands. Our study supports the view that conceptual representations, even abstract concepts, can be grounded in sensorimotor experiences.

The Inhibition Effect of Affordances in Action Picture Naming: An ERP Study

How quickly are different kinds of conceptual knowledge activated in action picture naming? Using a masked priming paradigm, we manipulated the prime category type (artificial vs. natural), prime action type (precision, power, vs. neutral grip), and target action type (precision vs. power grip) in action picture naming, while electrophysiological signals were measured concurrently. Naming latencies showed an inhibition effect in the congruent action type condition compared with the neutral condition. ERP results showed that artificial and natural category primes induced smaller waveforms in precision or power action primes than neutral primes in the time window of 100-200 msec. Time-frequency results consistently presented a power desynchronization of the mu rhythm in the time window of 0-210 msec with precision action type artificial objects compared with neutral primes, which localized at the supplementary motor, precentral and postcentral areas in the left hemisphere. These findings suggest an inhibitory effect of affordances arising at conceptual preparation in action picture naming and provide evidence for embodied cognition.

Mu Rhythm Suppression Over Sensorimotor Regions is Associated with Greater Empathic Accuracy

When people encounter others’ emotions, they engage multiple brain systems, including parts of the sensorimotor cortex associated with motor simulation. Simulation-related brain activity is commonly described as a ‘low-level’ component of empathy and social cognition. It remains unclear whether and how sensorimotor simulation contributes to complex empathic judgments. Here, we combine a naturalistic social paradigm with a reliable index of sensorimotor cortex-based simulation: electroencephalography suppression of oscillatory activity in the mu frequency band. We recruited participants to watch naturalistic video clips of people (‘targets’) describing emotional life events. In two experiments, participants viewed these clips (i) with video and sound, (ii) with only video or (iii) with only sound and provided continuous ratings of how they believed the target felt. We operationalized ‘empathic accuracy’ as the correlation between participants’ inferences and targets’ self-report. In Experiment 1 (US sample), across all conditions, right-lateralized mu suppression tracked empathic accuracy. In Experiment 2 (Israeli sample), this replicated only when using individualized frequency-bands and only for the visual stimuli. Our results provide novel evidence that sensorimotor representations—as measured through mu suppression—play a role not only in low-level motor simulation, but also in higher-level inferences about others’ emotions, especially when visual cues are crucial for accuracy.

The neural inhibition network is causally involved in the disembodiment effect of linguistic negation

Negation applied to action contexts reduces the activation of the motor system. According to the Reusing Inhibition for Negation (RIN) hypothesis, such "disembodiment" effect occurs because understanding negations engages the reuse of inhibitory control mechanisms. Here, we investigated whether the right inferior frontal gyrus (rIFG) - a key area of the inhibitory control system - contributes to primary motor cortex (M1) processing of negated action-sentences. Using a perturb-and-measure paradigm, we applied off-line low-frequency repetitive TMS (rTMS) over the rIFG, before performing a reading task involving action and attentional sentences presented in both affirmative or negative form. During the reading task, motor excitability was assessed by recording motor-evoked potentials (MEPs) induced by single-pulse TMS (spTMS) over the left M1, at two loci in the sentence: the verb or the object. Results show that after sham stimulation (baseline), motor excitability measured on the verb, was reduced for negative, compared to affirmative action sentences. Crucially, neuromodulation of rIFG suppressed this inhibitory effect of negation, since motor excitability was equaled for negative and affirmative action sentences. As expected, no effect of negation was observed for attentional sentences or when the pulse was delivered over the object. Our study confirms that understanding negative action sentences inhibits M1. This effect took place at an early stage of semantic processing (i.e., while processing the verb in our task), and faded at a later time-point. Critically, by highlighting a causal role of rIFG in this motor inhibition, we provide direct neurophysiological support to the RIN hypothesis.

A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE)

The Action-sentence Compatibility Effect (ACE) is a well-known demonstration of the role of motor activity in the comprehension of language. Participants are asked to make sensibility judgments on sentences by producing movements toward the body or away from the body. The ACE is the finding that movements are faster when the direction of the movement (e.g., toward) matches the direction of the action in the to-be-judged sentence (e.g., Art gave you the pen describes action toward you). We report on a pre-registered, multi-lab replication of one version of the ACE. The results show that none of the 18 labs involved in the study observed a reliable ACE, and that the meta-analytic estimate of the size of the ACE was essentially zero.

Crossing hands behind your back reduces recall of manual action sentences and alters brain dynamics

The embodied meaning approach posits that understanding action-related language recruits motor processes in the brain. However, the functional impact of these motor processes on cognition has been questioned. The present study aims to provide new electrophysiological (EEG) evidence concerning the role of motor processes in the comprehension and memory of action language. Participants read lists of sentences including manual-action or attentional verbs, while keeping their hands either in front of them or crossing them behind their back. Results showed that posture impacted selectively the processing of manual action sentence, and not of attentional sentences, in three different ways: 1) EEG fronto-central beta rhythms, a signature of motor processes, were desynchronized while reading action sentences in the hands-in-front posture compared to the hands-behind posture. The estimated source was the posterior cingulate cortex, involved in proprioceptive regulation. 2) Recall of nouns associated with manual sentences decreased when learning occurred in the hands-behind posture. 3) ERPs analysis revealed that the initial posture at learning modulates neural processes during subsequent recall of manual sentences in the left superior frontal gyrus, which is related to motor processes. These results provide decisive evidence for the functional involvement of embodied simulations in the encoding and retrieval of action-related language.

Exploring the Co-occurrence of Manual Verbs and Actions in Early Mother-Child Communication

The embodiment approach has shown that motor neural networks are involved in the processing of action verbs. There is developmental evidence that embodied effects on verb processing are already present in early years. Yet, the ontogenetic origin of this motor reuse in action verbs remains unknown. This longitudinal study investigates the co-occurrence of manual verbs and actions during mother-child daily routines (free play, bathing, and dining) when children were 1 to 2 (Group 1) and 2 to 3 (Group 2) years old. Eight mother-child dyads were video-recorded in 3-month intervals across 12 months (27 recording hours), and the timing of verbs and manual actions (21,876 entries) were coded by independent observers. Results showed that the probability of matched verb-action co-occurrences were much higher (0.80 and 0.77) than that of random co-occurrences (0.13 and 0.15) for Group 1 and Group 2, respectively. The distributions of the verb-action temporal intervals in both groups were quite symmetrical and skewed with the peak corresponding to both 0.00 s synchronic intervals (8% of the cases) and the shortest +5 s interval (40% of the cases). Mother-led instances occurred in both groups whereas child-led instances were restricted to Group 2. Mothers pragmatically aligned their verbal productions, since they repeatedly used (74%) those verbs they shared with their children's repertoire (31%). In conclusion, the early multisensory communicative and manipulative scene affords grounding of verb meanings on the ongoing actions, facilitating verb-action pairing in the realm of social interactions, providing a new dimension to the prevailing solipsistic approach to embodiment.

Enhancing Motor Brain Activity Improves Memory for Action Language: A tDCS Study

The embodied cognition approach to linguistic meaning posits that action language understanding is grounded in sensory-motor systems. However, evidence that the human motor cortex is necessary for action language memory is meager. To address this issue, in two groups of healthy individuals, we perturbed the left primary motor cortex (M1) by means of either anodal or cathodal transcranial direct current stimulation (tDCS), before participants had to memorize lists of manual action and attentional sentences. In each group, participants received sham and active tDCS in two separate sessions. Following anodal tDCS (a-tDCS), participants improved the recall of action sentences compared with sham tDCS. No similar effects were detected following cathodal tDCS (c-tDCS). Both a-tDCS and c-tDCS induced variable changes in motor excitability, as measured by motor-evoked potentials induced by transcranial magnetic stimulation. Remarkably, across groups, action-specific memory improvements were positively predicted by changes in motor excitability. We provide evidence that excitatory modulation of the motor cortex selectively improves performance in a task requiring comprehension and memory of action sentences. These findings indicate that M1 is necessary for accurate processing of linguistic meanings and thus provide causal evidence that high-order cognitive functions are grounded in the human motor system.

Presetting an inhibitory state modifies the neural processing of negated action sentences. An ERP study

It has been proposed that understanding negated action sentences (You don't cut the bread) uses the neural networks of action inhibition. The evidence comes from studies in which affirmative or negative action language immediately preceded a Go/NoGo task. It was found that negation selectively modulates inhibition-related signatures of NoGo trials, supporting the Reusing Inhibition for Negation (RIN) hypothesis. To further explore this hypothesis, this study tested the reverse effects; namely, how presetting an inhibitory state affects the processing of negated action sentences. To this end, Go/NoGo responses preceded sentence reading and EEG activities were recorded throughout the entire trials. ERP results indicate that the presetting of inhibition by the NoGo cue induced a sustained modulation of waveform for negated action sentences relative to affirmative ones, which began shortly after the negation operator onset and remained beyond the action verb onset. Crucially, the estimated sources of such effect were the right inferior frontal gyrus and the left middle frontal gyrus, both relevant regions in the action inhibition circuitry. These results, complemented by previous findings, support the idea that action inhibition and negated action language share neural mechanisms and influence each other, thus confirming and extending the RIN hypothesis.

Motor-system dynamics during naturalistic reading of action narratives in first and second language

Do embodied semantic systems play different roles depending on when and how well a given language was learned? Emergent evidence suggests that this is the case for isolated, decontextualized stimuli, but no study has addressed the issue considering naturalistic narratives. Seeking to bridge this gap, we assessed motor-system dynamics in 26 Spanish-English bilinguals as they engaged in free, unconstrained reading of naturalistic action texts (ATs, highlighting the characters’ movements) and neutral texts (NTs, featuring low motility) in their first and second language (L1, L2). To explore functional connectivity spread over each reading session, we recorded ongoing high-density electroencephalographic signals and subjected them to functional connectivity analysis via a spatial clustering approach. Results showed that, in L1, AT (relative to NT) reading involved increased connectivity between left and right central electrodes consistently implicated in action-related processes, as well as distinct source-level modulations in motor regions. In L2, despite null group-level effects, enhanced motor-related connectivity during AT reading correlated positively with L2 proficiency and negatively with age of L2 learning. Taken together, these findings suggest that action simulations during unconstrained narrative reading involve neural couplings between motor-sensitive mechanisms, in proportion to how consolidated a language is. More generally, such evidence addresses recent calls to test the ecological validity of motor-resonance effects while offering new insights on their relation with experiential variables.

Hand-use norms for Dutch and English manual action verbs: Implicit measures from a pantomime task

Many studies use manual action verbs to test whether people use neural systems for controlling manual actions to understand language about those actions. Yet, few of these studies empirically establish how people use their hands to perform the actions described by those verbs, relying instead on explicit self-report measures. Here, participants pantomimed the manual actions described by a large set of Dutch (N = 251) and English (N = 250) verbs, allowing us to approximate the extent to which people use each of their hands to perform these actions. After the pantomime task, participants also provided explicit ratings of each of these actions. The results from the pantomime task showed that most manual actions cannot be described accurately as either "unimanual" or "bimanual." With a few exceptions, unimanual action verbs do not describe actions that are performed with only one hand, and bimanual verbs do not describe actions that are performed by using both hands equally. Instead, individual actions vary continuously in the extent to which people use their non-dominant hand to perform them, and in the extent to which people consistently prefer one hand or the other to perform them. Finally, by comparing participants' implicit behavior to their explicit ratings, we found that participants' self-report showed only limited correspondence with their observed motor behavior. We provide all of our measures in both raw and summary format, offering researchers a precision tool for constructing stimulus sets for experiments on embodied cognition.

The role of motor system in action-related language comprehension in L1 and L2: An fMRI study

The framework of embodied cognition has challenged the modular view of a language-cognition divide by suggesting that meaning-retrieval critically involves the sensory-motor system. Despite extensive research into the neural mechanisms underlying language-motor coupling, it remains unclear how the motor system might be differentially engaged by different levels of linguistic abstraction and language proficiency. To address this issue, we used fMRI to quantify neural activations in brain regions underlying motor and language processing in Chinese-English speakers' processing of literal, metaphorical, and abstract language in their L1 and L2. Results overall revealed a response in motor ROIs gradually attenuating in intensity from literal to abstract via metaphorical language in both L1 and L2. Furthermore, contrast analyses between L1 and L2 showed overall greater activations of motor ROIs in the L2. We conclude that motor involvement in language processing is graded rather than all-or-none and that the motor system has a dual-functional role.

Brain Inhibitory Mechanisms Are Involved in the Processing of Sentential Negation, Regardless of Its Content. Evidence From EEG Theta and Beta Rhythms

The two-step process account of negation understanding posits an initial representation of the negated events, followed by a representation of the actual state of events. On the other hand, behavioral and neurophysiological studies provided evidence that linguistic negation suppresses or reduces the activation of the negated events, contributing to shift attention to the actual state of events. However, the specific mechanism of this suppression is poorly known. Recently, based on the brain organization principle of neural reuse (Anderson, 2010), it has been proposed that understanding linguistic negation partially relies upon the neurophysiological mechanisms of response inhibition. Specifically, it was reported that negated action-related sentences modulate EEG signatures of response inhibition (de Vega et al., 2016; Beltrán et al., 2018). In the current EEG study, we ponder whether the reusing of response inhibition processes by negation is constrained to action-related contents or consists of a more general-purpose mechanism. To this end, we employed the same dual-task paradigm as in our prior study—a Go/NoGo task embedded into a sentence comprehension task—but this time including both action and non-action sentences. The results confirmed that the increase of theta power elicited by NoGo trials was modulated by negative sentences, compared to their affirmative counterparts, and this polarity effect was statistically similar for both action- and non-action-related sentences. Thus, a general-purpose inhibitory control mechanism, rather than one specific for action language, is likely operating in the comprehension of sentential negation to produce the transition between alternative representations.

Embodiment Effect on the Comprehension of Mandarin Manual Action Language: An ERP Study

Embodiment theories argue that language comprehension involves activating specific sensory-motor systems in the brain. Previous research performed in English and other Indo-European languages suggests that, when compared to compatible sentences referring to the same actions performed sequentially (e.g. 'After cleaning the wound he unrolled the bandage'), incompatible sentences describing two manual actions performed simultaneously by an agent (e.g. 'While cleaning the wound he unrolled the bandage') were worse understood and increased the event-related potentials (ERPs) component N400. The present ERP research aims to further investigate brain response to motor compatibility in native Mandarin speakers. The Chinese experimental sentences described two manual actions either in incongruent conditions marked by the Chinese parallel structure … … ('yibian…yibian…'/'while… while…') or congruent conditions marked by the sequential structure … … ('xian…ranhou…'/'firstly… then…'). The last action clause elicited larger fronto-central N400 in the incongruent condition, which reveals that there are semantic embodiment effects on the comprehension of Mandarin manual action language.

Motor resonance during linguistic processing as shown by EEG in a naturalistic VR environment

Embodied cognition studies have shown motor resonance during action language processing, indicating that linguistic representations are at least partially multimodal. However, constraints of this activation linked to linguistic and extra-linguistic context, function and timing have not yet been fully explored. Importantly, embodied cognition binds social and physical contexts to cognition, suggesting that more ecologically valid contexts will yield more valid measures of cognitive processing. Herein, we measured cortical motor activation during language processing in a fully immersive Cave automatic virtual environment (CAVE). EEG was recorded while participants engaged in a Go/No-Go task. They heard action verbs and, for Go trials, performed a corresponding action on a virtual object. ERSP (event-related spectral perturbation) was calculated during verb processing, corresponding to the pattern of power suppression (event-related desynchronization - ERD) and enhancement (event-related synchronization - ERS) relative to the reference interval. Significant ERD emerged during verb processing in both the µ (8-13 Hz) and beta band (20-30 Hz) for both Go and No-Go trials. µ ERD emerged in the 400-500 msec time window, associated with lexical-semantic processing. Greater µ ERD emerged for Go compared to No-Go trials. The present results provide compelling evidence in a naturalistic setting of how motor and linguistic processes interact.

How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.

The role of the motor system in action understanding and communication: Evidence from human infants and non-human primates

There is growing evidence that activation of the motor system during observation of actions, a phenomenon first observed in non-human primates, underlies action understanding and even communication. This review (a) examines the evidence on motor system activity as an underlying neural correlate of action understanding; (b) reviews the theoretical and empirical work linking action understanding and the development of communication, with a specific focus on the role that gestures play as an intermediary; and (c) discusses the research on and existing opportunities for understanding the link between the motor system and communication in both humans and non-human primates, through the lens of action perception. Bringing together findings and perspectives from developmental social cognition in both humans and non-human primates and applying recent neuroscientific perspectives will help to elucidate the processes underlying the ability to understand and communicate with others.

Sentential negation modulates inhibition in a stop-signal task. Evidence from behavioral and ERP data

Embodiment theories claim that language meaning involves sensory-motor simulation processes in the brain. A challenge for these theories, however, is to explain how abstract words, such as negations, are processed. In this article, we test the hypothesis that understanding sentential negation (e.g., You will not cut the bread) reuses the neural circuitry of response inhibition. Participants read manual action sentences with either affirmative or negative polarity, embedded in a Stop-Signal paradigm, while their EEG was recorded. The results showed that the inhibition-related N1 and P3 components were enhanced by successful inhibition. Most important, the early N1 amplitude was also modulated by sentence polarity, producing the largest values for successful inhibitions in the context of negative sentences, whereas no polarity effect was found for failing inhibition or go trials. The estimated neural sources for N1 effects revealed activations in the right inferior frontal gyrus, a typical inhibition-related area. Also, the estimated stop-signal reaction time was larger in trials with negative sentences. These results provide strong evidence that action-related negative sentences consume neural resources of response inhibition, resulting in less efficient processing in the Stop-Signal task.

Event-related desynchronization of mu and beta oscillations during the processing of novel tool names

According to the embodied cognition framework, the formation of conceptual representations integrates the type of experience during learning. In this electroencephalographic study, we applied a linguistic variant of a training paradigm, in which participants learned to associate novel names to novel tools while either manipulating or visually exploring them. The analysis focused on event-related desynchronization (ERD) of oscillations in the mu and beta frequency range, which reflects activation of sensorimotor brain areas. After three training sessions, processing names of manipulated tools elicited a stronger ERD of the beta (18-25 Hz, 140-260 ms) and the lower mu rhythm (8-10 Hz, 320-440 ms) than processing names of visually explored tools, reflecting a possible reactivation of experiential sensorimotor information. Given the unexpected result that familiarized pseudo-words elicited an ERD comparable to names of manipulated tools, our findings could reflect a suppression of sensorimotor activity during the processing of objects with exclusively visual features.

Semantic discrimination impacts tDCS modulation of verb processing

Motor cortex activation observed during body-related verb processing hints at simulation accompanying linguistic understanding. By exploiting the up- and down-regulation that anodal and cathodal transcranial direct current stimulation (tDCS) exert on motor cortical excitability, we aimed at further characterizing the functional contribution of the motor system to linguistic processing. In a double-blind sham-controlled within-subjects design, online stimulation was applied to the left hemispheric hand-related motor cortex of 20 healthy subjects. A dual, double-dissociation task required participants to semantically discriminate concrete (hand/foot) from abstract verb primes as well as to respond with the hand or with the foot to verb-unrelated geometric targets. Analyses were conducted with linear mixed models. Semantic priming was confirmed by faster and more accurate reactions when the response effector was congruent with the verb's body part. Cathodal stimulation induced faster responses for hand verb primes thus indicating a somatotopical distribution of cortical activation as induced by body-related verbs. Importantly, this effect depended on performance in semantic discrimination. The current results point to verb processing being selectively modifiable by neuromodulation and at the same time to a dependence of tDCS effects on enhanced simulation. We discuss putative mechanisms operating in this reciprocal dependence of neuromodulation and motor resonance.

Time-Frequency Analysis of Mu Rhythm Activity during Picture and Video Action Naming Tasks

This study used whole-head 64 channel electroencephalography to measure changes in sensorimotor activity—as indexed by the mu rhythm—in neurologically-healthy adults, during subvocal confrontation naming tasks. Independent component analyses revealed sensorimotor mu component clusters in the right and left hemispheres. Event related spectral perturbation analyses indicated significantly stronger patterns of mu rhythm activity (pFDR < 0.05) during the video condition as compared to the picture condition, specifically in the left hemisphere. Mu activity is hypothesized to reflect typical patterns of sensorimotor activation during action verb naming tasks. These results support further investigation into sensorimotor cortical activity during action verb naming in clinical populations.

EEG beta-power changes reflect motor involvement in abstract action language processing

Brain oscillations in the α- and β-range become suppressed during motor processing and motor imagery. It has recently been discussed that such power changes also occur during action language processing. In our study, we compared β₂-oscillations (16-25Hz) during the observation of prototypical arm movements (revealed via motion tracking) as well as during semantic processing of concrete and abstract sentences containing arm-related action verbs. Whereas we did find a strong desynchronization in the β₂-range during action observation, the processing of action sentences evoked a rather weak desynchronization. However, this desynchronization occurred for action verbs in both concrete and abstract contexts. These results might indicate a tendency for abstract action language to be processed similar to concrete action language rather than abstract sentences. The oscillation patterns reflect the close relationship between language comprehension and motor functions - one of the core claims of current theories on embodied cognition.

Understanding approach and avoidance in verbal descriptions of everyday actions: An ERP study

Understanding verbal descriptions of everyday actions could involve the neural representation of action direction (avoidance and approach) toward persons and things. We recorded the electrophysiological activity of participants while they were reading approach/avoidance action sentences that were directed toward a target: a thing/a person (i.e., "Petra accepted/rejected Ramón in her group"/ "Petra accepted/rejected the receipt of the bank"). We measured brain potentials time locked to the target word. In the case of things, we found a N400-like component with right frontal distribution modulated by approach/avoidance action. This component was more negative in avoidance than in approach sentences. In the case of persons, a later negative event-related potential (545-750 ms) with left frontal distribution was sensitive to verb direction, showing more negative amplitude for approach than avoidance actions. In addition, more negativity in approach-person sentences was associated with fear avoidance trait, whereas less negativity in avoidance-person sentences was associated with a greater approach trait. Our results support that verbal descriptions of approach/avoidance actions are encoded differently depending on whether the target is a thing or a person. Implications of these results for a social, emotional and motivational understanding of action language are discussed.

Dimensional approaches to schizophrenia: A comparison of the Bern Psychopathology scale and the five-factor model of the Positive and Negative Syndrome Scale

The aim was to examine to what extent the dimensions of the BPS map the five factors derived from the PANSS in order to explore the level of agreement of these alternative dimensional approaches in patients with schizophrenia. 149 inpatients with schizophrenia spectrum disorders were recruited. Psychopathological symptoms were assessed with the Bern Psychopathology Scale (BPS) and the Positive and Negative Syndrome Scale (PANSS). Linear regression analyses were conducted to explore the association between the factors and the items of the BPS. The robustness of patterns was evaluated. An understandable overlap of both approaches was found for positive and negative symptoms and excitement. The PANSS positive factor was associated with symptoms of the affect domain in terms of both inhibition and disinhibition, the PANSS negative factor with symptoms of all three domains of the BPS as an inhibition and the PANSS excitement factor with an inhibition of the affect domain and a disinhibition of the language and motor domains. The results show that here is only a partial overlap between the system-specific approach of the BPS and the five-factor PANSS model. A longitudinal assessment of psychopathological symptoms would therefore be of interest.

Enjoying vs. smiling: Facial muscular activation in response to emotional language

The present study examined whether emotionally congruent facial muscular activation - a somatic index of emotional language embodiment can be elicited by reading subject-verb sentences composed of action verbs, that refer directly to facial expressions (e.g., Mario smiles), but also by reading more abstract state verbs, which provide more direct access to the emotions felt by the agent (e.g., Mario enjoys). To address this issue, we measured facial electromyography (EMG) while participants evaluated state and action verb sentences. We found emotional sentences including both verb categories to have valence-congruent effects on emotional ratings and corresponding facial muscle activations. As expected, state verb-sentences were judged with higher valence ratings than action verb-sentences. Moreover, despite emotional congruent facial activations were similar for the two linguistic categories, in a late temporal window we found a tendency for greater EMG modulation when reading action relative to state verb sentences. These results support embodied theories of language comprehension and suggest that understanding emotional action and state verb sentences relies on partially dissociable motor and emotional processes.

The coordination dynamics of social neuromarkers

Social behavior is a complex integrative function that entails many aspects of the brain’s sensory, cognitive, emotional and movement capacities. Its neural processes are seldom simultaneous but occur according to precise spatiotemporal choreographies, manifested by the coordination of their oscillations within and between brains. Methods with good temporal resolution can help to identify so-called “neuromarkers” of social function and aid in disentangling the dynamical architecture of social brains. In our ongoing research, we have used dual-electroencephalography (EEG) to study neuromarker dynamics during synchronic interactions in which pairs of subjects coordinate behavior spontaneously and intentionally (social coordination) and during diachronic transactions that require subjects to perceive or behave in turn (action observation, delayed imitation). In this paper, after outlining our dynamical approach to the neurophysiological basis of social behavior, we examine commonalities and differences in the neuromarkers that are recruited for both kinds of tasks. We find the neuromarker landscape to be task-specific: synchronic paradigms of social coordination reveal medial mu, alpha and the phi complex as contributing neuromarkers. Diachronic tasks recruit alpha as well, in addition to lateral mu rhythms and the newly discovered nu and kappa rhythms whose functional significance is still unclear. Social coordination, observation, and delayed imitation share commonality of context: in each of our experiments, subjects exchanged information through visual perception and moved in similar ways. Nonetheless, there was little overlap between their neuromarkers, a result that hints strongly of task-specific neural mechanisms for social behavior. The only neuromarker that transcended both synchronic and diachronic social behaviors was the ubiquitous alpha rhythm, which appears to be a key signature of visually-mediated social behaviors. The present paper is both an entry point and a challenge: much work remains to determine the nature and scope of recruitment of other neuromarkers, and to create theoretical models of their within- and between-brain dynamics during social interaction.

Factor structure of the Bern Psychopathology Scale in a sample of patients with schizophrenia spectrum disorders

BACKGROUND

The Bern Psychopathology Scale (BPS) is based on a system-specific approach to classifying the psychopathological symptom pattern of schizophrenia. It consists of subscales for three domains (language, affect and motor behaviour) that are hypothesized to be related to specific brain circuits. The aim of the study was to examine the factor structure of the BPS in patients with schizophrenia spectrum disorders.

METHODS

One hundred and forty-nine inpatients with schizophrenia spectrum disorders were recruited at the Department of Psychiatry II, Ulm University, Germany (n=100) and at the University Hospital of Psychiatry, Bern, Switzerland (n=49). Psychopathology was assessed with the BPS. The VARCLUS procedure of SAS(®) (a type of oblique component analysis) was used for statistical analysis.

RESULTS

Six clusters were identified (inhibited language, inhibited motor behaviour, inhibited affect, disinhibited affect, disinhibited language/motor behaviour, inhibited language/motor behaviour) which explained 40.13% of the total variance of the data. A binary division of attributes into an inhibited and disinhibited cluster was appropriate, although an overlap was found between the language and motor behaviour domains. There was a clear distinction between qualitative and quantitative symptoms.

CONCLUSIONS

The results argue for the validity of the BPS in identifying subsyndromes of schizophrenia spectrum disorders according to a dimensional approach. Future research should address the longitudinal assessment of dimensional psychopathological symptoms and elucidate the underlying neurobiological processes.