EEG beta-power changes reflect motor involvement in abstract action language processing

The Embodied Effect in the Comprehension of Chinese Action-Verb Metaphors

Embodied cognition holds that one's body, actions, perceptions, and situations are integrated into the cognitive process and emphasizes the fact that sensorimotor systems play a role in language comprehension. Previous studies verified the embodied effect in literal language processing but few of them paid attention to metaphors in embodied cognition. The present study aims to explore the embodied effect in the comprehension of Chinese action-verb metaphor. Participants watched a video containing icons and corresponding actions to learn the relationship between them and how to perform these actions in the learning phase and in the test phase, a series of action-describing metaphor phrases were presented to participants with either the icons as primes or no prime at all. The results confirmed the embodied effect as the reaction times (RTs) were significantly shorter when action prime matched the action-verb in the following action-verb metaphor than that of no-prime condition, which are consistent with the facilitation observed in previous relevant studies in embodied cognition. In conclusion, this study verified the embodied effect in the comprehension of Chinese action-verb metaphor, offering further support to embodied cognition and providing a new interpretation for the metaphoric meaning construction of Chinese action-verbs.

Negation mitigates rather than inverts the neural representations of adjectives

Combinatoric linguistic operations underpin human language processes, but how meaning is composed and refined in the mind of the reader is not well understood. We address this puzzle by exploiting the ubiquitous function of negation. We track the online effects of negation ("not") and intensifiers ("really") on the representation of scalar adjectives (e.g., "good") in parametrically designed behavioral and neurophysiological (MEG) experiments. The behavioral data show that participants first interpret negated adjectives as affirmative and later modify their interpretation towards, but never exactly as, the opposite meaning. Decoding analyses of neural activity further reveal significant above chance decoding accuracy for negated adjectives within 600 ms from adjective onset, suggesting that negation does not invert the representation of adjectives (i.e., "not bad" represented as "good"); furthermore, decoding accuracy for negated adjectives is found to be significantly lower than that for affirmative adjectives. Overall, these results suggest that negation mitigates rather than inverts the neural representations of adjectives. This putative suppression mechanism of negation is supported by increased synchronization of beta-band neural activity in sensorimotor areas. The analysis of negation provides a steppingstone to understand how the human brain represents changes of meaning over time.

The concrete processing of Chinese action metaphors: an ERP study

The present research adopts ERP (Event-Related Potentials) technology to investigate whether there exists a concreteness effect in the processing of Chinese action verbs within metaphorical context. The mean amplitudes of N400 activated by action metaphors were compared with those activated by literal verbs and abstract verbs. The findings indicated that the Met verbs evoked a significantly larger N400 response at frontal brain region compared to the Abs verbs at a time window 200-500 ms, while the Met verbs elicited a notably greater N400 amplitude specifically at the posterior brain region in comparison to the Lit verbs at 300-500 ms time window. These results may be interpreted as indicating that the comprehension of the Met verbs is based on the concrete action semantics.

The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization

The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.

Spatiotemporal Dynamics of Activation in Motor and Language Areas Suggest a Compensatory Role of the Motor Cortex in Second Language Processing

The involvement of the motor cortex in language understanding has been intensively discussed in the framework of embodied cognition. Although some studies have provided evidence for the involvement of the motor cortex in different receptive language tasks, the role that it plays in language perception and understanding is still unclear. In the present study, we explored the degree of involvement of language and motor areas in a visually presented sentence comprehension task, modulated by language proficiency (L1: native language, L2: second language) and linguistic abstractness (literal, metaphorical, and abstract). Magnetoencephalography data were recorded from 26 late Chinese learners of English. A cluster-based permutation F test was performed on the amplitude of the source waveform for each motor and language region of interest (ROI). Results showed a significant effect of language proficiency in both language and motor ROIs, manifested as overall greater involvement of language ROIs (short insular gyri and planum polare of the superior temporal gyrus) in the L1 than the L2 during 300-500 ms, and overall greater involvement of motor ROI (central sulcus) in the L2 than the L1 during 600-800 ms. We interpreted the over-recruitment of the motor area in the L2 as a higher demand for cognitive resources to compensate for the inadequate engagement of the language network. In general, our results indicate a compensatory role of the motor cortex in L2 understanding.

Embodying Language through Gestures: Residuals of Motor Memories Modulate Motor Cortex Excitability during Abstract Words Comprehension

There is a debate about whether abstract semantics could be represented in a motor domain as concrete language. A contextual association with a motor schema (action or gesture) seems crucial to highlighting the motor system involvement. The present study with transcranial magnetic stimulation aimed to assess motor cortex excitability changes during abstract word comprehension after conditioning word reading to a gesture execution with congruent or incongruent meaning. Twelve healthy volunteers were engaged in a lexical-decision task responding to abstract words or meaningless verbal stimuli. Motor cortex (M1) excitability was measured at different after-stimulus intervals (100, 250, or 500 ms) before and after an associative-learning training where the execution of the gesture followed word processing. Results showed a significant post-training decrease in hand motor evoked potentials at an early processing stage (100 ms) in correspondence to words congruent with the gestures presented during the training. We hypothesized that traces of individual semantic memory, combined with training effects, induced M1 inhibition due to the redundancy of evoked motor representation. No modulation of cortical excitability was found for meaningless or incongruent words. We discuss data considering the possible implications in research to understand the neural basis of language development and language rehabilitation protocols.

Effect of the Menstrual Cycle on Electroencephalogram Alpha and Beta Bands During Motor Imagery and Action Observation

Female sex steroids (FSS) can affect the motor system, modulating motor cortex excitability as well as performance in dexterity and coordination tasks. However, it has not yet been explored whether FSS affects the cognitive components of motor behavior. Mu is a sensorimotor rhythm observed by electroencephalography (EEG) in alpha (8–12 Hz) and beta (15–30 Hz) frequency bands in practices such as motor imagery (MI) and action observation (AO). This rhythm represents a window for studying the activity of neural circuits involved in motor cognition. Herein we investigated whether the alpha-mu and beta-mu power in the sensorimotor region (C3 and C4, hypothesis-driven approach) and the alpha and beta power over frontal, parietal, and occipital regions (data-driven approach) are modulated differently in the menstrual, follicular, and luteal phases of menstrual cycles in right-handed dominant women. To do so, these women underwent MI and AO in the three menstrual cycle phases. The spectral activity of the cortical regions for the alpha and beta bands were compared between phases of the menstrual cycle and a correlation analysis was also performed in relation to estrogen and progesterone levels. For the hypothesis-based approach, beta-mu event-related desynchronization (ERD) was significantly stronger in the C3 channel in the follicular phase than in the menstrual and luteal phases. For the data-driven approach, beta ERD during MI was higher in the follicular phase than in the menstrual and luteal phases in the frontal region. These findings suggest the effect of FSS on executive movement control. No effect of menstrual cycle phases was observed in cortical areas investigated during OA, but alpha and beta bands correlated positively with the follicular phase plasma estradiol level. Thus, the attenuation of alpha and beta bands referring to mirror neuron activities appears to be associated with inhibition of cortical activity when estradiol levels are lower, improving cognitive processing of motor action.

Text Materialities, Affordances, and the Embodied Turn in the Study of Reading

Digital texts have for decades been a challenge for reading research, creating a range of questions about reading and a need for new theories and concepts. In this paper, we focus on materialities of texts and suggest an embodied, enacted, and extended approach to the research on digital reading. We refer to findings showing that cognitive activities in reading are grounded in bodily and social experiences, and we explore the cognitive role of the body in reading, claiming that–influenced by tacit knowledge and the task at hand–textual meaning is enacted through a mental and physical engagement with text. Further, applying the concept of affordances, we examine how digital technologies have induced new ways of physically handling and mentally interpreting text, indicating that brain, body, text, and technologies are integrated parts of an extended process of reading. The aim of the paper is to encourage empirical research on the interplay between body (including brain), text, and text materialities, a focus we argue will deepen our understand of the current transformation of reading.

Abstract Action Language Processing in Eleven-Year-Old Children: Influence of Upper Limb Movement on Sentence Comprehension

Regarding the embodiment of language processing in adults, there is evidence of a close connection between sensorimotor brain areas and brain areas relevant to the processing of action verbs. This thesis is hotly debated and has therefore been thoroughly studied in adults. However, there are still questions concerning its development in children. The present study deals with the processing of action verbs in concrete and abstract sentences in 60 eleven-year-olds using a decision time paradigm. Sixty-five children mirrored arm movements or sat still and rated the semantic plausibility of sentences. The data of the current study suggest that eleven-year-olds are likely to misunderstand the meaning of action verbs in abstract contexts. Their decision times were faster and their error rates for action verbs in concrete sentences were lower. However, the gender of the children had a significant influence on the decision time and the number of errors, especially when processing abstract sentences. Females were more likely to benefit from an arm movement before the decision, while males were better if they sat still beforehand. Overall, children made quite a few errors when assessing the plausibility of sentences, but the female participants more often gave plausibility assessments that deviated from our expectations, especially when processing abstract sentences. It can be assumed that the embodiment of language processing plays some role in 11-year-old children, but is not yet as mature as it is in adults. Especially with regard to the processing of abstract language, the embodied system still has to change and mature in the course of child development.

Parametric Cortical Representations of Complexity and Preference for Artistic and Computer-Generated Fractal Patterns Revealed by Single-Trial EEG Power Spectral Analysis

Fractals are self-similar patterns that repeat at different scales, the complexity of which are expressed as a fractional Euclidean dimension D between 0 (a point) and 2 (a filled plane). The drip paintings of American painter Jackson Pollock (JP) are fractal in nature, and Pollock's most illustrious works are of the high-D (~1.7) category. This would imply that people prefer more complex fractal patterns, but some research has instead suggested people prefer lower-D fractals. Furthermore, research has suggested that parietal and frontal brain activity tracks the complexity of fractal patterns, but previous research has artificially binned fractals depending on fractal dimension, rather than treating fractal dimension as a parametrically varying value. We used white layers extracted from JP artwork as stimuli, and constructed statistically matched 2-dimensional random Cantor sets as control stimuli. We recorded the electroencephalogram (EEG) while participants viewed the JP and matched random Cantor fractal patterns. Participants then rated their subjective preference for each pattern. We used a single-trial analysis to construct within-subject models relating subjective preference to fractal dimension D, as well as relating D and subjective preference to single-trial EEG power spectra. Results indicated that participants preferred higher-D images for both JP and Cantor stimuli. Power spectral analysis showed that, for artistic fractal images, parietal alpha and beta power parametrically tracked complexity of fractal patterns, while for matched mathematical fractals, parietal power tracked complexity of patterns over a range of frequencies, but most prominently in alpha band. Furthermore, parietal alpha power parametrically tracked aesthetic preference for both artistic and matched Cantor patterns. Overall, our results suggest that perception of complexity for artistic and computer-generated fractal images is reflected in parietal-occipital alpha and beta activity, and neural substrates of preference for complex stimuli are reflected in parietal alpha band activity.

The role of motor system in action-related language comprehension in L1 and L2: An fMRI study

The framework of embodied cognition has challenged the modular view of a language-cognition divide by suggesting that meaning-retrieval critically involves the sensory-motor system. Despite extensive research into the neural mechanisms underlying language-motor coupling, it remains unclear how the motor system might be differentially engaged by different levels of linguistic abstraction and language proficiency. To address this issue, we used fMRI to quantify neural activations in brain regions underlying motor and language processing in Chinese-English speakers' processing of literal, metaphorical, and abstract language in their L1 and L2. Results overall revealed a response in motor ROIs gradually attenuating in intensity from literal to abstract via metaphorical language in both L1 and L2. Furthermore, contrast analyses between L1 and L2 showed overall greater activations of motor ROIs in the L2. We conclude that motor involvement in language processing is graded rather than all-or-none and that the motor system has a dual-functional role.

Action verb processing specifically modulates motor behaviour and sensorimotor neuronal oscillations

Understanding action-related language recruits the brain’s motor system and can interact with motor behaviour. The current study shows MEG oscillatory patterns during verb-motor priming. Hand and foot verbs were followed by hand or foot responses, with faster reaction times for congruent conditions. In ROIs placed in the hand/arm and foot/leg portions of the sensorimotor cortex, this behavioural priming effect was accompanied by modulations in MEG oscillatory patterns preceding the responses. Power suppression in the alpha/beta frequency bands was reduced in congruent conditions in the body-part-specific ROIs. These results imply that the verb-motor priming effect may be a direct consequence of motor cortex contributions to action word processing.

Motivational intensity and visual word search: Layout matters

Motivational intensity has been previously linked to information processing. In particular, it has been argued that affects which are high in motivational intensity tend to narrow cognitive scope. A similar effect has been attributed to negative affect, which has been linked to narrowing of cognitive scope. In this paper, we investigated how these phenomena manifest themselves during visual word search. We conducted three studies in which participants were instructed to perform word category identification. We manipulated motivational intensity by controlling reward expectations and affect via reward outcomes. Importantly, we altered visual search paradigms, assessing the effects of affective manipulations as modulated by information arrangement. We recorded multiple physiological signals (EEG, EDA, ECG and eye tracking) to assess whether motivational states can be predicted by physiology. Across the three studies, we found that high motivational intensity narrowed visual attentional scope by altering visual search strategies, especially when information was displayed sparsely. Instead, when information was vertically listed, approach-directed motivational intensity appeared to improve memory encoding. We also observed that physiology, in particular eye tracking, may be used to detect biases induced by motivational intensity, especially when information is sparsely organised.

Effortful verb retrieval from semantic memory drives beta suppression in mesial frontal regions involved in action initiation

The contribution of the motor cortex to the semantic retrieval of verbs remains a subject of debate in neuroscience. Here, we examined whether additional engagement of the cortical motor system was required when access to verbs semantics was hindered during a verb generation task. We asked participants to produce verbs related to presented noun cues that were either strongly associated with a single verb to prompt fast and effortless verb retrieval, or were weakly associated with multiple verbs and more difficult to respond to. Using power suppression of magnetoencephalography beta oscillations (15-30 Hz) as an index of cortical activation, we performed a whole-brain analysis in order to identify the cortical regions sensitive to the difficulty of verb semantic retrieval. Highly reliable suppression of beta oscillations occurred 250 ms after the noun cue presentation and was sustained until the onset of verbal response. This was localized to multiple cortical regions, mainly in the temporal and frontal lobes of the left hemisphere. Crucially, the only cortical regions where beta suppression was sensitive to the task difficulty, were the higher order motor areas on the medial and lateral surfaces of the frontal lobe. Stronger activation of the premotor cortex and supplementary motor area accompanied the effortful verb retrieval and preceded the preparation of verbal responses for more than 500 ms, thus, overlapping with the time window of verb retrieval from semantic memory. Our results suggest that reactivation of verb-related motor plans in higher order motor circuitry promotes the semantic retrieval of target verbs.

Mnemonic effects of action simulation from pictures and phrases

Several theoretical approaches suggest that language comprehension and action observation rely on similar mental simulations. Granted that these two simulations partially overlap, we assumed that simulations stemming from action observations are more direct than those stemming from action phrases. The implied prediction was that simulation from action observation should prevail on simulation from action phrases when their effects are contrasted. The results of three experiments confirmed that, when at encoding the phrases were paired with pictures of actions whose kinematics was incongruent with the implied kinematics of the actions described in the phrases, memory for action phrases was impaired (Experiment 1). However, the reverse was not true: when the pictures were paired with phrases representing actions whose kinematics were incongruent with the kinematics of the actions portrayed in the pictures, memory for pictures portraying actions was not impaired (Experiment 2). Also, in line with evidence that simulations from action phrases and those from action observation partially overlap, when their effects were not contrasted their products were misrecognized. In our experiments, when action phrases only presented at recognition described actions depicted in pictures seen at encoding, they were misrecognized as had already been read at encoding (Experiment 1); further, when pictures only presented at recognition portrayed actions described in phrases presented at encoding, they were misrecognized as seen at encoding (Experiment 2). A third experiment excluded the possibility that the pattern of findings was simply a consequence of better memory for pictures of actions as opposed to memory for action phrases (Experiment 3). The implications of our results in relation to the literature on simulation in language comprehension and action observation are discussed.

Role of Sensorimotor Cortex in Gestural-Verbal Integration

Action comprehension that is related to language or gestural integration has been shown to engage the motor system in the brain, thus providing preliminary evidence for the gestural-verbal embodiment concept. Based on the involvement of the sensorimotor cortex (M1) in language processing, we aimed to further explore its role in the cognitive embodiment necessary for gestural-verbal integration. As such, we applied anodal (excitatory) and sham transcranial direct current stimulation (tDCS) over the left M1 (with reference electrode over the contralateral supraorbital region) during a gestural-verbal integration task where subjects had to make a decision about the semantic congruency of the gesture (prime) and the word (target). We used a cross-over within-subject design in young subjects. Attentional load and simple reaction time (RT) tasks served as control conditions, applied during stimulation (order of three tasks was counterbalanced). Our results showed that anodal (atDCS) compared to sham tDCS (stDCS) reduced RTs in the gestural-verbal integration task, specifically for incongruent pairs of gestures and verbal expressions, with no effect on control task performance. Our findings provide evidence for the involvement of the sensorimotor system in gestural-verbal integration performance. Further, our results suggest that functional modulation induced by sensorimotor tDCS may be specific to gestural-verbal integration. Future studies should now evaluate the modulatory effect of tDCS on semantic congruency by using tDCS over additional brain regions and include assessments of neural connectivity.

Sensorimotor characteristics of sign translations modulate EEG when deaf signers read English

Bilingual individuals automatically translate written words from one language to another. While this process is established in spoken-language bilinguals, there is less known about its occurrence in deaf bilinguals who know signed and spoken languages. Since sign language uses motion and space to convey linguistic content, it is possible that action simulation in the brain's sensorimotor system plays a role in this process. We recorded EEG from deaf participants fluent in ASL as they read individual English words and found significant differences in alpha and beta EEG at central electrode sites during the reading of English words whose ASL translations use two hands, compared to English words whose ASL translations use one hand. Hearing non-signers did not show any differences between conditions. These results demonstrate the involvement of the sensorimotor system in cross-linguistic, cross-modal translation, and suggest that covert action simulation processes are involved when deaf signers read.

Alpha and Beta Oscillations Index Semantic Congruency between Speech and Gestures in Clear and Degraded Speech

Previous work revealed that visual semantic information conveyed by gestures can enhance degraded speech comprehension, but the mechanisms underlying these integration processes under adverse listening conditions remain poorly understood. We used MEG to investigate how oscillatory dynamics support speech–gesture integration when integration load is manipulated by auditory (e.g., speech degradation) and visual semantic (e.g., gesture congruency) factors. Participants were presented with videos of an actress uttering an action verb in clear or degraded speech, accompanied by a matching (mixing gesture + “mixing”) or mismatching (drinking gesture + “walking”) gesture. In clear speech, alpha/beta power was more suppressed in the left inferior frontal gyrus and motor and visual cortices when integration load increased in response to mismatching versus matching gestures. In degraded speech, beta power was less suppressed over posterior STS and medial temporal lobe for mismatching compared with matching gestures, showing that integration load was lowest when speech was degraded and mismatching gestures could not be integrated and disambiguate the degraded signal. Our results thus provide novel insights on how low-frequency oscillatory modulations in different parts of the cortex support the semantic audiovisual integration of gestures in clear and degraded speech: When speech is clear, the left inferior frontal gyrus and motor and visual cortices engage because higher-level semantic information increases semantic integration load. When speech is degraded, posterior STS/middle temporal gyrus and medial temporal lobe are less engaged because integration load is lowest when visual semantic information does not aid lexical retrieval and speech and gestures cannot be integrated.

Implication of N400 and P600 waves in the Linguistic Code Change in Monolinguals and Bilinguals

There is evidence of the importance of N400 and P600 waves in linguistic processes, theses brain waves are related to syntax. This work proposes to evaluate learning process through the analysis of responses generated when formulation of word is requested, an artificial grammar test (AGT) is developed and N400 and P600 peaks are taken as indicators of performance; and two different groups of subjects took the AGT, 5 monolinguals and 5 bilinguals.The AGT is composed by 30 hybrids, each hybrid defines rules to formulate words; then if this word accomplished the rules, it is considered as grammatical. The N400 and P600 waves are computed by each word letter, and the mean for all 30 hybrids is compared between both two groups by electrode.Greater amplitudes for N400 and P600 peaks was found for monolinguals in comparison with bilinguals.

Event-related desynchronization of mu and beta oscillations during the processing of novel tool names

According to the embodied cognition framework, the formation of conceptual representations integrates the type of experience during learning. In this electroencephalographic study, we applied a linguistic variant of a training paradigm, in which participants learned to associate novel names to novel tools while either manipulating or visually exploring them. The analysis focused on event-related desynchronization (ERD) of oscillations in the mu and beta frequency range, which reflects activation of sensorimotor brain areas. After three training sessions, processing names of manipulated tools elicited a stronger ERD of the beta (18-25 Hz, 140-260 ms) and the lower mu rhythm (8-10 Hz, 320-440 ms) than processing names of visually explored tools, reflecting a possible reactivation of experiential sensorimotor information. Given the unexpected result that familiarized pseudo-words elicited an ERD comparable to names of manipulated tools, our findings could reflect a suppression of sensorimotor activity during the processing of objects with exclusively visual features.