Grasping hand verbs: oscillatory beta and alpha correlates of action-word processing

The Neural Correlates of Embodied L2 Learning: Does Embodied L2 Verb Learning Affect Representation and Retention?

We investigated how naturalistic actions in a highly immersive, multimodal, interactive 3D virtual reality (VR) environment may enhance word encoding by recording EEG in a pre/post-test learning paradigm. While behavior data have shown that coupling word encoding with gestures congruent with word meaning enhances learning, the neural underpinnings of this effect have yet to be elucidated. We coupled EEG recording with VR to examine whether embodied learning improves learning and creates linguistic representations that produce greater motor resonance. Participants learned action verbs in an L2 in two different conditions: specific action (observing and performing congruent actions on virtual objects) and pointing (observing actions and pointing to virtual objects). Pre- and post-training participants performed a match-mismatch task as we measured EEG (variation in the N400 response as a function of match between observed actions and auditory verbs) and a passive listening task while we measured motor activation (mu [8-13 Hz] and beta band [13-30 Hz] desynchronization during auditory verb processing) during verb processing. Contrary to our expectations, post-training results revealed neither semantic nor motor effects in either group when considered independently of learning success. Behavioral results showed a great deal of variability in learning success. When considering performance, low performance learners showed no semantic effect and high performance learners exhibited an N400 effect for mismatch versus match trials post-training, independent of the type of learning. Taken as a whole, our results suggest that embodied processes can play an important role in L2 learning.

Fast & scrupulous: Gesture-based alarms improve accuracy and reaction times under various mental workload levels. An ERSP study

In high-risk environments, fast and accurate responses to warning systems are essential to efficiently handle emergency situations. The aim of the present study was twofold: 1) investigating whether hand action videos (i.e., gesture alarms) trigger faster and more accurate responses than text alarm messages (i.e., written alarms), especially when mental workload (MWL) is high; and 2) investigating the brain activity in response to both types of alarms as a function of MWL. Regardless of MWL, participants (N = 28) were found to be both faster and more accurate when responding to gesture alarms than to written alarms. Brain electrophysiological results suggest that this greater efficiency might be due to a facilitation of the action execution, reflected by the decrease in mu and beta power observed around the response time window observed at C3 and C4 electrodes. These results suggest that gesture alarms may improve operators' performances in emergency situations.

Meaning in hand: Investigating shared mechanisms of motor imagery and sensorimotor simulation in language processing

There is substantial evidence to support grounded theories of semantic representation, however the mechanisms of simulation in most theories are underspecified. In the present study, we used an individual differences approach to test whether motor imagery may share some mechanisms with sensorimotor simulations engaged during semantic processing. We quantified individual differences in motor imagery ability via implicit imagery tasks and explicit imagery questionnaires and tested their relationship to sensorimotor effects in syntactic classification tasks. In Experiment 1 (N = 185) we tested relationships between motor imagery and semantic processing of body-object interaction meaning (BOI; the degree to which you can interact with a word's referent) and foot/leg action meaning. We observed two interactions between imagery ability measured on the Florida Praxis Imagery Questionnaire (FPIQ) and BOI effects in semantic processing (response time and accuracy). In both interactions poorer imagery ability was associated with null BOI effects, whereas better imagery was associated with BOI effects. We also observed faster and more accurate responses to verbs associated with more foot/leg action meaning than verbs with less foot/leg action meaning, but this foot/leg action effect did not significantly interact with individual differences in motor imagery. In Experiment 2 (N = 195) we tested whether the interactions observed in Experiment 1 were dependent on the object-directed nature of the actions, or whether similar effects would be observed for hand actions not associated with objects. We also expanded our investigation beyond hand and foot imagery to consider whole body imagery. We observed an interaction between performance on a hand laterality judgement task (HLJT; assessing hand motor imagery) and sensorimotor effects in semantic processing of verbs associated with hand/arm action meaning. Participants with the fastest responses on the most difficult trials of the HLJT showed no significant difference in their response times to words with high and low hand/arm action meaning. We also observed faster and more accurate responses to high relative to low embodiment verbs, but this sensorimotor effect did not interact with individual differences in motor imagery. The results suggest specific (and not general) associations, in that some, but not all forms of hand and object-directed motor imagery are related to sensorimotor effects in language processing of hand/arm action verbs and nouns describing objects that are easy to interact with. As such, hand and object-directed motor imagery may share mechanisms with sensorimotor simulation during semantic processing.

Learning of new associations invokes a major change in modulations of cortical beta oscillations in human adults

Large-scale cortical beta (β) oscillations were implicated in the learning processes, but their exact role is debated. We used MEG to explore the dynamics of movement-related β-oscillations while 22 adults learned, through trial and error, novel associations between four auditory pseudowords and movements of four limbs. As learning proceeded, spatial-temporal characteristics of β-oscillations accompanying cue-triggered movements underwent a major transition. Early in learning, widespread suppression of β-power occurred long before movement initiation and sustained throughout the whole behavioral trial. When learning advanced and performance reached asymptote, β-suppression after the initiation of correct motor response was replaced by a rise in β-power mainly in the prefrontal and medial temporal regions of the left hemisphere. This post-decision β-power predicted trial-by-trial response times (RT) at both stages of learning (before and after the rules become familiar), but with different signs of interaction. When a subject just started to acquire associative rules and gradually improved task performance, a decrease in RT correlated with the increase in the post-decision β-band power. When the participants implemented the already acquired rules, faster (more confident) responses were associated with the weaker post-decision β-band synchronization. Our findings suggest that maximal beta activity is pertinent to a distinct stage of learning and may serve to strengthen the newly learned association in a distributed memory network.

Congruent action context releases Mu rhythm desynchronization when visual objects activate competing action representations

Recent findings demonstrated that object perception is affected by the competition between action representations. Simultaneous activation of distinct structural ("grasp-to-move") and functional ("grasp-to-use") action representations slows down perceptual judgements on objects. At the brain level, competition reduces motor resonance effects during manipulable object perception, reflected by an extinction of μ rhythm desynchronization. However, how this competition is solved in the absence of object-directed action remains unclear. The present study investigates the role of context in the resolution of the competition between conflicting action representations during mere object perception. To this aim, thirty-eight volunteers were instructed to perform a reachability judgment task on 3D objects presented at different distances in a virtual environment. Objects were conflictual objects associated with distinct structural and functional action representations. Verbs were used to provide a neutral or congruent action context prior or after object presentation. Neurophysiological correlates of the competition between action representation were recorded using EEG. The main result showed a release of μ rhythm desynchronization when reachable conflictual objects were presented with a congruent action context. Context influenced μ rhythm desynchronization when the action context was provided prior or after object presentation in a time-window compatible with object-context integration (around 1000 ms after the presentation of the first stimulus). These findings revealed that action context biases competition between co-activated action representations during mere object perception and demonstrated that μ rhythm desynchronization may be an index of activation but also competition between action representations in perception.

Induced and Evoked Brain Activation Related to the Processing of Onomatopoetic Verbs

Grounded cognition theory postulates that cognitive processes related to motor or sensory content are processed by brain networks involved in motor execution and perception, respectively. Processing words with auditory features was shown to activate the auditory cortex. Our study aimed at determining whether onomatopoetic verbs (e.g., “tröpfeln”—to dripple), whose articulation reproduces the sound of respective actions, engage the auditory cortex more than non-onomatopoetic verbs. Alpha and beta brain frequencies as well as evoked-related fields (ERFs) were targeted as potential neurophysiological correlates of this linguistic auditory quality. Twenty participants were measured with magnetoencephalography (MEG) while semantically processing visually presented onomatopoetic and non-onomatopoetic German verbs. While a descriptively stronger left temporal alpha desynchronization for onomatopoetic verbs did not reach statistical significance, a larger ERF for onomatopoetic verbs emerged at about 240 ms in the centro-parietal area. Findings suggest increased cortical activation related to onomatopoeias in linguistically relevant areas.

Cognitive Control Promotes Either Honesty or Dishonesty, Depending on One's Moral Default

Cognitive control is crucially involved in making (dis)honest decisions. However, the precise nature of this role has been hotly debated. Is honesty an intuitive response, or is will power needed to override an intuitive inclination to cheat? A reconciliation of these conflicting views proposes that cognitive control enables dishonest participants to be honest, whereas it allows those who are generally honest to cheat. Thus, cognitive control does not promote (dis)honesty per se; it depends on one's moral default. In the present study, we tested this proposal using electroencephalograms in humans (males and females) in combination with an independent localizer (Stroop task) to mitigate the problem of reverse inference. Our analysis revealed that the neural signature evoked by cognitive control demands in the Stroop task can be used to estimate (dis)honest choices in an independent cheating task, providing converging evidence that cognitive control can indeed help honest participants to cheat, whereas it facilitates honesty for cheaters.SIGNIFICANCE STATEMENT Dishonesty causes enormous economic losses. To target dishonesty with interventions, a rigorous understanding of the underlying cognitive mechanisms is required. A recent study found that cognitive control enables honest participants to cheat, whereas it helps cheaters to be honest. However, it is evident that a single study does not suffice as support for a novel hypothesis. Therefore, we tested the replicability of this finding using a different modality (EEG instead of fMRI) together with an independent localizer task to avoid reverse inference. We find that the same neural signature evoked by cognitive control demands in the localizer task can be used to estimate (dis)honesty in an independent cheating task, establishing converging evidence that the effect of cognitive control indeed depends on a person's moral default.

Neurophysiological mechanisms of perspective-taking: An MEG investigation of agency

According to the embodied cognition framework, sensory and motor areas are recruited during language understanding through simulation processes. Behavioral and imaging findings point to a dependence of the latter on perspective-taking (e.g., first person "I" versus third person "s/he"). The current study aims at identifying possible neurophysiological correlates of perspective in a linguistic context. Twenty healthy participants were measured with magnetoencephalography (MEG) while semantically processing visually presented inflected German verbs in the first- and third-person perspective, simple present tense. Results show that the first-person perspective induces stronger beta (15-25 Hz) desynchronization in the right-hemispheric posterior superior temporal sulcus, ventral posterior cingulate gyrus, and V5/MT+ area; no modulation of sensorimotor cortex emerged. Moreover, a stronger event-related field (ERF) was observed for the first-person perspective at about 150 ms after pronoun-verb onset, originating in occipital and moving to central and left temporal cortical sites. No effect of perspective on sensory gating was found when targeting the N1 component related to tones following the linguistic stimuli. Results indicate an effect of linguistic perspective-taking on brain activation patterns. The contribution of the single brain areas and their role in self-other distinction is further discussed.

Crossing hands behind your back reduces recall of manual action sentences and alters brain dynamics

The embodied meaning approach posits that understanding action-related language recruits motor processes in the brain. However, the functional impact of these motor processes on cognition has been questioned. The present study aims to provide new electrophysiological (EEG) evidence concerning the role of motor processes in the comprehension and memory of action language. Participants read lists of sentences including manual-action or attentional verbs, while keeping their hands either in front of them or crossing them behind their back. Results showed that posture impacted selectively the processing of manual action sentence, and not of attentional sentences, in three different ways: 1) EEG fronto-central beta rhythms, a signature of motor processes, were desynchronized while reading action sentences in the hands-in-front posture compared to the hands-behind posture. The estimated source was the posterior cingulate cortex, involved in proprioceptive regulation. 2) Recall of nouns associated with manual sentences decreased when learning occurred in the hands-behind posture. 3) ERPs analysis revealed that the initial posture at learning modulates neural processes during subsequent recall of manual sentences in the left superior frontal gyrus, which is related to motor processes. These results provide decisive evidence for the functional involvement of embodied simulations in the encoding and retrieval of action-related language.

Hand-use norms for Dutch and English manual action verbs: Implicit measures from a pantomime task

Many studies use manual action verbs to test whether people use neural systems for controlling manual actions to understand language about those actions. Yet, few of these studies empirically establish how people use their hands to perform the actions described by those verbs, relying instead on explicit self-report measures. Here, participants pantomimed the manual actions described by a large set of Dutch (N = 251) and English (N = 250) verbs, allowing us to approximate the extent to which people use each of their hands to perform these actions. After the pantomime task, participants also provided explicit ratings of each of these actions. The results from the pantomime task showed that most manual actions cannot be described accurately as either "unimanual" or "bimanual." With a few exceptions, unimanual action verbs do not describe actions that are performed with only one hand, and bimanual verbs do not describe actions that are performed by using both hands equally. Instead, individual actions vary continuously in the extent to which people use their non-dominant hand to perform them, and in the extent to which people consistently prefer one hand or the other to perform them. Finally, by comparing participants' implicit behavior to their explicit ratings, we found that participants' self-report showed only limited correspondence with their observed motor behavior. We provide all of our measures in both raw and summary format, offering researchers a precision tool for constructing stimulus sets for experiments on embodied cognition.

Auditory cortex sensitivity to the loudness attribute of verbs

The auditory cortex was shown to be activated during the processing of words describing actions with acoustic features. The present study further examines whether processing visually presented action words characterized by different levels of loudness, i.e. "loud" (to shout) and "quiet" actions (to whisper), differentially engage the auditory cortex. Twenty healthy participants were measured with magnetoencephalography (MEG) while reading inflected verbs followed by a short tone and semantic tasks. Based on the results of a localizer task, loudness sensitive temporal Brodmann areas A22, A41/42, and pSTS were inspected in the word paradigm. "Loud" actions induced significantly stronger beta power suppression compared to "quiet" actions in the left hemisphere. Smaller N100m amplitude related to tones following "loud" compared to "quiet" actions confirmed that auditory cortex sensitivity was modulated by action words. Results point to possible selective auditory simulation mechanisms involved in verb processing and support embodiment theories.

Action verb processing specifically modulates motor behaviour and sensorimotor neuronal oscillations

Understanding action-related language recruits the brain’s motor system and can interact with motor behaviour. The current study shows MEG oscillatory patterns during verb-motor priming. Hand and foot verbs were followed by hand or foot responses, with faster reaction times for congruent conditions. In ROIs placed in the hand/arm and foot/leg portions of the sensorimotor cortex, this behavioural priming effect was accompanied by modulations in MEG oscillatory patterns preceding the responses. Power suppression in the alpha/beta frequency bands was reduced in congruent conditions in the body-part-specific ROIs. These results imply that the verb-motor priming effect may be a direct consequence of motor cortex contributions to action word processing.

Dissociable electrophysiological correlates of semantic access of motor and non-motor concepts

The notion of semantic embodiment posits that concepts are represented in the same neural sensorimotor systems that were involved in their acquisition. However, evidence in support of embodied semantics – in particular the hypothesised contribution of motor and premotor cortex to the representation of action concepts – is varied. Here, we tested the hypothesis that, consistent with semantic embodiment, sensorimotor cortices will rapidly become active while healthy participants access the meaning of visually-presented motor and non-motor action verbs. Event-related potentials revealed early differential processing of motor and non-motor verbs (164–203 ms) within distinct regions of cortex likely reflecting rapid cortical activation of differentially distributed semantic representations. However, we found no evidence for a specific role of sensorimotor cortices in supporting these representations. Moreover, we observed a later modulation of the alpha band (8–12 Hz) from 555–785 ms over central electrodes, with estimated generators within the left superior parietal lobule, which may reflect post-lexical activation of the object-directed features of the motor action concepts. In conclusion, we find no evidence for a specific role of sensorimotor cortices when healthy participants judge the meaning of visually-presented action verbs. However, the relative contribution of sensorimotor cortices to action comprehension may vary as a function of task goals.

Effortful verb retrieval from semantic memory drives beta suppression in mesial frontal regions involved in action initiation

The contribution of the motor cortex to the semantic retrieval of verbs remains a subject of debate in neuroscience. Here, we examined whether additional engagement of the cortical motor system was required when access to verbs semantics was hindered during a verb generation task. We asked participants to produce verbs related to presented noun cues that were either strongly associated with a single verb to prompt fast and effortless verb retrieval, or were weakly associated with multiple verbs and more difficult to respond to. Using power suppression of magnetoencephalography beta oscillations (15-30 Hz) as an index of cortical activation, we performed a whole-brain analysis in order to identify the cortical regions sensitive to the difficulty of verb semantic retrieval. Highly reliable suppression of beta oscillations occurred 250 ms after the noun cue presentation and was sustained until the onset of verbal response. This was localized to multiple cortical regions, mainly in the temporal and frontal lobes of the left hemisphere. Crucially, the only cortical regions where beta suppression was sensitive to the task difficulty, were the higher order motor areas on the medial and lateral surfaces of the frontal lobe. Stronger activation of the premotor cortex and supplementary motor area accompanied the effortful verb retrieval and preceded the preparation of verbal responses for more than 500 ms, thus, overlapping with the time window of verb retrieval from semantic memory. Our results suggest that reactivation of verb-related motor plans in higher order motor circuitry promotes the semantic retrieval of target verbs.

The effects of transcranial alternating current stimulation (tACS) at individual alpha peak frequency (iAPF) on motor cortex excitability in young and elderly adults

Transcranial alternating current stimulation (tACS) can modulate brain oscillations, cortical excitability and behaviour. In aging, the decrease in EEG alpha activity (8–12 Hz) in the parieto-occipital and mu rhythm in the motor cortex are correlated with the decline in cognitive and motor functions, respectively. Increasing alpha activity using tACS might therefore improve cognitive and motor function in the elderly. The present study explored the influence of tACS on cortical excitability in young and old healthy adults. We applied tACS at individual alpha peak frequency for 10 min (1.5 mA) to the left motor cortex. Transcranial magnetic stimulation was used to assess the changes in cortical excitability as measured by motor-evoked potentials at rest, before and after stimulation. TACS increased cortical excitability in both groups. However, our results also suggest that the mechanism behind the effects was different, as we observed an increase and decrease in intracortical inhibition in the old group and young group, respectively. Our results indicate that both groups profited similarly from the stimulation. There was no indication that tACS was more effective in conditions of low alpha power, that is, in the elderly.

Event-related desynchronization of mu and beta oscillations during the processing of novel tool names

According to the embodied cognition framework, the formation of conceptual representations integrates the type of experience during learning. In this electroencephalographic study, we applied a linguistic variant of a training paradigm, in which participants learned to associate novel names to novel tools while either manipulating or visually exploring them. The analysis focused on event-related desynchronization (ERD) of oscillations in the mu and beta frequency range, which reflects activation of sensorimotor brain areas. After three training sessions, processing names of manipulated tools elicited a stronger ERD of the beta (18-25 Hz, 140-260 ms) and the lower mu rhythm (8-10 Hz, 320-440 ms) than processing names of visually explored tools, reflecting a possible reactivation of experiential sensorimotor information. Given the unexpected result that familiarized pseudo-words elicited an ERD comparable to names of manipulated tools, our findings could reflect a suppression of sensorimotor activity during the processing of objects with exclusively visual features.

Semantic discrimination impacts tDCS modulation of verb processing

Motor cortex activation observed during body-related verb processing hints at simulation accompanying linguistic understanding. By exploiting the up- and down-regulation that anodal and cathodal transcranial direct current stimulation (tDCS) exert on motor cortical excitability, we aimed at further characterizing the functional contribution of the motor system to linguistic processing. In a double-blind sham-controlled within-subjects design, online stimulation was applied to the left hemispheric hand-related motor cortex of 20 healthy subjects. A dual, double-dissociation task required participants to semantically discriminate concrete (hand/foot) from abstract verb primes as well as to respond with the hand or with the foot to verb-unrelated geometric targets. Analyses were conducted with linear mixed models. Semantic priming was confirmed by faster and more accurate reactions when the response effector was congruent with the verb's body part. Cathodal stimulation induced faster responses for hand verb primes thus indicating a somatotopical distribution of cortical activation as induced by body-related verbs. Importantly, this effect depended on performance in semantic discrimination. The current results point to verb processing being selectively modifiable by neuromodulation and at the same time to a dependence of tDCS effects on enhanced simulation. We discuss putative mechanisms operating in this reciprocal dependence of neuromodulation and motor resonance.

Auditory perception modulated by word reading

Theories of embodied cognition positing that sensorimotor areas are indispensable during language comprehension are supported by neuroimaging and behavioural studies. Among others, the auditory system has been suggested to be important for understanding sound-related words (visually presented) and the motor system for action-related words. In this behavioural study, using a sound detection task embedded in a lexical decision task, we show that in participants with high lexical decision performance sound verbs improve auditory perception. The amount of modulation was correlated with lexical decision performance. Our study provides convergent behavioural evidence of auditory cortex involvement in word processing, supporting the view of embodied language comprehension concerning the auditory domain.

Language-motor interference reflected in MEG beta oscillations

The involvement of the brain's motor system in action-related language processing can lead to overt interference with simultaneous action execution. The aim of the current study was to find evidence for this behavioural interference effect and to investigate its neurophysiological correlates using oscillatory MEG analysis. Subjects performed a semantic decision task on single action verbs, describing actions executed with the hands or the feet, and abstract verbs. Right hand button press responses were given for concrete verbs only. Therefore, longer response latencies for hand compared to foot verbs should reflect interference. We found interference effects to depend on verb imageability: overall response latencies for hand verbs did not differ significantly from foot verbs. However, imageability interacted with effector: while response latencies to hand and foot verbs with low imageability were equally fast, those for highly imageable hand verbs were longer than for highly imageable foot verbs. The difference is reflected in motor-related MEG beta band power suppression, which was weaker for highly imageable hand verbs compared with highly imageable foot verbs. This provides a putative neuronal mechanism for language-motor interference where the involvement of cortical hand motor areas in hand verb processing interacts with the typical beta suppression seen before movements. We found that the facilitatory effect of higher imageability on action verb processing time is perturbed when verb and motor response relate to the same body part. Importantly, this effect is accompanied by neurophysiological effects in beta band oscillations. The attenuated power suppression around the time of movement, reflecting decreased cortical excitability, seems to result from motor simulation during action-related language processing. This is in line with embodied cognition theories.