Action verb processing specifically modulates motor behaviour and sensorimotor neuronal oscillations

Negated actions are simulated within the primary motor cortex

Controversy persists regarding the representation of linguistically negated actions, specifically concerning activation and inhibitory mechanisms in the motor system, and whether negated action sentences evoke an initial motor simulation of the action to be negated. We conducted two experiments probing corticospinal excitability (CSE) and short-interval intracortical inhibition (SICI) in the primary motor cortex at different latencies while reading affirmative and negative action sentences. In experiment one, twenty-six participants read action and non-action sentences in affirmative or negative forms. Using transcranial magnetic stimulation, we probed CSE in hand muscles at rest and at several latencies after verb presentation. We observed a greater CSE for action sentences compared to non-action sentences, regardless of verb form. In experiment two, nineteen participants read affirmative and negative action sentences. We measured CSE and SICI at short and long latencies after verb presentation. CSE was greater for affirmative and negative action sentences at both latencies compared to rest. SICI did not change at the short latency but increased at longer latencies, regardless of verb form. Negated action sentences showed the same motor excitability as affirmed action sentences with no additional inhibition at early latencies. These results lend support for the idea that actions to be negated are initially simulated within the motor system. Neural differences between affirmative and negative action sentences may occur outside the primary motor cortex.

Neural dynamics of social verb processing: an MEG study

Human vocabularies include specific words to communicate interpersonal behaviors, a core linguistic function mainly afforded by social verbs (SVs). This skill has been proposed to engage dedicated systems subserving social knowledge. Yet, neurocognitive evidence is scarce, and no study has examined spectro-temporal and spatial signatures of SV access. Here, we combined magnetoencephalography and time-resolved decoding methods to characterize the neural dynamics underpinning SVs, relative to nonsocial verbs (nSVs), via a lexical decision task. Time-frequency analysis revealed stronger beta (20 Hz) power decreases for SVs in right fronto-temporal sensors at early stages. Time-resolved decoding showed that beta oscillations significantly discriminated SVs and nSVs between 180 and 230 ms. Sources of this effect were traced to the right anterior superior temporal gyrus (a key hub underpinning social conceptual knowledge) as well as parietal, pre/motor and prefrontal cortices supporting nonverbal social cognition. Finally, representational similarity analyses showed that the observed fronto-temporal neural patterns were specifically predicted by verbs' socialness, as opposed to other psycholinguistic dimensions such as sensorimotor content, emotional valence, arousal, and concreteness. Overall, verbal conveyance of socialness seems to involve distinct neurolinguistic patterns, partly shared by more general sociocognitive and lexicosemantic processes.

Activity in Occipito-Temporal Cortex Is Involved in Tool-Use Planning and Contributes to Tool-Related Semantic Neural Representations

Tool use and language are highly refined human abilities which may show neural commonalities due to their potential reciprocal interaction during evolution. Recent work provided evidence for shared neural resources between tool use and syntax. However, whether activity within the tool-use network also contributes to semantic neural representations of tool nouns remains untested. To this aim, we identified the tool-use planning network with functional magnetic resonance imaging while participants used pliers. The very same participants underwent a semantic priming task including two categories, tool nouns and animal nouns, to highlight the respective underlying networks. With multivariate analyses of the activation neural patterns, we tested whether activity in tool-use brain clusters takes part in the neural representation of tool nouns as compared with animal nouns. The results revealed that word semantic categories were decoded within the left occipito-temporal cortex activated by preparing to use a tool, with similar patterns of brain activity for words within the same category. In addition, in the same area, neural activations for tool nouns were found to be higher than those for animal nouns. These findings suggest that activity in tool-use related brain areas encodes semantic information separately for tool nouns and animal nouns, thus supporting the embodiment of tool-noun processing in the tool-use sensorimotor network.

The Neural Correlates of Embodied L2 Learning: Does Embodied L2 Verb Learning Affect Representation and Retention?

We investigated how naturalistic actions in a highly immersive, multimodal, interactive 3D virtual reality (VR) environment may enhance word encoding by recording EEG in a pre/post-test learning paradigm. While behavior data have shown that coupling word encoding with gestures congruent with word meaning enhances learning, the neural underpinnings of this effect have yet to be elucidated. We coupled EEG recording with VR to examine whether embodied learning improves learning and creates linguistic representations that produce greater motor resonance. Participants learned action verbs in an L2 in two different conditions: specific action (observing and performing congruent actions on virtual objects) and pointing (observing actions and pointing to virtual objects). Pre- and post-training participants performed a match-mismatch task as we measured EEG (variation in the N400 response as a function of match between observed actions and auditory verbs) and a passive listening task while we measured motor activation (mu [8-13 Hz] and beta band [13-30 Hz] desynchronization during auditory verb processing) during verb processing. Contrary to our expectations, post-training results revealed neither semantic nor motor effects in either group when considered independently of learning success. Behavioral results showed a great deal of variability in learning success. When considering performance, low performance learners showed no semantic effect and high performance learners exhibited an N400 effect for mismatch versus match trials post-training, independent of the type of learning. Taken as a whole, our results suggest that embodied processes can play an important role in L2 learning.

The different effects of a sensorimotor grounding on AoA between bilingual concepts

Introduction

Psycholinguistic studies have argued for the age of acquisition (AoA) of words as a marker of concept learning, showing that the semantic features of concepts themselves influence the age at which their labels are learned. However, empirical evidence suggests that semantic features such as imageability and linguistic phenomena such as frequency do not adequately predict AoA. The present study takes the developmental approach of embodied cognition and investigates the effects of sensorimotor experiences on the ease of acquisition of the concept acquired in bilinguals. Specifically, we investigated (1) whether the sensorimotor experience can explain AoA beyond frequency; (2) and whether these patterns are consistent across L1 Chinese and L2 English.

Methods

We conducted sensorimotor rating measures in both Chinese and English on 207 items in which Chinese-English bilingual adults were requested to evaluate the extent to which they experienced concepts by employing six perceptual senses and five effectors for actions located in various regions of the body. Meanwhile, data on AoA and frequency were collected.

Results

The present study showed the sensorimotor experience was closely linked with AoAs in both languages. However, the correlation analysis revealed a trend of higher correlations between AoAs for the same concepts and L1 Chinese, relative to L2 English for the present Chinese-English bilinguals. Importantly, the hierarchical regression analysis demonstrated that after controlling for frequency, sensorimotor experience explained additional variance in L1 AoA. However, L2 sensorimotor experience did not explain the variance in L2 AoA. Sensorimotor experience explained more share of variance in L1 AoA but frequency accounted for more variance in L2 AoA.

Discussion

The findings suggest that concept acquisition should consider the grounding in appropriate sensorimotor experience beyond linguistic phenomena like frequency.

Brain-computer interfaces and human factors: the role of language and cultural differences-Still a missing gap?

Brain-computer interfaces (BCIs) aim at the non-invasive investigation of brain activity for supporting communication and interaction of the users with their environment by means of brain-machine assisted technologies. Despite technological progress and promising research aimed at understanding the influence of human factors on BCI effectiveness, some topics still remain unexplored. The aim of this article is to discuss why it is important to consider the language of the user, its embodied grounding in perception, action and emotions, and its interaction with cultural differences in information processing in future BCI research. Based on evidence from recent studies, it is proposed that detection of language abilities and language training are two main topics of enquiry of future BCI studies to extend communication among vulnerable and healthy BCI users from bench to bedside and real world applications. In addition, cultural differences shape perception, actions, cognition, language and emotions subjectively, behaviorally as well as neuronally. Therefore, BCI applications should consider cultural differences in information processing to develop culture- and language-sensitive BCI applications for different user groups and BCIs, and investigate the linguistic and cultural contexts in which the BCI will be used.

Imagining and reading actions: Towards similar motor representations

While action language and motor imagery both engage the motor system, determining whether these two processes indeed share the same motor representations would contribute to better understanding their underlying mechanisms. We conducted two experiments probing the mutual influence of these two processes. In Exp.1, hand-action verbs were presented subliminally, and participants (n = 36) selected the verb they thought they perceived from two alternatives. When congruent actions were imagined prior to this task, accuracy significantly increased, i.e. participants were better able to "see" the subliminal verbs. In Exp.2, participants (n = 19) imagined hand flexion or extension, while corticospinal excitability was measured via transcranial magnetic stimulation. Corticospinal excitability was modulated by action verbs subliminally presented prior to imagery. Specifically, the typical increase observed during imagery was suppressed after presentation of incongruent action verbs. This mutual influence of action language and motor imagery, both at behavioral and neurophysiological levels, suggests overlapping motor representations.

Grasping the semantic of actions: a combined behavioral and MEG study

There is experimental evidence that the brain systems involved in action execution also play a role in action observation and understanding. Recently, it has been suggested that the sensorimotor system is also involved in language processing. Supporting results are slower response times and weaker motor-related MEG Beta band power suppression in semantic decision tasks on single action verbs labels when the stimulus and the motor response involve the same effector. Attenuated power suppression indicates decreased cortical excitability and consequent decreased readiness to act. The embodied approach forwards that the simultaneous involvement of the sensorimotor system in the processing of the linguistic content and in the planning of the response determines this language-motor interference effect. Here, in a combined behavioral and MEG study we investigated to what extent the processing of actions visually presented (i.e., pictures of actions) and verbally described (i.e., verbs in written words) share common neural mechanisms. The findings demonstrated that, whether an action is experienced visually or verbally, its processing engages the sensorimotor system in a comparable way. These results provide further support to the embodied view of semantic processing, suggesting that this process is independent from the modality of presentation of the stimulus, including language.

Does the Motor Cortex Want the Full Story? The Influence of Sentence Context on Corticospinal Excitability in Action Language Processing

The reading of action verbs has been shown to activate motor areas, whereby sentence context may serve to either globally strengthen this activation or to selectively sharpen it. To investigate this issue, we manipulated the presence of manual actions and sentence context, assessing the level of corticospinal excitability by means of transcranial magnetic stimulation. We hypothesized that context would serve to sharpen the neural representation of the described actions in the motor cortex, reflected in context-specific modulation of corticospinal excitability. Participants silently read manual action verbs and non-manual verbs, preceded by a full sentence (rich context) or not (minimal context). Transcranial magnetic stimulation pulses were delivered at rest or shortly after verb presentation. The coil was positioned over the cortical representation of the right first dorsal interosseous (pointer finger). We observed a general increase of corticospinal excitability while reading both manual action and non-manual verbs in minimal context, whereas the modulation was action-specific in rich context: corticospinal excitability increased while reading manual verbs, but did not differ from baseline for non-manual verbs. These findings suggest that sentence context sharpens motor representations, activating the motor cortex when relevant and eliminating any residual motor activation when no action is present.

Motor features of abstract verbs determine their representations in the motor system

Embodied cognition theory posits that concept representations inherently rely on sensorimotor experiences that accompany their acquisitions. This is well established through concrete concepts. However, it is debatable whether representations of abstract concepts are based on sensorimotor representations. This study investigated the causal role of associated motor experiences that accompany concept acquisition in the involvement of the motor system in the abstract verb processing. Through two experiments, we examined the action–sentence compatibility effect, in the test phase after an increase in motor features during the learning phase for abstract verbs with low motor features (Experiment 1) or novel words with no conceptual features at all (Experiment 2). After associated motor experiences were added in the word learning phase, action–sentence compatibility effect was found in the semantic processing tasks during the test phase for abstract verbs (Experiment 1a) and novel words (Experiment 2). This was lacking in the word font color judgment task requiring no semantic processing (Experiment 1b). Coupled with our previous study, these findings suggest that motor features formed during word learning could causally affect embodiment in the motor system for abstract verbs, and reactivation of motor experiences in abstract verb processing depends on a given task’s demands. Our study supports the view that conceptual representations, even abstract concepts, can be grounded in sensorimotor experiences.

The Inhibition Effect of Affordances in Action Picture Naming: An ERP Study

How quickly are different kinds of conceptual knowledge activated in action picture naming? Using a masked priming paradigm, we manipulated the prime category type (artificial vs. natural), prime action type (precision, power, vs. neutral grip), and target action type (precision vs. power grip) in action picture naming, while electrophysiological signals were measured concurrently. Naming latencies showed an inhibition effect in the congruent action type condition compared with the neutral condition. ERP results showed that artificial and natural category primes induced smaller waveforms in precision or power action primes than neutral primes in the time window of 100-200 msec. Time-frequency results consistently presented a power desynchronization of the mu rhythm in the time window of 0-210 msec with precision action type artificial objects compared with neutral primes, which localized at the supplementary motor, precentral and postcentral areas in the left hemisphere. These findings suggest an inhibitory effect of affordances arising at conceptual preparation in action picture naming and provide evidence for embodied cognition.

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.

Neurophysiological mechanisms of perspective-taking: An MEG investigation of agency

According to the embodied cognition framework, sensory and motor areas are recruited during language understanding through simulation processes. Behavioral and imaging findings point to a dependence of the latter on perspective-taking (e.g., first person "I" versus third person "s/he"). The current study aims at identifying possible neurophysiological correlates of perspective in a linguistic context. Twenty healthy participants were measured with magnetoencephalography (MEG) while semantically processing visually presented inflected German verbs in the first- and third-person perspective, simple present tense. Results show that the first-person perspective induces stronger beta (15-25 Hz) desynchronization in the right-hemispheric posterior superior temporal sulcus, ventral posterior cingulate gyrus, and V5/MT+ area; no modulation of sensorimotor cortex emerged. Moreover, a stronger event-related field (ERF) was observed for the first-person perspective at about 150 ms after pronoun-verb onset, originating in occipital and moving to central and left temporal cortical sites. No effect of perspective on sensory gating was found when targeting the N1 component related to tones following the linguistic stimuli. Results indicate an effect of linguistic perspective-taking on brain activation patterns. The contribution of the single brain areas and their role in self-other distinction is further discussed.

Embodied negation and levels of concreteness: A TMS study on German and Italian language processing

According to the embodied cognition perspective, linguistic negation may block the motor simulations induced by language processing. Transcranial magnetic stimulation (TMS) was applied to the left primary motor cortex (hand area) of monolingual Italian and German healthy participants during a rapid serial visual presentation of sentences from their own language. In these languages, the negative particle is located at the beginning and at the end of the sentence, respectively. The study investigated whether the interruption of the motor simulation processes, accounted for by reduced motor evoked potentials (MEPs), takes place similarly in two languages differing on the position of the negative marker. Different levels of sentence concreteness were also manipulated to investigate if negation exerts generalized effects or if it is affected by the semantic features of the sentence. Our findings indicate that negation acts as a block on motor representations, but independently from the language and words concreteness level.

Exploring the Co-occurrence of Manual Verbs and Actions in Early Mother-Child Communication

The embodiment approach has shown that motor neural networks are involved in the processing of action verbs. There is developmental evidence that embodied effects on verb processing are already present in early years. Yet, the ontogenetic origin of this motor reuse in action verbs remains unknown. This longitudinal study investigates the co-occurrence of manual verbs and actions during mother-child daily routines (free play, bathing, and dining) when children were 1 to 2 (Group 1) and 2 to 3 (Group 2) years old. Eight mother-child dyads were video-recorded in 3-month intervals across 12 months (27 recording hours), and the timing of verbs and manual actions (21,876 entries) were coded by independent observers. Results showed that the probability of matched verb-action co-occurrences were much higher (0.80 and 0.77) than that of random co-occurrences (0.13 and 0.15) for Group 1 and Group 2, respectively. The distributions of the verb-action temporal intervals in both groups were quite symmetrical and skewed with the peak corresponding to both 0.00 s synchronic intervals (8% of the cases) and the shortest +5 s interval (40% of the cases). Mother-led instances occurred in both groups whereas child-led instances were restricted to Group 2. Mothers pragmatically aligned their verbal productions, since they repeatedly used (74%) those verbs they shared with their children's repertoire (31%). In conclusion, the early multisensory communicative and manipulative scene affords grounding of verb meanings on the ongoing actions, facilitating verb-action pairing in the realm of social interactions, providing a new dimension to the prevailing solipsistic approach to embodiment.