Too late to be grounded? Motor resonance for action words acquired after middle childhood

Embodied Semantics: Early Simultaneous Motor Grounding in First and Second Languages

BACKGROUND/OBJECTIVES

Although the embodiment of action-related language is well-established in the mother tongue (L1), less is known about the embodiment of a second language (L2) acquired later in life through formal instruction. We used the high temporal resolution of ERPs and topographic ERP analyses to compare embodiment in L1 and L2 and to investigate whether L1 and L2 are embodied with different strengths at different stages of linguistic processing.

METHODS

Subjects were presented with action-related and non-action-related verbs in a silent reading task. Subjects were late French-German and German-French bilinguals, respectively, and we could therefore collapse across languages to avoid common confounding between language (French and German) and order of acquisition (L1, L2).

RESULTS

We could show distinct effects of embodiment and language. Embodiment affected only the sensory and lexical stages of processing with increased strength and power of the N1 component for motor vs. non-motor verbs, and language affected the lexical and semantic stages of processing with stronger P2/N400 components for L2 than for L1. Non-motor verbs elicited a stronger P1 component in L2.

CONCLUSIONS

Our results suggest that processing words in L2 requires more effortful processing. Importantly, L1 and L2 are not embodied differently, and embodiment affects early and similar stages of processing in L1 and L2, possibly integrating other process of action-language interaction.

Automatic mental simulation in native and non-native speakers

Pictures of objects are verified faster when they match the implied orientation, shape, and color in a sentence-picture verification task, suggesting that people mentally simulate these features during language comprehension. Previous studies had an unintended correlation between match status and the required response, which may have influenced participants' responses by eliciting strategic use of this correlation. We removed this correlation by including color-matching filler trials and investigated if the color-match effect was still obtained. In both a native sample (Experiment 1) and a non-native sample (Experiment 2), we found strong evidence for a color-match advantage on median reaction time and error rates. Our results are consistent with the view that color is automatically simulated during language comprehension as predicted by the grounded cognition framework.

Horizontal mapping of time-related words in first and second language

The existence of a consistent horizontal spatial-conceptual mapping for words denoting time is a well-established phenomenon. For example, words related to the past or future (e.g., yesterday/tomorrow) facilitate respective leftward/rightward attentional shifts and responses, suggesting the visual-spatial grounding of temporal semantics, at least in the native language (L1). To examine whether similar horizontal bias also accompanies access to time-related words in a second language (L2), we tested 53 Russian-English (Experiment 1) and 48 German-English (Experiment 2) bilinguals, who classified randomly presented L1 and L2 time-related words as past- or future-related using left or right response keys. The predicted spatial congruency effect was registered in all tested languages and, furthermore, was positively associated with higher L2 proficiency in Experiment 2. Our findings (1) support the notion of horizontal spatial-conceptual mapping in diverse L1s, (2) demonstrate the existence of a similar spatial bias when processing temporal words in L2, and (3) show that the strength of time-space association in L2 may depend on individual L2 proficiency.

Bilinguals on the footbridge: the role of foreign-language proficiency in moral decision making

Socio-cognitive research on bilinguals points to a moral foreign-language effect (MFLE), with more utilitarian choices (e.g., sacrificing someone to save more people) for moral dilemmas presented in the second language (L2) relative to the first language. Yet, inconsistent results highlight the influence of subject-level variables, including a critical underexplored factor: L2 proficiency (L2p). Here we provide a systematic review of 57 bilingualism studies on moral dilemmas, showing that L2p rarely modulates responses to impersonal dilemmas, but it does impact personal dilemmas (with MFLEs proving consistent at intermediate L2p levels but unsystematic at high L2p levels). We propose an empirico-theoretical framework to conceptualize such patterns, highlighting the impact of L2p on four affective mediating factors: mental imagery, inhibitory control, prosocial behavior and numerical processing. Finally, we outline core challenges for the field. These insights open new avenues at the crossing of bilingualism and social cognition research.

Ecological Meanings: A Consensus Paper on Individual Differences and Contextual Influences in Embodied Language

Embodied theories of cognition consider many aspects of language and other cognitive domains as the result of sensory and motor processes. In this view, the appraisal and the use of concepts are based on mechanisms of simulation grounded on prior sensorimotor experiences. Even though these theories continue receiving attention and support, increasing evidence indicates the need to consider the flexible nature of the simulation process, and to accordingly refine embodied accounts. In this consensus paper, we discuss two potential sources of variability in experimental studies on embodiment of language: individual differences and context. Specifically, we show how factors contributing to individual differences may explain inconsistent findings in embodied language phenomena. These factors include sensorimotor or cultural experiences, imagery, context-related factors, and cognitive strategies. We also analyze the different contextual modulations, from single words to sentences and narratives, as well as the top-down and bottom-up influences. Similarly, we review recent efforts to include cultural and language diversity, aging, neurodegenerative diseases, and brain disorders, as well as bilingual evidence into the embodiment framework. We address the importance of considering individual differences and context in clinical studies to drive translational research more efficiently, and we indicate recommendations on how to correctly address these issues in future research. Systematically investigating individual differences and context may contribute to understanding the dynamic nature of simulation in language processes, refining embodied theories of cognition, and ultimately filling the gap between cognition in artificial experimental settings and cognition in the wild (i.e., in everyday life).

Embodiment of action-related language in the native and a late foreign language - An fMRI-study

Theories of embodied cognition postulate that language processing activates similar sensory-motor structures as when interacting with the environment. Only little is known about the neural substrate of embodiment in a foreign language (L2) as compared to the mother tongue (L1). In this fMRI study, we investigated embodiment of motor and non-motor action verbs in L1 and L2 including 31 late bilinguals. Half had German as L1 and French as L2, and the other half vice-versa. We collapsed across languages to avoid the confound between language and order of language acquisition. Region of interest analyses showed stronger activation in motor regions during L2 than during L1 processing, independently of the motor-relatedness of the verbs. Moreover, a stronger involvement of motor regions for motor-related as compared to non-motor-related verbs, similarly for L1 and L2, was found. Overall, the similarity between L1 and L2 embodiment seems to depend on individual and contextual factors.

Body into Narrative: Behavioral and Neurophysiological Signatures of Action Text Processing After Ecological Motor Training

Embodied cognition research indicates that sensorimotor training can influence action concept processing. Yet, most studies employ isolated (pseudo)randomized stimuli and require repetitive single-effector responses, thus lacking ecological validity. Moreover, the neural signatures of these effects remain poorly understood. Here, we examined whether immersive bodily training can modulate behavioral and functional connectivity correlates of action-verb processing in naturalistic narratives. The study involved three phases. First, in the Pre-training phase, 32 healthy persons listened to an action text (rich in movement descriptions) and a non-action text (focused on its characters' perceptual and mental processes), completed comprehension questionnaires, and underwent resting-state electroencephalogram (EEG) recordings. Second, in the four-day Training phase, half the participants completed an exergaming intervention (eliciting full-body movements for 60 min a day) while the remaining half played static videogames (requiring no bodily engagement other than button presses). Finally, in the Post-training phase, all participants repeated the Pre-training protocol with different action and non-action texts and a new EEG session. We found that exergaming selectively reduced action-verb outcomes and fronto-posterior functional connectivity in the motor-sensitive ∼ 10-20 Hz range, both patterns being positively correlated. Conversely, static videogame playing yielded no specific effect on any linguistic category and did not modulate functional connectivity. Together, these findings suggest that action-verb processing and key neural correlates can be focally influenced by full-body motor training in a highly ecological setting. Our study illuminates the role of situated experience and sensorimotor circuits in action-concept processing, addressing calls for naturalistic insights on language embodiment.

Tracking Object-State Representations During Real-Time Language Comprehension by Native and Non-native Speakers of English

The present "visual world" eye-tracking study examined the time-course of how native and non-native speakers keep track of implied object-state representations during real-time language processing. Fifty-two native speakers of English and 46 non-native speakers with advanced English proficiency joined this study. They heard short stories describing a target object (e.g., an onion) either having undergone a substantial change-of-state (e.g., chop the onion) or a minimal change-of-state (e.g., weigh the onion) while their eye movements toward competing object-states (e.g., a chopped onion vs. an intact onion) and two unrelated distractors were tracked. We found that both groups successfully directed their visual attention toward the end-state of the target object that was implied in the linguistic context. However, neither group showed anticipatory eye movements toward the implied object-state when hearing the critical verb (e.g., "weigh/chop"). Only native English speakers but not non-native speakers showed a bias in visual attention during the determiner ("the") before the noun (e.g., "onion"). Our results suggested that although native and non-native speakers of English largely overlapped in their time-courses of keeping track of object-state representations during real-time language comprehension, non-native speakers showed a short delay in updating the implied object-state representations.

How words ripple through bilingual hands: Motor-language coupling during L1 and L2 writing

The speed of our hand movements can be affected by concurrent processing of manual action verbs (MaVs). Whereas this phenomenon is well established for native languages (L1s), it remains underexplored in late foreign languages (L2s), especially during highly automatized tasks. Here we timed keystroke activity while Spanish-English bilinguals copied MaVs, non-manual action verbs, and non-action verbs in their L1 and L2. Motor planning and execution dynamics were indexed by first-letter lag (the time-lapse between word presentation and first keystroke) and whole-word lag (the time-lapse between first and last keystroke), respectively. Despite yielding no effects on motor planning, MaVs facilitated typing execution in L1 but delayed it in L2, irrespective of the subjects' typing skills, age of L2 learning, and L2 competence. Therefore, motor-language coupling effects seem to be present in both languages though they can arise differently in each. These results extend language grounding models, illuminating the role of embodied mechanisms throughout life.

Motor-system dynamics during naturalistic reading of action narratives in first and second language

Do embodied semantic systems play different roles depending on when and how well a given language was learned? Emergent evidence suggests that this is the case for isolated, decontextualized stimuli, but no study has addressed the issue considering naturalistic narratives. Seeking to bridge this gap, we assessed motor-system dynamics in 26 Spanish-English bilinguals as they engaged in free, unconstrained reading of naturalistic action texts (ATs, highlighting the characters’ movements) and neutral texts (NTs, featuring low motility) in their first and second language (L1, L2). To explore functional connectivity spread over each reading session, we recorded ongoing high-density electroencephalographic signals and subjected them to functional connectivity analysis via a spatial clustering approach. Results showed that, in L1, AT (relative to NT) reading involved increased connectivity between left and right central electrodes consistently implicated in action-related processes, as well as distinct source-level modulations in motor regions. In L2, despite null group-level effects, enhanced motor-related connectivity during AT reading correlated positively with L2 proficiency and negatively with age of L2 learning. Taken together, these findings suggest that action simulations during unconstrained narrative reading involve neural couplings between motor-sensitive mechanisms, in proportion to how consolidated a language is. More generally, such evidence addresses recent calls to test the ecological validity of motor-resonance effects while offering new insights on their relation with experiential variables.